[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:15:09.030364  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:36785
I20260709 13:15:09.031913  2851 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:15:09.033037  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:09.052497  2857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:09.052595  2858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:09.052590  2860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:09.054322  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:10.188908  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:10.189210  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:10.189381  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602910189363 us; error 0 us; skew 500 ppm
I20260709 13:15:10.190464  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:10.196177  2851 webserver.cc:533] Webserver started at http://127.2.200.254:44253/ using document root <none> and password file <none>
I20260709 13:15:10.197269  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:10.197486  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:10.197908  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:10.203917  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "823d7b8d84b14537878439c7f8d31e88"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.211679  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:15:10.217304  2866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.218741  2851 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:15:10.219141  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "823d7b8d84b14537878439c7f8d31e88"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.219486  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:10.292002  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:10.294166  2851 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:15:10.294813  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:10.369257  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:36785
I20260709 13:15:10.369343  2917 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:36785 every 8 connection(s)
I20260709 13:15:10.376951  2918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:10.398463  2918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88: Bootstrap starting.
I20260709 13:15:10.404377  2918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:10.406270  2918 log.cc:826] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88: Log is configured to *not* fsync() on all Append() calls
I20260709 13:15:10.411016  2918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88: No bootstrap required, opened a new log
I20260709 13:15:10.432211  2918 raft_consensus.cc:359] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823d7b8d84b14537878439c7f8d31e88" member_type: VOTER }
I20260709 13:15:10.432785  2918 raft_consensus.cc:385] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:10.433040  2918 raft_consensus.cc:740] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823d7b8d84b14537878439c7f8d31e88, State: Initialized, Role: FOLLOWER
I20260709 13:15:10.433935  2918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823d7b8d84b14537878439c7f8d31e88" member_type: VOTER }
I20260709 13:15:10.434415  2918 raft_consensus.cc:399] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:10.434702  2918 raft_consensus.cc:493] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:10.435144  2918 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:10.439376  2918 raft_consensus.cc:515] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823d7b8d84b14537878439c7f8d31e88" member_type: VOTER }
I20260709 13:15:10.440161  2918 leader_election.cc:304] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 823d7b8d84b14537878439c7f8d31e88; no voters: 
I20260709 13:15:10.441879  2918 leader_election.cc:290] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:10.442195  2921 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:10.444209  2921 raft_consensus.cc:697] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 1 LEADER]: Becoming Leader. State: Replica: 823d7b8d84b14537878439c7f8d31e88, State: Running, Role: LEADER
I20260709 13:15:10.445145  2921 consensus_queue.cc:237] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823d7b8d84b14537878439c7f8d31e88" member_type: VOTER }
I20260709 13:15:10.446163  2918 sys_catalog.cc:565] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:10.455096  2922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "823d7b8d84b14537878439c7f8d31e88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823d7b8d84b14537878439c7f8d31e88" member_type: VOTER } }
I20260709 13:15:10.455590  2923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 823d7b8d84b14537878439c7f8d31e88. Latest consensus state: current_term: 1 leader_uuid: "823d7b8d84b14537878439c7f8d31e88" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "823d7b8d84b14537878439c7f8d31e88" member_type: VOTER } }
I20260709 13:15:10.455819  2922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:10.456142  2923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:10.460143  2930 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:10.471477  2930 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:10.473683  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:10.490517  2930 catalog_manager.cc:1383] Generated new cluster ID: eaeac608cca94eb78c560206e9303d34
I20260709 13:15:10.490842  2930 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:10.515815  2930 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:10.518024  2930 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:10.540726  2930 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88: Generated new TSK 0
I20260709 13:15:10.542367  2930 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:10.606464  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:10.614756  2940 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:10.615711  2941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:10.619895  2851 server_base.cc:1061] running on GCE node
W20260709 13:15:10.620038  2943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:10.621120  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:10.621327  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:10.621515  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602910621496 us; error 0 us; skew 500 ppm
I20260709 13:15:10.622121  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:10.626082  2851 webserver.cc:533] Webserver started at http://127.2.200.193:34319/ using document root <none> and password file <none>
I20260709 13:15:10.626606  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:10.626796  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:10.627084  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:10.628502  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "4dec59b548f447a2becb166c8bde83de"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.634536  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 13:15:10.639182  2948 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.640036  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:15:10.640481  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "4dec59b548f447a2becb166c8bde83de"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.640898  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:10.668427  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:10.670351  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:10.673128  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:10.678452  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:10.678773  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.679095  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:10.679337  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.776686  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:46791
I20260709 13:15:10.776872  3010 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:46791 every 8 connection(s)
I20260709 13:15:10.786201  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:10.798002  3015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:10.804242  3016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:10.806595  3018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:10.810105  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:10.811242  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:10.811547  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:10.811756  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602910811739 us; error 0 us; skew 500 ppm
I20260709 13:15:10.812526  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:10.816087  2851 webserver.cc:533] Webserver started at http://127.2.200.194:41887/ using document root <none> and password file <none>
I20260709 13:15:10.816640  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:10.816861  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:10.817173  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:10.818301  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "13737e4959ab4cdbb9289ca1036cde02"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.819362  3011 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36785
I20260709 13:15:10.819859  3011 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:10.821094  3011 heartbeater.cc:507] Master 127.2.200.254:36785 requested a full tablet report, sending...
I20260709 13:15:10.824797  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:15:10.825698  2883 ts_manager.cc:194] Registered new tserver with Master: 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791)
I20260709 13:15:10.829102  3023 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.829234  2883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59612
I20260709 13:15:10.830237  2851 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:15:10.830475  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "13737e4959ab4cdbb9289ca1036cde02"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.830710  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:10.856118  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:10.857435  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:10.859768  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:10.863050  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:10.863230  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.863479  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:10.863623  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:10.962988  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:34833
I20260709 13:15:10.963207  3085 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:34833 every 8 connection(s)
I20260709 13:15:10.972623  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:10.979918  3089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:10.981967  3090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:10.985028  3086 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36785
I20260709 13:15:10.985417  3086 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:10.986254  3086 heartbeater.cc:507] Master 127.2.200.254:36785 requested a full tablet report, sending...
W20260709 13:15:10.986531  3092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:10.988627  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:10.989080  2883 ts_manager.cc:194] Registered new tserver with Master: 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:10.989820  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:10.990056  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:10.990231  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602910990212 us; error 0 us; skew 500 ppm
I20260709 13:15:10.990767  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:10.990873  2883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59626
I20260709 13:15:10.993542  2851 webserver.cc:533] Webserver started at http://127.2.200.195:34627/ using document root <none> and password file <none>
I20260709 13:15:10.994102  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:10.994279  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:10.994529  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:10.995502  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "11d623eeca434e989ebc6b1b3bb8e231"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:10.999943  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:11.003185  3097 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.004443  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:11.004701  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "11d623eeca434e989ebc6b1b3bb8e231"
format_stamp: "Formatted at 2026-07-09 13:15:10 on dist-test-slave-108k"
I20260709 13:15:11.005005  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:11.031114  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:11.032807  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:11.035710  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:11.038048  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:11.038321  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.038617  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:11.038764  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:11.132515  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:32787
I20260709 13:15:11.132628  3159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:32787 every 8 connection(s)
I20260709 13:15:11.151707  3160 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36785
I20260709 13:15:11.152325  3160 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:11.153728  3160 heartbeater.cc:507] Master 127.2.200.254:36785 requested a full tablet report, sending...
I20260709 13:15:11.156637  2883 ts_manager.cc:194] Registered new tserver with Master: 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:11.157343  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018133772s
I20260709 13:15:11.158505  2883 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59634
I20260709 13:15:11.210611  2883 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59648:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:11.214803  2883 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:11.325359  3051 tablet_service.cc:1511] Processing CreateTablet for tablet a32f26f5556b4b12a7a8e32ead1ea456 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:11.325762  3050 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0a3042136f4a54a7db6456dc440ad8 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:11.327883  3049 tablet_service.cc:1511] Processing CreateTablet for tablet 5987451194a84c6c915b70640266b555 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:11.331466  3048 tablet_service.cc:1511] Processing CreateTablet for tablet c02eeaf549bb4987ba2acf3ba3546928 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:11.335693  3047 tablet_service.cc:1511] Processing CreateTablet for tablet 8b397188f9f94287a660b3f38e21f97b (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:11.336086  2976 tablet_service.cc:1511] Processing CreateTablet for tablet a32f26f5556b4b12a7a8e32ead1ea456 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:15:11.338047  2974 tablet_service.cc:1511] Processing CreateTablet for tablet 5987451194a84c6c915b70640266b555 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:11.338532  2975 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0a3042136f4a54a7db6456dc440ad8 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:11.339291  3046 tablet_service.cc:1511] Processing CreateTablet for tablet f80a50e2fd1640889c63bbe13363f5b6 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:11.340647  2973 tablet_service.cc:1511] Processing CreateTablet for tablet c02eeaf549bb4987ba2acf3ba3546928 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:11.340845  2972 tablet_service.cc:1511] Processing CreateTablet for tablet 8b397188f9f94287a660b3f38e21f97b (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:11.342835  3045 tablet_service.cc:1511] Processing CreateTablet for tablet 54f2040741684ef3b8415fcc562ed48e (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:11.343001  2971 tablet_service.cc:1511] Processing CreateTablet for tablet f80a50e2fd1640889c63bbe13363f5b6 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:11.346966  3044 tablet_service.cc:1511] Processing CreateTablet for tablet 113e062ffc5d416ba5e7bfdf4b539ed1 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:11.347252  2969 tablet_service.cc:1511] Processing CreateTablet for tablet 113e062ffc5d416ba5e7bfdf4b539ed1 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:11.349262  3051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f26f5556b4b12a7a8e32ead1ea456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.349377  2970 tablet_service.cc:1511] Processing CreateTablet for tablet 54f2040741684ef3b8415fcc562ed48e (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:11.350183  3049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5987451194a84c6c915b70640266b555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.351110  2970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f2040741684ef3b8415fcc562ed48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.353472  3050 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0a3042136f4a54a7db6456dc440ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.356434  3046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80a50e2fd1640889c63bbe13363f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.356387  2976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f26f5556b4b12a7a8e32ead1ea456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.350129  3043 tablet_service.cc:1511] Processing CreateTablet for tablet 2b88c53b0d5344f5b06dd897cab945f9 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:11.360028  2975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0a3042136f4a54a7db6456dc440ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.363654  3045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f2040741684ef3b8415fcc562ed48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.364665  2972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b397188f9f94287a660b3f38e21f97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.363732  2968 tablet_service.cc:1511] Processing CreateTablet for tablet 2b88c53b0d5344f5b06dd897cab945f9 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:11.369017  3043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b88c53b0d5344f5b06dd897cab945f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.371625  2973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02eeaf549bb4987ba2acf3ba3546928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.372952  3048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02eeaf549bb4987ba2acf3ba3546928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.373450  2974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5987451194a84c6c915b70640266b555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.381959  2971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80a50e2fd1640889c63bbe13363f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.382771  3044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113e062ffc5d416ba5e7bfdf4b539ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.383433  2969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113e062ffc5d416ba5e7bfdf4b539ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.388639  3047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b397188f9f94287a660b3f38e21f97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.388648  2968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b88c53b0d5344f5b06dd897cab945f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.455670  3124 tablet_service.cc:1511] Processing CreateTablet for tablet 4b0a3042136f4a54a7db6456dc440ad8 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:15:11.462255  3124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b0a3042136f4a54a7db6456dc440ad8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.460866  3123 tablet_service.cc:1511] Processing CreateTablet for tablet 5987451194a84c6c915b70640266b555 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:15:11.460808  3125 tablet_service.cc:1511] Processing CreateTablet for tablet a32f26f5556b4b12a7a8e32ead1ea456 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION VALUES < 238609294
W20260709 13:15:11.484465  2931 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:11.484447  3120 tablet_service.cc:1511] Processing CreateTablet for tablet f80a50e2fd1640889c63bbe13363f5b6 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:15:11.487106  3122 tablet_service.cc:1511] Processing CreateTablet for tablet c02eeaf549bb4987ba2acf3ba3546928 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:15:11.490525  3118 tablet_service.cc:1511] Processing CreateTablet for tablet 113e062ffc5d416ba5e7bfdf4b539ed1 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:15:11.480983  3119 tablet_service.cc:1511] Processing CreateTablet for tablet 54f2040741684ef3b8415fcc562ed48e (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:15:11.499686  3121 tablet_service.cc:1511] Processing CreateTablet for tablet 8b397188f9f94287a660b3f38e21f97b (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:15:11.502630  3123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5987451194a84c6c915b70640266b555. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.507191  3122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c02eeaf549bb4987ba2acf3ba3546928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.506091  3117 tablet_service.cc:1511] Processing CreateTablet for tablet 2b88c53b0d5344f5b06dd897cab945f9 (DEFAULT_TABLE table=test-workload [id=4475608caf394fd2b1e20c30de43a5b2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:15:11.510640  3119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54f2040741684ef3b8415fcc562ed48e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.512339  3117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b88c53b0d5344f5b06dd897cab945f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.515473  3120 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f80a50e2fd1640889c63bbe13363f5b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.517225  3121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b397188f9f94287a660b3f38e21f97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.519624  3178 tablet_bootstrap.cc:492] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:11.537563  3118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 113e062ffc5d416ba5e7bfdf4b539ed1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.545845  3125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a32f26f5556b4b12a7a8e32ead1ea456. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:11.538163  3179 tablet_bootstrap.cc:492] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:11.591442  3178 tablet_bootstrap.cc:654] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.632714  3179 tablet_bootstrap.cc:654] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.632712  3180 tablet_bootstrap.cc:492] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:11.646488  3179 tablet_bootstrap.cc:492] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:11.649166  3178 tablet_bootstrap.cc:492] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:11.649449  3179 ts_tablet_manager.cc:1403] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.009s
I20260709 13:15:11.649624  3178 ts_tablet_manager.cc:1403] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.003s
I20260709 13:15:11.650113  3180 tablet_bootstrap.cc:654] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.654069  3179 raft_consensus.cc:359] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.653756  3178 raft_consensus.cc:359] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.654955  3178 raft_consensus.cc:385] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.655264  3178 raft_consensus.cc:740] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.655992  3178 consensus_queue.cc:260] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.656898  3180 tablet_bootstrap.cc:492] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:11.656996  3179 raft_consensus.cc:385] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.657394  3180 ts_tablet_manager.cc:1403] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.007s
I20260709 13:15:11.657435  3179 raft_consensus.cc:740] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.658329  3179 consensus_queue.cc:260] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.661604  3180 raft_consensus.cc:359] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.662384  3180 raft_consensus.cc:385] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.662688  3180 raft_consensus.cc:740] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.663887  3180 consensus_queue.cc:260] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.664827  3179 ts_tablet_manager.cc:1434] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 13:15:11.665725  3011 heartbeater.cc:499] Master 127.2.200.254:36785 was elected leader, sending a full tablet report...
I20260709 13:15:11.666062  3179 tablet_bootstrap.cc:492] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:11.674365  3086 heartbeater.cc:499] Master 127.2.200.254:36785 was elected leader, sending a full tablet report...
I20260709 13:15:11.674857  3179 tablet_bootstrap.cc:654] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.681564  3160 heartbeater.cc:499] Master 127.2.200.254:36785 was elected leader, sending a full tablet report...
I20260709 13:15:11.683293  3179 tablet_bootstrap.cc:492] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:11.683779  3179 ts_tablet_manager.cc:1403] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.004s
I20260709 13:15:11.686537  3179 raft_consensus.cc:359] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.687227  3179 raft_consensus.cc:385] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.687528  3179 raft_consensus.cc:740] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.688201  3179 consensus_queue.cc:260] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.690598  3179 ts_tablet_manager.cc:1434] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:15:11.691395  3184 raft_consensus.cc:493] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.691874  3184 raft_consensus.cc:515] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.692548  3179 tablet_bootstrap.cc:492] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:11.690115  3180 ts_tablet_manager.cc:1434] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.002s
I20260709 13:15:11.696599  3180 tablet_bootstrap.cc:492] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:11.698122  3184 leader_election.cc:290] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:11.691815  3178 ts_tablet_manager.cc:1434] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.007s
I20260709 13:15:11.704838  3178 tablet_bootstrap.cc:492] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:11.706496  3179 tablet_bootstrap.cc:654] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.714130  3180 tablet_bootstrap.cc:654] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.718824  3178 tablet_bootstrap.cc:654] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:11.724462  3087 tablet.cc:2406] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:11.729169  3179 tablet_bootstrap.cc:492] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:11.735955  3180 tablet_bootstrap.cc:492] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:11.738837  3179 ts_tablet_manager.cc:1403] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.008s
I20260709 13:15:11.739311  3180 ts_tablet_manager.cc:1403] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.003s
I20260709 13:15:11.739645  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:11.740455  2986 raft_consensus.cc:2468] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 0.
I20260709 13:15:11.741997  3179 raft_consensus.cc:359] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.742089  3025 leader_election.cc:304] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:11.742522  3179 raft_consensus.cc:385] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.742731  3179 raft_consensus.cc:740] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.743163  3184 raft_consensus.cc:2804] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.743538  3184 raft_consensus.cc:493] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.743860  3184 raft_consensus.cc:3060] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.744151  3180 raft_consensus.cc:359] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.744678  3180 raft_consensus.cc:385] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.745134  3180 raft_consensus.cc:740] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.746127  3180 consensus_queue.cc:260] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.749256  3180 ts_tablet_manager.cc:1434] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:11.749279  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:11.750782  3180 tablet_bootstrap.cc:492] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:11.751468  3184 raft_consensus.cc:515] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.750821  3135 raft_consensus.cc:2468] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 0.
I20260709 13:15:11.743376  3179 consensus_queue.cc:260] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.757159  3179 ts_tablet_manager.cc:1434] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:15:11.757539  3180 tablet_bootstrap.cc:654] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.758102  3179 tablet_bootstrap.cc:492] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:11.761727  3185 raft_consensus.cc:493] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.762239  3185 raft_consensus.cc:515] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.765012  3185 leader_election.cc:290] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:11.772914  3179 tablet_bootstrap.cc:654] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.773910  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:11.774506  2986 raft_consensus.cc:3060] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.782018  3184 leader_election.cc:290] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:11.783281  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:11.783879  3135 raft_consensus.cc:3060] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.788552  3180 tablet_bootstrap.cc:492] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:11.789227  3180 ts_tablet_manager.cc:1403] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.011s
I20260709 13:15:11.792387  2986 raft_consensus.cc:2468] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 1.
I20260709 13:15:11.792698  3180 raft_consensus.cc:359] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.797640  3178 tablet_bootstrap.cc:492] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:11.798132  3178 ts_tablet_manager.cc:1403] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.014s
I20260709 13:15:11.799551  3025 leader_election.cc:304] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:11.800390  3184 raft_consensus.cc:2804] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.802580  3135 raft_consensus.cc:2468] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 1.
I20260709 13:15:11.794415  3180 raft_consensus.cc:385] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.809132  3184 raft_consensus.cc:697] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:11.805158  3180 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.810269  3180 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.812908  3178 raft_consensus.cc:359] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.813633  3178 raft_consensus.cc:385] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.813923  3178 raft_consensus.cc:740] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.814690  3178 consensus_queue.cc:260] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.815557  3180 ts_tablet_manager.cc:1434] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.005s
I20260709 13:15:11.810127  3184 consensus_queue.cc:237] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.817690  3180 tablet_bootstrap.cc:492] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:11.821337  3179 tablet_bootstrap.cc:492] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:11.821719  3178 ts_tablet_manager.cc:1434] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.004s
I20260709 13:15:11.822717  3178 tablet_bootstrap.cc:492] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:11.821794  3179 ts_tablet_manager.cc:1403] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.021s
I20260709 13:15:11.826603  3180 tablet_bootstrap.cc:654] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.830463  3179 raft_consensus.cc:359] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.831377  3179 raft_consensus.cc:385] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.834314  3179 raft_consensus.cc:740] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.835162  3179 consensus_queue.cc:260] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.840672  3178 tablet_bootstrap.cc:654] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.842725  3179 ts_tablet_manager.cc:1434] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:11.843534  3180 tablet_bootstrap.cc:492] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:11.843758  3179 tablet_bootstrap.cc:492] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:11.843954  3180 ts_tablet_manager.cc:1403] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.007s
I20260709 13:15:11.843725  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:11.847008  3186 raft_consensus.cc:493] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.847712  3186 raft_consensus.cc:515] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
W20260709 13:15:11.850612  2952 leader_election.cc:343] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.857648  3186 leader_election.cc:290] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:11.882380  2883 catalog_manager.cc:5697] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.886399  3180 raft_consensus.cc:359] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.887504  3180 raft_consensus.cc:385] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.887806  3180 raft_consensus.cc:740] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.888485  3178 tablet_bootstrap.cc:492] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:11.888301  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:11.889025  3178 ts_tablet_manager.cc:1403] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.003s
I20260709 13:15:11.888682  3180 consensus_queue.cc:260] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.889137  3135 raft_consensus.cc:2468] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:11.893776  2952 leader_election.cc:304] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:11.895190  3185 raft_consensus.cc:2804] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.895630  3185 raft_consensus.cc:493] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.896332  3185 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.897749  3179 tablet_bootstrap.cc:654] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.896487  3178 raft_consensus.cc:359] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.899266  3178 raft_consensus.cc:385] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.900310  3178 raft_consensus.cc:740] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.901188  3178 consensus_queue.cc:260] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.903940  3178 ts_tablet_manager.cc:1434] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:15:11.904963  3178 tablet_bootstrap.cc:492] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:11.906205  3180 ts_tablet_manager.cc:1434] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.009s
I20260709 13:15:11.907042  3185 raft_consensus.cc:515] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.908077  3180 tablet_bootstrap.cc:492] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:11.910001  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
W20260709 13:15:11.912287  2952 leader_election.cc:343] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.915297  3185 leader_election.cc:290] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:11.916275  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:11.916960  3135 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.917266  3178 tablet_bootstrap.cc:654] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.923318  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:11.925063  2986 raft_consensus.cc:2393] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11d623eeca434e989ebc6b1b3bb8e231 in current term 1: Already voted for candidate 4dec59b548f447a2becb166c8bde83de in this term.
I20260709 13:15:11.927708  3135 raft_consensus.cc:2468] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:11.928485  3180 tablet_bootstrap.cc:654] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.930156  2952 leader_election.cc:304] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:11.931918  3185 raft_consensus.cc:2804] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:11.953162  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:11.953509  3178 tablet_bootstrap.cc:492] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:11.954088  3178 ts_tablet_manager.cc:1403] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.005s
I20260709 13:15:11.953893  3185 raft_consensus.cc:697] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
W20260709 13:15:11.955567  3101 leader_election.cc:343] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.956022  3101 leader_election.cc:304] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231; no voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:11.956990  3186 raft_consensus.cc:2749] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:11.957732  3179 tablet_bootstrap.cc:492] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:11.957324  3185 consensus_queue.cc:237] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.958684  3179 ts_tablet_manager.cc:1403] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.011s
I20260709 13:15:11.957851  3178 raft_consensus.cc:359] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.959157  3178 raft_consensus.cc:385] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.959473  3178 raft_consensus.cc:740] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.960326  3178 consensus_queue.cc:260] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.962538  3178 ts_tablet_manager.cc:1434] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:11.963809  3178 tablet_bootstrap.cc:492] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:11.964562  3180 tablet_bootstrap.cc:492] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:11.965530  3180 ts_tablet_manager.cc:1403] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.006s
I20260709 13:15:11.968426  3180 raft_consensus.cc:359] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.962312  3179 raft_consensus.cc:359] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.969040  3207 raft_consensus.cc:493] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:11.969306  3179 raft_consensus.cc:385] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.969780  3179 raft_consensus.cc:740] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.969594  3207 raft_consensus.cc:515] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.970232  3178 tablet_bootstrap.cc:654] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:11.970717  3179 consensus_queue.cc:260] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.971722  3207 leader_election.cc:290] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:11.972831  3180 raft_consensus.cc:385] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:11.973857  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:11.974669  3061 raft_consensus.cc:2468] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:11.973228  3180 raft_consensus.cc:740] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:11.977058  2952 leader_election.cc:304] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:11.977205  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
W20260709 13:15:11.979164  2952 leader_election.cc:343] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:11.981546  3211 raft_consensus.cc:2804] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:11.982903  3211 raft_consensus.cc:493] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:11.983356  3211 raft_consensus.cc:3060] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:11.980331  3180 consensus_queue.cc:260] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.986066  3180 ts_tablet_manager.cc:1434] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.003s
I20260709 13:15:11.984620  2883 catalog_manager.cc:5697] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 1 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:11.992573  3179 ts_tablet_manager.cc:1434] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:15:11.999392  3180 tablet_bootstrap.cc:492] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:12.003091  3211 raft_consensus.cc:515] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:11.995054  3179 tablet_bootstrap.cc:492] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:12.005390  3211 leader_election.cc:290] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.006852  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.006852  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.007853  3061 raft_consensus.cc:3060] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:12.009994  2952 leader_election.cc:343] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.012127  3178 tablet_bootstrap.cc:492] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:12.012719  3178 ts_tablet_manager.cc:1403] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.009s
I20260709 13:15:12.017491  3178 raft_consensus.cc:359] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.020175  3178 raft_consensus.cc:385] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.020175  3061 raft_consensus.cc:2468] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.020537  3178 raft_consensus.cc:740] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.021366  3178 consensus_queue.cc:260] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.021714  2952 leader_election.cc:304] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 11d623eeca434e989ebc6b1b3bb8e231
I20260709 13:15:12.020279  3179 tablet_bootstrap.cc:654] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.023679  3178 ts_tablet_manager.cc:1434] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:15:12.024856  3178 tablet_bootstrap.cc:492] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:12.032227  3178 tablet_bootstrap.cc:654] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.032955  3211 raft_consensus.cc:2804] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.034138  3211 raft_consensus.cc:697] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.035050  3211 consensus_queue.cc:237] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.036042  3179 tablet_bootstrap.cc:492] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:12.036561  3179 ts_tablet_manager.cc:1403] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.005s
I20260709 13:15:12.037112  3180 tablet_bootstrap.cc:654] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.039506  3179 raft_consensus.cc:359] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.040552  3179 raft_consensus.cc:385] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.040998  3179 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.041857  3179 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.044647  3179 ts_tablet_manager.cc:1434] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:12.045789  3179 tablet_bootstrap.cc:492] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:12.051553  3184 raft_consensus.cc:493] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.052189  3185 raft_consensus.cc:493] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.052059  3184 raft_consensus.cc:515] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.052654  3185 raft_consensus.cc:515] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.053646  3178 tablet_bootstrap.cc:492] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:12.054442  3184 leader_election.cc:290] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.054867  3185 leader_election.cc:290] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.056048  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.056473  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
W20260709 13:15:12.060112  3025 leader_election.cc:343] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:12.060293  2952 leader_election.cc:343] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.056895  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
W20260709 13:15:12.062733  3027 leader_election.cc:343] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.063163  3027 leader_election.cc:304] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02; no voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.056116  3178 ts_tablet_manager.cc:1403] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.000s
I20260709 13:15:12.057049  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:12.056504  3180 tablet_bootstrap.cc:492] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:12.064443  3180 ts_tablet_manager.cc:1403] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.005s
I20260709 13:15:12.063946  3184 raft_consensus.cc:2749] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.064316  3135 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:12.066059  2952 leader_election.cc:304] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:12.066454  3178 raft_consensus.cc:359] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.067440  3211 raft_consensus.cc:2804] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.067225  3180 raft_consensus.cc:359] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.067844  3179 tablet_bootstrap.cc:654] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.067188  2883 catalog_manager.cc:5697] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 1 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.067116  3178 raft_consensus.cc:385] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.068418  3178 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.069195  3178 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.067801  3211 raft_consensus.cc:493] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.070209  3211 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.070391  3180 raft_consensus.cc:385] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.070755  3180 raft_consensus.cc:740] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.071480  3180 consensus_queue.cc:260] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.073480  3180 ts_tablet_manager.cc:1434] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:15:12.074584  3180 tablet_bootstrap.cc:492] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:12.081722  3180 tablet_bootstrap.cc:654] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.088133  3184 raft_consensus.cc:493] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.088647  3184 raft_consensus.cc:515] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.089716  3179 tablet_bootstrap.cc:492] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:12.091140  3184 leader_election.cc:290] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.091367  3179 ts_tablet_manager.cc:1403] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.007s
I20260709 13:15:12.092128  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.092747  2986 raft_consensus.cc:2468] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 0.
I20260709 13:15:12.094012  3025 leader_election.cc:304] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.095024  3196 raft_consensus.cc:2804] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.095378  3196 raft_consensus.cc:493] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.095541  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:12.095822  3196 raft_consensus.cc:3060] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:12.096976  3027 leader_election.cc:343] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.099210  3179 raft_consensus.cc:359] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.099910  3179 raft_consensus.cc:385] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.100087  3185 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.100360  3179 raft_consensus.cc:740] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.100553  3185 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.101187  3179 consensus_queue.cc:260] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.102684  3185 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.104070  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:12.104079  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:12.104348  3196 raft_consensus.cc:515] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.105343  3179 ts_tablet_manager.cc:1434] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.005s
W20260709 13:15:12.105901  2952 leader_election.cc:343] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.106295  3179 tablet_bootstrap.cc:492] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:12.107746  3184 raft_consensus.cc:493] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.107962  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.108420  3184 raft_consensus.cc:515] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.109512  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:12.110280  2986 raft_consensus.cc:3060] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.110657  3184 leader_election.cc:290] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.111397  3178 ts_tablet_manager.cc:1434] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.003s
I20260709 13:15:12.112376  3178 tablet_bootstrap.cc:492] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
W20260709 13:15:12.114910  3027 leader_election.cc:343] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.115123  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.115856  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
W20260709 13:15:12.116750  3025 leader_election.cc:343] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.106417  3196 leader_election.cc:290] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
W20260709 13:15:12.117206  3027 leader_election.cc:343] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.094244  3211 raft_consensus.cc:515] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.117628  3027 leader_election.cc:304] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02; no voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.120354  3179 tablet_bootstrap.cc:654] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.120836  3135 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:12.122087  2952 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:12.123148  3185 raft_consensus.cc:2804] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.123499  3185 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.123812  3185 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.127525  3196 raft_consensus.cc:2749] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.129361  3180 tablet_bootstrap.cc:492] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:12.131595  3180 ts_tablet_manager.cc:1403] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.005s
I20260709 13:15:12.132249  3178 tablet_bootstrap.cc:654] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.135146  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.135726  3061 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.133669  3211 leader_election.cc:290] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.141077  3178 tablet_bootstrap.cc:492] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:12.141209  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.141608  3178 ts_tablet_manager.cc:1403] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.007s
I20260709 13:15:12.141880  3135 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.147593  3178 raft_consensus.cc:359] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.148437  3178 raft_consensus.cc:385] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.148962  3178 raft_consensus.cc:740] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.149981  3178 consensus_queue.cc:260] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.151086  3061 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.152397  2952 leader_election.cc:304] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.153334  3211 raft_consensus.cc:2804] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.130963  2986 raft_consensus.cc:2468] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 1.
I20260709 13:15:12.153929  3211 raft_consensus.cc:697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.154950  3211 consensus_queue.cc:237] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.157305  3025 leader_election.cc:304] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 11d623eeca434e989ebc6b1b3bb8e231
I20260709 13:15:12.159737  3196 raft_consensus.cc:2804] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.159683  3185 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.157716  3180 raft_consensus.cc:359] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.148634  3135 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.160319  3196 raft_consensus.cc:697] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:12.161607  3196 consensus_queue.cc:237] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.165518  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
W20260709 13:15:12.166939  2952 leader_election.cc:343] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:12.169184  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.169857  3135 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.173492  3178 ts_tablet_manager.cc:1434] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 13:15:12.173940  3185 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.174629  3180 raft_consensus.cc:385] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.174832  3178 tablet_bootstrap.cc:492] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:12.175058  3180 raft_consensus.cc:740] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.176040  3180 consensus_queue.cc:260] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.178539  3180 ts_tablet_manager.cc:1434] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 13:15:12.179540  3180 tablet_bootstrap.cc:492] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:12.182871  3135 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.188380  2952 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:12.190376  3185 raft_consensus.cc:2804] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.196040  3185 raft_consensus.cc:697] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.195339  2883 catalog_manager.cc:5697] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.196966  3185 consensus_queue.cc:237] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.207846  3179 tablet_bootstrap.cc:492] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:12.208586  3179 ts_tablet_manager.cc:1403] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.102s	user 0.017s	sys 0.037s
I20260709 13:15:12.210260  3178 tablet_bootstrap.cc:654] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.212153  3179 raft_consensus.cc:359] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.213537  3179 raft_consensus.cc:385] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.213828  3179 raft_consensus.cc:740] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.214514  3179 consensus_queue.cc:260] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.216805  3179 ts_tablet_manager.cc:1434] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:12.217166  3180 tablet_bootstrap.cc:654] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.217733  3179 tablet_bootstrap.cc:492] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: Bootstrap starting.
I20260709 13:15:12.222231  3178 tablet_bootstrap.cc:492] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:12.222657  3178 ts_tablet_manager.cc:1403] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 13:15:12.222097  2882 catalog_manager.cc:5697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 1 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.225868  3178 raft_consensus.cc:359] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.226518  3178 raft_consensus.cc:385] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.226775  3178 raft_consensus.cc:740] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.227882  3196 consensus_queue.cc:1048] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.230625  3179 tablet_bootstrap.cc:654] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.227381  3178 consensus_queue.cc:260] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.234862  3178 ts_tablet_manager.cc:1434] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:15:12.235718  3178 tablet_bootstrap.cc:492] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02: Bootstrap starting.
I20260709 13:15:12.243559  3180 tablet_bootstrap.cc:492] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:12.244082  3180 ts_tablet_manager.cc:1403] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.012s
I20260709 13:15:12.244541  3178 tablet_bootstrap.cc:654] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.247648  3180 raft_consensus.cc:359] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.248374  3180 raft_consensus.cc:385] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.248678  3180 raft_consensus.cc:740] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.249786  3180 consensus_queue.cc:260] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.252357  3180 ts_tablet_manager.cc:1434] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:12.253364  3180 tablet_bootstrap.cc:492] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231: Bootstrap starting.
I20260709 13:15:12.250052  3179 tablet_bootstrap.cc:492] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: No bootstrap required, opened a new log
I20260709 13:15:12.253932  3179 ts_tablet_manager.cc:1403] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.000s
I20260709 13:15:12.254585  3178 tablet_bootstrap.cc:492] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02: No bootstrap required, opened a new log
I20260709 13:15:12.255124  3178 ts_tablet_manager.cc:1403] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.003s
I20260709 13:15:12.256626  3179 raft_consensus.cc:359] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.257388  3179 raft_consensus.cc:385] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.261482  3179 raft_consensus.cc:740] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.258198  3178 raft_consensus.cc:359] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.262295  3178 raft_consensus.cc:385] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.262599  3178 raft_consensus.cc:740] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.263248  3178 consensus_queue.cc:260] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.262306  3179 consensus_queue.cc:260] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.265322  3180 tablet_bootstrap.cc:654] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:12.266139  3179 ts_tablet_manager.cc:1434] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:15:12.270284  3178 ts_tablet_manager.cc:1434] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:12.268126  2882 catalog_manager.cc:5697] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 1 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.278568  3180 tablet_bootstrap.cc:492] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231: No bootstrap required, opened a new log
I20260709 13:15:12.279117  3180 ts_tablet_manager.cc:1403] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:15:12.281175  3186 raft_consensus.cc:493] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.281675  3186 raft_consensus.cc:515] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.283509  3186 leader_election.cc:290] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791)
I20260709 13:15:12.288348  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.289054  2986 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 0.
I20260709 13:15:12.290030  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:12.290623  3061 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 0.
I20260709 13:15:12.288241  3180 raft_consensus.cc:359] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.291375  3180 raft_consensus.cc:385] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:12.291672  3180 raft_consensus.cc:740] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Initialized, Role: FOLLOWER
I20260709 13:15:12.292419  3180 consensus_queue.cc:260] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.293414  3101 leader_election.cc:304] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 
I20260709 13:15:12.295974  3186 raft_consensus.cc:493] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.296444  3186 raft_consensus.cc:515] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.298936  3186 leader_election.cc:290] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:12.299630  3186 raft_consensus.cc:2804] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.300051  3186 raft_consensus.cc:493] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.300367  3186 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.301988  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.307492  3184 consensus_queue.cc:1048] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.316705  3185 raft_consensus.cc:493] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.317273  3185 raft_consensus.cc:515] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.319401  3185 leader_election.cc:290] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.320642  3186 raft_consensus.cc:515] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.321201  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:12.321777  3061 raft_consensus.cc:2468] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:12.322947  2952 leader_election.cc:304] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.323709  3185 raft_consensus.cc:2804] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.323686  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:12.324190  3185 raft_consensus.cc:493] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.324404  2985 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.324723  3185 raft_consensus.cc:3060] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.332031  2985 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 1.
I20260709 13:15:12.333681  3099 leader_election.cc:304] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.334883  3231 raft_consensus.cc:2804] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.335160  3180 ts_tablet_manager.cc:1434] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231: Time spent starting tablet: real 0.056s	user 0.010s	sys 0.012s
I20260709 13:15:12.335481  3231 raft_consensus.cc:697] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 LEADER]: Becoming Leader. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:12.332108  3185 raft_consensus.cc:515] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.336421  3231 consensus_queue.cc:237] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.338111  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.338666  3061 raft_consensus.cc:3060] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:12.344010  3101 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:34833, user_credentials={real_user=slave}} blocked reactor thread for 50848.7us
I20260709 13:15:12.344440  3060 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.348546  3211 raft_consensus.cc:493] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.349035  3211 raft_consensus.cc:515] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.349038  3061 raft_consensus.cc:2468] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.351030  3211 leader_election.cc:290] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.352036  3059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:12.352185  2952 leader_election.cc:304] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.352742  3059 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:12.353259  3185 leader_election.cc:290] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.353850  2952 leader_election.cc:304] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.353940  3211 raft_consensus.cc:2804] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.354646  3207 raft_consensus.cc:2804] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:12.355008  3207 raft_consensus.cc:493] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:12.355357  3207 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.358597  3211 raft_consensus.cc:697] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.359582  3211 consensus_queue.cc:237] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.362663  3186 leader_election.cc:290] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791)
I20260709 13:15:12.364048  3207 raft_consensus.cc:515] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.365423  3059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:12.366504  3059 raft_consensus.cc:2393] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11d623eeca434e989ebc6b1b3bb8e231 in current term 1: Already voted for candidate 4dec59b548f447a2becb166c8bde83de in this term.
I20260709 13:15:12.369881  3059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.370460  3059 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.372274  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.373245  3061 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.370826  2882 catalog_manager.cc:5697] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 reported cstate change: term changed from 0 to 1, leader changed from <none> to 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:12.374641  3211 consensus_queue.cc:1048] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.375890  3207 leader_election.cc:290] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.379268  3133 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:12.381192  3133 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 0.
I20260709 13:15:12.378862  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.381271  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.383577  3135 raft_consensus.cc:3060] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.384038  3132 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.385105  3059 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 1.
I20260709 13:15:12.385974  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:12.389140  3061 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.390262  2952 leader_election.cc:304] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.393235  3207 raft_consensus.cc:2804] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:12.393721  3207 raft_consensus.cc:697] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.394097  2882 catalog_manager.cc:5697] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 1 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.394510  3207 consensus_queue.cc:237] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.402073  3135 raft_consensus.cc:2468] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.403023  3132 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 1.
I20260709 13:15:12.383236  3101 leader_election.cc:304] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231; no voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.404175  3186 raft_consensus.cc:3060] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.411389  3186 raft_consensus.cc:2749] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.415156  3186 raft_consensus.cc:493] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.415711  3186 raft_consensus.cc:515] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.420929  3186 leader_election.cc:290] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:12.421607  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.422312  2986 raft_consensus.cc:2393] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11d623eeca434e989ebc6b1b3bb8e231 in current term 1: Already voted for candidate 13737e4959ab4cdbb9289ca1036cde02 in this term.
I20260709 13:15:12.423328  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:12.424960  3101 leader_election.cc:304] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231; no voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.425642  3236 consensus_queue.cc:1048] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.425985  3186 raft_consensus.cc:3060] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.431464  3186 raft_consensus.cc:2749] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:12.433945  2883 catalog_manager.cc:5697] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 1 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.437320  3185 consensus_queue.cc:1048] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.461174  3236 consensus_queue.cc:1048] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.596585  3236 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.608132  3207 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.688364  3060 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:12.694407  3184 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:12.694892  3184 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.695391  3207 consensus_queue.cc:1048] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.697856  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
mode: GRACEFUL
new_leader_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:58122
I20260709 13:15:12.700322  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:12.700486  3135 raft_consensus.cc:606] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 LEADER]: Received request to transfer leadership to TS 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.698791  3184 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.699833  3132 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231" is_pre_election: true
I20260709 13:15:12.702970  3132 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 1.
I20260709 13:15:12.704214  3027 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.707479  3196 raft_consensus.cc:2804] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:12.708914  3196 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dec59b548f447a2becb166c8bde83de)
I20260709 13:15:12.709252  3196 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.715581  3196 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.717316  3211 consensus_queue.cc:1048] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.718469  3196 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.719080  2986 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:12.720906  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.724956  3184 consensus_queue.cc:1048] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.727443  3061 raft_consensus.cc:1240] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Rejecting Update request from peer 4dec59b548f447a2becb166c8bde83de for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:12.728192  3025 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02; no voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:12.729688  3207 consensus_queue.cc:1059] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.732707  3207 raft_consensus.cc:3055] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.733054  3207 raft_consensus.cc:740] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.733840  3207 consensus_queue.cc:260] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.735380  3207 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.731482  3196 raft_consensus.cc:2749] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:12.741209  3196 consensus_queue.cc:1048] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.752316  3186 consensus_queue.cc:1048] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.768635  3231 raft_consensus.cc:993] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: : Instructing follower 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:12.769330  3231 raft_consensus.cc:1081] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 LEADER]: Signalling peer 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:12.774112  2984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:54014
I20260709 13:15:12.774726  2984 raft_consensus.cc:493] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.775082  2984 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.782510  3232 consensus_queue.cc:1048] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.798518  2984 raft_consensus.cc:515] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.801759  2985 raft_consensus.cc:1240] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Rejecting Update request from peer 11d623eeca434e989ebc6b1b3bb8e231 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:12.806563  2983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:15:12.807368  2983 raft_consensus.cc:606] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:12.809237  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.810312  3135 raft_consensus.cc:3055] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.810637  3135 raft_consensus.cc:740] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:12.810794  3231 consensus_queue.cc:1059] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.811720  3060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.808265  2984 leader_election.cc:290] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 2 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.815678  3135 consensus_queue.cc:260] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.825173  3207 consensus_queue.cc:1048] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.833129  2984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:15:12.833828  2984 raft_consensus.cc:606] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:12.833947  3135 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.842291  3135 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 2.
W20260709 13:15:12.842873  3231 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:12.846529  2984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
mode: GRACEFUL
new_leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:15:12.847211  2984 raft_consensus.cc:606] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Received request to transfer leadership to TS 11d623eeca434e989ebc6b1b3bb8e231
I20260709 13:15:12.849289  3211 consensus_queue.cc:1048] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.852694  2952 leader_election.cc:304] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:12.853413  3236 raft_consensus.cc:2804] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.853838  3236 raft_consensus.cc:697] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.854590  3236 consensus_queue.cc:237] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.864481  2882 catalog_manager.cc:5697] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 1 to 2, leader changed from 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195) to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 2 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.867785  3211 raft_consensus.cc:993] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:12.868219  3236 raft_consensus.cc:1081] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:12.870477  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55232
I20260709 13:15:12.871074  3061 raft_consensus.cc:493] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.871384  3061 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.879094  3061 raft_consensus.cc:515] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.879639  3236 consensus_queue.cc:1048] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:12.881875  3061 leader_election.cc:290] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:12.882208  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:12.882926  3135 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.886955  2984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:12.887581  2984 raft_consensus.cc:3055] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.887878  2984 raft_consensus.cc:740] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.888628  2984 consensus_queue.cc:260] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.889873  2984 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.895797  2984 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:12.897035  3135 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:12.897761  3025 leader_election.cc:304] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:12.898554  3252 raft_consensus.cc:2804] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.898978  3252 raft_consensus.cc:697] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:12.899753  3252 consensus_queue.cc:237] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.914610  3236 consensus_queue.cc:1048] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:12.914166  2883 catalog_manager.cc:5697] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 1 to 2, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:12.977837  3241 raft_consensus.cc:993] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: : Instructing follower 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:12.978264  3236 raft_consensus.cc:1081] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Signalling peer 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:12.979594  3134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:58118
I20260709 13:15:12.980015  3134 raft_consensus.cc:493] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:12.980271  3134 raft_consensus.cc:3060] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.984681  3134 raft_consensus.cc:515] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.986398  3134 leader_election.cc:290] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:12.987537  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:12.987537  2984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b88c53b0d5344f5b06dd897cab945f9" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:12.988243  3061 raft_consensus.cc:3060] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.988308  2984 raft_consensus.cc:3055] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:12.988700  2984 raft_consensus.cc:740] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:12.989533  2984 consensus_queue.cc:260] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:12.990694  2984 raft_consensus.cc:3060] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:12.995162  3061 raft_consensus.cc:2468] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 2.
I20260709 13:15:12.996598  3101 leader_election.cc:304] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 
I20260709 13:15:12.997213  2984 raft_consensus.cc:2468] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 2.
I20260709 13:15:12.997473  3231 raft_consensus.cc:2804] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:12.998036  3231 raft_consensus.cc:697] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Becoming Leader. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:12.998879  3231 consensus_queue.cc:237] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:13.006348  2883 catalog_manager.cc:5697] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 reported cstate change: term changed from 1 to 2, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:13.116823  3241 raft_consensus.cc:993] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:13.117236  3236 raft_consensus.cc:1081] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:13.119156  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55232
I20260709 13:15:13.119715  3061 raft_consensus.cc:493] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:13.120054  3061 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.126986  3061 raft_consensus.cc:515] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:13.129164  3061 leader_election.cc:290] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:13.130863  3134 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:13.130805  2984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:13.131606  3134 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.131682  2984 raft_consensus.cc:3055] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:13.132189  2984 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:13.133387  2984 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:13.134712  2984 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.139485  3134 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:13.140970  3027 leader_election.cc:304] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 
I20260709 13:15:13.141733  2984 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:13.141844  3252 raft_consensus.cc:2804] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:13.142452  3252 raft_consensus.cc:697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:13.143502  3252 consensus_queue.cc:237] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:13.150857  2883 catalog_manager.cc:5697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 1 to 2, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:13.250756  3134 raft_consensus.cc:1275] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.252295  3236 consensus_queue.cc:1048] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.266736  3061 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:13.272737  3061 raft_consensus.cc:1275] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.274034  3185 consensus_queue.cc:1048] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.460178  3134 raft_consensus.cc:1275] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.461462  3252 consensus_queue.cc:1048] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.468422  2984 raft_consensus.cc:1275] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.470017  3262 consensus_queue.cc:1048] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.592648  2984 raft_consensus.cc:1275] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.593994  3231 consensus_queue.cc:1048] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.603590  3061 raft_consensus.cc:1275] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.605151  3231 consensus_queue.cc:1048] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.609094  2984 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.610387  3262 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:13.620713  3134 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:13.622720  3253 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.221784  3272 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dec59b548f447a2becb166c8bde83de)
I20260709 13:15:14.222487  3272 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:14.224551  3272 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:14.225595  2984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de" is_pre_election: true
I20260709 13:15:14.225766  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02" is_pre_election: true
I20260709 13:15:14.226531  2984 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 2.
I20260709 13:15:14.226737  3061 raft_consensus.cc:2393] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11d623eeca434e989ebc6b1b3bb8e231 in current term 2: Already voted for candidate 13737e4959ab4cdbb9289ca1036cde02 in this term.
I20260709 13:15:14.227859  3099 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:14.228662  3272 raft_consensus.cc:2804] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:14.228989  3272 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dec59b548f447a2becb166c8bde83de)
I20260709 13:15:14.229252  3272 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:14.234238  3272 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:14.235664  3272 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:14.236560  2984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:14.236815  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:14.237529  3061 raft_consensus.cc:2393] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 11d623eeca434e989ebc6b1b3bb8e231 in current term 2: Already voted for candidate 13737e4959ab4cdbb9289ca1036cde02 in this term.
I20260709 13:15:14.242149  2984 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 2.
I20260709 13:15:14.243420  3099 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:14.244234  3272 raft_consensus.cc:2804] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:14.244742  3272 raft_consensus.cc:697] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Becoming Leader. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:14.245476  3272 consensus_queue.cc:237] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:14.252698  2883 catalog_manager.cc:5697] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 reported cstate change: term changed from 1 to 2, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:14.687341  2985 raft_consensus.cc:1275] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.688587  3272 consensus_queue.cc:1048] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:14.699081  3061 raft_consensus.cc:1275] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:14.700979  3271 consensus_queue.cc:1048] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:15.877900  2851 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:15:15.878690  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:15.896107  3061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
mode: GRACEFUL
new_leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:15:15.896603  3061 raft_consensus.cc:606] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Received request to transfer leadership to TS 11d623eeca434e989ebc6b1b3bb8e231
I20260709 13:15:15.898015  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:15:15.898608  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:15.901208  3253 raft_consensus.cc:993] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: : Instructing follower 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:15.901592  3287 raft_consensus.cc:1081] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Signalling peer 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:15.903059  3134 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:58104
I20260709 13:15:15.903497  3134 raft_consensus.cc:493] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:15.903839  3134 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.908980  3134 raft_consensus.cc:515] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:15.910528  3134 leader_election.cc:290] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 3 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:15.911199  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:15.911664  2985 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.911504  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:15.912142  3061 raft_consensus.cc:3055] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:15.912446  3061 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:15.913257  3061 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:15.914237  3061 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:15.916508  2985 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 3.
I20260709 13:15:15.917629  3099 leader_election.cc:304] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:15.918406  3280 raft_consensus.cc:2804] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:15.918656  3061 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 3.
I20260709 13:15:15.920594  3280 raft_consensus.cc:697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Becoming Leader. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:15.921691  3280 consensus_queue.cc:237] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:15.929033  2882 catalog_manager.cc:5697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 reported cstate change: term changed from 2 to 3, leader changed from 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194) to 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:16.472919  2985 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:16.474330  3280 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.487251  3061 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:16.489197  3280 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:16.899664  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:16.911409  2985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:15:16.911929  2985 raft_consensus.cc:606] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:16.916792  2985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:15:16.917276  2985 raft_consensus.cc:606] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:16.921618  2985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5987451194a84c6c915b70640266b555"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:54024
I20260709 13:15:16.922066  2985 raft_consensus.cc:606] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:16.926544  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:58122
I20260709 13:15:16.926971  3135 raft_consensus.cc:606] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:16.937680  3135 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
mode: GRACEFUL
new_leader_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:58122
I20260709 13:15:16.938156  3135 raft_consensus.cc:606] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Received request to transfer leadership to TS 13737e4959ab4cdbb9289ca1036cde02
I20260709 13:15:17.017699  3270 raft_consensus.cc:993] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.018112  3270 raft_consensus.cc:1081] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.019449  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5987451194a84c6c915b70640266b555"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55232
I20260709 13:15:17.019881  3061 raft_consensus.cc:493] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.020133  3061 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.023906  3061 raft_consensus.cc:515] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.025266  3061 leader_election.cc:290] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:17.026083  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:17.026371  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:17.026513  2985 raft_consensus.cc:3055] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:17.026835  2985 raft_consensus.cc:740] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:17.026868  3135 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.027441  2985 consensus_queue.cc:260] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.028283  2985 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.031323  3135 raft_consensus.cc:2468] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:17.032428  3027 leader_election.cc:304] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 
I20260709 13:15:17.032590  2985 raft_consensus.cc:2468] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:17.033121  3287 raft_consensus.cc:2804] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:17.034101  3287 raft_consensus.cc:697] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:17.034801  3287 consensus_queue.cc:237] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.041007  2880 catalog_manager.cc:5697] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 1 to 2, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.094380  3309 raft_consensus.cc:993] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.094843  3310 raft_consensus.cc:1081] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.096530  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55246
I20260709 13:15:17.097272  3061 raft_consensus.cc:493] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.097581  3061 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.102522  3061 raft_consensus.cc:515] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.104583  3061 leader_election.cc:290] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 4 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:17.105366  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:17.105631  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:17.105881  2985 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.106122  3135 raft_consensus.cc:3055] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:17.106472  3135 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:17.107136  3135 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.107931  3135 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:17.110888  2985 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 4.
I20260709 13:15:17.111900  3025 leader_election.cc:304] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:17.112607  3135 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 4.
I20260709 13:15:17.112666  3287 raft_consensus.cc:2804] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:17.113138  3287 raft_consensus.cc:697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:17.113837  3287 consensus_queue.cc:237] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.120661  3302 raft_consensus.cc:993] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.121202  3270 raft_consensus.cc:1081] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.120906  2880 catalog_manager.cc:5697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 3 to 4, leader changed from 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.122586  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55232
I20260709 13:15:17.123018  3061 raft_consensus.cc:493] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.123338  3061 raft_consensus.cc:3060] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.128535  3061 raft_consensus.cc:515] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.130043  3061 leader_election.cc:290] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:17.131057  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:17.131063  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b0a3042136f4a54a7db6456dc440ad8" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:17.131731  2985 raft_consensus.cc:3055] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:17.131744  3135 raft_consensus.cc:3060] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.132282  2985 raft_consensus.cc:740] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:17.133111  2985 consensus_queue.cc:260] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.134289  2985 raft_consensus.cc:3060] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:17.137084  3309 raft_consensus.cc:993] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.137616  3310 raft_consensus.cc:1081] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.139322  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55246
I20260709 13:15:17.139278  3135 raft_consensus.cc:2468] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:17.139964  3061 raft_consensus.cc:493] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.141010  3061 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.140817  3027 leader_election.cc:304] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 
I20260709 13:15:17.141422  2985 raft_consensus.cc:2468] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 2.
I20260709 13:15:17.141891  3287 raft_consensus.cc:2804] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:17.142359  3287 raft_consensus.cc:697] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:17.143134  3287 consensus_queue.cc:237] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.147058  3061 raft_consensus.cc:515] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.148856  3061 leader_election.cc:290] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 3 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:17.149472  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:17.149861  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c02eeaf549bb4987ba2acf3ba3546928" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:17.150031  2985 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.150411  3135 raft_consensus.cc:3055] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:17.150817  3135 raft_consensus.cc:740] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:17.150453  2880 catalog_manager.cc:5697] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 1 to 2, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.151582  3135 consensus_queue.cc:260] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.152705  3135 raft_consensus.cc:3060] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.155740  2985 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 3.
I20260709 13:15:17.156813  3025 leader_election.cc:304] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:17.157425  3287 raft_consensus.cc:2804] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:17.157621  3135 raft_consensus.cc:2468] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 3.
I20260709 13:15:17.157820  3287 raft_consensus.cc:697] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:17.158617  3287 consensus_queue.cc:237] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.165181  2880 catalog_manager.cc:5697] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 2 to 3, leader changed from 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.251995  3302 raft_consensus.cc:993] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: : Instructing follower 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.252405  3302 raft_consensus.cc:1081] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Signalling peer 13737e4959ab4cdbb9289ca1036cde02 to start an election
I20260709 13:15:17.253983  3061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
 from {username='slave'} at 127.0.0.1:55232
I20260709 13:15:17.254518  3061 raft_consensus.cc:493] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:17.254835  3061 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.259678  3061 raft_consensus.cc:515] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.261475  3061 leader_election.cc:290] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 3 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:17.262639  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:17.262629  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a32f26f5556b4b12a7a8e32ead1ea456" candidate_uuid: "13737e4959ab4cdbb9289ca1036cde02" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:17.263401  3135 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.263430  2985 raft_consensus.cc:3055] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:17.263931  2985 raft_consensus.cc:740] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:17.264714  2985 consensus_queue.cc:260] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.265902  2985 raft_consensus.cc:3060] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:17.269982  3135 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 3.
I20260709 13:15:17.271144  3027 leader_election.cc:304] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 13737e4959ab4cdbb9289ca1036cde02; no voters: 
I20260709 13:15:17.271930  3303 raft_consensus.cc:2804] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:17.272074  2985 raft_consensus.cc:2468] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13737e4959ab4cdbb9289ca1036cde02 in term 3.
I20260709 13:15:17.272408  3303 raft_consensus.cc:697] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 LEADER]: Becoming Leader. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:17.273265  3303 consensus_queue.cc:237] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:17.280390  2880 catalog_manager.cc:5697] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 reported cstate change: term changed from 2 to 3, leader changed from 4dec59b548f447a2becb166c8bde83de (127.2.200.193) to 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "13737e4959ab4cdbb9289ca1036cde02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:17.500716  3135 raft_consensus.cc:1275] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.502125  3303 consensus_queue.cc:1048] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.512599  2984 raft_consensus.cc:1275] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.513922  3303 consensus_queue.cc:1048] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.591742  2984 raft_consensus.cc:1275] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.593320  3303 consensus_queue.cc:1048] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.594087  2984 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 4 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.595583  3303 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:17.607048  3135 raft_consensus.cc:1275] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:17.608139  3134 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 4 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:17.611716  3322 consensus_queue.cc:1048] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:17.612715  3303 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:17.640383  3135 raft_consensus.cc:1275] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.641953  3322 consensus_queue.cc:1048] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.651341  2985 raft_consensus.cc:1275] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.652704  3321 consensus_queue.cc:1048] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.694983  3135 raft_consensus.cc:1275] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.696146  3321 consensus_queue.cc:1048] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:17.704844  2985 raft_consensus.cc:1275] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Refusing update from remote peer 13737e4959ab4cdbb9289ca1036cde02: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:17.706403  3323 consensus_queue.cc:1048] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:19.942544  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:19.951161  3061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
mode: GRACEFUL
new_leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:15:19.951962  3061 raft_consensus.cc:606] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 LEADER]: Received request to transfer leadership to TS 11d623eeca434e989ebc6b1b3bb8e231
I20260709 13:15:19.954686  3061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
mode: GRACEFUL
new_leader_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:15:19.955165  3061 raft_consensus.cc:606] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Received request to transfer leadership to TS 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:19.957708  3061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5987451194a84c6c915b70640266b555"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
mode: GRACEFUL
new_leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:15:19.958348  3061 raft_consensus.cc:606] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Received request to transfer leadership to TS 11d623eeca434e989ebc6b1b3bb8e231
I20260709 13:15:19.961009  3061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
mode: GRACEFUL
new_leader_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:15:19.961700  3061 raft_consensus.cc:606] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Received request to transfer leadership to TS 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:19.964443  3061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6"
dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
mode: GRACEFUL
new_leader_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:55258
I20260709 13:15:19.965148  3061 raft_consensus.cc:606] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Received request to transfer leadership to TS 4dec59b548f447a2becb166c8bde83de
I20260709 13:15:19.966230  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:15:19.966687  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:20.042932  3333 raft_consensus.cc:993] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: : Instructing follower 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:20.043486  3334 raft_consensus.cc:1081] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Signalling peer 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:20.044962  3135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5987451194a84c6c915b70640266b555"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:58104
I20260709 13:15:20.045379  3135 raft_consensus.cc:493] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.045763  3135 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.050486  3135 raft_consensus.cc:515] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.051998  3135 leader_election.cc:290] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 3 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:20.053051  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:20.053169  2984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5987451194a84c6c915b70640266b555" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:20.054040  3061 raft_consensus.cc:3055] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:20.054193  2984 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.054641  3061 raft_consensus.cc:740] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:20.055513  3061 consensus_queue.cc:260] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.056753  3061 raft_consensus.cc:3060] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.061334  2984 raft_consensus.cc:2468] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 3.
I20260709 13:15:20.063050  3099 leader_election.cc:304] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:20.063153  3061 raft_consensus.cc:2468] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 3.
I20260709 13:15:20.064294  3330 raft_consensus.cc:2804] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:20.065817  3330 raft_consensus.cc:697] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Becoming Leader. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:20.066720  3330 consensus_queue.cc:237] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.073822  2880 catalog_manager.cc:5697] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 reported cstate change: term changed from 2 to 3, leader changed from 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194) to 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.125031  3333 raft_consensus.cc:993] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: : Instructing follower 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:20.125440  3334 raft_consensus.cc:1081] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Signalling peer 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:20.126997  2984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:15:20.127460  2984 raft_consensus.cc:493] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.127740  2984 raft_consensus.cc:3060] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.132277  2984 raft_consensus.cc:515] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.133937  2984 leader_election.cc:290] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 2 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:20.134749  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:20.135035  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b397188f9f94287a660b3f38e21f97b" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:20.135272  3061 raft_consensus.cc:3055] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.135509  3135 raft_consensus.cc:3060] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.135596  3061 raft_consensus.cc:740] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:20.136332  3061 consensus_queue.cc:260] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.137387  3061 raft_consensus.cc:3060] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.141762  3135 raft_consensus.cc:2468] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 2.
I20260709 13:15:20.143162  2952 leader_election.cc:304] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:20.143291  3061 raft_consensus.cc:2468] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 2.
I20260709 13:15:20.144930  3341 raft_consensus.cc:2804] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.145951  3341 raft_consensus.cc:697] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:20.146775  3341 consensus_queue.cc:237] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.154069  2880 catalog_manager.cc:5697] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 1 to 2, leader changed from 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194) to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 2 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.155885  3334 raft_consensus.cc:993] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: : Instructing follower 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:20.156379  3333 raft_consensus.cc:1081] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Signalling peer 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:20.158468  2984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:15:20.159024  2984 raft_consensus.cc:493] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.159409  2984 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.166620  2984 raft_consensus.cc:515] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.168272  2984 leader_election.cc:290] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 3 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:20.168884  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:20.169196  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f80a50e2fd1640889c63bbe13363f5b6" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:20.169404  3061 raft_consensus.cc:3055] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:20.169696  3135 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.169710  3061 raft_consensus.cc:740] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:20.170571  3061 consensus_queue.cc:260] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.171737  3061 raft_consensus.cc:3060] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:20.175794  3135 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 3.
I20260709 13:15:20.176895  2952 leader_election.cc:304] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:20.177377  3061 raft_consensus.cc:2468] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 3.
I20260709 13:15:20.177779  3341 raft_consensus.cc:2804] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:20.178272  3341 raft_consensus.cc:697] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 3 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:20.179001  3341 consensus_queue.cc:237] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.186403  2880 catalog_manager.cc:5697] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 2 to 3, leader changed from 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194) to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 3 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.316586  3334 raft_consensus.cc:993] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: : Instructing follower 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:20.317121  3333 raft_consensus.cc:1081] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 LEADER]: Signalling peer 11d623eeca434e989ebc6b1b3bb8e231 to start an election
I20260709 13:15:20.318778  3135 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1"
dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
 from {username='slave'} at 127.0.0.1:58104
I20260709 13:15:20.319316  3135 raft_consensus.cc:493] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.319643  3135 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.320580  3333 raft_consensus.cc:993] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: : Instructing follower 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:20.320986  3334 raft_consensus.cc:1081] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Signalling peer 4dec59b548f447a2becb166c8bde83de to start an election
I20260709 13:15:20.322844  2984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e"
dest_uuid: "4dec59b548f447a2becb166c8bde83de"
 from {username='slave'} at 127.0.0.1:54008
I20260709 13:15:20.323383  2984 raft_consensus.cc:493] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:20.323740  2984 raft_consensus.cc:3060] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.324074  3135 raft_consensus.cc:515] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.326237  3135 leader_election.cc:290] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 5 election: Requested vote from peers 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791), 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833)
I20260709 13:15:20.327105  3061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:20.327198  2985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "113e062ffc5d416ba5e7bfdf4b539ed1" candidate_uuid: "11d623eeca434e989ebc6b1b3bb8e231" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4dec59b548f447a2becb166c8bde83de"
I20260709 13:15:20.327836  2985 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.327807  3061 raft_consensus.cc:3055] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:15:20.328997  3061 raft_consensus.cc:740] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:20.329962  3061 consensus_queue.cc:260] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.330869  2984 raft_consensus.cc:515] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.331228  3061 raft_consensus.cc:3060] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:15:20.333200  2984 leader_election.cc:290] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 2 election: Requested vote from peers 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833), 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195:32787)
I20260709 13:15:20.334084  3060 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "13737e4959ab4cdbb9289ca1036cde02"
I20260709 13:15:20.334826  3060 raft_consensus.cc:3055] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:20.334169  3135 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54f2040741684ef3b8415fcc562ed48e" candidate_uuid: "4dec59b548f447a2becb166c8bde83de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "11d623eeca434e989ebc6b1b3bb8e231"
I20260709 13:15:20.335124  3060 raft_consensus.cc:740] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 13737e4959ab4cdbb9289ca1036cde02, State: Running, Role: LEADER
I20260709 13:15:20.335606  3135 raft_consensus.cc:3060] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.336122  2985 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 5.
I20260709 13:15:20.336385  3060 consensus_queue.cc:260] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.337245  3099 leader_election.cc:304] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11d623eeca434e989ebc6b1b3bb8e231, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:20.337682  3060 raft_consensus.cc:3060] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:20.338100  3330 raft_consensus.cc:2804] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:15:20.340879  3330 raft_consensus.cc:697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 5 LEADER]: Becoming Leader. State: Replica: 11d623eeca434e989ebc6b1b3bb8e231, State: Running, Role: LEADER
I20260709 13:15:20.341857  3330 consensus_queue.cc:237] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.345345  3135 raft_consensus.cc:2468] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 2.
I20260709 13:15:20.345451  3060 raft_consensus.cc:2468] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dec59b548f447a2becb166c8bde83de in term 2.
I20260709 13:15:20.346727  2952 leader_election.cc:304] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13737e4959ab4cdbb9289ca1036cde02, 4dec59b548f447a2becb166c8bde83de; no voters: 
I20260709 13:15:20.347568  3341 raft_consensus.cc:2804] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:20.338059  3061 raft_consensus.cc:2468] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11d623eeca434e989ebc6b1b3bb8e231 in term 5.
I20260709 13:15:20.348299  3341 raft_consensus.cc:697] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Becoming Leader. State: Replica: 4dec59b548f447a2becb166c8bde83de, State: Running, Role: LEADER
I20260709 13:15:20.349642  3341 consensus_queue.cc:237] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } }
I20260709 13:15:20.354015  2880 catalog_manager.cc:5697] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 reported cstate change: term changed from 4 to 5, leader changed from 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194) to 11d623eeca434e989ebc6b1b3bb8e231 (127.2.200.195). New cstate: current_term: 5 leader_uuid: "11d623eeca434e989ebc6b1b3bb8e231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:20.358578  2882 catalog_manager.cc:5697] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de reported cstate change: term changed from 1 to 2, leader changed from 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194) to 4dec59b548f447a2becb166c8bde83de (127.2.200.193). New cstate: current_term: 2 leader_uuid: "4dec59b548f447a2becb166c8bde83de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:20.599534  3135 raft_consensus.cc:1275] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.601047  3341 consensus_queue.cc:1048] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:20.612586  3061 raft_consensus.cc:1275] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.614300  3342 consensus_queue.cc:1048] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:20.661526  3059 raft_consensus.cc:1275] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.663185  3350 consensus_queue.cc:1048] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.672498  3135 raft_consensus.cc:1275] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.673877  3341 consensus_queue.cc:1048] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.681921  2985 raft_consensus.cc:1275] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.683506  3330 consensus_queue.cc:1048] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:20.693964  3059 raft_consensus.cc:1275] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:20.696506  3335 consensus_queue.cc:1048] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:20.862704  3059 raft_consensus.cc:1275] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.863758  3061 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 5 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:20.864698  3342 consensus_queue.cc:1048] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:20.865618  3335 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13737e4959ab4cdbb9289ca1036cde02" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:20.874800  3135 raft_consensus.cc:1275] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Refusing update from remote peer 4dec59b548f447a2becb166c8bde83de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:20.876689  3341 consensus_queue.cc:1048] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [LEADER]: Connected to new peer: Peer: permanent_uuid: "11d623eeca434e989ebc6b1b3bb8e231" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 32787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:20.880172  2985 raft_consensus.cc:1275] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 5 FOLLOWER]: Refusing update from remote peer 11d623eeca434e989ebc6b1b3bb8e231: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:15:20.885901  3330 consensus_queue.cc:1048] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dec59b548f447a2becb166c8bde83de" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 46791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:20.967564  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:20.972802  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
I20260709 13:15:21.003338  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:21.004379  2851 tablet_replica.cc:333] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.005395  2851 raft_consensus.cc:2243] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.006136  2851 raft_consensus.cc:2272] T a32f26f5556b4b12a7a8e32ead1ea456 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.009126  2851 tablet_replica.cc:333] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.009837  2851 raft_consensus.cc:2243] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.010852  2851 raft_consensus.cc:2272] T f80a50e2fd1640889c63bbe13363f5b6 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.013445  2851 tablet_replica.cc:333] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.013984  2851 raft_consensus.cc:2243] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.014446  2851 raft_consensus.cc:2272] T c02eeaf549bb4987ba2acf3ba3546928 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.016193  2851 tablet_replica.cc:333] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.016665  2851 raft_consensus.cc:2243] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.017424  2851 raft_consensus.cc:2272] T 8b397188f9f94287a660b3f38e21f97b P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.020315  2851 tablet_replica.cc:333] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.021059  2851 raft_consensus.cc:2243] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.021582  2851 raft_consensus.cc:2272] T 4b0a3042136f4a54a7db6456dc440ad8 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.023429  2851 tablet_replica.cc:333] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.023958  2851 raft_consensus.cc:2243] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.024379  2851 raft_consensus.cc:2272] T 2b88c53b0d5344f5b06dd897cab945f9 P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.026382  2851 tablet_replica.cc:333] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.026994  2851 raft_consensus.cc:2243] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.027745  2851 raft_consensus.cc:2272] T 54f2040741684ef3b8415fcc562ed48e P 4dec59b548f447a2becb166c8bde83de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.030004  2851 tablet_replica.cc:333] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.030480  2851 raft_consensus.cc:2243] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.030972  2851 raft_consensus.cc:2272] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 4dec59b548f447a2becb166c8bde83de [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.033242  2851 tablet_replica.cc:333] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de: stopping tablet replica
I20260709 13:15:21.033679  2851 raft_consensus.cc:2243] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.034073  2851 raft_consensus.cc:2272] T 5987451194a84c6c915b70640266b555 P 4dec59b548f447a2becb166c8bde83de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.138091  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:15:21.157706  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
W20260709 13:15:21.170424  3099 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.200.193:46791: connect: Connection refused (error 111)
W20260709 13:15:21.178520  3099 consensus_peers.cc:597] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 -> Peer 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791): Couldn't send request to peer 4dec59b548f447a2becb166c8bde83de. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:46791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.187800  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:21.188496  2851 tablet_replica.cc:333] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.189062  2851 raft_consensus.cc:2243] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.189832  2851 raft_consensus.cc:2272] T a32f26f5556b4b12a7a8e32ead1ea456 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.191461  2851 tablet_replica.cc:333] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.191927  2851 raft_consensus.cc:2243] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.192282  2851 raft_consensus.cc:2272] T 5987451194a84c6c915b70640266b555 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.194227  2851 tablet_replica.cc:333] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.194685  2851 raft_consensus.cc:2243] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.195060  2851 raft_consensus.cc:2272] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 13737e4959ab4cdbb9289ca1036cde02 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.197333  2851 tablet_replica.cc:333] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.197836  2851 raft_consensus.cc:2243] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.198556  2851 raft_consensus.cc:2272] T c02eeaf549bb4987ba2acf3ba3546928 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.200105  2851 tablet_replica.cc:333] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.200553  2851 raft_consensus.cc:2243] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.200942  2851 raft_consensus.cc:2272] T f80a50e2fd1640889c63bbe13363f5b6 P 13737e4959ab4cdbb9289ca1036cde02 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.203152  2851 tablet_replica.cc:333] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.204221  2851 raft_consensus.cc:2243] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.204826  2851 raft_consensus.cc:2272] T 8b397188f9f94287a660b3f38e21f97b P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.206979  2851 tablet_replica.cc:333] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.207492  2851 raft_consensus.cc:2243] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.207888  2851 raft_consensus.cc:2272] T 2b88c53b0d5344f5b06dd897cab945f9 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.209494  2851 tablet_replica.cc:333] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.209939  2851 raft_consensus.cc:2243] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.210629  2851 raft_consensus.cc:2272] T 4b0a3042136f4a54a7db6456dc440ad8 P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.212097  2851 tablet_replica.cc:333] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02: stopping tablet replica
I20260709 13:15:21.212527  2851 raft_consensus.cc:2243] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.212924  2851 raft_consensus.cc:2272] T 54f2040741684ef3b8415fcc562ed48e P 13737e4959ab4cdbb9289ca1036cde02 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.242367  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
W20260709 13:15:21.258544  3099 consensus_peers.cc:597] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 -> Peer 4dec59b548f447a2becb166c8bde83de (127.2.200.193:46791): Couldn't send request to peer 4dec59b548f447a2becb166c8bde83de. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:46791: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.263732  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
I20260709 13:15:21.286880  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:21.287539  2851 tablet_replica.cc:333] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.288084  2851 raft_consensus.cc:2243] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.288517  2851 raft_consensus.cc:2272] T 4b0a3042136f4a54a7db6456dc440ad8 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.290205  2851 tablet_replica.cc:333] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.290684  2851 raft_consensus.cc:2243] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.291395  2851 raft_consensus.cc:2272] T 2b88c53b0d5344f5b06dd897cab945f9 P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.293185  2851 tablet_replica.cc:333] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.293689  2851 raft_consensus.cc:2243] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.294096  2851 raft_consensus.cc:2272] T a32f26f5556b4b12a7a8e32ead1ea456 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.295997  2851 tablet_replica.cc:333] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.296609  2851 raft_consensus.cc:2243] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.297115  2851 raft_consensus.cc:2272] T 8b397188f9f94287a660b3f38e21f97b P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.299958  2851 tablet_replica.cc:333] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.300549  2851 raft_consensus.cc:2243] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.300966  2851 raft_consensus.cc:2272] T f80a50e2fd1640889c63bbe13363f5b6 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:21.302062  3101 consensus_peers.cc:597] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 -> Peer 13737e4959ab4cdbb9289ca1036cde02 (127.2.200.194:34833): Couldn't send request to peer 13737e4959ab4cdbb9289ca1036cde02. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:34833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:21.303210  2851 tablet_replica.cc:333] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.303705  2851 raft_consensus.cc:2243] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.304107  2851 raft_consensus.cc:2272] T c02eeaf549bb4987ba2acf3ba3546928 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.305667  2851 tablet_replica.cc:333] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.306110  2851 raft_consensus.cc:2243] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.306766  2851 raft_consensus.cc:2272] T 5987451194a84c6c915b70640266b555 P 11d623eeca434e989ebc6b1b3bb8e231 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.308471  2851 tablet_replica.cc:333] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.308944  2851 raft_consensus.cc:2243] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.309610  2851 raft_consensus.cc:2272] T 113e062ffc5d416ba5e7bfdf4b539ed1 P 11d623eeca434e989ebc6b1b3bb8e231 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.311326  2851 tablet_replica.cc:333] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231: stopping tablet replica
I20260709 13:15:21.311733  2851 raft_consensus.cc:2243] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:21.312098  2851 raft_consensus.cc:2272] T 54f2040741684ef3b8415fcc562ed48e P 11d623eeca434e989ebc6b1b3bb8e231 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.338737  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:15:21.359737  2851 master.cc:562] Master@127.2.200.254:36785 shutting down...
I20260709 13:15:21.482977  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:21.483692  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:21.484047  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P 823d7b8d84b14537878439c7f8d31e88: stopping tablet replica
I20260709 13:15:21.504061  2851 master.cc:584] Master@127.2.200.254:36785 shutdown complete.
11d623eeca434e989ebc6b1b3bb8e231  2
13737e4959ab4cdbb9289ca1036cde02  4
4dec59b548f447a2becb166c8bde83de  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12523 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:15:21.550987  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:36679
I20260709 13:15:21.552161  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:21.557562  3365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.558933  3366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.559599  3368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:21.559957  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:21.560925  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:21.561118  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:21.561267  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602921561250 us; error 0 us; skew 500 ppm
I20260709 13:15:21.561779  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:21.564639  2851 webserver.cc:533] Webserver started at http://127.2.200.254:35271/ using document root <none> and password file <none>
I20260709 13:15:21.565212  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:21.565389  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:21.565645  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:21.566730  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "0f7a1ec52a7943189517ee46ef2c71fb"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:21.571033  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:21.574373  3373 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.575112  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:21.575347  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "0f7a1ec52a7943189517ee46ef2c71fb"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:21.575584  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:21.595721  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:21.596959  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:21.638518  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:36679
I20260709 13:15:21.638775  3424 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:36679 every 8 connection(s)
I20260709 13:15:21.642732  3425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:21.653465  3425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb: Bootstrap starting.
I20260709 13:15:21.657968  3425 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:21.661967  3425 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb: No bootstrap required, opened a new log
I20260709 13:15:21.663993  3425 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" member_type: VOTER }
I20260709 13:15:21.664348  3425 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:21.664573  3425 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f7a1ec52a7943189517ee46ef2c71fb, State: Initialized, Role: FOLLOWER
I20260709 13:15:21.665186  3425 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" member_type: VOTER }
I20260709 13:15:21.665630  3425 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:21.665848  3425 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:21.666095  3425 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:21.670073  3425 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" member_type: VOTER }
I20260709 13:15:21.670571  3425 leader_election.cc:304] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f7a1ec52a7943189517ee46ef2c71fb; no voters: 
I20260709 13:15:21.671634  3425 leader_election.cc:290] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:21.672024  3428 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:21.673230  3428 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 1 LEADER]: Becoming Leader. State: Replica: 0f7a1ec52a7943189517ee46ef2c71fb, State: Running, Role: LEADER
I20260709 13:15:21.673884  3428 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" member_type: VOTER }
I20260709 13:15:21.674350  3425 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:21.677918  3429 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" member_type: VOTER } }
I20260709 13:15:21.678504  3429 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:21.678711  3430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f7a1ec52a7943189517ee46ef2c71fb. Latest consensus state: current_term: 1 leader_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f7a1ec52a7943189517ee46ef2c71fb" member_type: VOTER } }
I20260709 13:15:21.679198  3430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:21.681921  3434 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:21.689093  3434 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:21.690140  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:21.697111  3434 catalog_manager.cc:1383] Generated new cluster ID: 1c5d1cbcff2a478492b2fca16befc43a
I20260709 13:15:21.697413  3434 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:21.723385  3434 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:21.725632  3434 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:21.767364  3434 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb: Generated new TSK 0
I20260709 13:15:21.768024  3434 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:21.782517  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:21.788283  3446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.789279  3447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.790377  3449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:21.791920  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:21.793032  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:21.793340  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:21.793530  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602921793510 us; error 0 us; skew 500 ppm
I20260709 13:15:21.794070  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:21.796382  2851 webserver.cc:533] Webserver started at http://127.2.200.193:37061/ using document root <none> and password file <none>
I20260709 13:15:21.796883  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:21.797061  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:21.797333  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:21.798424  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "97df71c0d999454ab320455705be2e9c"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:21.803120  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:21.806298  3454 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.807017  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:15:21.807293  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "97df71c0d999454ab320455705be2e9c"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:21.807539  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:21.818646  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:21.820060  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:21.821806  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:21.824402  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:21.824666  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.824967  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:21.825150  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.873523  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:37113
I20260709 13:15:21.873648  3516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:37113 every 8 connection(s)
I20260709 13:15:21.878865  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:21.886075  3521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.887687  3522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:21.891000  2851 server_base.cc:1061] running on GCE node
W20260709 13:15:21.891682  3524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:21.892520  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:21.892729  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:21.892941  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602921892921 us; error 0 us; skew 500 ppm
I20260709 13:15:21.893419  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:21.895685  2851 webserver.cc:533] Webserver started at http://127.2.200.194:42157/ using document root <none> and password file <none>
I20260709 13:15:21.896147  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:21.896324  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:21.896624  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:21.898003  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "0cd76c7989de4097b678951e57963f97"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:21.900183  3517 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36679
I20260709 13:15:21.900552  3517 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:21.901262  3517 heartbeater.cc:507] Master 127.2.200.254:36679 requested a full tablet report, sending...
I20260709 13:15:21.902913  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 13:15:21.903309  3390 ts_manager.cc:194] Registered new tserver with Master: 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113)
I20260709 13:15:21.905169  3390 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54722
I20260709 13:15:21.907433  3529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.908509  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:15:21.909032  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "0cd76c7989de4097b678951e57963f97"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:21.909348  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:21.922482  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:21.923971  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:21.925673  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:21.928467  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:21.928689  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.928985  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:21.929131  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:21.975031  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:40189
I20260709 13:15:21.975302  3591 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:40189 every 8 connection(s)
I20260709 13:15:21.979579  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:21.987079  3595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.987449  3596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:21.990875  3598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:21.991448  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:21.991890  3592 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36679
I20260709 13:15:21.992239  3592 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:21.992353  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:21.992586  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:21.992738  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602921992720 us; error 0 us; skew 500 ppm
I20260709 13:15:21.992959  3592 heartbeater.cc:507] Master 127.2.200.254:36679 requested a full tablet report, sending...
I20260709 13:15:21.993340  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:21.994988  3390 ts_manager.cc:194] Registered new tserver with Master: 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:21.995841  2851 webserver.cc:533] Webserver started at http://127.2.200.195:40659/ using document root <none> and password file <none>
I20260709 13:15:21.996407  3390 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54736
I20260709 13:15:21.996426  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:21.996908  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:21.997231  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:21.998632  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "dc706bc58b604723836cb9ee0ee020ed"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:22.003319  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:22.006820  3603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.007665  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:22.007984  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "dc706bc58b604723836cb9ee0ee020ed"
format_stamp: "Formatted at 2026-07-09 13:15:21 on dist-test-slave-108k"
I20260709 13:15:22.008255  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:22.018841  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:22.020213  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:22.022219  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:22.025868  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:22.026109  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.026353  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:22.026507  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:22.072695  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:44225
I20260709 13:15:22.072839  3665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:44225 every 8 connection(s)
I20260709 13:15:22.088521  3666 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36679
I20260709 13:15:22.088908  3666 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:22.089746  3666 heartbeater.cc:507] Master 127.2.200.254:36679 requested a full tablet report, sending...
I20260709 13:15:22.091882  3390 ts_manager.cc:194] Registered new tserver with Master: dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.092712  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01636667s
I20260709 13:15:22.093214  3390 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54740
I20260709 13:15:22.119436  3390 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54748:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:22.122503  3390 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:22.205543  3555 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf06386369444cb88ca8c656dacb4cb (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:22.206707  3482 tablet_service.cc:1511] Processing CreateTablet for tablet 5513eae6b02c4a3ca430e97d17d1a2ac (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:22.207185  3555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf06386369444cb88ca8c656dacb4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.207907  3482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5513eae6b02c4a3ca430e97d17d1a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.209834  3554 tablet_service.cc:1511] Processing CreateTablet for tablet 87a297db0cd945b7a113160041262f10 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:22.211112  3554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a297db0cd945b7a113160041262f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.210958  3557 tablet_service.cc:1511] Processing CreateTablet for tablet 5513eae6b02c4a3ca430e97d17d1a2ac (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:22.212141  3557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5513eae6b02c4a3ca430e97d17d1a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.212373  3474 tablet_service.cc:1511] Processing CreateTablet for tablet 2fac776eb23a42c285a0ca23d1bcef7f (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:22.213138  3553 tablet_service.cc:1511] Processing CreateTablet for tablet b3b54dc6897d42b393a4abbc4f659f0a (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:22.213613  3474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fac776eb23a42c285a0ca23d1bcef7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.214864  3552 tablet_service.cc:1511] Processing CreateTablet for tablet 3da420265d5e4b399e988cc4bb63a7b6 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:22.216351  3552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da420265d5e4b399e988cc4bb63a7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.217907  3481 tablet_service.cc:1511] Processing CreateTablet for tablet 30d754e54912452fb04c9408fe323638 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:22.219168  3481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d754e54912452fb04c9408fe323638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.221921  3480 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf06386369444cb88ca8c656dacb4cb (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:22.223148  3480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf06386369444cb88ca8c656dacb4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.224886  3479 tablet_service.cc:1511] Processing CreateTablet for tablet 87a297db0cd945b7a113160041262f10 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:22.226565  3479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a297db0cd945b7a113160041262f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.229961  3478 tablet_service.cc:1511] Processing CreateTablet for tablet b3b54dc6897d42b393a4abbc4f659f0a (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:22.231315  3478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b54dc6897d42b393a4abbc4f659f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.233919  3477 tablet_service.cc:1511] Processing CreateTablet for tablet 3da420265d5e4b399e988cc4bb63a7b6 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:22.235213  3477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da420265d5e4b399e988cc4bb63a7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.237938  3476 tablet_service.cc:1511] Processing CreateTablet for tablet 9c822b28f1a744f9afaa81b676c0b4a0 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:22.239172  3476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c822b28f1a744f9afaa81b676c0b4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.242238  3475 tablet_service.cc:1511] Processing CreateTablet for tablet 87d9193802b943329d908b7b7748ad6e (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:22.243507  3475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d9193802b943329d908b7b7748ad6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.209834  3556 tablet_service.cc:1511] Processing CreateTablet for tablet 30d754e54912452fb04c9408fe323638 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:22.245434  3556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d754e54912452fb04c9408fe323638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.245723  3473 tablet_service.cc:1511] Processing CreateTablet for tablet e0cc7d5812d649bc9ff4609381f87e0b (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:22.249118  3473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cc7d5812d649bc9ff4609381f87e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.249541  3553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b54dc6897d42b393a4abbc4f659f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.259549  3551 tablet_service.cc:1511] Processing CreateTablet for tablet 2fac776eb23a42c285a0ca23d1bcef7f (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:22.261214  3550 tablet_service.cc:1511] Processing CreateTablet for tablet e0cc7d5812d649bc9ff4609381f87e0b (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:22.261927  3551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fac776eb23a42c285a0ca23d1bcef7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.265118  3550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cc7d5812d649bc9ff4609381f87e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.279076  3631 tablet_service.cc:1511] Processing CreateTablet for tablet 5513eae6b02c4a3ca430e97d17d1a2ac (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:15:22.279721  3555 tablet_service.cc:1511] Processing CreateTablet for tablet 87d9193802b943329d908b7b7748ad6e (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:22.280396  3631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5513eae6b02c4a3ca430e97d17d1a2ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.280923  3555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d9193802b943329d908b7b7748ad6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.282861  3557 tablet_service.cc:1511] Processing CreateTablet for tablet 9c822b28f1a744f9afaa81b676c0b4a0 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:22.283363  3629 tablet_service.cc:1511] Processing CreateTablet for tablet 2bf06386369444cb88ca8c656dacb4cb (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:15:22.286325  3628 tablet_service.cc:1511] Processing CreateTablet for tablet 87a297db0cd945b7a113160041262f10 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:15:22.288888  3627 tablet_service.cc:1511] Processing CreateTablet for tablet b3b54dc6897d42b393a4abbc4f659f0a (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:15:22.291236  3626 tablet_service.cc:1511] Processing CreateTablet for tablet 3da420265d5e4b399e988cc4bb63a7b6 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:15:22.293565  3625 tablet_service.cc:1511] Processing CreateTablet for tablet 9c822b28f1a744f9afaa81b676c0b4a0 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:15:22.295918  3624 tablet_service.cc:1511] Processing CreateTablet for tablet 87d9193802b943329d908b7b7748ad6e (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:15:22.298374  3623 tablet_service.cc:1511] Processing CreateTablet for tablet 2fac776eb23a42c285a0ca23d1bcef7f (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:15:22.281872  3630 tablet_service.cc:1511] Processing CreateTablet for tablet 30d754e54912452fb04c9408fe323638 (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:15:22.301291  3557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c822b28f1a744f9afaa81b676c0b4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.301327  3622 tablet_service.cc:1511] Processing CreateTablet for tablet e0cc7d5812d649bc9ff4609381f87e0b (DEFAULT_TABLE table=test-workload [id=66753eb9af674652a66688b7f95da220]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:15:22.302119  3629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bf06386369444cb88ca8c656dacb4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.303063  3630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d754e54912452fb04c9408fe323638. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.305117  3626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3da420265d5e4b399e988cc4bb63a7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.309101  3628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a297db0cd945b7a113160041262f10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.337214  3625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c822b28f1a744f9afaa81b676c0b4a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.341288  3624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87d9193802b943329d908b7b7748ad6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.341666  3682 tablet_bootstrap.cc:492] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.347697  3681 tablet_bootstrap.cc:492] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.349274  3622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cc7d5812d649bc9ff4609381f87e0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.350715  3623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fac776eb23a42c285a0ca23d1bcef7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.354476  3627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b54dc6897d42b393a4abbc4f659f0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:22.363183  3681 tablet_bootstrap.cc:654] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.394215  3682 tablet_bootstrap.cc:654] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.408727  3683 tablet_bootstrap.cc:492] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.412591  3681 tablet_bootstrap.cc:492] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.413177  3681 ts_tablet_manager.cc:1403] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.066s	user 0.004s	sys 0.015s
I20260709 13:15:22.415197  3683 tablet_bootstrap.cc:654] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.415944  3681 raft_consensus.cc:359] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.416584  3681 raft_consensus.cc:385] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.416850  3681 raft_consensus.cc:740] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.417668  3681 consensus_queue.cc:260] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.428001  3681 ts_tablet_manager.cc:1434] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:15:22.429121  3592 heartbeater.cc:499] Master 127.2.200.254:36679 was elected leader, sending a full tablet report...
I20260709 13:15:22.429517  3681 tablet_bootstrap.cc:492] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.429855  3683 tablet_bootstrap.cc:492] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.430320  3683 ts_tablet_manager.cc:1403] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:15:22.430279  3682 tablet_bootstrap.cc:492] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.430944  3682 ts_tablet_manager.cc:1403] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.090s	user 0.005s	sys 0.012s
I20260709 13:15:22.433195  3683 raft_consensus.cc:359] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.433892  3683 raft_consensus.cc:385] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.433632  3682 raft_consensus.cc:359] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.434203  3683 raft_consensus.cc:740] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.434368  3682 raft_consensus.cc:385] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.434712  3682 raft_consensus.cc:740] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.434962  3683 consensus_queue.cc:260] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.435360  3682 consensus_queue.cc:260] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.436344  3681 tablet_bootstrap.cc:654] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.443737  3681 tablet_bootstrap.cc:492] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.444260  3681 ts_tablet_manager.cc:1403] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.001s
I20260709 13:15:22.447312  3681 raft_consensus.cc:359] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.448109  3681 raft_consensus.cc:385] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.448400  3681 raft_consensus.cc:740] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.450517  3683 ts_tablet_manager.cc:1434] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 13:15:22.450764  3666 heartbeater.cc:499] Master 127.2.200.254:36679 was elected leader, sending a full tablet report...
I20260709 13:15:22.451265  3682 ts_tablet_manager.cc:1434] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.016s
I20260709 13:15:22.451470  3683 tablet_bootstrap.cc:492] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.454599  3517 heartbeater.cc:499] Master 127.2.200.254:36679 was elected leader, sending a full tablet report...
I20260709 13:15:22.456954  3683 tablet_bootstrap.cc:654] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.458989  3682 tablet_bootstrap.cc:492] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.464478  3683 tablet_bootstrap.cc:492] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.464999  3683 ts_tablet_manager.cc:1403] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:15:22.465670  3682 tablet_bootstrap.cc:654] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.467789  3683 raft_consensus.cc:359] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.468653  3683 raft_consensus.cc:385] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.468441  3681 consensus_queue.cc:260] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.468999  3683 raft_consensus.cc:740] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.469892  3683 consensus_queue.cc:260] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.470508  3681 ts_tablet_manager.cc:1434] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:15:22.470906  3682 tablet_bootstrap.cc:492] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.471390  3682 ts_tablet_manager.cc:1403] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:15:22.471417  3681 tablet_bootstrap.cc:492] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.471891  3683 ts_tablet_manager.cc:1434] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:22.474099  3683 tablet_bootstrap.cc:492] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.474483  3682 raft_consensus.cc:359] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.475186  3682 raft_consensus.cc:385] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.475508  3682 raft_consensus.cc:740] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.476289  3682 consensus_queue.cc:260] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.478451  3682 ts_tablet_manager.cc:1434] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:22.480319  3682 tablet_bootstrap.cc:492] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.480700  3683 tablet_bootstrap.cc:654] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.486785  3682 tablet_bootstrap.cc:654] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.495157  3681 tablet_bootstrap.cc:654] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.498171  3683 tablet_bootstrap.cc:492] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.498674  3683 ts_tablet_manager.cc:1403] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:15:22.499055  3682 tablet_bootstrap.cc:492] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.499475  3682 ts_tablet_manager.cc:1403] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:15:22.500629  3681 tablet_bootstrap.cc:492] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.501089  3681 ts_tablet_manager.cc:1403] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.002s
I20260709 13:15:22.501353  3683 raft_consensus.cc:359] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.501875  3683 raft_consensus.cc:385] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.502099  3683 raft_consensus.cc:740] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.502674  3683 consensus_queue.cc:260] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.502585  3682 raft_consensus.cc:359] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.503463  3682 raft_consensus.cc:385] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.503750  3682 raft_consensus.cc:740] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.504125  3681 raft_consensus.cc:359] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.504721  3683 ts_tablet_manager.cc:1434] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 13:15:22.504915  3681 raft_consensus.cc:385] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.504561  3682 consensus_queue.cc:260] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.505378  3681 raft_consensus.cc:740] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.505728  3683 tablet_bootstrap.cc:492] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.507133  3682 ts_tablet_manager.cc:1434] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:22.510747  3682 tablet_bootstrap.cc:492] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.517169  3682 tablet_bootstrap.cc:654] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.509481  3681 consensus_queue.cc:260] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.519479  3681 ts_tablet_manager.cc:1434] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:15:22.517169  3683 tablet_bootstrap.cc:654] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.520334  3681 tablet_bootstrap.cc:492] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.522586  3682 tablet_bootstrap.cc:492] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.523110  3682 ts_tablet_manager.cc:1403] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 13:15:22.526392  3682 raft_consensus.cc:359] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.527472  3681 tablet_bootstrap.cc:654] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.527426  3682 raft_consensus.cc:385] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.527912  3682 raft_consensus.cc:740] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.528810  3682 consensus_queue.cc:260] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.531154  3682 ts_tablet_manager.cc:1434] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:15:22.532150  3682 tablet_bootstrap.cc:492] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.538353  3682 tablet_bootstrap.cc:654] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.545297  3689 raft_consensus.cc:493] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.545841  3689 raft_consensus.cc:515] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.548465  3683 tablet_bootstrap.cc:492] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.552942  3689 leader_election.cc:290] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.555260  3687 raft_consensus.cc:493] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.555863  3687 raft_consensus.cc:515] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.563868  3683 ts_tablet_manager.cc:1403] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.058s	user 0.022s	sys 0.010s
I20260709 13:15:22.565743  3682 tablet_bootstrap.cc:492] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.566370  3682 ts_tablet_manager.cc:1403] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.003s
I20260709 13:15:22.569327  3683 raft_consensus.cc:359] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.572537  3683 raft_consensus.cc:385] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.571177  3687 leader_election.cc:290] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.573503  3683 raft_consensus.cc:740] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.569887  3682 raft_consensus.cc:359] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.574697  3682 raft_consensus.cc:385] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.575016  3682 raft_consensus.cc:740] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.575574  3689 raft_consensus.cc:493] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.575150  3683 consensus_queue.cc:260] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.576047  3689 raft_consensus.cc:515] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.575752  3682 consensus_queue.cc:260] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.576324  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:22.578475  3689 leader_election.cc:290] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.579025  3689 raft_consensus.cc:493] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.579445  3689 raft_consensus.cc:515] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.581797  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:22.582778  3689 leader_election.cc:290] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
W20260709 13:15:22.583575  3458 leader_election.cc:343] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:22.584233  3458 leader_election.cc:343] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.585436  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
W20260709 13:15:22.586721  3458 leader_election.cc:343] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.594035  3682 ts_tablet_manager.cc:1434] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 13:15:22.595072  3682 tablet_bootstrap.cc:492] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.595494  3681 tablet_bootstrap.cc:492] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.595929  3681 ts_tablet_manager.cc:1403] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.007s
I20260709 13:15:22.598409  3683 ts_tablet_manager.cc:1434] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:15:22.599414  3683 tablet_bootstrap.cc:492] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.605293  3683 tablet_bootstrap.cc:654] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.619837  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.620589  3641 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
I20260709 13:15:22.620843  3682 tablet_bootstrap.cc:654] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.622846  3683 tablet_bootstrap.cc:492] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.623322  3683 ts_tablet_manager.cc:1403] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.002s
I20260709 13:15:22.616312  3681 raft_consensus.cc:359] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.624821  3681 raft_consensus.cc:385] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.624747  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a297db0cd945b7a113160041262f10" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:22.625265  3681 raft_consensus.cc:740] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.625499  3492 raft_consensus.cc:2468] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 0.
I20260709 13:15:22.626135  3681 consensus_queue.cc:260] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.626487  3533 leader_election.cc:304] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:22.626876  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.627583  3687 raft_consensus.cc:2804] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.627672  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.628086  3687 raft_consensus.cc:493] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.628441  3687 raft_consensus.cc:3060] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.629209  3456 leader_election.cc:304] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:22.629876  3682 tablet_bootstrap.cc:492] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.630146  3705 raft_consensus.cc:2804] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.630399  3682 ts_tablet_manager.cc:1403] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.002s
I20260709 13:15:22.630517  3705 raft_consensus.cc:493] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.631259  3705 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.631891  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a297db0cd945b7a113160041262f10" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.632688  3640 raft_consensus.cc:2468] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 0.
W20260709 13:15:22.631466  3456 leader_election.cc:343] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.634624  3456 leader_election.cc:304] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 97df71c0d999454ab320455705be2e9c; no voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:22.635457  3706 raft_consensus.cc:2749] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.626150  3683 raft_consensus.cc:359] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.636407  3683 raft_consensus.cc:385] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.636739  3683 raft_consensus.cc:740] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.636484  3682 raft_consensus.cc:359] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.637470  3682 raft_consensus.cc:385] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.637816  3682 raft_consensus.cc:740] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.637603  3683 consensus_queue.cc:260] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.638504  3641 raft_consensus.cc:2468] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
I20260709 13:15:22.638711  3682 consensus_queue.cc:260] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.635701  3687 raft_consensus.cc:515] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.639374  3705 raft_consensus.cc:515] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.641438  3705 leader_election.cc:290] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.642094  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a297db0cd945b7a113160041262f10" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:22.642163  3456 leader_election.cc:304] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:22.642732  3492 raft_consensus.cc:3060] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.643718  3682 ts_tablet_manager.cc:1434] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:22.643790  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:22.644402  3641 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.644973  3682 tablet_bootstrap.cc:492] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.645514  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:22.646073  3567 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.651914  3682 tablet_bootstrap.cc:654] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.654243  3683 ts_tablet_manager.cc:1434] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:15:22.655258  3683 tablet_bootstrap.cc:492] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.655797  3705 raft_consensus.cc:2804] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.656210  3705 raft_consensus.cc:493] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.656549  3705 raft_consensus.cc:3060] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.661247  3683 tablet_bootstrap.cc:654] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.661931  3567 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:22.663100  3458 leader_election.cc:304] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:22.663975  3706 raft_consensus.cc:2804] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.664477  3706 raft_consensus.cc:697] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:22.665304  3706 consensus_queue.cc:237] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.652534  3641 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:22.669651  3689 raft_consensus.cc:493] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.670127  3689 raft_consensus.cc:515] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.672437  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a297db0cd945b7a113160041262f10" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:22.672683  3689 leader_election.cc:290] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.673734  3641 raft_consensus.cc:3060] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.673780  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.674062  3492 raft_consensus.cc:2468] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 1.
I20260709 13:15:22.674437  3640 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
I20260709 13:15:22.674722  3705 raft_consensus.cc:515] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.675999  3456 leader_election.cc:304] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:22.676864  3689 raft_consensus.cc:2804] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.677217  3689 raft_consensus.cc:493] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.677515  3689 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.681102  3533 leader_election.cc:304] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:22.682685  3641 raft_consensus.cc:2468] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 1.
W20260709 13:15:22.685238  3438 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:22.684113  3689 raft_consensus.cc:515] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.686889  3390 catalog_manager.cc:5697] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 1 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.688606  3566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:22.689743  3566 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.690807  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:22.691361  3641 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.671804  3687 leader_election.cc:290] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.683561  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:22.707095  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:22.709059  3687 raft_consensus.cc:2804] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.709719  3687 raft_consensus.cc:697] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:22.710680  3687 consensus_queue.cc:237] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.713296  3705 leader_election.cc:290] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
W20260709 13:15:22.713428  3458 leader_election.cc:343] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.701167  3566 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:22.701443  3641 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:22.722338  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:22.723090  3640 raft_consensus.cc:3060] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.724364  3681 ts_tablet_manager.cc:1434] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.128s	user 0.010s	sys 0.013s
I20260709 13:15:22.725649  3681 tablet_bootstrap.cc:492] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.716122  3458 leader_election.cc:304] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:22.730300  3705 raft_consensus.cc:2804] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.730782  3705 raft_consensus.cc:697] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:22.699522  3689 leader_election.cc:290] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.732708  3713 raft_consensus.cc:493] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.733597  3713 raft_consensus.cc:515] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.733865  3705 consensus_queue.cc:237] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:22.734787  3640 raft_consensus.cc:2468] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:22.735725  3713 leader_election.cc:290] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.736069  3456 leader_election.cc:304] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:22.737504  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.738555  3689 raft_consensus.cc:2804] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.738701  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
W20260709 13:15:22.739023  3531 leader_election.cc:343] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.739058  3689 raft_consensus.cc:697] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
W20260709 13:15:22.740903  3533 leader_election.cc:343] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.741396  3533 leader_election.cc:304] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd76c7989de4097b678951e57963f97; no voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:22.740202  3689 consensus_queue.cc:237] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
W20260709 13:15:22.743556  3421 debug-util.cc:398] Leaking SignalData structure 0x7b080004d560 after lost signal to thread 2854
I20260709 13:15:22.743260  3709 raft_consensus.cc:2749] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.741254  3682 tablet_bootstrap.cc:492] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.747859  3682 ts_tablet_manager.cc:1403] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.103s	user 0.034s	sys 0.026s
I20260709 13:15:22.747363  3681 tablet_bootstrap.cc:654] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.751145  3682 raft_consensus.cc:359] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.746106  3683 tablet_bootstrap.cc:492] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.753194  3682 raft_consensus.cc:385] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.754106  3683 ts_tablet_manager.cc:1403] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.028s
I20260709 13:15:22.758781  3683 raft_consensus.cc:359] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.759578  3683 raft_consensus.cc:385] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.759886  3683 raft_consensus.cc:740] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.761144  3682 raft_consensus.cc:740] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.760684  3683 consensus_queue.cc:260] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.762283  3682 consensus_queue.cc:260] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.764950  3683 ts_tablet_manager.cc:1434] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:22.765954  3683 tablet_bootstrap.cc:492] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.767994  3682 ts_tablet_manager.cc:1434] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:15:22.769016  3682 tablet_bootstrap.cc:492] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.773447  3683 tablet_bootstrap.cc:654] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.776355  3682 tablet_bootstrap.cc:654] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.789525  3388 catalog_manager.cc:5697] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.792557  3390 catalog_manager.cc:5697] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 1 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:22.796820  3390 catalog_manager.cc:5697] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 1 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:22.800335  3682 tablet_bootstrap.cc:492] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.803457  3682 ts_tablet_manager.cc:1403] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.008s
I20260709 13:15:22.806097  3682 raft_consensus.cc:359] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.806818  3682 raft_consensus.cc:385] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.807145  3682 raft_consensus.cc:740] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.807796  3682 consensus_queue.cc:260] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.811197  3682 ts_tablet_manager.cc:1434] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:22.812081  3682 tablet_bootstrap.cc:492] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.817394  3682 tablet_bootstrap.cc:654] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.819411  3681 tablet_bootstrap.cc:492] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.820175  3681 ts_tablet_manager.cc:1403] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.024s
I20260709 13:15:22.822547  3683 tablet_bootstrap.cc:492] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.822824  3681 raft_consensus.cc:359] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.822999  3683 ts_tablet_manager.cc:1403] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.030s
I20260709 13:15:22.823530  3681 raft_consensus.cc:385] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.823832  3681 raft_consensus.cc:740] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.824721  3681 consensus_queue.cc:260] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.829219  3683 raft_consensus.cc:359] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.829945  3683 raft_consensus.cc:385] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.830219  3683 raft_consensus.cc:740] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.831055  3683 consensus_queue.cc:260] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.832983  3683 ts_tablet_manager.cc:1434] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:15:22.833923  3683 tablet_bootstrap.cc:492] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.834375  3681 ts_tablet_manager.cc:1434] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 13:15:22.840003  3683 tablet_bootstrap.cc:654] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.843155  3682 tablet_bootstrap.cc:492] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.843811  3682 ts_tablet_manager.cc:1403] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.006s
I20260709 13:15:22.846465  3682 raft_consensus.cc:359] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.847124  3682 raft_consensus.cc:385] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.847376  3682 raft_consensus.cc:740] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.848141  3682 consensus_queue.cc:260] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.855273  3688 raft_consensus.cc:493] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.855800  3688 raft_consensus.cc:515] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.857002  3682 ts_tablet_manager.cc:1434] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:15:22.857970  3683 tablet_bootstrap.cc:492] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.858291  3688 leader_election.cc:290] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:22.858402  3683 ts_tablet_manager.cc:1403] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.013s
I20260709 13:15:22.861063  3683 raft_consensus.cc:359] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.861765  3683 raft_consensus.cc:385] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.862039  3683 raft_consensus.cc:740] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.862709  3683 consensus_queue.cc:260] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.864496  3682 tablet_bootstrap.cc:492] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c: Bootstrap starting.
I20260709 13:15:22.864624  3683 ts_tablet_manager.cc:1434] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:15:22.865528  3683 tablet_bootstrap.cc:492] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.870352  3682 tablet_bootstrap.cc:654] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.870754  3683 tablet_bootstrap.cc:654] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.882118  3681 tablet_bootstrap.cc:492] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.882807  3683 tablet_bootstrap.cc:492] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.883251  3689 raft_consensus.cc:493] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.883405  3683 ts_tablet_manager.cc:1403] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:15:22.883782  3689 raft_consensus.cc:515] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.885921  3689 leader_election.cc:290] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.886708  3566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:22.886647  3683 raft_consensus.cc:359] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.887436  3683 raft_consensus.cc:385] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.887359  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.888073  3640 raft_consensus.cc:2468] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
W20260709 13:15:22.888228  3458 leader_election.cc:343] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.888860  3683 raft_consensus.cc:740] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.889305  3456 leader_election.cc:304] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:22.889751  3683 consensus_queue.cc:260] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.890405  3689 raft_consensus.cc:2804] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.890875  3689 raft_consensus.cc:493] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.891252  3689 raft_consensus.cc:3060] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.892045  3683 ts_tablet_manager.cc:1434] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:15:22.892943  3683 tablet_bootstrap.cc:492] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: Bootstrap starting.
I20260709 13:15:22.898432  3683 tablet_bootstrap.cc:654] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.900028  3682 tablet_bootstrap.cc:492] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c: No bootstrap required, opened a new log
I20260709 13:15:22.900523  3682 ts_tablet_manager.cc:1403] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.003s
I20260709 13:15:22.903107  3682 raft_consensus.cc:359] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.904006  3682 raft_consensus.cc:385] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.904321  3682 raft_consensus.cc:740] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.898201  3689 raft_consensus.cc:515] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.907339  3566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
W20260709 13:15:22.909317  3458 leader_election.cc:343] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.909246  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:22.910344  3640 raft_consensus.cc:3060] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.913558  3689 leader_election.cc:290] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.916368  3682 consensus_queue.cc:260] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.925197  3688 raft_consensus.cc:493] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.925714  3688 raft_consensus.cc:515] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.927732  3682 ts_tablet_manager.cc:1434] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:15:22.928824  3688 leader_election.cc:290] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:22.934329  3687 raft_consensus.cc:493] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:22.934841  3687 raft_consensus.cc:515] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.936861  3687 leader_election.cc:290] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:22.939301  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:22.939431  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:22.940153  3641 raft_consensus.cc:2393] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd76c7989de4097b678951e57963f97 in current term 1: Already voted for candidate 97df71c0d999454ab320455705be2e9c in this term.
I20260709 13:15:22.941432  3531 leader_election.cc:304] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd76c7989de4097b678951e57963f97; no voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:22.942509  3687 raft_consensus.cc:3060] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.934362  3681 tablet_bootstrap.cc:654] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.948848  3566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:22.950377  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:22.951138  3687 raft_consensus.cc:2749] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:22.951937  3607 leader_election.cc:343] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:22.952418  3607 leader_election.cc:343] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:22.955178  3681 tablet_bootstrap.cc:492] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.955668  3681 ts_tablet_manager.cc:1403] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.074s	user 0.006s	sys 0.005s
I20260709 13:15:22.956620  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:22.957080  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:22.957397  3492 raft_consensus.cc:2393] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dc706bc58b604723836cb9ee0ee020ed in current term 1: Already voted for candidate 97df71c0d999454ab320455705be2e9c in this term.
I20260709 13:15:22.957693  3491 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 0.
I20260709 13:15:22.958434  3681 raft_consensus.cc:359] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.958727  3607 leader_election.cc:304] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c
I20260709 13:15:22.959131  3681 raft_consensus.cc:385] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.959465  3681 raft_consensus.cc:740] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.959810  3607 leader_election.cc:304] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:22.952302  3640 raft_consensus.cc:2468] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:22.960160  3681 consensus_queue.cc:260] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.960976  3688 raft_consensus.cc:2749] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:22.961572  3731 raft_consensus.cc:2804] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:22.961992  3731 raft_consensus.cc:493] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:22.962349  3681 ts_tablet_manager.cc:1434] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:15:22.962383  3731 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:22.963478  3681 tablet_bootstrap.cc:492] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:22.963768  3456 leader_election.cc:304] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:22.964509  3689 raft_consensus.cc:2804] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:22.964965  3689 raft_consensus.cc:697] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:22.965579  3683 tablet_bootstrap.cc:492] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: No bootstrap required, opened a new log
I20260709 13:15:22.965992  3683 ts_tablet_manager.cc:1403] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.029s
I20260709 13:15:22.965715  3689 consensus_queue.cc:237] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.968393  3683 raft_consensus.cc:359] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.969040  3683 raft_consensus.cc:385] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.969280  3683 raft_consensus.cc:740] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.970314  3683 consensus_queue.cc:260] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.972573  3683 ts_tablet_manager.cc:1434] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:22.978596  3681 tablet_bootstrap.cc:654] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.990051  3681 tablet_bootstrap.cc:492] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:22.990576  3681 ts_tablet_manager.cc:1403] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.011s
I20260709 13:15:22.993487  3681 raft_consensus.cc:359] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.994237  3681 raft_consensus.cc:385] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:22.994561  3681 raft_consensus.cc:740] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:22.995291  3681 consensus_queue.cc:260] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:22.997704  3681 ts_tablet_manager.cc:1434] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:15:22.998694  3681 tablet_bootstrap.cc:492] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:23.005489  3681 tablet_bootstrap.cc:654] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:22.999188  3731 raft_consensus.cc:515] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.014829  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.015164  3705 raft_consensus.cc:493] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.015443  3491 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.015630  3705 raft_consensus.cc:515] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.017756  3705 leader_election.cc:290] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.020113  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:23.020179  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.021032  3640 raft_consensus.cc:2468] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
W20260709 13:15:23.021602  3458 leader_election.cc:343] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.022650  3456 leader_election.cc:304] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:23.023623  3705 raft_consensus.cc:2804] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.022640  3491 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 1.
I20260709 13:15:23.024036  3731 leader_election.cc:290] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:23.024731  3705 raft_consensus.cc:493] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.025344  3705 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.028355  3607 leader_election.cc:304] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.024242  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:23.029194  3731 raft_consensus.cc:2804] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:23.030386  3607 leader_election.cc:343] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.030786  3731 raft_consensus.cc:697] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Becoming Leader. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:23.031634  3731 consensus_queue.cc:237] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.031275  3387 catalog_manager.cc:5697] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 1 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.036535  3681 tablet_bootstrap.cc:492] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:23.036996  3681 ts_tablet_manager.cc:1403] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.038s	user 0.027s	sys 0.000s
I20260709 13:15:23.039451  3681 raft_consensus.cc:359] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.040052  3681 raft_consensus.cc:385] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.040283  3681 raft_consensus.cc:740] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.040903  3681 consensus_queue.cc:260] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.042663  3681 ts_tablet_manager.cc:1434] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:23.043594  3681 tablet_bootstrap.cc:492] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:23.049062  3681 tablet_bootstrap.cc:654] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.051386  3388 catalog_manager.cc:5697] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed reported cstate change: term changed from 0 to 1, leader changed from <none> to dc706bc58b604723836cb9ee0ee020ed (127.2.200.195). New cstate: current_term: 1 leader_uuid: "dc706bc58b604723836cb9ee0ee020ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.047793  3705 raft_consensus.cc:515] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.055002  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
W20260709 13:15:23.056378  3458 leader_election.cc:343] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:23.058494  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.059010  3640 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.063330  3705 leader_election.cc:290] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.065320  3640 raft_consensus.cc:2468] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:23.065681  3681 tablet_bootstrap.cc:492] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:23.066283  3456 leader_election.cc:304] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 0cd76c7989de4097b678951e57963f97
I20260709 13:15:23.066347  3681 ts_tablet_manager.cc:1403] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 13:15:23.066955  3705 raft_consensus.cc:2804] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.067409  3705 raft_consensus.cc:697] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.068507  3687 raft_consensus.cc:493] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.068185  3705 consensus_queue.cc:237] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.068970  3687 raft_consensus.cc:515] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.069087  3681 raft_consensus.cc:359] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.069768  3681 raft_consensus.cc:385] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.070017  3681 raft_consensus.cc:740] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.070891  3687 leader_election.cc:290] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.070626  3681 consensus_queue.cc:260] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.072911  3681 ts_tablet_manager.cc:1434] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:15:23.073767  3681 tablet_bootstrap.cc:492] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: Bootstrap starting.
I20260709 13:15:23.075882  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:23.076594  3491 raft_consensus.cc:2468] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 0.
I20260709 13:15:23.079319  3681 tablet_bootstrap.cc:654] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:23.079366  3533 leader_election.cc:304] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:23.080570  3709 raft_consensus.cc:2804] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.080948  3709 raft_consensus.cc:493] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.081250  3709 raft_consensus.cc:3060] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.090610  3681 tablet_bootstrap.cc:492] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: No bootstrap required, opened a new log
I20260709 13:15:23.091064  3681 ts_tablet_manager.cc:1403] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:15:23.093152  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.088665  3709 raft_consensus.cc:515] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.094583  3640 raft_consensus.cc:2468] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 0.
I20260709 13:15:23.093582  3681 raft_consensus.cc:359] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.095422  3681 raft_consensus.cc:385] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:23.095681  3681 raft_consensus.cc:740] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Initialized, Role: FOLLOWER
I20260709 13:15:23.096369  3681 consensus_queue.cc:260] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.098441  3681 ts_tablet_manager.cc:1434] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:23.102010  3709 leader_election.cc:290] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.104806  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.104820  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.105486  3640 raft_consensus.cc:3060] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.105629  3491 raft_consensus.cc:3060] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.104663  3387 catalog_manager.cc:5697] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 1 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.112833  3640 raft_consensus.cc:2468] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 1.
I20260709 13:15:23.113984  3531 leader_election.cc:304] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.114064  3491 raft_consensus.cc:2468] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 1.
I20260709 13:15:23.115072  3709 raft_consensus.cc:2804] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.115532  3709 raft_consensus.cc:697] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.116328  3709 consensus_queue.cc:237] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.127024  3387 catalog_manager.cc:5697] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.130507  3705 raft_consensus.cc:493] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.131029  3705 raft_consensus.cc:515] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.133152  3705 leader_election.cc:290] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.135221  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.135870  3640 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
I20260709 13:15:23.136264  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:23.136875  3565 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 0.
I20260709 13:15:23.137171  3456 leader_election.cc:304] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.137998  3705 raft_consensus.cc:2804] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.138372  3705 raft_consensus.cc:493] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.138715  3705 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.143540  3705 raft_consensus.cc:515] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.145582  3705 leader_election.cc:290] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.145951  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:23.146204  3640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.146548  3565 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.146695  3640 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.152462  3689 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.153270  3565 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:23.153376  3640 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 1.
I20260709 13:15:23.154510  3458 leader_election.cc:304] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:23.155296  3689 raft_consensus.cc:2804] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.155738  3689 raft_consensus.cc:697] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.156572  3689 consensus_queue.cc:237] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.160964  3709 consensus_queue.cc:1048] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.161342  3706 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.186838  3388 catalog_manager.cc:5697] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 1 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.200273  3709 raft_consensus.cc:493] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.201377  3709 raft_consensus.cc:515] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.203470  3709 leader_election.cc:290] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.204123  3709 raft_consensus.cc:493] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.204597  3709 raft_consensus.cc:515] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.205681  3731 raft_consensus.cc:493] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.206116  3731 raft_consensus.cc:515] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.206408  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.206992  3641 raft_consensus.cc:2468] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 0.
I20260709 13:15:23.207998  3731 leader_election.cc:290] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:23.208141  3531 leader_election.cc:304] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.208914  3687 consensus_queue.cc:1048] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.210072  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:23.210683  3492 raft_consensus.cc:2468] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 0.
I20260709 13:15:23.212206  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97" is_pre_election: true
I20260709 13:15:23.213450  3607 leader_election.cc:304] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.214468  3688 raft_consensus.cc:2804] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.214792  3688 raft_consensus.cc:493] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.215102  3688 raft_consensus.cc:3060] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.218071  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:23.218648  3492 raft_consensus.cc:2468] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 0.
I20260709 13:15:23.218832  3706 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.210232  3687 raft_consensus.cc:2804] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:23.221241  3565 raft_consensus.cc:2468] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 0.
I20260709 13:15:23.222573  3687 raft_consensus.cc:493] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:23.222985  3687 raft_consensus.cc:3060] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.234310  3688 raft_consensus.cc:515] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.241441  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:23.244190  3709 leader_election.cc:290] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.245352  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.247798  3639 raft_consensus.cc:2393] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd76c7989de4097b678951e57963f97 in current term 1: Already voted for candidate 97df71c0d999454ab320455705be2e9c in this term.
I20260709 13:15:23.248409  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.248677  3531 leader_election.cc:304] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd76c7989de4097b678951e57963f97; no voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:23.249024  3492 raft_consensus.cc:3060] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.249895  3709 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.256421  3709 raft_consensus.cc:2749] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.267710  3709 raft_consensus.cc:493] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.268262  3709 raft_consensus.cc:515] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.270545  3709 leader_election.cc:290] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.272590  3490 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:23.273494  3490 raft_consensus.cc:2393] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd76c7989de4097b678951e57963f97 in current term 1: Already voted for candidate dc706bc58b604723836cb9ee0ee020ed in this term.
I20260709 13:15:23.275082  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.276295  3689 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.277381  3533 leader_election.cc:304] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd76c7989de4097b678951e57963f97; no voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:23.278786  3747 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.284701  3565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:23.264207  3492 raft_consensus.cc:2468] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 1.
I20260709 13:15:23.281437  3688 leader_election.cc:290] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:23.279641  3687 raft_consensus.cc:515] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.292332  3747 raft_consensus.cc:2749] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.292673  3565 raft_consensus.cc:2393] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate dc706bc58b604723836cb9ee0ee020ed in current term 1: Already voted for candidate 0cd76c7989de4097b678951e57963f97 in this term.
I20260709 13:15:23.295495  3607 leader_election.cc:304] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.295953  3687 leader_election.cc:290] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.298367  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.299597  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0cc7d5812d649bc9ff4609381f87e0b" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.300308  3491 raft_consensus.cc:2393] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cd76c7989de4097b678951e57963f97 in current term 1: Already voted for candidate dc706bc58b604723836cb9ee0ee020ed in this term.
I20260709 13:15:23.298529  3688 raft_consensus.cc:2804] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:23.300835  3688 raft_consensus.cc:697] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Becoming Leader. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:23.301862  3688 consensus_queue.cc:237] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.316900  3531 leader_election.cc:304] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd76c7989de4097b678951e57963f97; no voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:23.318540  3747 raft_consensus.cc:2749] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.322492  3752 consensus_queue.cc:1048] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:15:23.321228  3387 catalog_manager.cc:5697] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed reported cstate change: term changed from 0 to 1, leader changed from <none> to dc706bc58b604723836cb9ee0ee020ed (127.2.200.195). New cstate: current_term: 1 leader_uuid: "dc706bc58b604723836cb9ee0ee020ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:23.326824  3689 consensus_queue.cc:1048] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.332549  3747 raft_consensus.cc:493] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:23.333155  3747 raft_consensus.cc:515] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.337262  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97df71c0d999454ab320455705be2e9c" is_pre_election: true
I20260709 13:15:23.337818  3641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d754e54912452fb04c9408fe323638" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dc706bc58b604723836cb9ee0ee020ed" is_pre_election: true
I20260709 13:15:23.338714  3641 raft_consensus.cc:2393] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd76c7989de4097b678951e57963f97 in current term 1: Already voted for candidate 97df71c0d999454ab320455705be2e9c in this term.
I20260709 13:15:23.339833  3531 leader_election.cc:304] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd76c7989de4097b678951e57963f97; no voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:23.340641  3687 raft_consensus.cc:3060] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:23.347939  3687 raft_consensus.cc:2749] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:23.348836  3747 leader_election.cc:290] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.403519  3566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87a297db0cd945b7a113160041262f10"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:56392
I20260709 13:15:23.404138  3566 raft_consensus.cc:606] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:23.409003  3566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:56392
I20260709 13:15:23.409667  3566 raft_consensus.cc:606] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:23.423563  3491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:36330
I20260709 13:15:23.424054  3491 raft_consensus.cc:606] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Received request to transfer leadership to TS 0cd76c7989de4097b678951e57963f97
I20260709 13:15:23.439355  3639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
mode: GRACEFUL
new_leader_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:15:23.439849  3639 raft_consensus.cc:606] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Received request to transfer leadership to TS 0cd76c7989de4097b678951e57963f97
I20260709 13:15:23.444725  3491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:36330
I20260709 13:15:23.445230  3491 raft_consensus.cc:606] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Received request to transfer leadership to TS 0cd76c7989de4097b678951e57963f97
I20260709 13:15:23.450505  3752 consensus_queue.cc:1048] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.451324  3491 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:36330
I20260709 13:15:23.451934  3491 raft_consensus.cc:606] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Received request to transfer leadership to TS 0cd76c7989de4097b678951e57963f97
I20260709 13:15:23.459057  3752 raft_consensus.cc:993] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: : Instructing follower 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.459496  3752 raft_consensus.cc:1081] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Signalling peer 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.463377  3567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:56368
I20260709 13:15:23.463935  3567 raft_consensus.cc:493] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.464278  3567 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.465253  3689 consensus_queue.cc:1048] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.472097  3567 raft_consensus.cc:515] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.475871  3566 raft_consensus.cc:1240] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Rejecting Update request from peer 97df71c0d999454ab320455705be2e9c for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.476502  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.477161  3491 raft_consensus.cc:3055] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.477463  3491 raft_consensus.cc:740] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.478204  3491 consensus_queue.cc:260] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.479327  3491 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.479441  3567 leader_election.cc:290] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.483403  3688 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.488016  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.489261  3639 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.495329  3491 raft_consensus.cc:2468] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.496737  3533 leader_election.cc:304] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:23.497673  3687 raft_consensus.cc:2804] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.498145  3687 raft_consensus.cc:697] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.499063  3687 consensus_queue.cc:237] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.499987  3688 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.510251  3639 raft_consensus.cc:2468] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.517525  3389 catalog_manager.cc:5697] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 1 to 2, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.525382  3688 raft_consensus.cc:993] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: : Instructing follower 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.526011  3688 raft_consensus.cc:1081] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Signalling peer 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.528081  3567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:56378
I20260709 13:15:23.528569  3567 raft_consensus.cc:493] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.528908  3567 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.531662  3687 consensus_queue.cc:1048] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:23.537439  3567 raft_consensus.cc:515] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.539539  3567 leader_election.cc:290] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.541422  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.541838  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.541991  3491 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.542407  3639 raft_consensus.cc:3055] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.542752  3639 raft_consensus.cc:740] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:23.543715  3639 consensus_queue.cc:260] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.544921  3639 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.549012  3491 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.550902  3713 raft_consensus.cc:993] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:23.550732  3533 leader_election.cc:304] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:23.551486  3747 raft_consensus.cc:1081] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:23.552712  3747 raft_consensus.cc:2804] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.553228  3747 raft_consensus.cc:697] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.553494  3491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36318
I20260709 13:15:23.554018  3491 raft_consensus.cc:493] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.554368  3491 raft_consensus.cc:3060] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.554610  3639 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.554037  3747 consensus_queue.cc:237] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.562163  3491 raft_consensus.cc:515] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.563133  3492 raft_consensus.cc:1240] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Rejecting Update request from peer 0cd76c7989de4097b678951e57963f97 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:23.563635  3747 consensus_queue.cc:1048] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.565238  3709 consensus_queue.cc:1059] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.567857  3389 catalog_manager.cc:5697] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 1 to 2, leader changed from dc706bc58b604723836cb9ee0ee020ed (127.2.200.195) to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.574052  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:23.574707  3567 raft_consensus.cc:3055] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.575023  3567 raft_consensus.cc:740] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.575865  3567 consensus_queue.cc:260] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.577081  3567 raft_consensus.cc:3060] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.581400  3752 consensus_queue.cc:1048] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.583966  3567 raft_consensus.cc:2468] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 2.
I20260709 13:15:23.588100  3458 leader_election.cc:304] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:23.588874  3689 raft_consensus.cc:2804] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.583861  3752 consensus_queue.cc:1048] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.589522  3689 raft_consensus.cc:697] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 2 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.590358  3689 consensus_queue.cc:237] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.585896  3491 leader_election.cc:290] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 2 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.597515  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b54dc6897d42b393a4abbc4f659f0a" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.598165  3639 raft_consensus.cc:3060] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.622690  3389 catalog_manager.cc:5697] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 1 to 2, leader changed from 0cd76c7989de4097b678951e57963f97 (127.2.200.194) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 2 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.629370  3639 raft_consensus.cc:2468] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 2.
I20260709 13:15:23.715488  3706 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.731101  3706 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.731676  3705 raft_consensus.cc:993] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: : Instructing follower 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.732123  3705 raft_consensus.cc:1081] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Signalling peer 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.735304  3567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:56368
I20260709 13:15:23.735975  3567 raft_consensus.cc:493] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.736348  3567 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.746474  3567 raft_consensus.cc:515] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.749867  3567 leader_election.cc:290] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.751423  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.752074  3491 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.752310  3639 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.753938  3491 raft_consensus.cc:3055] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.754279  3491 raft_consensus.cc:740] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.755056  3491 consensus_queue.cc:260] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.756268  3491 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.760975  3639 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.762233  3531 leader_election.cc:304] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.762936  3766 raft_consensus.cc:2804] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.763352  3766 raft_consensus.cc:697] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.764137  3766 consensus_queue.cc:237] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.764977  3491 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.770319  3771 raft_consensus.cc:993] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: : Instructing follower 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.770779  3771 raft_consensus.cc:1081] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Signalling peer 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:23.772496  3566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:56368
I20260709 13:15:23.773061  3566 raft_consensus.cc:493] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.773422  3566 raft_consensus.cc:3060] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.773435  3709 raft_consensus.cc:993] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:23.774072  3709 raft_consensus.cc:1081] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:23.776160  3491 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87a297db0cd945b7a113160041262f10"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36318
I20260709 13:15:23.776814  3491 raft_consensus.cc:493] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:23.777290  3491 raft_consensus.cc:3060] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.777417  3387 catalog_manager.cc:5697] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 1 to 2, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.780915  3566 raft_consensus.cc:515] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.784475  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.784303  3491 raft_consensus.cc:515] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.785072  3639 raft_consensus.cc:3060] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.786412  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fac776eb23a42c285a0ca23d1bcef7f" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:23.786947  3492 raft_consensus.cc:3055] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.787249  3492 raft_consensus.cc:740] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.787499  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a297db0cd945b7a113160041262f10" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:23.787993  3567 raft_consensus.cc:3055] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:23.788306  3567 raft_consensus.cc:740] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.788012  3492 consensus_queue.cc:260] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.789215  3567 consensus_queue.cc:260] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.789958  3492 raft_consensus.cc:3060] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.790223  3567 raft_consensus.cc:3060] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.791417  3566 leader_election.cc:290] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.794320  3639 raft_consensus.cc:2468] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.796089  3531 leader_election.cc:304] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:23.796892  3766 raft_consensus.cc:2804] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.797349  3766 raft_consensus.cc:697] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:23.798127  3766 consensus_queue.cc:237] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.798730  3492 raft_consensus.cc:2468] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 2.
I20260709 13:15:23.802897  3567 raft_consensus.cc:2468] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 2.
I20260709 13:15:23.804592  3458 leader_election.cc:304] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:23.806850  3771 raft_consensus.cc:2804] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:23.807005  3491 leader_election.cc:290] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 2 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:23.807376  3771 raft_consensus.cc:697] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 2 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:23.808949  3771 consensus_queue.cc:237] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:23.807951  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a297db0cd945b7a113160041262f10" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:23.809254  3387 catalog_manager.cc:5697] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 1 to 2, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.810304  3639 raft_consensus.cc:3060] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:23.818980  3731 consensus_queue.cc:1048] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:23.818722  3389 catalog_manager.cc:5697] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 1 to 2, leader changed from 0cd76c7989de4097b678951e57963f97 (127.2.200.194) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 2 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:23.824208  3639 raft_consensus.cc:2468] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 2.
I20260709 13:15:23.834539  3763 consensus_queue.cc:1048] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:23.975214  3639 raft_consensus.cc:1275] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.976585  3766 consensus_queue.cc:1048] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.985621  3491 raft_consensus.cc:1275] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.987051  3766 consensus_queue.cc:1048] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:23.995638  3567 raft_consensus.cc:1275] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:23.999658  3752 consensus_queue.cc:1048] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.010437  3639 raft_consensus.cc:1275] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.011906  3771 consensus_queue.cc:1048] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.046432  3491 raft_consensus.cc:1275] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.047959  3766 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.056926  3639 raft_consensus.cc:1275] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.058442  3709 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.220060  3491 raft_consensus.cc:1275] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.221629  3709 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.224072  3567 raft_consensus.cc:1275] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.225616  3771 consensus_queue.cc:1048] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.230953  3639 raft_consensus.cc:1275] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.233088  3709 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.247478  3639 raft_consensus.cc:1275] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.248926  3705 consensus_queue.cc:1048] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.276523  3639 raft_consensus.cc:1275] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.277884  3709 consensus_queue.cc:1048] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:24.286384  3491 raft_consensus.cc:1275] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:24.289078  3747 consensus_queue.cc:1048] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:26.490319  2851 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:15:26.491304  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:26.509213  3492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:36334
I20260709 13:15:26.509891  3492 raft_consensus.cc:606] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Received request to transfer leadership to TS dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:26.512754  3492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:36334
I20260709 13:15:26.513507  3492 raft_consensus.cc:606] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Received request to transfer leadership to TS dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:26.514817  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:15:26.515358  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:26.939898  3771 raft_consensus.cc:993] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: : Instructing follower dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:26.940371  3771 raft_consensus.cc:1081] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Signalling peer dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:26.942078  3639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:58488
I20260709 13:15:26.942584  3639 raft_consensus.cc:493] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:26.942860  3639 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.947888  3639 raft_consensus.cc:515] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:26.949424  3639 leader_election.cc:290] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 2 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:26.950131  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:26.950495  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:26.950639  3492 raft_consensus.cc:3055] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:26.950933  3567 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.950984  3492 raft_consensus.cc:740] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:26.951675  3492 consensus_queue.cc:260] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:26.952559  3492 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:26.956897  3567 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 2.
I20260709 13:15:26.957131  3492 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 2.
I20260709 13:15:26.957962  3607 leader_election.cc:304] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:26.958810  3779 raft_consensus.cc:2804] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:26.960260  3779 raft_consensus.cc:697] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Becoming Leader. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:26.961376  3779 consensus_queue.cc:237] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:26.969300  3389 catalog_manager.cc:5697] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed reported cstate change: term changed from 1 to 2, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to dc706bc58b604723836cb9ee0ee020ed (127.2.200.195). New cstate: current_term: 2 leader_uuid: "dc706bc58b604723836cb9ee0ee020ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:27.007249  3780 raft_consensus.cc:993] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: : Instructing follower dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:27.007651  3771 raft_consensus.cc:1081] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Signalling peer dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:27.009760  3639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:58488
I20260709 13:15:27.010324  3639 raft_consensus.cc:493] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.010568  3639 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.014403  3639 raft_consensus.cc:515] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:27.015810  3639 leader_election.cc:290] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 2 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113)
I20260709 13:15:27.016947  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:27.016880  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:27.017618  3492 raft_consensus.cc:3055] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:27.017676  3567 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.018092  3492 raft_consensus.cc:740] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:27.018909  3492 consensus_queue.cc:260] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:27.020092  3492 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:27.024377  3567 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 2.
I20260709 13:15:27.025628  3607 leader_election.cc:304] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:27.026175  3492 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 2.
I20260709 13:15:27.026295  3779 raft_consensus.cc:2804] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:27.026726  3779 raft_consensus.cc:697] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Becoming Leader. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:27.027408  3779 consensus_queue.cc:237] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:27.034731  3389 catalog_manager.cc:5697] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed reported cstate change: term changed from 1 to 2, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to dc706bc58b604723836cb9ee0ee020ed (127.2.200.195). New cstate: current_term: 2 leader_uuid: "dc706bc58b604723836cb9ee0ee020ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.438930  3567 raft_consensus.cc:1275] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.440493  3779 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.449447  3492 raft_consensus.cc:1275] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.451069  3783 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.503201  3492 raft_consensus.cc:1275] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.504485  3792 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:27.513224  3567 raft_consensus.cc:1275] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:27.514917  3792 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:27.516090  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:27.535120  3639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:15:27.535593  3639 raft_consensus.cc:606] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:27.544366  3639 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:15:27.544842  3639 raft_consensus.cc:606] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:27.554811  3567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:56392
I20260709 13:15:27.555437  3567 raft_consensus.cc:606] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:27.561479  3567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:56392
I20260709 13:15:27.561932  3567 raft_consensus.cc:606] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:27.567210  3567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
mode: GRACEFUL
new_leader_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:56392
I20260709 13:15:27.567813  3567 raft_consensus.cc:606] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Received request to transfer leadership to TS 97df71c0d999454ab320455705be2e9c
I20260709 13:15:27.570497  3798 raft_consensus.cc:993] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.570964  3777 raft_consensus.cc:1081] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.572820  3492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36318
I20260709 13:15:27.573352  3492 raft_consensus.cc:493] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.573704  3492 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.578552  3492 raft_consensus.cc:515] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.580272  3492 leader_election.cc:290] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:27.581207  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:27.581408  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87d9193802b943329d908b7b7748ad6e" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:27.581650  3567 raft_consensus.cc:3055] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:27.581843  3639 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.581921  3567 raft_consensus.cc:740] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:27.582582  3567 consensus_queue.cc:260] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.583369  3567 raft_consensus.cc:3060] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.586295  3639 raft_consensus.cc:2468] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.587240  3567 raft_consensus.cc:2468] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.587301  3456 leader_election.cc:304] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:27.588083  3771 raft_consensus.cc:2804] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:27.589015  3771 raft_consensus.cc:697] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:27.589655  3771 consensus_queue.cc:237] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.595997  3389 catalog_manager.cc:5697] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 2 to 3, leader changed from 0cd76c7989de4097b678951e57963f97 (127.2.200.194) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 3 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.608450  3798 raft_consensus.cc:993] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.608888  3777 raft_consensus.cc:1081] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.610430  3492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36318
I20260709 13:15:27.611034  3492 raft_consensus.cc:493] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.611325  3492 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.615806  3492 raft_consensus.cc:515] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.617391  3492 leader_election.cc:290] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:27.618554  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:27.618571  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:27.618991  3639 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.619273  3567 raft_consensus.cc:3055] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:27.619655  3567 raft_consensus.cc:740] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:27.620265  3567 consensus_queue.cc:260] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.621191  3567 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.623119  3639 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.623982  3456 leader_election.cc:304] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:27.624608  3771 raft_consensus.cc:2804] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:27.625087  3771 raft_consensus.cc:697] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:27.625732  3567 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.625866  3771 consensus_queue.cc:237] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.632825  3389 catalog_manager.cc:5697] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 2 to 3, leader changed from 0cd76c7989de4097b678951e57963f97 (127.2.200.194) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 3 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.851332  3783 raft_consensus.cc:993] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.851788  3792 raft_consensus.cc:1081] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.853188  3492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36326
I20260709 13:15:27.853609  3492 raft_consensus.cc:493] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.853936  3492 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.858273  3492 raft_consensus.cc:515] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.859786  3492 leader_election.cc:290] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:27.860548  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:27.860821  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:27.861119  3567 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.861254  3639 raft_consensus.cc:3055] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:27.861568  3639 raft_consensus.cc:740] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:27.862224  3639 consensus_queue.cc:260] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.863286  3639 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.867029  3567 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.868053  3798 raft_consensus.cc:993] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.867959  3458 leader_election.cc:304] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:27.868471  3798 raft_consensus.cc:1081] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:27.868701  3771 raft_consensus.cc:2804] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:27.869167  3771 raft_consensus.cc:697] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:27.869174  3639 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.870213  3492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36318
I20260709 13:15:27.870124  3771 consensus_queue.cc:237] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.870745  3492 raft_consensus.cc:493] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:27.871112  3492 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.876432  3492 raft_consensus.cc:515] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.876869  3389 catalog_manager.cc:5697] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 2 to 3, leader changed from dc706bc58b604723836cb9ee0ee020ed (127.2.200.195) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 3 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:27.878717  3492 leader_election.cc:290] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:27.879264  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:27.879729  3639 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.878931  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:27.881148  3567 raft_consensus.cc:3055] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:27.881374  3567 raft_consensus.cc:740] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:27.881947  3567 consensus_queue.cc:260] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.882778  3567 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:27.885313  3639 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.886368  3456 leader_election.cc:304] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97df71c0d999454ab320455705be2e9c, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:27.886977  3771 raft_consensus.cc:2804] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:27.887427  3771 raft_consensus.cc:697] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:27.887446  3567 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:27.888366  3771 consensus_queue.cc:237] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:27.894965  3389 catalog_manager.cc:5697] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 2 to 3, leader changed from 0cd76c7989de4097b678951e57963f97 (127.2.200.194) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 3 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:28.018872  3567 raft_consensus.cc:1275] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.020283  3771 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.023447  3783 raft_consensus.cc:993] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: : Instructing follower 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:28.023885  3792 raft_consensus.cc:1081] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Signalling peer 97df71c0d999454ab320455705be2e9c to start an election
I20260709 13:15:28.025375  3492 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
 from {username='slave'} at 127.0.0.1:36326
I20260709 13:15:28.025837  3492 raft_consensus.cc:493] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:28.026188  3492 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.036423  3639 raft_consensus.cc:1275] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.037343  3492 raft_consensus.cc:515] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:28.038564  3809 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:28.039620  3492 leader_election.cc:290] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Requested vote from peers 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:28.040815  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:28.041407  3639 raft_consensus.cc:3055] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:28.041639  3639 raft_consensus.cc:740] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:28.042155  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "97df71c0d999454ab320455705be2e9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:28.042654  3567 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.042559  3639 consensus_queue.cc:260] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:28.043807  3639 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:28.047866  3567 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:28.047997  3639 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 97df71c0d999454ab320455705be2e9c in term 3.
I20260709 13:15:28.049028  3458 leader_election.cc:304] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, 97df71c0d999454ab320455705be2e9c; no voters: 
I20260709 13:15:28.049840  3809 raft_consensus.cc:2804] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:28.050487  3809 raft_consensus.cc:697] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Leader. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:28.051304  3809 consensus_queue.cc:237] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:28.057695  3389 catalog_manager.cc:5697] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c reported cstate change: term changed from 2 to 3, leader changed from dc706bc58b604723836cb9ee0ee020ed (127.2.200.195) to 97df71c0d999454ab320455705be2e9c (127.2.200.193). New cstate: current_term: 3 leader_uuid: "97df71c0d999454ab320455705be2e9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:28.122870  3567 raft_consensus.cc:1275] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.124161  3809 consensus_queue.cc:1048] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.132573  3641 raft_consensus.cc:1275] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.134186  3799 consensus_queue.cc:1048] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.309293  3567 raft_consensus.cc:1275] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.310351  3809 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.318401  3639 raft_consensus.cc:1275] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.319712  3771 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.416292  3567 raft_consensus.cc:1275] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.417487  3771 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.427448  3640 raft_consensus.cc:1275] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.428997  3809 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.554385  3567 raft_consensus.cc:1275] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.555699  3799 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:28.566021  3639 raft_consensus.cc:1275] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Refusing update from remote peer 97df71c0d999454ab320455705be2e9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:15:28.567492  3799 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:30.576390  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:30.586689  3492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:36334
I20260709 13:15:30.587553  3492 raft_consensus.cc:606] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Received request to transfer leadership to TS 0cd76c7989de4097b678951e57963f97
I20260709 13:15:30.590382  3492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:36334
I20260709 13:15:30.590761  3492 raft_consensus.cc:606] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Received request to transfer leadership to TS dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:30.593014  3492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:36334
I20260709 13:15:30.593405  3492 raft_consensus.cc:606] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Received request to transfer leadership to TS 0cd76c7989de4097b678951e57963f97
I20260709 13:15:30.595597  3492 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0"
dest_uuid: "97df71c0d999454ab320455705be2e9c"
mode: GRACEFUL
new_leader_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:36334
I20260709 13:15:30.596103  3492 raft_consensus.cc:606] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Received request to transfer leadership to TS dc706bc58b604723836cb9ee0ee020ed
I20260709 13:15:30.597429  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:15:30.598042  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:15:30.887866  3822 raft_consensus.cc:993] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: : Instructing follower dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:30.888322  3822 raft_consensus.cc:1081] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Signalling peer dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:30.889809  3639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:58488
I20260709 13:15:30.890231  3639 raft_consensus.cc:493] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.890508  3639 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.895354  3639 raft_consensus.cc:515] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:30.896879  3639 leader_election.cc:290] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 4 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:30.897817  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:30.898173  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c822b28f1a744f9afaa81b676c0b4a0" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:30.898507  3492 raft_consensus.cc:3055] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:30.898696  3567 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.898824  3492 raft_consensus.cc:740] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:30.899652  3492 consensus_queue.cc:260] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:30.900895  3492 raft_consensus.cc:3060] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.906750  3567 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 4.
I20260709 13:15:30.908124  3607 leader_election.cc:304] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:30.908499  3492 raft_consensus.cc:2468] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 4.
I20260709 13:15:30.908967  3820 raft_consensus.cc:2804] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:30.910065  3820 raft_consensus.cc:697] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 4 LEADER]: Becoming Leader. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:30.910883  3820 consensus_queue.cc:237] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:30.917661  3389 catalog_manager.cc:5697] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed reported cstate change: term changed from 3 to 4, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to dc706bc58b604723836cb9ee0ee020ed (127.2.200.195). New cstate: current_term: 4 leader_uuid: "dc706bc58b604723836cb9ee0ee020ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:30.947147  3799 raft_consensus.cc:993] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: : Instructing follower 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:30.947569  3822 raft_consensus.cc:1081] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Signalling peer 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:30.948940  3567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:56368
I20260709 13:15:30.949343  3567 raft_consensus.cc:493] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:30.949601  3567 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.954897  3567 raft_consensus.cc:515] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:30.956324  3567 leader_election.cc:290] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 4 election: Requested vote from peers dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225), 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113)
I20260709 13:15:30.957576  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:30.957626  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5513eae6b02c4a3ca430e97d17d1a2ac" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:30.958190  3492 raft_consensus.cc:3055] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:30.958220  3639 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.958549  3492 raft_consensus.cc:740] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:30.959374  3492 consensus_queue.cc:260] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:30.960264  3492 raft_consensus.cc:3060] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:30.962704  3639 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 4.
I20260709 13:15:30.963794  3531 leader_election.cc:304] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:30.964389  3492 raft_consensus.cc:2468] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 4.
I20260709 13:15:30.964507  3798 raft_consensus.cc:2804] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:30.965596  3798 raft_consensus.cc:697] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 4 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:30.966391  3798 consensus_queue.cc:237] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } }
I20260709 13:15:30.973277  3389 catalog_manager.cc:5697] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 3 to 4, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.039136  3799 raft_consensus.cc:993] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: : Instructing follower 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:31.039613  3799 raft_consensus.cc:1081] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Signalling peer 0cd76c7989de4097b678951e57963f97 to start an election
I20260709 13:15:31.040994  3567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb"
dest_uuid: "0cd76c7989de4097b678951e57963f97"
 from {username='slave'} at 127.0.0.1:56368
I20260709 13:15:31.041407  3567 raft_consensus.cc:493] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.041638  3567 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.045753  3567 raft_consensus.cc:515] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:31.047196  3567 leader_election.cc:290] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 4 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), dc706bc58b604723836cb9ee0ee020ed (127.2.200.195:44225)
I20260709 13:15:31.047981  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:31.048193  3639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bf06386369444cb88ca8c656dacb4cb" candidate_uuid: "0cd76c7989de4097b678951e57963f97" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
I20260709 13:15:31.048417  3492 raft_consensus.cc:3055] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:31.048631  3639 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.048686  3492 raft_consensus.cc:740] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:31.049463  3492 consensus_queue.cc:260] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:31.050289  3492 raft_consensus.cc:3060] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.052732  3639 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 4.
I20260709 13:15:31.053690  3531 leader_election.cc:304] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:31.054328  3798 raft_consensus.cc:2804] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:31.054461  3492 raft_consensus.cc:2468] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd76c7989de4097b678951e57963f97 in term 4.
I20260709 13:15:31.054690  3798 raft_consensus.cc:697] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 4 LEADER]: Becoming Leader. State: Replica: 0cd76c7989de4097b678951e57963f97, State: Running, Role: LEADER
I20260709 13:15:31.055510  3798 consensus_queue.cc:237] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:31.061992  3389 catalog_manager.cc:5697] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 reported cstate change: term changed from 3 to 4, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to 0cd76c7989de4097b678951e57963f97 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "0cd76c7989de4097b678951e57963f97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:31.111646  3822 raft_consensus.cc:993] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: : Instructing follower dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:31.112077  3799 raft_consensus.cc:1081] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Signalling peer dc706bc58b604723836cb9ee0ee020ed to start an election
I20260709 13:15:31.113505  3639 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6"
dest_uuid: "dc706bc58b604723836cb9ee0ee020ed"
 from {username='slave'} at 127.0.0.1:58488
I20260709 13:15:31.113940  3639 raft_consensus.cc:493] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:15:31.114205  3639 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.120270  3639 raft_consensus.cc:515] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:31.122433  3639 leader_election.cc:290] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 4 election: Requested vote from peers 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113), 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189)
I20260709 13:15:31.123103  3492 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "97df71c0d999454ab320455705be2e9c"
I20260709 13:15:31.123580  3492 raft_consensus.cc:3055] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:15:31.123433  3567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3da420265d5e4b399e988cc4bb63a7b6" candidate_uuid: "dc706bc58b604723836cb9ee0ee020ed" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0cd76c7989de4097b678951e57963f97"
I20260709 13:15:31.123817  3492 raft_consensus.cc:740] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 97df71c0d999454ab320455705be2e9c, State: Running, Role: LEADER
I20260709 13:15:31.124145  3567 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.124478  3492 consensus_queue.cc:260] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:31.125370  3492 raft_consensus.cc:3060] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:31.129634  3567 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 4.
I20260709 13:15:31.130091  3492 raft_consensus.cc:2468] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dc706bc58b604723836cb9ee0ee020ed in term 4.
I20260709 13:15:31.130875  3607 leader_election.cc:304] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd76c7989de4097b678951e57963f97, dc706bc58b604723836cb9ee0ee020ed; no voters: 
I20260709 13:15:31.131661  3820 raft_consensus.cc:2804] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:15:31.132097  3820 raft_consensus.cc:697] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 4 LEADER]: Becoming Leader. State: Replica: dc706bc58b604723836cb9ee0ee020ed, State: Running, Role: LEADER
I20260709 13:15:31.133026  3820 consensus_queue.cc:237] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } }
I20260709 13:15:31.140020  3389 catalog_manager.cc:5697] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed reported cstate change: term changed from 3 to 4, leader changed from 97df71c0d999454ab320455705be2e9c (127.2.200.193) to dc706bc58b604723836cb9ee0ee020ed (127.2.200.195). New cstate: current_term: 4 leader_uuid: "dc706bc58b604723836cb9ee0ee020ed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:31.426614  3492 raft_consensus.cc:1275] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.427894  3820 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.438000  3567 raft_consensus.cc:1275] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.439242  3820 consensus_queue.cc:1048] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.470254  3639 raft_consensus.cc:1275] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.471560  3798 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.481568  3492 raft_consensus.cc:1275] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.482903  3829 consensus_queue.cc:1048] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.579071  3639 raft_consensus.cc:1275] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.580395  3829 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dc706bc58b604723836cb9ee0ee020ed" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 44225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:31.589761  3492 raft_consensus.cc:1275] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Refusing update from remote peer 0cd76c7989de4097b678951e57963f97: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.593520  3842 consensus_queue.cc:1048] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97df71c0d999454ab320455705be2e9c" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 37113 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.599006  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:15:31.606666  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
W20260709 13:15:31.612702  3607 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 13:15:31.616600  3607 consensus_peers.cc:597] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed -> Peer 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113): Couldn't send request to peer 97df71c0d999454ab320455705be2e9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:31.628415  3607 consensus_peers.cc:597] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed -> Peer 97df71c0d999454ab320455705be2e9c (127.2.200.193:37113): Couldn't send request to peer 97df71c0d999454ab320455705be2e9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.638758  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:31.639523  2851 tablet_replica.cc:333] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.640158  2851 raft_consensus.cc:2243] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.641048  2851 raft_consensus.cc:2272] T b3b54dc6897d42b393a4abbc4f659f0a P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.642983  2851 tablet_replica.cc:333] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.643529  2851 raft_consensus.cc:2243] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.644320  2851 raft_consensus.cc:2272] T 87d9193802b943329d908b7b7748ad6e P 97df71c0d999454ab320455705be2e9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.646498  2851 tablet_replica.cc:333] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.647058  2851 raft_consensus.cc:2243] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.647466  2851 raft_consensus.cc:2272] T 9c822b28f1a744f9afaa81b676c0b4a0 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.649602  2851 tablet_replica.cc:333] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.650110  2851 raft_consensus.cc:2243] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.650480  2851 raft_consensus.cc:2272] T 2bf06386369444cb88ca8c656dacb4cb P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.652390  2851 tablet_replica.cc:333] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.652963  2851 raft_consensus.cc:2243] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.653666  2851 raft_consensus.cc:2272] T 30d754e54912452fb04c9408fe323638 P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.655303  2851 tablet_replica.cc:333] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.655762  2851 raft_consensus.cc:2243] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.656172  2851 raft_consensus.cc:2272] T e0cc7d5812d649bc9ff4609381f87e0b P 97df71c0d999454ab320455705be2e9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.657927  2851 tablet_replica.cc:333] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.658385  2851 raft_consensus.cc:2243] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.659116  2851 raft_consensus.cc:2272] T 87a297db0cd945b7a113160041262f10 P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.660662  2851 tablet_replica.cc:333] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.661132  2851 raft_consensus.cc:2243] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.661463  2851 raft_consensus.cc:2272] T 3da420265d5e4b399e988cc4bb63a7b6 P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.663005  2851 tablet_replica.cc:333] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.663411  2851 raft_consensus.cc:2243] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.663755  2851 raft_consensus.cc:2272] T 5513eae6b02c4a3ca430e97d17d1a2ac P 97df71c0d999454ab320455705be2e9c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.665745  2851 tablet_replica.cc:333] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c: stopping tablet replica
I20260709 13:15:31.666189  2851 raft_consensus.cc:2243] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.666600  2851 raft_consensus.cc:2272] T 2fac776eb23a42c285a0ca23d1bcef7f P 97df71c0d999454ab320455705be2e9c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.696965  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:15:31.721616  3567 raft_consensus.cc:1275] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Refusing update from remote peer dc706bc58b604723836cb9ee0ee020ed: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:15:31.723129  3820 consensus_queue.cc:1048] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd76c7989de4097b678951e57963f97" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 40189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:15:31.724673  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
W20260709 13:15:31.728700  3607 consensus_peers.cc:597] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed -> Peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Couldn't send request to peer 0cd76c7989de4097b678951e57963f97. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.753897  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:31.754619  2851 tablet_replica.cc:333] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.755249  2851 raft_consensus.cc:2243] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.755666  2851 raft_consensus.cc:2272] T 87d9193802b943329d908b7b7748ad6e P 0cd76c7989de4097b678951e57963f97 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.758495  2851 tablet_replica.cc:333] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.758989  2851 raft_consensus.cc:2243] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.759356  2851 raft_consensus.cc:2272] T 30d754e54912452fb04c9408fe323638 P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.761093  2851 tablet_replica.cc:333] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.761670  2851 raft_consensus.cc:2243] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.762188  2851 raft_consensus.cc:2272] T b3b54dc6897d42b393a4abbc4f659f0a P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.764072  2851 tablet_replica.cc:333] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.764686  2851 raft_consensus.cc:2243] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.765256  2851 raft_consensus.cc:2272] T 3da420265d5e4b399e988cc4bb63a7b6 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:15:31.766192  3607 consensus_peers.cc:597] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed -> Peer 0cd76c7989de4097b678951e57963f97 (127.2.200.194:40189): Couldn't send request to peer 0cd76c7989de4097b678951e57963f97. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:31.766959  2851 tablet_replica.cc:333] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.767551  2851 raft_consensus.cc:2243] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.768586  2851 raft_consensus.cc:2272] T 5513eae6b02c4a3ca430e97d17d1a2ac P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.770901  2851 tablet_replica.cc:333] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.771389  2851 raft_consensus.cc:2243] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.772127  2851 raft_consensus.cc:2272] T 2fac776eb23a42c285a0ca23d1bcef7f P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.774184  2851 tablet_replica.cc:333] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.774767  2851 raft_consensus.cc:2243] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.775177  2851 raft_consensus.cc:2272] T 9c822b28f1a744f9afaa81b676c0b4a0 P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.777299  2851 tablet_replica.cc:333] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.777822  2851 raft_consensus.cc:2243] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.778522  2851 raft_consensus.cc:2272] T 2bf06386369444cb88ca8c656dacb4cb P 0cd76c7989de4097b678951e57963f97 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.780303  2851 tablet_replica.cc:333] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.780740  2851 raft_consensus.cc:2243] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.781136  2851 raft_consensus.cc:2272] T e0cc7d5812d649bc9ff4609381f87e0b P 0cd76c7989de4097b678951e57963f97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.782783  2851 tablet_replica.cc:333] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97: stopping tablet replica
I20260709 13:15:31.783205  2851 raft_consensus.cc:2243] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.783584  2851 raft_consensus.cc:2272] T 87a297db0cd945b7a113160041262f10 P 0cd76c7989de4097b678951e57963f97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.814630  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
I20260709 13:15:31.834185  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
I20260709 13:15:31.860646  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:15:31.861682  2851 tablet_replica.cc:333] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.862823  2851 raft_consensus.cc:2243] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.863656  2851 raft_consensus.cc:2272] T 87d9193802b943329d908b7b7748ad6e P dc706bc58b604723836cb9ee0ee020ed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.866263  2851 tablet_replica.cc:333] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.866865  2851 raft_consensus.cc:2243] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.867304  2851 raft_consensus.cc:2272] T b3b54dc6897d42b393a4abbc4f659f0a P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.869313  2851 tablet_replica.cc:333] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.869903  2851 raft_consensus.cc:2243] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.870342  2851 raft_consensus.cc:2272] T 30d754e54912452fb04c9408fe323638 P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.872263  2851 tablet_replica.cc:333] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.873064  2851 raft_consensus.cc:2243] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.873579  2851 raft_consensus.cc:2272] T 5513eae6b02c4a3ca430e97d17d1a2ac P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.875957  2851 tablet_replica.cc:333] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.878465  2851 raft_consensus.cc:2243] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.879199  2851 pending_rounds.cc:70] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: Trying to abort 1 pending ops.
I20260709 13:15:31.879410  2851 pending_rounds.cc:77] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305637605928357888 op_type: NO_OP noop_request { }
I20260709 13:15:31.880064  2851 raft_consensus.cc:2889] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:15:31.880506  2851 raft_consensus.cc:2272] T 3da420265d5e4b399e988cc4bb63a7b6 P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.882606  2851 tablet_replica.cc:333] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.883088  2851 raft_consensus.cc:2243] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.884310  2851 raft_consensus.cc:2272] T e0cc7d5812d649bc9ff4609381f87e0b P dc706bc58b604723836cb9ee0ee020ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.887447  2851 tablet_replica.cc:333] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.887904  2851 raft_consensus.cc:2243] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.888285  2851 raft_consensus.cc:2272] T 87a297db0cd945b7a113160041262f10 P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.890079  2851 tablet_replica.cc:333] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.890524  2851 raft_consensus.cc:2243] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.890892  2851 raft_consensus.cc:2272] T 2fac776eb23a42c285a0ca23d1bcef7f P dc706bc58b604723836cb9ee0ee020ed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.892501  2851 tablet_replica.cc:333] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.893003  2851 raft_consensus.cc:2243] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:31.893404  2851 raft_consensus.cc:2272] T 2bf06386369444cb88ca8c656dacb4cb P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.895620  2851 tablet_replica.cc:333] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed: stopping tablet replica
I20260709 13:15:31.896049  2851 raft_consensus.cc:2243] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.899295  2851 raft_consensus.cc:2272] T 9c822b28f1a744f9afaa81b676c0b4a0 P dc706bc58b604723836cb9ee0ee020ed [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.928550  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:15:31.949859  2851 master.cc:562] Master@127.2.200.254:36679 shutting down...
I20260709 13:15:31.970899  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:15:31.971393  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:31.971827  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0f7a1ec52a7943189517ee46ef2c71fb: stopping tablet replica
I20260709 13:15:32.006158  2851 master.cc:584] Master@127.2.200.254:36679 shutdown complete.
0cd76c7989de4097b678951e57963f97  4
97df71c0d999454ab320455705be2e9c  5
dc706bc58b604723836cb9ee0ee020ed  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10498 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:15:32.048472  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:44439
I20260709 13:15:32.049594  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.055516  3846 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.055655  3845 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.056375  3848 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.057017  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:32.057873  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.058058  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.058202  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602932058188 us; error 0 us; skew 500 ppm
I20260709 13:15:32.058704  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.061729  2851 webserver.cc:533] Webserver started at http://127.2.200.254:40351/ using document root <none> and password file <none>
I20260709 13:15:32.062305  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.062493  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.062793  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.064069  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "8dad18bff2f044b2a76f2e5726c72315"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.069954  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260709 13:15:32.073657  3853 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.074390  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:15:32.074676  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "8dad18bff2f044b2a76f2e5726c72315"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.074955  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.100554  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.101845  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.143972  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:44439
I20260709 13:15:32.143996  3904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:44439 every 8 connection(s)
I20260709 13:15:32.148448  3905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.161375  3905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Bootstrap starting.
I20260709 13:15:32.166134  3905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:32.171716  3905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: No bootstrap required, opened a new log
I20260709 13:15:32.173954  3905 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dad18bff2f044b2a76f2e5726c72315" member_type: VOTER }
I20260709 13:15:32.174312  3905 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:32.174533  3905 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dad18bff2f044b2a76f2e5726c72315, State: Initialized, Role: FOLLOWER
I20260709 13:15:32.175092  3905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dad18bff2f044b2a76f2e5726c72315" member_type: VOTER }
I20260709 13:15:32.175529  3905 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:15:32.175740  3905 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:15:32.175982  3905 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:32.180051  3905 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dad18bff2f044b2a76f2e5726c72315" member_type: VOTER }
I20260709 13:15:32.180532  3905 leader_election.cc:304] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8dad18bff2f044b2a76f2e5726c72315; no voters: 
I20260709 13:15:32.181625  3905 leader_election.cc:290] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:15:32.181927  3908 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:32.183314  3908 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 1 LEADER]: Becoming Leader. State: Replica: 8dad18bff2f044b2a76f2e5726c72315, State: Running, Role: LEADER
I20260709 13:15:32.183943  3908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dad18bff2f044b2a76f2e5726c72315" member_type: VOTER }
I20260709 13:15:32.184253  3905 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:15:32.188506  3910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8dad18bff2f044b2a76f2e5726c72315. Latest consensus state: current_term: 1 leader_uuid: "8dad18bff2f044b2a76f2e5726c72315" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dad18bff2f044b2a76f2e5726c72315" member_type: VOTER } }
I20260709 13:15:32.188894  3909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8dad18bff2f044b2a76f2e5726c72315" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8dad18bff2f044b2a76f2e5726c72315" member_type: VOTER } }
I20260709 13:15:32.189184  3910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:32.189597  3909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [sys.catalog]: This master's current role is: LEADER
I20260709 13:15:32.192931  3915 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:15:32.197929  3915 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:15:32.202607  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:15:32.206605  3915 catalog_manager.cc:1383] Generated new cluster ID: cc00eec3594244a3a2a85b021dad78db
I20260709 13:15:32.207068  3915 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:15:32.227952  3915 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:15:32.229393  3915 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:15:32.244812  3915 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Generated new TSK 0
I20260709 13:15:32.245548  3915 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:15:32.269745  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.275578  3926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.276506  3927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.277717  3929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.278024  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:32.278825  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.279006  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.279124  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602932279113 us; error 0 us; skew 500 ppm
I20260709 13:15:32.279567  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.281999  2851 webserver.cc:533] Webserver started at http://127.2.200.193:42495/ using document root <none> and password file <none>
I20260709 13:15:32.282425  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.282586  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.282794  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.283775  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "1e032f02b0aa450384dda978641ba666"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.288156  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:32.291514  3934 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.292382  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:32.292814  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "1e032f02b0aa450384dda978641ba666"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.293133  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.316133  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.317457  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.319111  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:32.321561  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:32.321755  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.322000  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:32.322157  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.366338  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:44737
I20260709 13:15:32.366496  3996 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:44737 every 8 connection(s)
I20260709 13:15:32.372107  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.379460  4001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.381165  4002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.382879  4004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.383097  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:32.383980  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.384153  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.384321  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602932384306 us; error 0 us; skew 500 ppm
I20260709 13:15:32.384874  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.387527  2851 webserver.cc:533] Webserver started at http://127.2.200.194:44559/ using document root <none> and password file <none>
I20260709 13:15:32.388046  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.388279  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.388592  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.389979  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "b8c8b10100a146e6a81f308505fe9f46"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.390491  3997 heartbeater.cc:344] Connected to a master server at 127.2.200.254:44439
I20260709 13:15:32.390923  3997 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:32.391701  3997 heartbeater.cc:507] Master 127.2.200.254:44439 requested a full tablet report, sending...
I20260709 13:15:32.393889  3870 ts_manager.cc:194] Registered new tserver with Master: 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:15:32.395498  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:15:32.396237  3870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60820
I20260709 13:15:32.399729  4009 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.400535  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:15:32.400838  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "b8c8b10100a146e6a81f308505fe9f46"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.401104  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.434842  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.436044  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.437552  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:32.439730  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:32.439919  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.440148  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:32.440295  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.479889  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:33461
I20260709 13:15:32.480041  4071 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:33461 every 8 connection(s)
I20260709 13:15:32.484483  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:32.491416  4075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:32.493074  4076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.494423  2851 server_base.cc:1061] running on GCE node
W20260709 13:15:32.495314  4078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:32.496284  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:32.496533  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:32.496834  4072 heartbeater.cc:344] Connected to a master server at 127.2.200.254:44439
I20260709 13:15:32.496896  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602932496874 us; error 0 us; skew 500 ppm
I20260709 13:15:32.497308  4072 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:32.497681  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:32.498049  4072 heartbeater.cc:507] Master 127.2.200.254:44439 requested a full tablet report, sending...
I20260709 13:15:32.500355  3870 ts_manager.cc:194] Registered new tserver with Master: b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:32.501171  2851 webserver.cc:533] Webserver started at http://127.2.200.195:33895/ using document root <none> and password file <none>
I20260709 13:15:32.501784  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:32.502025  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:32.502128  3870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60834
I20260709 13:15:32.502344  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:32.503696  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "0f3fa9d459de485e824f023c55580bc6"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.508314  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:15:32.511960  4083 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.512735  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:15:32.513023  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "0f3fa9d459de485e824f023c55580bc6"
format_stamp: "Formatted at 2026-07-09 13:15:32 on dist-test-slave-108k"
I20260709 13:15:32.513259  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:32.524412  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:32.525647  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:32.527055  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:32.529333  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:32.529553  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.529778  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:32.529932  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:32.579007  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:41513
I20260709 13:15:32.579083  4145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:41513 every 8 connection(s)
I20260709 13:15:32.593605  4146 heartbeater.cc:344] Connected to a master server at 127.2.200.254:44439
I20260709 13:15:32.594056  4146 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:32.594792  4146 heartbeater.cc:507] Master 127.2.200.254:44439 requested a full tablet report, sending...
I20260709 13:15:32.596688  3870 ts_manager.cc:194] Registered new tserver with Master: 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:32.597220  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014916468s
I20260709 13:15:32.598052  3870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60848
I20260709 13:15:32.623306  3870 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60860:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:15:32.629165  3870 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:15:32.828445  3957 tablet_service.cc:1511] Processing CreateTablet for tablet 53a55b3994714eaca86c1f4d5e9a466e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:32.830020  3957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a55b3994714eaca86c1f4d5e9a466e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.829932  3960 tablet_service.cc:1511] Processing CreateTablet for tablet 9d32e7a943df43b289705f4bb80afdda (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:32.831305  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d32e7a943df43b289705f4bb80afdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.831658  3958 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0ea046ec794443af9a7689d2920002 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:32.833216  3958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0ea046ec794443af9a7689d2920002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.837906  3959 tablet_service.cc:1511] Processing CreateTablet for tablet 5e95edd135954b96b72b4881f6d032db (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:32.839243  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e95edd135954b96b72b4881f6d032db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.841677  3961 tablet_service.cc:1511] Processing CreateTablet for tablet 685b92d286284315bf0bfd731587b546 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:32.842967  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685b92d286284315bf0bfd731587b546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.828445  3962 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3ee0cd50984b8594b3c3f0dda39a22 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:32.850467  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3ee0cd50984b8594b3c3f0dda39a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.851894  3954 tablet_service.cc:1511] Processing CreateTablet for tablet de8b8c30ab5342a588659a5531a6a633 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:32.853195  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8b8c30ab5342a588659a5531a6a633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.857936  3953 tablet_service.cc:1511] Processing CreateTablet for tablet bc7c268f55f94e0daca09ce6107e964b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:32.859731  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7c268f55f94e0daca09ce6107e964b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.862007  3956 tablet_service.cc:1511] Processing CreateTablet for tablet b68b34d0f4bd480da49284d88135af8b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:32.863539  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68b34d0f4bd480da49284d88135af8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.872750  4037 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3ee0cd50984b8594b3c3f0dda39a22 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:32.874869  4037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3ee0cd50984b8594b3c3f0dda39a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.850358  3955 tablet_service.cc:1511] Processing CreateTablet for tablet bd0cb418885343fdbc63ca85b6214aec (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:32.878038  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cb418885343fdbc63ca85b6214aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.886037  3960 tablet_service.cc:1511] Processing CreateTablet for tablet c59c25d70b304877b556dc3d686ab76e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:32.887534  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59c25d70b304877b556dc3d686ab76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.901801  4036 tablet_service.cc:1511] Processing CreateTablet for tablet 685b92d286284315bf0bfd731587b546 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:32.903270  4036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685b92d286284315bf0bfd731587b546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.903919  3955 tablet_service.cc:1511] Processing CreateTablet for tablet 98d2f9d8927b4f92bc7e4a37d023c1f8 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:32.924489  4031 tablet_service.cc:1511] Processing CreateTablet for tablet b68b34d0f4bd480da49284d88135af8b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:32.925997  4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68b34d0f4bd480da49284d88135af8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.926700  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d2f9d8927b4f92bc7e4a37d023c1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.917220  4034 tablet_service.cc:1511] Processing CreateTablet for tablet 5e95edd135954b96b72b4881f6d032db (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:32.933812  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e95edd135954b96b72b4881f6d032db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.919694  4033 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0ea046ec794443af9a7689d2920002 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:32.937673  4033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0ea046ec794443af9a7689d2920002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.922067  4032 tablet_service.cc:1511] Processing CreateTablet for tablet 53a55b3994714eaca86c1f4d5e9a466e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:32.941715  4032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a55b3994714eaca86c1f4d5e9a466e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.914723  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 9d32e7a943df43b289705f4bb80afdda (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:32.945634  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d32e7a943df43b289705f4bb80afdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.957919  3961 tablet_service.cc:1511] Processing CreateTablet for tablet 921fb867175f444ca511e3c2b6c9aa5c (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:32.969537  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 921fb867175f444ca511e3c2b6c9aa5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.964885  3953 tablet_service.cc:1511] Processing CreateTablet for tablet fa0ecf853c3e4d398a5b18c0126a0448 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:32.965905  3954 tablet_service.cc:1511] Processing CreateTablet for tablet b34dfd1b29be4147bfda87c498945aeb (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:32.966544  4030 tablet_service.cc:1511] Processing CreateTablet for tablet bd0cb418885343fdbc63ca85b6214aec (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:32.978641  4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cb418885343fdbc63ca85b6214aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.979176  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ecf853c3e4d398a5b18c0126a0448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.985074  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34dfd1b29be4147bfda87c498945aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.968052  3959 tablet_service.cc:1511] Processing CreateTablet for tablet 50aca70be0884ed09aa97127d571282f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:32.969272  4029 tablet_service.cc:1511] Processing CreateTablet for tablet de8b8c30ab5342a588659a5531a6a633 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:32.989792  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8b8c30ab5342a588659a5531a6a633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.962678  3956 tablet_service.cc:1511] Processing CreateTablet for tablet c86a274746124a40b574d2dfb4d0e34d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:32.991074  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a274746124a40b574d2dfb4d0e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:32.974691  4028 tablet_service.cc:1511] Processing CreateTablet for tablet bc7c268f55f94e0daca09ce6107e964b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:32.998867  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7c268f55f94e0daca09ce6107e964b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.003024  4111 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3ee0cd50984b8594b3c3f0dda39a22 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:15:33.004424  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3ee0cd50984b8594b3c3f0dda39a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.005889  4110 tablet_service.cc:1511] Processing CreateTablet for tablet 685b92d286284315bf0bfd731587b546 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:15:33.006718  4103 tablet_service.cc:1511] Processing CreateTablet for tablet de8b8c30ab5342a588659a5531a6a633 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:15:33.008013  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685b92d286284315bf0bfd731587b546. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.009963  4109 tablet_service.cc:1511] Processing CreateTablet for tablet 9d32e7a943df43b289705f4bb80afdda (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:15:33.011231  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d32e7a943df43b289705f4bb80afdda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.011224  4102 tablet_service.cc:1511] Processing CreateTablet for tablet bc7c268f55f94e0daca09ce6107e964b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:15:33.012691  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc7c268f55f94e0daca09ce6107e964b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.013898  4108 tablet_service.cc:1511] Processing CreateTablet for tablet 5e95edd135954b96b72b4881f6d032db (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:15:33.015167  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e95edd135954b96b72b4881f6d032db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.017892  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0ea046ec794443af9a7689d2920002 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:15:33.019168  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0ea046ec794443af9a7689d2920002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.021864  4106 tablet_service.cc:1511] Processing CreateTablet for tablet 53a55b3994714eaca86c1f4d5e9a466e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:15:33.023097  4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53a55b3994714eaca86c1f4d5e9a466e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.025930  4105 tablet_service.cc:1511] Processing CreateTablet for tablet b68b34d0f4bd480da49284d88135af8b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:15:33.027362  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68b34d0f4bd480da49284d88135af8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.029379  4104 tablet_service.cc:1511] Processing CreateTablet for tablet bd0cb418885343fdbc63ca85b6214aec (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:15:33.031659  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cb418885343fdbc63ca85b6214aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.040941  3958 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb75fd2816c4878a8cdd7b7595c52f3 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:33.042235  3958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb75fd2816c4878a8cdd7b7595c52f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.051568  4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8b8c30ab5342a588659a5531a6a633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.055315  3955 tablet_service.cc:1511] Processing CreateTablet for tablet e58a5e86e7dd4d16a56a3a67f2ac29d7 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:33.056649  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58a5e86e7dd4d16a56a3a67f2ac29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.065415  3953 tablet_service.cc:1511] Processing CreateTablet for tablet 43c0a60eab684a2386715908ca218355 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:33.072990  4161 tablet_bootstrap.cc:492] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:33.060818  3957 tablet_service.cc:1511] Processing CreateTablet for tablet 254ff72f01fd4cc2ade8c8909c20f5bb (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:33.109234  3957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ff72f01fd4cc2ade8c8909c20f5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.111677  3962 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6116be669b48d88215ae1f69b092a1 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:33.112856  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50aca70be0884ed09aa97127d571282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.125708  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c0a60eab684a2386715908ca218355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.130474  4105 tablet_service.cc:1511] Processing CreateTablet for tablet c59c25d70b304877b556dc3d686ab76e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:33.131771  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59c25d70b304877b556dc3d686ab76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.143790  4029 tablet_service.cc:1511] Processing CreateTablet for tablet b34dfd1b29be4147bfda87c498945aeb (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:33.145077  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34dfd1b29be4147bfda87c498945aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.149252  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 921fb867175f444ca511e3c2b6c9aa5c (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:33.150772  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 921fb867175f444ca511e3c2b6c9aa5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.150940  4032 tablet_service.cc:1511] Processing CreateTablet for tablet fa0ecf853c3e4d398a5b18c0126a0448 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:33.152024  4032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ecf853c3e4d398a5b18c0126a0448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.153847  4031 tablet_service.cc:1511] Processing CreateTablet for tablet 50aca70be0884ed09aa97127d571282f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:33.155229  4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50aca70be0884ed09aa97127d571282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.163985  4103 tablet_service.cc:1511] Processing CreateTablet for tablet 98d2f9d8927b4f92bc7e4a37d023c1f8 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:33.164227  4106 tablet_service.cc:1511] Processing CreateTablet for tablet b34dfd1b29be4147bfda87c498945aeb (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:15:33.165030  4028 tablet_service.cc:1511] Processing CreateTablet for tablet e58a5e86e7dd4d16a56a3a67f2ac29d7 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:33.166208  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58a5e86e7dd4d16a56a3a67f2ac29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.166327  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb75fd2816c4878a8cdd7b7595c52f3 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:33.137600  4037 tablet_service.cc:1511] Processing CreateTablet for tablet c59c25d70b304877b556dc3d686ab76e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:15:33.173223  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb75fd2816c4878a8cdd7b7595c52f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.174187  4037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59c25d70b304877b556dc3d686ab76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.179409  4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d2f9d8927b4f92bc7e4a37d023c1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.185360  4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b34dfd1b29be4147bfda87c498945aeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.185173  4109 tablet_service.cc:1511] Processing CreateTablet for tablet 921fb867175f444ca511e3c2b6c9aa5c (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:15:33.185917  4107 tablet_service.cc:1511] Processing CreateTablet for tablet c86a274746124a40b574d2dfb4d0e34d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:33.187117  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a274746124a40b574d2dfb4d0e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.189522  4163 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:33.190477  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 43c0a60eab684a2386715908ca218355 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:33.191601  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c0a60eab684a2386715908ca218355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.138065  4036 tablet_service.cc:1511] Processing CreateTablet for tablet c86a274746124a40b574d2dfb4d0e34d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:15:33.193197  4034 tablet_service.cc:1511] Processing CreateTablet for tablet 98d2f9d8927b4f92bc7e4a37d023c1f8 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:15:33.193687  4036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a274746124a40b574d2dfb4d0e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.195436  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6116be669b48d88215ae1f69b092a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.198513  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98d2f9d8927b4f92bc7e4a37d023c1f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.200143  3960 tablet_service.cc:1511] Processing CreateTablet for tablet 1a83d90df1f344e4bcaf5128f021d5a8 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 13:15:33.205298  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:33.207748  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a83d90df1f344e4bcaf5128f021d5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.218698  4110 tablet_service.cc:1511] Processing CreateTablet for tablet e58a5e86e7dd4d16a56a3a67f2ac29d7 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:15:33.206625  4161 tablet_bootstrap.cc:654] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.225613  4162 tablet_bootstrap.cc:492] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:33.226722  4104 tablet_service.cc:1511] Processing CreateTablet for tablet 8cb75fd2816c4878a8cdd7b7595c52f3 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:15:33.216420  4108 tablet_service.cc:1511] Processing CreateTablet for tablet 50aca70be0884ed09aa97127d571282f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:15:33.230055  3956 tablet_service.cc:1511] Processing CreateTablet for tablet e20b6631af674e838a0accf36c31749f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:33.188709  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 921fb867175f444ca511e3c2b6c9aa5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.231356  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b6631af674e838a0accf36c31749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.224385  4033 tablet_service.cc:1511] Processing CreateTablet for tablet 254ff72f01fd4cc2ade8c8909c20f5bb (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:33.226732  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 1a83d90df1f344e4bcaf5128f021d5a8 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:33.233477  4033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ff72f01fd4cc2ade8c8909c20f5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.234925  3954 tablet_service.cc:1511] Processing CreateTablet for tablet fdf62b06bdd54048a2cc215663a17a2e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:33.236057  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf62b06bdd54048a2cc215663a17a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.237049  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e58a5e86e7dd4d16a56a3a67f2ac29d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.241056  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a83d90df1f344e4bcaf5128f021d5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.245061  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50aca70be0884ed09aa97127d571282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.246305  4163 tablet_bootstrap.cc:654] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.251552  4102 tablet_service.cc:1511] Processing CreateTablet for tablet fa0ecf853c3e4d398a5b18c0126a0448 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:15:33.252857  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ecf853c3e4d398a5b18c0126a0448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.257282  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cb75fd2816c4878a8cdd7b7595c52f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.257874  4111 tablet_service.cc:1511] Processing CreateTablet for tablet 254ff72f01fd4cc2ade8c8909c20f5bb (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:15:33.258860  4162 tablet_bootstrap.cc:654] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.259089  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 254ff72f01fd4cc2ade8c8909c20f5bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.261883  4029 tablet_service.cc:1511] Processing CreateTablet for tablet e20b6631af674e838a0accf36c31749f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:33.247309  3961 tablet_service.cc:1511] Processing CreateTablet for tablet c31345ac12b54b42b93f8e1e71274615 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:33.263131  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b6631af674e838a0accf36c31749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.212438  4030 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6116be669b48d88215ae1f69b092a1 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:33.264102  4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6116be669b48d88215ae1f69b092a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.269431  3957 tablet_service.cc:1511] Processing CreateTablet for tablet 1be06cbb19234936aabe0a7128358755 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:33.267964  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31345ac12b54b42b93f8e1e71274615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.275947  4032 tablet_service.cc:1511] Processing CreateTablet for tablet fdf62b06bdd54048a2cc215663a17a2e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:33.277174  3957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be06cbb19234936aabe0a7128358755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.279623  3955 tablet_service.cc:1511] Processing CreateTablet for tablet 450ecd71cd99442cb269ac276ec3d83e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:33.284504  4032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf62b06bdd54048a2cc215663a17a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.283078  3958 tablet_service.cc:1511] Processing CreateTablet for tablet 17894d3c75534c379dd3bb78bf4eea00 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:33.306075  3959 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8eecd98f04495f9ed7470925ed9487 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:33.307116  3953 tablet_service.cc:1511] Processing CreateTablet for tablet ff7454fcd1f54b6eb01038eb8ecb273c (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:33.309020  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450ecd71cd99442cb269ac276ec3d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.323606  4105 tablet_service.cc:1511] Processing CreateTablet for tablet 43c0a60eab684a2386715908ca218355 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:15:33.324891  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43c0a60eab684a2386715908ca218355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.329595  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8eecd98f04495f9ed7470925ed9487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.343618  4034 tablet_service.cc:1511] Processing CreateTablet for tablet 1be06cbb19234936aabe0a7128358755 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:33.344914  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be06cbb19234936aabe0a7128358755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.345988  3962 tablet_service.cc:1511] Processing CreateTablet for tablet a389492bb09a4483ad432f0b945c7a61 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:33.347297  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a389492bb09a4483ad432f0b945c7a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.347553  4028 tablet_service.cc:1511] Processing CreateTablet for tablet 450ecd71cd99442cb269ac276ec3d83e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:33.320266  4031 tablet_service.cc:1511] Processing CreateTablet for tablet c31345ac12b54b42b93f8e1e71274615 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:33.356094  3958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17894d3c75534c379dd3bb78bf4eea00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.365433  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7454fcd1f54b6eb01038eb8ecb273c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.366608  4161 tablet_bootstrap.cc:492] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:33.367096  4161 ts_tablet_manager.cc:1403] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.295s	user 0.007s	sys 0.008s
W20260709 13:15:33.356930  3856 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44140.6us
I20260709 13:15:33.369817  4161 raft_consensus.cc:359] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.370523  4161 raft_consensus.cc:385] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.370800  4161 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.371609  4161 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.354684  4036 tablet_service.cc:1511] Processing CreateTablet for tablet 17894d3c75534c379dd3bb78bf4eea00 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:33.348719  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450ecd71cd99442cb269ac276ec3d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.352233  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 2c6116be669b48d88215ae1f69b092a1 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:15:33.368257  3956 tablet_service.cc:1511] Processing CreateTablet for tablet e32744704d014399851a0661c8929ded (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:33.355574  4163 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:33.378270  4163 ts_tablet_manager.cc:1403] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.189s	user 0.012s	sys 0.014s
I20260709 13:15:33.390744  4163 raft_consensus.cc:359] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.391618  4163 raft_consensus.cc:385] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.391934  4163 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.392576  4161 ts_tablet_manager.cc:1434] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.007s
I20260709 13:15:33.390926  4109 tablet_service.cc:1511] Processing CreateTablet for tablet 450ecd71cd99442cb269ac276ec3d83e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:15:33.392896  4163 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.393597  4036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17894d3c75534c379dd3bb78bf4eea00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.394227  4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31345ac12b54b42b93f8e1e71274615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.394495  4110 tablet_service.cc:1511] Processing CreateTablet for tablet c31345ac12b54b42b93f8e1e71274615 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:15:33.395171  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32744704d014399851a0661c8929ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.395646  4103 tablet_service.cc:1511] Processing CreateTablet for tablet 1be06cbb19234936aabe0a7128358755 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:15:33.399930  3997 heartbeater.cc:499] Master 127.2.200.254:44439 was elected leader, sending a full tablet report...
I20260709 13:15:33.403594  4029 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef4e92169eb4f9e9b2217d164131a56 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:33.359073  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8eecd98f04495f9ed7470925ed9487 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:33.409441  4032 tablet_service.cc:1511] Processing CreateTablet for tablet e32744704d014399851a0661c8929ded (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:33.412182  3961 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef4e92169eb4f9e9b2217d164131a56 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:33.413003  4106 tablet_service.cc:1511] Processing CreateTablet for tablet 1a83d90df1f344e4bcaf5128f021d5a8 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:15:33.413475  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef4e92169eb4f9e9b2217d164131a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.379256  4104 tablet_service.cc:1511] Processing CreateTablet for tablet e20b6631af674e838a0accf36c31749f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:15:33.418705  4162 tablet_bootstrap.cc:492] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:33.451529  4162 ts_tablet_manager.cc:1403] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.226s	user 0.022s	sys 0.000s
I20260709 13:15:33.454536  4162 raft_consensus.cc:359] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.455232  4162 raft_consensus.cc:385] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.455514  4162 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.422387  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef4e92169eb4f9e9b2217d164131a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.456905  4032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32744704d014399851a0661c8929ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.423162  4167 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.456645  4162 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.457626  4163 ts_tablet_manager.cc:1434] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.015s
I20260709 13:15:33.457543  4167 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.460041  4167 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:33.423398  4030 tablet_service.cc:1511] Processing CreateTablet for tablet a389492bb09a4483ad432f0b945c7a61 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:33.461216  4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a389492bb09a4483ad432f0b945c7a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.429562  4161 tablet_bootstrap.cc:492] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:33.430634  3955 tablet_service.cc:1511] Processing CreateTablet for tablet f6112c480d954932a8aa350e7919f25d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:33.432201  4028 tablet_service.cc:1511] Processing CreateTablet for tablet f6112c480d954932a8aa350e7919f25d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:33.379249  4102 tablet_service.cc:1511] Processing CreateTablet for tablet fdf62b06bdd54048a2cc215663a17a2e (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:15:33.432736  3960 tablet_service.cc:1511] Processing CreateTablet for tablet e1f289732f2a4c498b8d722dbadc5721 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:33.439128  3954 tablet_service.cc:1511] Processing CreateTablet for tablet 397fa935c4d84e7fbb1e5dc631ce3711 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:33.439523  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6116be669b48d88215ae1f69b092a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.440408  4037 tablet_service.cc:1511] Processing CreateTablet for tablet ff7454fcd1f54b6eb01038eb8ecb273c (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:33.446969  3953 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd2df3c22d48b1b21bf6951d14bc61 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:33.445609  3962 tablet_service.cc:1511] Processing CreateTablet for tablet d99c13fc3b7f4e2687824e0a5911512a (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:33.473835  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6112c480d954932a8aa350e7919f25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.471297  3957 tablet_service.cc:1511] Processing CreateTablet for tablet c90b568035464cd5a8006c0d5876087d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:33.478300  4031 tablet_service.cc:1511] Processing CreateTablet for tablet e1f289732f2a4c498b8d722dbadc5721 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:33.478901  4146 heartbeater.cc:499] Master 127.2.200.254:44439 was elected leader, sending a full tablet report...
I20260709 13:15:33.481904  4161 tablet_bootstrap.cc:654] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.472067  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8eecd98f04495f9ed7470925ed9487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.500226  4037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7454fcd1f54b6eb01038eb8ecb273c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.503602  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 450ecd71cd99442cb269ac276ec3d83e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.504462  4105 tablet_service.cc:1511] Processing CreateTablet for tablet 17894d3c75534c379dd3bb78bf4eea00 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:15:33.505762  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17894d3c75534c379dd3bb78bf4eea00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.508241  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 9b8eecd98f04495f9ed7470925ed9487 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:15:33.509245  4072 heartbeater.cc:499] Master 127.2.200.254:44439 was elected leader, sending a full tablet report...
I20260709 13:15:33.509826  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8eecd98f04495f9ed7470925ed9487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.510910  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31345ac12b54b42b93f8e1e71274615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.513037  4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1be06cbb19234936aabe0a7128358755. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.515296  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b6631af674e838a0accf36c31749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.517895  4163 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:33.518653  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf62b06bdd54048a2cc215663a17a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.518391  4111 tablet_service.cc:1511] Processing CreateTablet for tablet ff7454fcd1f54b6eb01038eb8ecb273c (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:15:33.519568  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff7454fcd1f54b6eb01038eb8ecb273c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.520402  3956 tablet_service.cc:1511] Processing CreateTablet for tablet f8e3b561578040338afbbb292ee9e4b7 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:33.526085  4163 tablet_bootstrap.cc:654] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.528779  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f289732f2a4c498b8d722dbadc5721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.529234  4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f289732f2a4c498b8d722dbadc5721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.533046  3958 tablet_service.cc:1511] Processing CreateTablet for tablet e61a3a06f437423cad355c7951a460bc (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:33.534958  4162 ts_tablet_manager.cc:1434] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.083s	user 0.005s	sys 0.011s
I20260709 13:15:33.535979  4162 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:33.541051  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99c13fc3b7f4e2687824e0a5911512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.532409  4108 tablet_service.cc:1511] Processing CreateTablet for tablet e32744704d014399851a0661c8929ded (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:15:33.545300  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd2df3c22d48b1b21bf6951d14bc61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.551348  4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a83d90df1f344e4bcaf5128f021d5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.552156  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fa935c4d84e7fbb1e5dc631ce3711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.548592  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6112c480d954932a8aa350e7919f25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.561376  3958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61a3a06f437423cad355c7951a460bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.564491  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3b561578040338afbbb292ee9e4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.583407  4104 tablet_service.cc:1511] Processing CreateTablet for tablet a389492bb09a4483ad432f0b945c7a61 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:15:33.587225  3957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90b568035464cd5a8006c0d5876087d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.589211  3959 tablet_service.cc:1511] Processing CreateTablet for tablet b759a28e523c491c941636a30d249939 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:33.591421  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b759a28e523c491c941636a30d249939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.608394  4161 tablet_bootstrap.cc:492] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:33.608990  4161 ts_tablet_manager.cc:1403] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.180s	user 0.011s	sys 0.004s
I20260709 13:15:33.611999  4161 raft_consensus.cc:359] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.612689  4161 raft_consensus.cc:385] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.612996  4161 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.613807  4161 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.618355  4029 tablet_service.cc:1511] Processing CreateTablet for tablet d99c13fc3b7f4e2687824e0a5911512a (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:33.619553  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99c13fc3b7f4e2687824e0a5911512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.627522  4169 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.608474  4032 tablet_service.cc:1511] Processing CreateTablet for tablet 397fa935c4d84e7fbb1e5dc631ce3711 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:33.628019  4169 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.628664  4032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fa935c4d84e7fbb1e5dc631ce3711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.629930  4033 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd2df3c22d48b1b21bf6951d14bc61 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:33.631119  4033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd2df3c22d48b1b21bf6951d14bc61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.596854  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32744704d014399851a0661c8929ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.616334  4036 tablet_service.cc:1511] Processing CreateTablet for tablet c90b568035464cd5a8006c0d5876087d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:33.632303  4169 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:33.640936  4161 ts_tablet_manager.cc:1434] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:15:33.655823  4161 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:33.661405  3955 tablet_service.cc:1511] Processing CreateTablet for tablet c6a714afc3c644f991d9a9aa8e5be0c1 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:33.634433  3961 tablet_service.cc:1511] Processing CreateTablet for tablet 591ff6c19f7a4eb5b62c1a1043659414 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:33.669777  4163 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:33.670475  4163 ts_tablet_manager.cc:1403] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.153s	user 0.019s	sys 0.010s
I20260709 13:15:33.673394  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:33.675266  4036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90b568035464cd5a8006c0d5876087d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.680888  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a714afc3c644f991d9a9aa8e5be0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.684751  4030 tablet_service.cc:1511] Processing CreateTablet for tablet e61a3a06f437423cad355c7951a460bc (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:33.686476  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591ff6c19f7a4eb5b62c1a1043659414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.686993  4163 raft_consensus.cc:359] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.687803  4163 raft_consensus.cc:385] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.688143  4163 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.688967  4163 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.690091  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a389492bb09a4483ad432f0b945c7a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.694047  4029 tablet_service.cc:1511] Processing CreateTablet for tablet b759a28e523c491c941636a30d249939 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:33.712920  4034 tablet_service.cc:1511] Processing CreateTablet for tablet f8e3b561578040338afbbb292ee9e4b7 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:33.698400  4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61a3a06f437423cad355c7951a460bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.699348  3953 tablet_service.cc:1511] Processing CreateTablet for tablet cf4967e9db3b4158acf225267ad19344 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:33.700147  4037 tablet_service.cc:1511] Processing CreateTablet for tablet 591ff6c19f7a4eb5b62c1a1043659414 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:33.702873  4162 tablet_bootstrap.cc:654] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:33.681949  3937 leader_election.cc:343] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.712482  3960 tablet_service.cc:1511] Processing CreateTablet for tablet ca8ba08e728f473582080f90e4e45db9 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:33.719465  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3b561578040338afbbb292ee9e4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.719658  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8ba08e728f473582080f90e4e45db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.723758  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:33.726377  4037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591ff6c19f7a4eb5b62c1a1043659414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.729151  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b759a28e523c491c941636a30d249939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.734516  4110 tablet_service.cc:1511] Processing CreateTablet for tablet 6ef4e92169eb4f9e9b2217d164131a56 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:15:33.735805  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ef4e92169eb4f9e9b2217d164131a56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.735524  4106 tablet_service.cc:1511] Processing CreateTablet for tablet f6112c480d954932a8aa350e7919f25d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:15:33.736726  4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6112c480d954932a8aa350e7919f25d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.749774  4031 tablet_service.cc:1511] Processing CreateTablet for tablet cf4967e9db3b4158acf225267ad19344 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:33.751029  4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4967e9db3b4158acf225267ad19344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.752535  4111 tablet_service.cc:1511] Processing CreateTablet for tablet 397fa935c4d84e7fbb1e5dc631ce3711 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:15:33.753875  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fa935c4d84e7fbb1e5dc631ce3711. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:33.758814  3937 leader_election.cc:343] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.759724  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:33.761413  4168 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.758850  4105 tablet_service.cc:1511] Processing CreateTablet for tablet e1f289732f2a4c498b8d722dbadc5721 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:15:33.765910  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f289732f2a4c498b8d722dbadc5721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.772275  4168 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.772951  4168 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.775224  4168 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:33.776726  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:33.778589  3937 leader_election.cc:343] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.778848  4107 tablet_service.cc:1511] Processing CreateTablet for tablet c90b568035464cd5a8006c0d5876087d (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:15:33.779614  4103 tablet_service.cc:1511] Processing CreateTablet for tablet d99c13fc3b7f4e2687824e0a5911512a (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:15:33.780107  4163 ts_tablet_manager.cc:1434] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.109s	user 0.006s	sys 0.000s
I20260709 13:15:33.780220  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c90b568035464cd5a8006c0d5876087d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.781136  4163 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:33.781876  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:33.783337  4086 leader_election.cc:343] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.790184  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:33.791392  3937 leader_election.cc:343] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.791802  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:33.792992  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4967e9db3b4158acf225267ad19344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.793207  4168 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.747960  4161 tablet_bootstrap.cc:654] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.799077  3958 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2ae4b33244245aaa1efb074fadddf (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:33.803174  3962 tablet_service.cc:1511] Processing CreateTablet for tablet 03c57dfd62654a78a41a253899d8f909 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:33.811537  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c57dfd62654a78a41a253899d8f909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.814097  4102 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd2df3c22d48b1b21bf6951d14bc61 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:15:33.803006  4109 tablet_service.cc:1511] Processing CreateTablet for tablet e61a3a06f437423cad355c7951a460bc (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:15:33.820901  4163 tablet_bootstrap.cc:654] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:33.826880  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:33.827346  4035 tablet_service.cc:1511] Processing CreateTablet for tablet c6a714afc3c644f991d9a9aa8e5be0c1 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:15:33.828446  4085 leader_election.cc:343] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:33.828933  4085 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:33.830081  4169 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:33.830588  3956 tablet_service.cc:1511] Processing CreateTablet for tablet c01d887181724ddca1d1982ca3ad050f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:33.831776  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01d887181724ddca1d1982ca3ad050f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.833967  3957 tablet_service.cc:1511] Processing CreateTablet for tablet d8048c0ac04c4be68d870fbac077eb4a (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:33.828572  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a714afc3c644f991d9a9aa8e5be0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.836639  4033 tablet_service.cc:1511] Processing CreateTablet for tablet f21aeb9fd3a643048c424b1d243ad8ba (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:33.796432  3954 tablet_service.cc:1511] Processing CreateTablet for tablet f21aeb9fd3a643048c424b1d243ad8ba (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:33.845278  4106 tablet_service.cc:1511] Processing CreateTablet for tablet f8e3b561578040338afbbb292ee9e4b7 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:15:33.838382  4028 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2ae4b33244245aaa1efb074fadddf (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:33.848915  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2ae4b33244245aaa1efb074fadddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.850683  4033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21aeb9fd3a643048c424b1d243ad8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.835318  3957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8048c0ac04c4be68d870fbac077eb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.853093  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21aeb9fd3a643048c424b1d243ad8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.839411  3959 tablet_service.cc:1511] Processing CreateTablet for tablet 08c710fdf5ab4acda53986eba38f08dd (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:33.843138  3955 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7bedca9d544f8992960c04a55f9233 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:33.844457  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61a3a06f437423cad355c7951a460bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.859228  3958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2ae4b33244245aaa1efb074fadddf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.861917  4104 tablet_service.cc:1511] Processing CreateTablet for tablet b759a28e523c491c941636a30d249939 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:15:33.865092  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd2df3c22d48b1b21bf6951d14bc61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.870714  4036 tablet_service.cc:1511] Processing CreateTablet for tablet 03c57dfd62654a78a41a253899d8f909 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:33.872052  4036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c57dfd62654a78a41a253899d8f909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.873353  4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3b561578040338afbbb292ee9e4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.885069  4170 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:33.885576  4170 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:33.886087  3953 tablet_service.cc:1511] Processing CreateTablet for tablet 237eb348003645f7abcc1c18bd324690 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:33.887471  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237eb348003645f7abcc1c18bd324690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.888908  4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99c13fc3b7f4e2687824e0a5911512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.889643  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b759a28e523c491c941636a30d249939. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.892180  4162 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:33.892683  4162 ts_tablet_manager.cc:1403] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.357s	user 0.010s	sys 0.012s
I20260709 13:15:33.893596  4170 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:33.896692  4029 tablet_service.cc:1511] Processing CreateTablet for tablet 1d07f106b6d347c6bb068bd5140bc810 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:33.898629  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d07f106b6d347c6bb068bd5140bc810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.899474  4162 raft_consensus.cc:359] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:33.900239  4162 raft_consensus.cc:385] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:33.901084  4034 tablet_service.cc:1511] Processing CreateTablet for tablet ca8ba08e728f473582080f90e4e45db9 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:33.902369  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8ba08e728f473582080f90e4e45db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.908149  4037 tablet_service.cc:1511] Processing CreateTablet for tablet 08c710fdf5ab4acda53986eba38f08dd (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:33.900537  4162 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:33.925616  4111 tablet_service.cc:1511] Processing CreateTablet for tablet 591ff6c19f7a4eb5b62c1a1043659414 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:15:33.926422  4037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c710fdf5ab4acda53986eba38f08dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.926330  4162 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:33.927017  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 591ff6c19f7a4eb5b62c1a1043659414. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.928068  4032 tablet_service.cc:1511] Processing CreateTablet for tablet c01d887181724ddca1d1982ca3ad050f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:33.929307  4032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01d887181724ddca1d1982ca3ad050f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.930230  4162 ts_tablet_manager.cc:1434] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:15:33.918861  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7bedca9d544f8992960c04a55f9233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.918000  3961 tablet_service.cc:1511] Processing CreateTablet for tablet 8a36ac8ab5384748b125e964d94793fd (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:33.920797  4163 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:33.941231  3962 tablet_service.cc:1511] Processing CreateTablet for tablet 8494aa7ed7a6427dbfb02b4753609e41 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:33.947211  4028 tablet_service.cc:1511] Processing CreateTablet for tablet d8048c0ac04c4be68d870fbac077eb4a (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:33.949748  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8048c0ac04c4be68d870fbac077eb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.950129  4163 ts_tablet_manager.cc:1403] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.169s	user 0.024s	sys 0.010s
I20260709 13:15:33.953310  3959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c710fdf5ab4acda53986eba38f08dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.876787  3960 tablet_service.cc:1511] Processing CreateTablet for tablet 1d07f106b6d347c6bb068bd5140bc810 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:33.962622  3960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d07f106b6d347c6bb068bd5140bc810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.963418  3957 tablet_service.cc:1511] Processing CreateTablet for tablet 42df9a30a23e4bd581e33127f2204a0b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:33.964591  3957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42df9a30a23e4bd581e33127f2204a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.983099  3962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8494aa7ed7a6427dbfb02b4753609e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.985229  4162 tablet_bootstrap.cc:492] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:33.985630  4110 tablet_service.cc:1511] Processing CreateTablet for tablet cf4967e9db3b4158acf225267ad19344 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:15:33.986985  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4967e9db3b4158acf225267ad19344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.994997  4161 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:33.995054  4030 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7bedca9d544f8992960c04a55f9233 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:33.995579  4161 ts_tablet_manager.cc:1403] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.340s	user 0.011s	sys 0.016s
I20260709 13:15:33.995236  4108 tablet_service.cc:1511] Processing CreateTablet for tablet ca8ba08e728f473582080f90e4e45db9 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:15:33.996327  4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7bedca9d544f8992960c04a55f9233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.996984  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca8ba08e728f473582080f90e4e45db9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:33.997763  4105 tablet_service.cc:1511] Processing CreateTablet for tablet f21aeb9fd3a643048c424b1d243ad8ba (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:15:34.017539  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f21aeb9fd3a643048c424b1d243ad8ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.017886  4109 tablet_service.cc:1511] Processing CreateTablet for tablet 03c57dfd62654a78a41a253899d8f909 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:15:34.019047  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c57dfd62654a78a41a253899d8f909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.026139  4104 tablet_service.cc:1511] Processing CreateTablet for tablet 1d07f106b6d347c6bb068bd5140bc810 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:15:34.027354  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d07f106b6d347c6bb068bd5140bc810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.027532  4034 tablet_service.cc:1511] Processing CreateTablet for tablet 237eb348003645f7abcc1c18bd324690 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:34.033499  4033 tablet_service.cc:1511] Processing CreateTablet for tablet 8a36ac8ab5384748b125e964d94793fd (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:34.001148  4103 tablet_service.cc:1511] Processing CreateTablet for tablet c6a714afc3c644f991d9a9aa8e5be0c1 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:15:34.036139  4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a714afc3c644f991d9a9aa8e5be0c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.001281  4035 tablet_service.cc:1511] Processing CreateTablet for tablet 8494aa7ed7a6427dbfb02b4753609e41 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:15:34.028645  4034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237eb348003645f7abcc1c18bd324690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.040524  4035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8494aa7ed7a6427dbfb02b4753609e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.008286  4161 raft_consensus.cc:359] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.040989  4161 raft_consensus.cc:385] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.041309  4161 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.010375  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.011503  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 36d2ae4b33244245aaa1efb074fadddf (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:15:34.012332  3961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a36ac8ab5384748b125e964d94793fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.043030  3958 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 48) took 1034 ms. Trace:
I20260709 13:15:34.034758  4029 tablet_service.cc:1511] Processing CreateTablet for tablet 42df9a30a23e4bd581e33127f2204a0b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:33.998384  4163 raft_consensus.cc:359] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.042807  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d2ae4b33244245aaa1efb074fadddf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:34.043460  4012 leader_election.cc:343] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.006479  4162 tablet_bootstrap.cc:654] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.044404  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42df9a30a23e4bd581e33127f2204a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.045641  4163 raft_consensus.cc:385] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.045979  4163 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.047771  4163 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.036273  4111 tablet_service.cc:1511] Processing CreateTablet for tablet d8048c0ac04c4be68d870fbac077eb4a (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:15:34.049969  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8048c0ac04c4be68d870fbac077eb4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.043473  3958 rpcz_store.cc:276] 0709 13:15:33.009068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.797271 (+788203us) service_pool.cc:224] Handling call
0709 13:15:33.837140 (+ 39869us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.837232 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:33.926907 (+ 89675us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:33.994652 (+ 67745us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.042972 (+ 48320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.066187  4033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a36ac8ab5384748b125e964d94793fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.033757  4102 tablet_service.cc:1511] Processing CreateTablet for tablet c01d887181724ddca1d1982ca3ad050f (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:15:34.075481  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c01d887181724ddca1d1982ca3ad050f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:15:34.091596  3856 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44895.2us
I20260709 13:15:34.092726  4161 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.102136  4161 ts_tablet_manager.cc:1434] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.106s	user 0.020s	sys 0.006s
I20260709 13:15:34.121202  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.121876  4163 ts_tablet_manager.cc:1434] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.169s	user 0.009s	sys 0.002s
W20260709 13:15:34.122865  4011 leader_election.cc:343] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.123302  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:34.124361  4170 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.125448  4161 tablet_bootstrap.cc:492] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.128948  4163 tablet_bootstrap.cc:492] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.142609  4161 tablet_bootstrap.cc:654] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.144568  4169 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.145150  4169 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.148859  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.149808  4169 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:34.151322  4086 leader_election.cc:343] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.151350  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:34.152851  4085 leader_election.cc:343] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.153282  4085 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.154138  4161 tablet_bootstrap.cc:492] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.154577  4161 ts_tablet_manager.cc:1403] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.007s
I20260709 13:15:34.154620  4169 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.157452  4161 raft_consensus.cc:359] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.158107  4161 raft_consensus.cc:385] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.158396  4161 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.159283  4161 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.161818  4106 tablet_service.cc:1511] Processing CreateTablet for tablet 2e7bedca9d544f8992960c04a55f9233 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:15:34.163036  4106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7bedca9d544f8992960c04a55f9233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.167903  4161 ts_tablet_manager.cc:1434] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 13:15:34.168321  3960 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 50) took 1150 ms. Trace:
I20260709 13:15:34.168670  3960 rpcz_store.cc:276] 0709 13:15:33.017657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.826773 (+809116us) service_pool.cc:224] Handling call
0709 13:15:33.962172 (+135399us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.962267 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:34.096671 (+134404us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:34.167893 (+ 71222us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.168270 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208576}
I20260709 13:15:34.174918  4161 tablet_bootstrap.cc:492] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.177842  4109 tablet_service.cc:1511] Processing CreateTablet for tablet 237eb348003645f7abcc1c18bd324690 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:15:34.181589  4161 tablet_bootstrap.cc:654] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.182204  3962 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 55) took 1032 ms. Trace:
I20260709 13:15:34.182360  3961 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 57) took 1010 ms. Trace:
I20260709 13:15:34.182777  4162 tablet_bootstrap.cc:492] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.183254  4162 ts_tablet_manager.cc:1403] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.198s	user 0.013s	sys 0.004s
I20260709 13:15:34.186275  4162 raft_consensus.cc:359] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.187475  4162 raft_consensus.cc:385] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.158401  3953 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 56) took 1008 ms. Trace:
I20260709 13:15:34.187736  3955 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 54) took 1049 ms. Trace:
I20260709 13:15:34.188206  3953 rpcz_store.cc:276] 0709 13:15:33.150243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.885082 (+734839us) service_pool.cc:224] Handling call
0709 13:15:33.887038 (+  1956us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.887128 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:34.038856 (+151728us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:34.157932 (+119076us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.158334 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.188365  3955 rpcz_store.cc:276] 0709 13:15:33.138305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.842315 (+704010us) service_pool.cc:224] Handling call
0709 13:15:33.867704 (+ 25389us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.877746 (+ 10042us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:34.004738 (+126992us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:34.187188 (+182450us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.187681 (+   493us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.192617  4161 tablet_bootstrap.cc:492] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.193084  4161 ts_tablet_manager.cc:1403] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:15:34.193897  3956 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45584 (request call id 51) took 1172 ms. Trace:
I20260709 13:15:34.195874  4161 raft_consensus.cc:359] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.196561  4161 raft_consensus.cc:385] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.197109  4161 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.196962  4111 tablet_service.cc:1511] Processing CreateTablet for tablet 08c710fdf5ab4acda53986eba38f08dd (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:15:34.182776  3961 rpcz_store.cc:276] 0709 13:15:33.171761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.917100 (+745339us) service_pool.cc:224] Handling call
0709 13:15:34.011404 (+ 94304us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:34.011737 (+   333us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:34.161182 (+149445us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:34.181904 (+ 20722us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.182306 (+   402us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.198055  4162 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.198529  4161 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.198877  4162 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.197126  4109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237eb348003645f7abcc1c18bd324690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.205391  4161 ts_tablet_manager.cc:1434] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:15:34.199132  4110 tablet_service.cc:1511] Processing CreateTablet for tablet 8494aa7ed7a6427dbfb02b4753609e41 (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:15:34.209192  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:34.206749  4161 tablet_bootstrap.cc:492] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.210167  4163 tablet_bootstrap.cc:654] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.210690  4110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8494aa7ed7a6427dbfb02b4753609e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.215924  4161 tablet_bootstrap.cc:654] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.218230  4107 tablet_service.cc:1511] Processing CreateTablet for tablet 42df9a30a23e4bd581e33127f2204a0b (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:15:34.219254  4162 ts_tablet_manager.cc:1434] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:15:34.218225  4111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08c710fdf5ab4acda53986eba38f08dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.204985  4108 tablet_service.cc:1511] Processing CreateTablet for tablet 8a36ac8ab5384748b125e964d94793fd (DEFAULT_TABLE table=test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:15:34.182585  3962 rpcz_store.cc:276] 0709 13:15:33.149930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.865981 (+716051us) service_pool.cc:224] Handling call
0709 13:15:33.981785 (+115804us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.982736 (+   951us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:34.031651 (+ 48915us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:34.181758 (+150107us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.182149 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.194248  3956 rpcz_store.cc:276] 0709 13:15:33.021905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.829729 (+807824us) service_pool.cc:224] Handling call
0709 13:15:33.831354 (+  1625us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.831449 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:34.014787 (+183338us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:34.193476 (+178689us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:34.193845 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:34.222605  4108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a36ac8ab5384748b125e964d94793fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.239321  4163 tablet_bootstrap.cc:492] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.239809  4163 ts_tablet_manager.cc:1403] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.000s
I20260709 13:15:34.233219  4162 tablet_bootstrap.cc:492] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.255331  4163 raft_consensus.cc:359] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.256047  4163 raft_consensus.cc:385] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.256392  4163 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.257982  4162 tablet_bootstrap.cc:654] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.259544  4107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42df9a30a23e4bd581e33127f2204a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:34.269037  4163 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.271588  4161 tablet_bootstrap.cc:492] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.272305  4161 ts_tablet_manager.cc:1403] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.066s	user 0.026s	sys 0.033s
I20260709 13:15:34.275432  4163 ts_tablet_manager.cc:1434] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:15:34.275177  4161 raft_consensus.cc:359] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.275868  4161 raft_consensus.cc:385] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.276165  4161 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.276507  4163 tablet_bootstrap.cc:492] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.276990  4161 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.282859  4163 tablet_bootstrap.cc:654] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.284528  4161 ts_tablet_manager.cc:1434] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:15:34.285575  4161 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.292192  4162 tablet_bootstrap.cc:492] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.292856  4162 ts_tablet_manager.cc:1403] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.011s
I20260709 13:15:34.294171  4161 tablet_bootstrap.cc:654] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.296226  4162 raft_consensus.cc:359] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.297060  4162 raft_consensus.cc:385] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.297398  4162 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.298346  4162 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.300486  4162 ts_tablet_manager.cc:1434] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:15:34.301494  4162 tablet_bootstrap.cc:492] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.306468  4161 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.306967  4161 ts_tablet_manager.cc:1403] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:15:34.308895  4162 tablet_bootstrap.cc:654] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.309707  4161 raft_consensus.cc:359] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.310415  4161 raft_consensus.cc:385] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.310705  4161 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.311563  4161 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.315047  4161 ts_tablet_manager.cc:1434] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.002s
I20260709 13:15:34.317480  4161 tablet_bootstrap.cc:492] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.318423  4162 tablet_bootstrap.cc:492] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.318946  4162 ts_tablet_manager.cc:1403] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:15:34.320785  4163 tablet_bootstrap.cc:492] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.321272  4163 ts_tablet_manager.cc:1403] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.019s
I20260709 13:15:34.321904  4162 raft_consensus.cc:359] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.322635  4162 raft_consensus.cc:385] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.322983  4162 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.323465  4161 tablet_bootstrap.cc:654] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.323904  4162 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.324043  4163 raft_consensus.cc:359] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.324831  4163 raft_consensus.cc:385] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.325132  4163 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.325824  4163 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.328662  4162 ts_tablet_manager.cc:1434] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:34.329784  4162 tablet_bootstrap.cc:492] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.334257  4161 tablet_bootstrap.cc:492] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.334717  4161 ts_tablet_manager.cc:1403] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.001s
I20260709 13:15:34.336112  4162 tablet_bootstrap.cc:654] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.336431  4163 ts_tablet_manager.cc:1434] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:34.337440  4163 tablet_bootstrap.cc:492] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.337441  4161 raft_consensus.cc:359] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.338238  4161 raft_consensus.cc:385] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.338481  4161 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.339375  4161 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.341504  4161 ts_tablet_manager.cc:1434] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:15:34.342351  4161 tablet_bootstrap.cc:492] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.343844  4163 tablet_bootstrap.cc:654] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.347626  4161 tablet_bootstrap.cc:654] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.355172  4163 tablet_bootstrap.cc:492] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.355264  4161 tablet_bootstrap.cc:492] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.355695  4163 ts_tablet_manager.cc:1403] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.008s
I20260709 13:15:34.355759  4161 ts_tablet_manager.cc:1403] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.009s
I20260709 13:15:34.358369  4161 raft_consensus.cc:359] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.358609  4163 raft_consensus.cc:359] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.359035  4161 raft_consensus.cc:385] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.359229  4163 raft_consensus.cc:385] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.359241  4162 tablet_bootstrap.cc:492] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.359328  4161 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.359652  4163 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.359958  4162 ts_tablet_manager.cc:1403] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.009s
I20260709 13:15:34.360219  4161 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.360347  4163 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.362167  4161 ts_tablet_manager.cc:1434] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:34.363233  4161 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.363260  4162 raft_consensus.cc:359] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.364174  4162 raft_consensus.cc:385] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.364452  4162 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.365458  4162 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.368250  4168 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.368448  4161 tablet_bootstrap.cc:654] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.368719  4168 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.370044  4162 ts_tablet_manager.cc:1434] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:15:34.370705  4168 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.371022  4162 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.373063  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.373724  4047 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:34.374755  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.377434  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.378849  4168 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.379361  4161 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.379251  4168 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.379784  4161 ts_tablet_manager.cc:1403] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 13:15:34.381522  4168 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.382326  4161 raft_consensus.cc:359] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.382927  4161 raft_consensus.cc:385] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.383162  4161 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
W20260709 13:15:34.383951  3937 leader_election.cc:343] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.384143  4161 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.385268  4168 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.385663  4168 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.385962  4168 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.385857  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.386076  4161 ts_tablet_manager.cc:1434] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:34.386493  4121 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:34.387281  4161 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.387713  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.377650  4162 tablet_bootstrap.cc:654] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.388309  4199 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.388731  4199 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:34.389062  3937 leader_election.cc:343] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.389715  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.390699  4199 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.391172  4199 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.391714  4199 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.393632  4199 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.394107  4199 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.394411  4199 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.394707  4199 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.397578  4168 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.399565  4168 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.400209  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.401547  4161 tablet_bootstrap.cc:654] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.401607  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.391234  4163 ts_tablet_manager.cc:1434] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:15:34.404032  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.404578  4047 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:34.404985  4163 tablet_bootstrap.cc:492] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.409675  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.411193  4163 tablet_bootstrap.cc:654] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.411078  4199 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.412324  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:34.412889  4047 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.413550  4161 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.413692  4162 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.414039  4161 ts_tablet_manager.cc:1403] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.001s
I20260709 13:15:34.414103  4162 ts_tablet_manager.cc:1403] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.010s
I20260709 13:15:34.416745  4161 raft_consensus.cc:359] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.417025  4162 raft_consensus.cc:359] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.417516  4161 raft_consensus.cc:385] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.417749  4162 raft_consensus.cc:385] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.417881  4161 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.418135  4162 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.418767  4161 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.418851  4162 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.420846  4161 ts_tablet_manager.cc:1434] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:34.422039  4161 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.422266  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:15:34.423748  3937 leader_election.cc:343] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.424606  3937 leader_election.cc:343] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.425288  3937 leader_election.cc:343] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.426100  3937 leader_election.cc:343] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.426626  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.420796  4047 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:34.428238  4161 tablet_bootstrap.cc:654] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.428369  4168 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.429733  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:34.430529  4168 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.430887  4168 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.431213  4168 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.438308  4168 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.440358  4168 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.441434  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:34.443463  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:34.444052  4047 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.444279  4162 ts_tablet_manager.cc:1434] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:15:34.446841  4162 tablet_bootstrap.cc:492] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.453051  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.462997  4161 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.458323  4162 tablet_bootstrap.cc:654] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.451683  4168 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.445662  4199 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.463882  4168 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:15:34.464057  3937 leader_election.cc:343] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.460316  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:34.451185  4047 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
W20260709 13:15:34.465420  3937 leader_election.cc:343] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.464699  4168 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.466104  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:34.462316  4163 tablet_bootstrap.cc:492] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.462489  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.466866  4199 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.467240  4120 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.467397  4199 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:34.468333  4199 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.463424  4161 ts_tablet_manager.cc:1403] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.010s
I20260709 13:15:34.474898  4120 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:34.476257  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.477227  4201 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.478739  4201 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:34.477205  4161 raft_consensus.cc:359] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.479491  4161 raft_consensus.cc:385] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.479576  4201 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.480110  4170 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.480186  4161 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.480619  4170 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.481609  4161 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.483678  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.484268  3972 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.484210  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.484683  4163 ts_tablet_manager.cc:1403] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.034s
I20260709 13:15:34.486176  4161 ts_tablet_manager.cc:1434] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
W20260709 13:15:34.486266  4012 leader_election.cc:343] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.482668  4170 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:15:34.487624  4170 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.488104  4170 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.488495  4161 tablet_bootstrap.cc:492] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.488526  4163 raft_consensus.cc:359] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.489568  4163 raft_consensus.cc:385] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.489429  4011 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:34.489874  4163 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.490568  4163 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.491204  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.491382  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.491765  4121 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.491971  3972 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.492655  4163 ts_tablet_manager.cc:1434] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:15:34.492991  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.493567  4163 tablet_bootstrap.cc:492] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.499536  4170 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.500602  4161 tablet_bootstrap.cc:654] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.500597  4170 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.501483  4170 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.501793  4170 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.506677  4211 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.507148  4211 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.507452  4211 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.511013  4162 tablet_bootstrap.cc:492] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.511463  4162 ts_tablet_manager.cc:1403] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.065s	user 0.018s	sys 0.005s
I20260709 13:15:34.514331  4163 tablet_bootstrap.cc:654] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.518847  4169 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.519327  4169 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.519572  4168 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.520097  4168 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.521143  4169 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.521854  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.522095  4168 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.522469  3972 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:34.521975  3870 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.524267  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.525043  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:15:34.525570  3937 leader_election.cc:343] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.524370  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.526336  4169 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.526208  4211 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.526770  4169 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.527132  4169 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.527405  4161 tablet_bootstrap.cc:492] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.527828  4161 ts_tablet_manager.cc:1403] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.040s	user 0.021s	sys 0.005s
I20260709 13:15:34.528733  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:15:34.529116  3937 leader_election.cc:343] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.529255  3972 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.529975  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.530483  4161 raft_consensus.cc:359] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.531128  4161 raft_consensus.cc:385] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.531157  4168 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.531502  4161 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.536008  3972 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.537321  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.538604  4210 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.539088  4169 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.541986  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:34.542105  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.542524  3972 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.542659  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:34.544627  4170 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.547932  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:34.545810  4162 raft_consensus.cc:359] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.548523  4162 raft_consensus.cc:385] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.548475  4047 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.548910  4162 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.549757  4162 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.546950  4169 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.551865  4161 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.554519  4161 ts_tablet_manager.cc:1434] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:15:34.555423  4161 tablet_bootstrap.cc:492] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.555740  4163 tablet_bootstrap.cc:492] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.556201  4163 ts_tablet_manager.cc:1403] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.005s
I20260709 13:15:34.559307  4163 raft_consensus.cc:359] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.559964  4163 raft_consensus.cc:385] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.560223  4163 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.551807  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.553166  4168 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.561338  4199 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.561515  4161 tablet_bootstrap.cc:654] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.561245  4168 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.561770  4199 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.563210  4168 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.564025  4163 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.563596  4199 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.552168  4210 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:34.566566  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.567836  4163 ts_tablet_manager.cc:1434] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 13:15:34.566699  4210 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.569784  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:34.570585  3937 leader_election.cc:343] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.570451  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:34.572048  3972 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:34.573532  4163 tablet_bootstrap.cc:492] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.575318  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:34.570691  4211 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.576133  4169 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.576232  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.566994  4170 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:15:34.572037  3971 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:34.572983  4012 leader_election.cc:343] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.570389  4120 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:34.582265  4162 ts_tablet_manager.cc:1434] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.071s	user 0.013s	sys 0.015s
I20260709 13:15:34.582999  4162 tablet_bootstrap.cc:492] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.577037  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.587678  4163 tablet_bootstrap.cc:654] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:34.588361  3937 leader_election.cc:343] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.588804  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.589573  4199 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.595592  4169 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:34.596482  4169 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.598028  3971 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.591378  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:34.590021  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:34.599661  4199 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:34.599844  3937 leader_election.cc:343] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.600067  4199 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.600394  4199 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.599736  4011 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:34.601778  4170 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.609380  4170 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:34.610189  4170 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.615965  4163 tablet_bootstrap.cc:492] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.616555  4163 ts_tablet_manager.cc:1403] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.001s
I20260709 13:15:34.616981  4162 tablet_bootstrap.cc:654] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.618150  4211 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.618592  4211 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.619207  4163 raft_consensus.cc:359] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.619796  4163 raft_consensus.cc:385] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.620127  4163 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.621654  4211 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.622413  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.622617  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.622866  4216 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.622555  4217 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.623090  3971 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.625747  4163 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.619427  4199 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.623051  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.623241  4120 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.628937  4121 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.633093  4163 ts_tablet_manager.cc:1434] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.007s
I20260709 13:15:34.633977  4163 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.630942  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.624846  4216 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.639549  4199 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.639992  4120 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.641399  4210 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.641556  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.641779  4210 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.642015  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.642176  3971 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.642663  4121 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.643530  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.642027  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:34.642128  4210 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:34.646171  3937 leader_election.cc:343] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.646826  4163 tablet_bootstrap.cc:654] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.647490  4170 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.625026  4217 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.647903  4170 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.649581  4170 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.651048  4121 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:34.652154  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.653275  4199 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.653971  4199 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:34.656090  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.656909  4047 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:34.654227  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.663628  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.664497  4218 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.667208  4170 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.671283  4210 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.653990  4217 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.673473  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:34.673614  4170 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.674662  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.679979  4121 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.680271  4210 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.671628  3869 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.675431  3971 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.679430  4218 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.681466  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.684496  4120 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.682077  4216 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.686910  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:34.687296  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.687474  3972 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.694233  3972 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.695627  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.697593  4216 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.698062  4216 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:34.698853  4216 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.708941  4120 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.712133  4121 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.713584  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.714732  4216 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.715293  4162 tablet_bootstrap.cc:492] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.715564  4216 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:34.715754  4162 ts_tablet_manager.cc:1403] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.012s
I20260709 13:15:34.716444  4216 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.714682  4199 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.717574  4161 tablet_bootstrap.cc:492] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.717996  4161 ts_tablet_manager.cc:1403] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.163s	user 0.010s	sys 0.002s
I20260709 13:15:34.719121  4162 raft_consensus.cc:359] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.719743  4162 raft_consensus.cc:385] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.719988  4162 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.719903  3971 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.720885  4162 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.720405  4161 raft_consensus.cc:359] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.722224  4161 raft_consensus.cc:385] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.722539  4161 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.722995  4162 ts_tablet_manager.cc:1434] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:15:34.723315  4161 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.724071  4162 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.725522  4161 ts_tablet_manager.cc:1434] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:34.726501  4161 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.732088  4161 tablet_bootstrap.cc:654] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.735191  4163 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.737414  4162 tablet_bootstrap.cc:654] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.737489  4163 ts_tablet_manager.cc:1403] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.006s
I20260709 13:15:34.740132  4163 raft_consensus.cc:359] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.740845  4163 raft_consensus.cc:385] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.741132  4163 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.741807  4163 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.744026  4163 ts_tablet_manager.cc:1434] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:34.745074  4163 tablet_bootstrap.cc:492] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.753849  4163 tablet_bootstrap.cc:654] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.798725  3867 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.801043  3867 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.806737  3867 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.817962  4162 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.817996  4161 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.818553  4162 ts_tablet_manager.cc:1403] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.046s
I20260709 13:15:34.818624  4161 ts_tablet_manager.cc:1403] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.000s
I20260709 13:15:34.820362  4163 tablet_bootstrap.cc:492] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.820808  4163 ts_tablet_manager.cc:1403] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.076s	user 0.037s	sys 0.024s
I20260709 13:15:34.821362  4162 raft_consensus.cc:359] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.822042  4162 raft_consensus.cc:385] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.821655  4161 raft_consensus.cc:359] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.822314  4162 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.822486  4161 raft_consensus.cc:385] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.822875  4161 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.823102  4162 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.823320  4163 raft_consensus.cc:359] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.823947  4163 raft_consensus.cc:385] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.823671  4161 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.824213  4163 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.825086  4162 ts_tablet_manager.cc:1434] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:34.825091  3870 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.826133  4162 tablet_bootstrap.cc:492] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.826387  4161 ts_tablet_manager.cc:1434] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:15:34.825088  4163 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.826853  3870 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:34.827332  4161 tablet_bootstrap.cc:492] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.828688  4163 ts_tablet_manager.cc:1434] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.004s
I20260709 13:15:34.829154  4199 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.830044  4163 tablet_bootstrap.cc:492] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.829710  4199 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.831843  4199 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.833372  4162 tablet_bootstrap.cc:654] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.834811  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.835644  4163 tablet_bootstrap.cc:654] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.836299  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.828644  3870 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:34.838354  3937 leader_election.cc:343] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:34.839068  3937 leader_election.cc:343] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.839433  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.840677  4199 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.843958  4163 tablet_bootstrap.cc:492] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:34.844874  4163 ts_tablet_manager.cc:1403] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:15:34.846306  4162 tablet_bootstrap.cc:492] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.847057  4162 ts_tablet_manager.cc:1403] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 13:15:34.847512  4163 raft_consensus.cc:359] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.848186  4163 raft_consensus.cc:385] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.848491  4163 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.849170  4163 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.849689  4161 tablet_bootstrap.cc:654] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.849953  4162 raft_consensus.cc:359] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.850589  4162 raft_consensus.cc:385] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.850764  4163 ts_tablet_manager.cc:1434] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:34.850905  4162 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.851783  4163 tablet_bootstrap.cc:492] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:34.851764  4162 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.854212  4162 ts_tablet_manager.cc:1434] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:15:34.855266  4162 tablet_bootstrap.cc:492] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:34.858460  3869 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:34.861464  4162 tablet_bootstrap.cc:654] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.862265  4216 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.862445  4218 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.862779  4216 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.863003  4218 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.865052  4216 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.868070  4217 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.868597  4217 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.870046  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.870689  4217 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.870658  4121 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.871727  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.872237  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.872303  4047 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:34.873760  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.874279  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.875144  4217 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.872927  3972 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:34.872704  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.875810  4217 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.877110  4217 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.876121  3971 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:34.880728  4216 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.881168  4216 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.881505  4216 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.886840  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.888147  4045 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:34.888311  4170 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.888861  4170 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:34.889604  3937 consensus_peers.cc:597] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:34.890334  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.891057  4161 tablet_bootstrap.cc:492] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:34.890941  3971 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:34.892136  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:34.892709  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.893075  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.893983  4169 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.894357  4169 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:34.894395  4012 leader_election.cc:343] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.894785  4169 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.894855  4168 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:34.895184  4011 leader_election.cc:343] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.895596  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:34.890882  4170 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.896091  4168 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.896941  4170 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:34.900467  4169 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.883699  4218 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.903882  4169 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.904600  4169 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.905045  4169 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } }
I20260709 13:15:34.891489  4161 ts_tablet_manager.cc:1403] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.000s
I20260709 13:15:34.913398  4163 tablet_bootstrap.cc:654] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.907555  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:34.908979  4161 raft_consensus.cc:359] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.933286  4161 raft_consensus.cc:385] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.933674  4161 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.910054  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.908495  4216 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.909091  4169 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:34.934813  4161 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.909811  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:34.944444  4216 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.907785  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:34.946908  4161 ts_tablet_manager.cc:1434] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.011s
I20260709 13:15:34.943308  3972 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:34.945019  4045 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.951473  4085 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:34.951660  4168 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:34.947826  4161 tablet_bootstrap.cc:492] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:34.947885  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:34.948863  3971 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.946866  4199 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.950264  4162 tablet_bootstrap.cc:492] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:34.955856  4162 ts_tablet_manager.cc:1403] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.011s
I20260709 13:15:34.955014  4199 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.957506  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:34.956471  4239 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.959065  4199 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:34.957521  3970 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:34.960095  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:34.963900  4046 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:34.965570  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:34.967489  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.968457  4199 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:34.968931  4199 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:34.970733  4199 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:34.972371  3937 leader_election.cc:343] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:34.984047  4161 tablet_bootstrap.cc:654] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:34.984555  3970 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:34.986076  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:34.986937  4216 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:34.987563  4216 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:34.988356  4216 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.989741  4162 raft_consensus.cc:359] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.990742  4162 raft_consensus.cc:385] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:34.991086  4162 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:34.994059  4240 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:34.994741  4240 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.998212  4162 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:34.999697  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:35.000370  4162 ts_tablet_manager.cc:1434] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:15:35.001950  4163 tablet_bootstrap.cc:492] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:35.002377  4163 ts_tablet_manager.cc:1403] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.151s	user 0.017s	sys 0.002s
I20260709 13:15:35.003690  4162 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:35.007759  4163 raft_consensus.cc:359] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.010106  4163 raft_consensus.cc:385] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.010368  4163 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.004293  4240 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:35.029002  4163 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.005074  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:35.009635  4045 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:35.035097  4200 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.035550  4200 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.037989  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:35.039407  4200 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.043254  4163 ts_tablet_manager.cc:1434] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.041s	user 0.010s	sys 0.013s
I20260709 13:15:35.044042  4163 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:35.012187  4217 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.046042  4119 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:35.048667  4169 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.050197  4121 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.053946  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:35.052460  4239 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.059026  4199 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.062284  4170 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.064272  4161 tablet_bootstrap.cc:492] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:35.064780  4161 ts_tablet_manager.cc:1403] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.028s
I20260709 13:15:35.047295  3971 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:35.047660  4240 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.073431  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:35.074331  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:35.077098  4046 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.077353  4199 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:35.079355  3937 leader_election.cc:343] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.078366  4240 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:35.090651  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:35.091289  4116 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.105162  4240 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.097401  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:35.107298  4119 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:35.110839  4210 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.112849  4210 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.114275  4169 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.115639  4163 tablet_bootstrap.cc:654] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.134505  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:35.135859  3972 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:35.146044  4161 raft_consensus.cc:359] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.146766  4161 raft_consensus.cc:385] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.147047  4161 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.147866  4161 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.150419  4161 ts_tablet_manager.cc:1434] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.085s	user 0.024s	sys 0.008s
I20260709 13:15:35.149348  4249 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:35.154772  3870 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.158821  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:35.160398  4200 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.160805  4200 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.161163  4200 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.161749  4046 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:35.160919  4201 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.168848  4217 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:35.168733  4210 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.171941  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:35.166088  4170 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:35.173446  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:35.175032  4217 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.175902  4161 tablet_bootstrap.cc:492] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:35.186084  4162 tablet_bootstrap.cc:654] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.186342  4116 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:35.190160  4170 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:35.191464  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:35.208663  4201 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.209216  4201 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:35.210103  4201 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.212656  4239 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.227519  4161 tablet_bootstrap.cc:654] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.212816  4170 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:15:35.243201  4200 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.245473  4200 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.245704  4163 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:35.246229  4163 ts_tablet_manager.cc:1403] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.202s	user 0.013s	sys 0.009s
I20260709 13:15:35.268949  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:35.271039  4116 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.271318  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:35.282397  3937 leader_election.cc:343] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:35.315061  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:35.282226  4116 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
W20260709 13:15:35.322166  4256 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:15:35.442497  4249 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:35.444471  4211 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.440434  4200 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.462080  4163 raft_consensus.cc:359] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.463246  4163 raft_consensus.cc:385] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.463924  4163 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
W20260709 13:15:35.440595  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74437.2us
I20260709 13:15:35.465776  4163 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.473402  4163 ts_tablet_manager.cc:1434] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.227s	user 0.014s	sys 0.013s
I20260709 13:15:35.474584  4162 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:35.475060  4162 ts_tablet_manager.cc:1403] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.472s	user 0.015s	sys 0.023s
W20260709 13:15:35.476313  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69884.4us
I20260709 13:15:35.477085  4275 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.478189  4275 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.478982  4161 tablet_bootstrap.cc:492] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:35.479415  4161 ts_tablet_manager.cc:1403] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.304s	user 0.032s	sys 0.003s
I20260709 13:15:35.480892  4163 tablet_bootstrap.cc:492] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:35.453027  4211 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.462639  4200 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.501080  4045 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.501425  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:35.502233  4211 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.503403  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:35.506675  4272 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 13:15:35.507114  4249 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.507563  4249 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:35.508353  4249 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.514529  4162 raft_consensus.cc:359] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.515308  4162 raft_consensus.cc:385] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.515612  4162 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.510967  4275 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.519858  4162 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.533593  3870 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.513605  4200 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.543918  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:35.544672  4162 ts_tablet_manager.cc:1434] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.003s
W20260709 13:15:35.545938  3937 leader_election.cc:343] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.546535  4047 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.546916  4200 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.545572  4162 tablet_bootstrap.cc:492] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:35.553610  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:35.563774  3937 leader_election.cc:343] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.564196  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:35.566550  4200 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.584195  4161 raft_consensus.cc:359] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.584936  4161 raft_consensus.cc:385] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.585217  4161 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.587561  4161 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.589613  4161 ts_tablet_manager.cc:1434] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.008s
I20260709 13:15:35.590517  4161 tablet_bootstrap.cc:492] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:35.590744  4163 tablet_bootstrap.cc:654] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.610823  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:35.619668  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:35.620922  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:35.623034  4200 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.627403  4162 tablet_bootstrap.cc:654] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.628059  4273 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:35.638904  4239 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:35.632287  4012 leader_election.cc:343] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.651082  3869 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.663197  4239 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.663546  4249 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:35.703281  4011 leader_election.cc:343] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.703868  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:35.705142  4163 tablet_bootstrap.cc:492] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:35.706096  4163 ts_tablet_manager.cc:1403] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.226s	user 0.033s	sys 0.060s
I20260709 13:15:35.706660  4273 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.705186  4161 tablet_bootstrap.cc:654] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.741789  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:35.741977  4163 raft_consensus.cc:359] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.742689  4163 raft_consensus.cc:385] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.742825  4276 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:35.742975  4163 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.743640  4163 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.746996  4163 ts_tablet_manager.cc:1434] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.041s	user 0.000s	sys 0.007s
I20260709 13:15:35.751965  4163 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:35.755982  4272 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:35.758028  4217 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.758500  4217 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.760461  4217 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:35.768436  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:35.769160  3968 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:35.772909  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:35.774288  4217 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.774710  4217 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.775030  4217 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.777140  3869 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.777637  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:35.779634  4086 leader_election.cc:343] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.807448  4163 tablet_bootstrap.cc:654] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.811108  4161 tablet_bootstrap.cc:492] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:35.811663  4161 ts_tablet_manager.cc:1403] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.221s	user 0.009s	sys 0.021s
I20260709 13:15:35.813654  4162 tablet_bootstrap.cc:492] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:35.814185  4162 ts_tablet_manager.cc:1403] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.269s	user 0.014s	sys 0.012s
I20260709 13:15:35.818704  4161 raft_consensus.cc:359] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.819423  4161 raft_consensus.cc:385] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.819685  4161 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.820338  4161 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.821843  4161 ts_tablet_manager.cc:1434] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:15:35.822676  4161 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:35.804713  4217 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.833470  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:35.834172  3969 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.835359  4162 raft_consensus.cc:359] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.836128  4162 raft_consensus.cc:385] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.836412  4162 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.839867  4161 tablet_bootstrap.cc:654] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.841926  4162 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.844184  4162 ts_tablet_manager.cc:1434] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:15:35.844604  4217 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:35.844856  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:35.845243  4162 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
W20260709 13:15:35.846436  4086 leader_election.cc:343] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.847034  4201 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.847512  4201 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.849905  4201 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.850628  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:35.853302  4046 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:35.856383  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:35.856488  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:35.857182  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:35.858496  4161 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:35.858937  4161 ts_tablet_manager.cc:1403] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.005s
I20260709 13:15:35.857241  4201 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.859457  4201 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.860102  4201 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.862390  3969 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:35.858862  4163 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:35.864277  4163 ts_tablet_manager.cc:1403] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.112s	user 0.007s	sys 0.012s
I20260709 13:15:35.865357  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:35.867302  4217 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.867240  4201 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.867257  4163 raft_consensus.cc:359] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.868037  4217 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:35.868244  4163 raft_consensus.cc:385] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.868660  4163 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.869494  4217 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.871009  4201 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.870435  4163 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.871742  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:35.871909  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:35.872720  4117 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.872900  4162 tablet_bootstrap.cc:654] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.872309  4046 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.873548  4163 ts_tablet_manager.cc:1434] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:15:35.875216  4163 tablet_bootstrap.cc:492] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:35.888042  4161 raft_consensus.cc:359] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.888976  4161 raft_consensus.cc:385] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.889562  4161 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.890311  4161 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.898164  4161 ts_tablet_manager.cc:1434] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.003s
I20260709 13:15:35.899318  4161 tablet_bootstrap.cc:492] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:35.904381  4117 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:35.904855  4163 tablet_bootstrap.cc:654] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.905660  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:35.906497  4201 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:35.907172  4201 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:35.905887  4046 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:35.909397  3869 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:35.912149  4162 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:35.911873  4201 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.912604  4162 ts_tablet_manager.cc:1403] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.068s	user 0.029s	sys 0.001s
I20260709 13:15:35.915141  4162 raft_consensus.cc:359] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.915773  4162 raft_consensus.cc:385] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.916041  4162 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.916811  4162 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.918296  4161 tablet_bootstrap.cc:654] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.918689  4162 ts_tablet_manager.cc:1434] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:35.919569  4162 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:35.922946  4163 tablet_bootstrap.cc:492] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:35.923436  4163 ts_tablet_manager.cc:1403] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.004s
I20260709 13:15:35.925802  4162 tablet_bootstrap.cc:654] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.925978  4163 raft_consensus.cc:359] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.926641  4163 raft_consensus.cc:385] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.927038  4163 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.928254  4163 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.931716  4163 ts_tablet_manager.cc:1434] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:15:35.933800  4163 tablet_bootstrap.cc:492] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:35.939917  4163 tablet_bootstrap.cc:654] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.943114  4201 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:35.946674  4161 tablet_bootstrap.cc:492] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:35.947244  4161 ts_tablet_manager.cc:1403] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 13:15:35.950997  4161 raft_consensus.cc:359] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.951665  4161 raft_consensus.cc:385] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.951943  4161 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.952742  4162 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:35.952973  4161 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.952926  3869 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:35.955436  4161 ts_tablet_manager.cc:1434] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:35.956456  4161 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:35.953655  4162 ts_tablet_manager.cc:1403] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.006s
I20260709 13:15:35.958325  4163 tablet_bootstrap.cc:492] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:35.958874  4163 ts_tablet_manager.cc:1403] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.025s	user 0.002s	sys 0.013s
I20260709 13:15:35.961433  4163 raft_consensus.cc:359] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.964177  4163 raft_consensus.cc:385] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.964263  4161 tablet_bootstrap.cc:654] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.964550  4163 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.965315  4163 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.965775  4162 raft_consensus.cc:359] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.966822  4162 raft_consensus.cc:385] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:35.967113  4162 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:35.967859  4272 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:35.967808  4162 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.968590  4272 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:35.970775  4272 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:35.971405  4162 ts_tablet_manager.cc:1434] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:15:35.967593  4163 ts_tablet_manager.cc:1434] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:35.972461  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:35.973764  4163 tablet_bootstrap.cc:492] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:35.974089  4162 tablet_bootstrap.cc:492] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:35.975395  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:35.978971  3937 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:15:35.979002  4012 leader_election.cc:343] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:35.980751  4162 tablet_bootstrap.cc:654] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.973644  3971 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:35.983438  4163 tablet_bootstrap.cc:654] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:35.983516  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:35.985385  4278 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:35.985754  4278 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:35.986083  4278 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:35.999892  4163 tablet_bootstrap.cc:492] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.000483  4163 ts_tablet_manager.cc:1403] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.005s
I20260709 13:15:36.003319  4163 raft_consensus.cc:359] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.004015  4163 raft_consensus.cc:385] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.004320  4163 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.005116  4163 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.007246  4163 ts_tablet_manager.cc:1434] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:36.008513  4163 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.005203  4278 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.014545  4163 tablet_bootstrap.cc:654] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.015045  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.015617  3971 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.016803  4201 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.017261  4201 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.019315  4201 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.021411  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.021844  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.022061  4117 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:36.022601  3971 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:15:36.023813  3937 leader_election.cc:343] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.024520  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.023813  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.025660  4201 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.026067  4201 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.026453  4201 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.027523  4161 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.028223  4272 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.028342  4161 ts_tablet_manager.cc:1403] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.010s
I20260709 13:15:36.028730  4272 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:36.029325  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:36.029904  4117 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.029809  4272 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.031219  4161 raft_consensus.cc:359] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.031951  4161 raft_consensus.cc:385] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.032205  4161 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.032904  4161 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.027828  4278 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.036379  4161 ts_tablet_manager.cc:1434] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:36.037286  4161 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.037344  4162 tablet_bootstrap.cc:492] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.037806  4162 ts_tablet_manager.cc:1403] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.064s	user 0.022s	sys 0.034s
I20260709 13:15:36.040288  4162 raft_consensus.cc:359] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.040983  4162 raft_consensus.cc:385] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.041270  4162 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.041900  4162 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.042661  4264 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.043118  4264 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.043736  4161 tablet_bootstrap.cc:654] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.045367  4264 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.045871  4217 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.046312  4217 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.046108  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.046983  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.048411  4162 ts_tablet_manager.cc:1434] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:36.048380  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:36.049258  4278 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.048477  4217 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.049904  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.050168  4162 tablet_bootstrap.cc:492] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.050554  4046 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.051668  4086 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.052471  4217 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.052845  4217 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.053190  4217 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.056191  4162 tablet_bootstrap.cc:654] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.050900  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.057242  3971 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.064009  4217 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.064201  4201 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.046947  4117 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:36.074234  4161 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.074623  4163 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.074754  4161 ts_tablet_manager.cc:1403] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 13:15:36.075196  4163 ts_tablet_manager.cc:1403] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.011s
I20260709 13:15:36.076555  4217 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.076853  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:36.078397  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.079028  3971 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:36.081133  3937 leader_election.cc:343] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.081991  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:36.082896  4046 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.082027  3868 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.088393  4201 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.092182  4163 raft_consensus.cc:359] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.092650  4161 raft_consensus.cc:359] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.093010  4163 raft_consensus.cc:385] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.093714  4161 raft_consensus.cc:385] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.093961  4163 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.094085  4161 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.094743  4163 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.094810  4161 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.096824  4163 ts_tablet_manager.cc:1434] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.005s
I20260709 13:15:36.099327  4163 tablet_bootstrap.cc:492] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.093660  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:36.101325  4117 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.104362  4161 ts_tablet_manager.cc:1434] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.005s
I20260709 13:15:36.104537  3971 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.104931  4201 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.105370  4201 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.105710  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:36.106527  4217 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.106971  4217 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:36.107295  4201 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.107736  4217 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.108987  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.111114  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.111707  4116 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
W20260709 13:15:36.113385  3937 leader_election.cc:343] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.114570  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.115592  4046 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.115828  4249 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.119406  4249 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.119798  4249 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.121717  4163 tablet_bootstrap.cc:654] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.121774  4162 tablet_bootstrap.cc:492] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.122292  4162 ts_tablet_manager.cc:1403] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.013s
I20260709 13:15:36.124832  4162 raft_consensus.cc:359] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.125463  4162 raft_consensus.cc:385] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.125707  4162 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.129834  4162 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.133316  4117 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:36.134711  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.135666  4201 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.136152  4201 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:36.136446  4162 ts_tablet_manager.cc:1434] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:15:36.137421  4162 tablet_bootstrap.cc:492] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.137039  4201 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.141497  4249 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.143481  4162 tablet_bootstrap.cc:654] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.129928  3868 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.147553  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:36.150287  3937 leader_election.cc:343] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.117847  4161 tablet_bootstrap.cc:492] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.156455  4249 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.158319  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:36.159200  4117 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.166471  4117 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:36.167205  4161 tablet_bootstrap.cc:654] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.167933  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.167944  3868 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.169049  4249 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.169742  4249 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:36.170666  4249 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.178453  4161 tablet_bootstrap.cc:492] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.178457  4163 tablet_bootstrap.cc:492] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.179077  4161 ts_tablet_manager.cc:1403] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 13:15:36.179131  4163 ts_tablet_manager.cc:1403] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.080s	user 0.032s	sys 0.010s
I20260709 13:15:36.183238  4163 raft_consensus.cc:359] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.184266  4161 raft_consensus.cc:359] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.188221  4163 raft_consensus.cc:385] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.184964  4162 tablet_bootstrap.cc:492] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.188551  4161 raft_consensus.cc:385] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.189023  4162 ts_tablet_manager.cc:1403] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.018s
I20260709 13:15:36.188972  4161 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.188647  4163 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.189090  3868 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.189831  4161 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.190352  4163 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.191826  4161 ts_tablet_manager.cc:1434] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:15:36.192711  4161 tablet_bootstrap.cc:492] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.192348  4162 raft_consensus.cc:359] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.193117  4162 raft_consensus.cc:385] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.193439  4162 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.194216  4162 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.195343  4163 ts_tablet_manager.cc:1434] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:36.196200  4163 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.199277  4161 tablet_bootstrap.cc:654] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.201540  4163 tablet_bootstrap.cc:654] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.205458  4162 ts_tablet_manager.cc:1434] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:36.206579  4162 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.209381  4163 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.209877  4163 ts_tablet_manager.cc:1403] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:15:36.215025  4161 tablet_bootstrap.cc:492] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.215477  4161 ts_tablet_manager.cc:1403] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 13:15:36.216104  4163 raft_consensus.cc:359] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.216735  4163 raft_consensus.cc:385] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.217008  4163 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.217628  4163 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.219332  4163 ts_tablet_manager.cc:1434] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:15:36.220170  4163 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.230525  4163 tablet_bootstrap.cc:654] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.230458  4201 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.231020  4201 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.231966  4161 raft_consensus.cc:359] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.232689  4161 raft_consensus.cc:385] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.232963  4161 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.233534  4161 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.233978  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.234313  4162 tablet_bootstrap.cc:654] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.235817  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.236893  4217 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.237389  4217 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.238235  4161 ts_tablet_manager.cc:1434] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
W20260709 13:15:36.237323  3937 leader_election.cc:343] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.239511  4161 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.241572  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.242092  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.242238  3971 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.242712  4046 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.243956  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.244866  4240 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.245246  4240 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.245584  4240 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:36.250006  3937 leader_election.cc:343] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.245038  4161 tablet_bootstrap.cc:654] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.254004  4218 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.254542  4218 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.258353  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.259065  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.259411  4161 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.259918  4161 ts_tablet_manager.cc:1403] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:15:36.260531  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:36.261523  4239 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.261886  4239 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.262207  4239 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.265625  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.262735  4161 raft_consensus.cc:359] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.267998  4161 raft_consensus.cc:385] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.268317  4161 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.269122  4161 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:36.272830  4086 leader_election.cc:343] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.239527  4217 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.234163  4201 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.256629  4218 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.250555  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.278591  4161 ts_tablet_manager.cc:1434] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:15:36.278541  4249 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.278982  4200 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.279593  4161 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.279508  4200 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.281777  4200 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.283494  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.284117  4046 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:36.284392  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.285247  4117 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:36.285308  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.286679  4249 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.287051  4249 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.287370  4249 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.291826  4240 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.295727  4249 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.299564  4239 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.301918  4161 tablet_bootstrap.cc:654] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.305570  4163 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.306028  4163 ts_tablet_manager.cc:1403] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.086s	user 0.053s	sys 0.022s
I20260709 13:15:36.306417  4239 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.307488  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:36.308177  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.308707  3971 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.309664  4163 raft_consensus.cc:359] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.310340  4163 raft_consensus.cc:385] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.310627  4163 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.310909  4249 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.311290  4163 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.312122  4162 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.312554  4162 ts_tablet_manager.cc:1403] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.106s	user 0.035s	sys 0.014s
I20260709 13:15:36.313002  4240 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.313598  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:36.314122  4163 ts_tablet_manager.cc:1434] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:36.315035  4163 tablet_bootstrap.cc:492] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.315407  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.315997  3969 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:36.316548  4086 leader_election.cc:343] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.320302  4249 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.320807  4249 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.322791  4249 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.323946  3969 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.324791  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.325261  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.314127  4117 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.316082  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:36.326354  3937 leader_election.cc:343] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.327121  4044 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:36.327454  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:36.328998  4162 raft_consensus.cc:359] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.329700  4162 raft_consensus.cc:385] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.329962  4162 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.330610  4162 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.333015  4162 ts_tablet_manager.cc:1434] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.000s
I20260709 13:15:36.333544  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:36.334481  4162 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.334803  4240 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.335273  4240 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:36.336054  4240 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.341147  4162 tablet_bootstrap.cc:654] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.343284  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:36.343833  4046 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.348202  4163 tablet_bootstrap.cc:654] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:36.348985  3937 leader_election.cc:343] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.349520  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.350680  4249 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.354339  4117 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:36.355597  4162 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.359352  4045 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.373871  3869 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.379041  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:36.381167  4249 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.381492  4162 ts_tablet_manager.cc:1403] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.007s
I20260709 13:15:36.381645  4249 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:36.382481  4249 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.391233  4162 raft_consensus.cc:359] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.391947  4162 raft_consensus.cc:385] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.391673  4201 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.392218  4162 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.393024  4162 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.396211  4162 ts_tablet_manager.cc:1434] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:15:36.403247  4240 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.403894  4240 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.406605  4239 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.407410  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.408717  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.409456  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.413293  4162 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.416456  4168 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.417240  4168 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.419600  4168 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.424163  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.424163  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:36.427062  3937 leader_election.cc:343] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.429031  4163 tablet_bootstrap.cc:492] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.429520  4163 ts_tablet_manager.cc:1403] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.115s	user 0.027s	sys 0.039s
I20260709 13:15:36.432410  4163 raft_consensus.cc:359] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.433065  4163 raft_consensus.cc:385] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.433339  4163 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.434281  4161 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.433965  4163 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.369652  4044 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.434743  4161 ts_tablet_manager.cc:1403] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.155s	user 0.053s	sys 0.054s
W20260709 13:15:36.409883  4086 leader_election.cc:343] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.437041  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.437351  4161 raft_consensus.cc:359] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.437983  4161 raft_consensus.cc:385] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.438076  4217 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.438262  4161 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.438511  4217 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.438879  4217 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.438941  4161 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.441428  4161 ts_tablet_manager.cc:1434] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:36.442303  4161 tablet_bootstrap.cc:492] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.369349  4047 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.448298  4161 tablet_bootstrap.cc:654] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.452701  4163 ts_tablet_manager.cc:1434] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:15:36.453009  4239 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.453913  4217 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.456743  4163 tablet_bootstrap.cc:492] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.457965  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.458534  3969 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.462694  4163 tablet_bootstrap.cc:654] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.465090  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.474216  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:15:36.465633  3937 leader_election.cc:343] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.475061  4163 tablet_bootstrap.cc:492] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.475072  4239 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.475206  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.360035  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.469776  4240 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.475870  4239 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:36.366017  4046 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:36.471930  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:36.476981  4239 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.472256  4217 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.475754  4163 ts_tablet_manager.cc:1403] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
W20260709 13:15:36.477689  4086 leader_election.cc:343] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.476444  4249 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.480075  4249 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.480540  4163 raft_consensus.cc:359] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.481181  4163 raft_consensus.cc:385] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.481424  4163 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.482034  4163 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.484014  4163 ts_tablet_manager.cc:1434] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:36.484920  4163 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.486917  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.487910  4218 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.488418  4218 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:36.489322  4218 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.493098  4240 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:36.466053  4162 tablet_bootstrap.cc:654] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.517657  4272 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.518406  4278 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.520010  4163 tablet_bootstrap.cc:654] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.520462  4278 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.523429  4278 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.526861  4278 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.527549  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.527674  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.528422  4117 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:36.537020  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:36.539561  4264 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.545702  4161 tablet_bootstrap.cc:492] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.546186  4161 ts_tablet_manager.cc:1403] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.104s	user 0.028s	sys 0.052s
I20260709 13:15:36.546413  4264 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.547816  4249 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.548314  4249 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.550524  4249 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.552939  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.552368  4161 raft_consensus.cc:359] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.554132  4240 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.553833  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.554553  4161 raft_consensus.cc:385] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.554864  4161 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
W20260709 13:15:36.555562  3937 leader_election.cc:343] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.556618  4161 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:36.556988  3937 leader_election.cc:343] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.557451  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.558327  4249 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.558637  4161 ts_tablet_manager.cc:1434] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:36.559556  4161 tablet_bootstrap.cc:492] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.570017  4163 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
W20260709 13:15:36.570274  3937 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.570649  4163 ts_tablet_manager.cc:1403] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.028s
I20260709 13:15:36.572470  4163 raft_consensus.cc:359] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.572983  4163 raft_consensus.cc:385] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.573314  4163 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.573974  4163 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.575969  4163 ts_tablet_manager.cc:1434] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:15:36.576530  4161 tablet_bootstrap.cc:654] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.577205  4163 tablet_bootstrap.cc:492] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.577344  4201 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.583489  4163 tablet_bootstrap.cc:654] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.588704  4161 tablet_bootstrap.cc:492] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.589372  4161 ts_tablet_manager.cc:1403] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.004s
I20260709 13:15:36.589767  3868 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:15:36.597801  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58029.6us
I20260709 13:15:36.596644  4161 raft_consensus.cc:359] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.603092  4161 raft_consensus.cc:385] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.603369  4161 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.603981  4161 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.604717  4162 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.605324  4162 ts_tablet_manager.cc:1403] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.192s	user 0.008s	sys 0.004s
I20260709 13:15:36.605937  4161 ts_tablet_manager.cc:1434] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.001s
I20260709 13:15:36.606817  4161 tablet_bootstrap.cc:492] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.607779  4162 raft_consensus.cc:359] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.608402  4162 raft_consensus.cc:385] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.608647  4162 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.609262  4162 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.611238  4162 ts_tablet_manager.cc:1434] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260709 13:15:36.612092  4162 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.613032  4161 tablet_bootstrap.cc:654] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.591956  3868 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.613543  4249 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.622741  4218 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.623226  4218 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.625321  4218 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.626853  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.627444  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.628125  3968 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
W20260709 13:15:36.628232  4086 leader_election.cc:343] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.629761  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.630740  4162 tablet_bootstrap.cc:654] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.631017  4218 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.631419  4218 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.631739  4218 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.635169  4161 tablet_bootstrap.cc:492] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.635646  4161 ts_tablet_manager.cc:1403] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.012s
I20260709 13:15:36.639482  4161 raft_consensus.cc:359] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.640125  4161 raft_consensus.cc:385] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.640367  4161 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.641075  4161 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.643146  4161 ts_tablet_manager.cc:1434] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:15:36.653456  4161 tablet_bootstrap.cc:492] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.585162  3869 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.655488  4249 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.659298  4161 tablet_bootstrap.cc:654] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.676028  4218 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.680166  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.680938  3969 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.689877  4162 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.690297  4162 ts_tablet_manager.cc:1403] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.007s
I20260709 13:15:36.690570  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:36.692027  4086 leader_election.cc:343] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.692203  4162 raft_consensus.cc:359] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.692720  4162 raft_consensus.cc:385] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.693025  4162 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.693670  4162 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.694911  4161 tablet_bootstrap.cc:492] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.695394  4161 ts_tablet_manager.cc:1403] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.017s
I20260709 13:15:36.695976  4162 ts_tablet_manager.cc:1434] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:15:36.696398  4218 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.698113  4161 raft_consensus.cc:359] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.698791  4161 raft_consensus.cc:385] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.699079  4161 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.699718  4161 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.702140  4162 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.702608  4161 ts_tablet_manager.cc:1434] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:36.703502  4161 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.705749  3969 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.706295  4264 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.706761  4264 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.707034  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.708814  4264 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.709285  4218 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.709448  4161 tablet_bootstrap.cc:654] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.709996  4218 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:36.710513  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.711135  4117 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:36.710858  4218 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.711624  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.712208  3968 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:36.713766  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.715979  4264 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.716347  4264 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.716686  4264 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.721902  4161 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.722409  4161 ts_tablet_manager.cc:1403] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:15:36.725076  4218 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.726210  4163 tablet_bootstrap.cc:492] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.726650  4163 ts_tablet_manager.cc:1403] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.150s	user 0.050s	sys 0.042s
I20260709 13:15:36.729382  4163 raft_consensus.cc:359] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.730225  4163 raft_consensus.cc:385] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.730504  4163 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.731156  4163 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.731349  4161 raft_consensus.cc:359] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.732105  4161 raft_consensus.cc:385] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.732479  4161 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.733294  4264 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.733235  4161 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.735560  4161 ts_tablet_manager.cc:1434] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.002s
I20260709 13:15:36.735975  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.736531  3968 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.736713  4161 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.743407  4161 tablet_bootstrap.cc:654] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.745828  3968 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:36.746964  4333 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.747150  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.747501  4333 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.748044  4272 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.748540  4272 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:36.749356  4272 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.753772  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:36.754189  4162 tablet_bootstrap.cc:654] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.754330  4117 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.758181  4333 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.758701  3868 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:36.760547  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.762172  4333 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.763796  4333 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.766117  4333 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.767138  4117 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:36.767938  4264 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.769945  4163 ts_tablet_manager.cc:1434] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:15:36.770414  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.770875  4163 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
W20260709 13:15:36.772092  3937 leader_election.cc:343] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.774574  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:36.774600  3937 leader_election.cc:343] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:36.776376  3937 leader_election.cc:343] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.776799  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.777761  4333 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.774950  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:36.779515  3937 leader_election.cc:343] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.779955  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.781057  4333 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.784421  4161 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.784986  4161 ts_tablet_manager.cc:1403] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.048s	user 0.021s	sys 0.024s
I20260709 13:15:36.787420  4161 raft_consensus.cc:359] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.788095  4161 raft_consensus.cc:385] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.788410  4161 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.789161  4161 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.790405  4239 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.791224  4161 ts_tablet_manager.cc:1434] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:36.798930  4162 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.799417  4162 ts_tablet_manager.cc:1403] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 13:15:36.791365  4163 tablet_bootstrap.cc:654] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.793743  3870 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:36.803787  4161 tablet_bootstrap.cc:492] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.802078  4162 raft_consensus.cc:359] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.806998  4162 raft_consensus.cc:385] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.807267  4162 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.807891  4162 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.809904  4162 ts_tablet_manager.cc:1434] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:15:36.810135  4161 tablet_bootstrap.cc:654] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.811055  4162 tablet_bootstrap.cc:492] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.813490  4163 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.813944  4163 ts_tablet_manager.cc:1403] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 13:15:36.816390  4163 raft_consensus.cc:359] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.817032  4163 raft_consensus.cc:385] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.821055  4163 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.821877  4163 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.824222  4163 ts_tablet_manager.cc:1434] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:36.825281  4163 tablet_bootstrap.cc:492] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.817054  4162 tablet_bootstrap.cc:654] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.834381  4162 tablet_bootstrap.cc:492] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.834923  4162 ts_tablet_manager.cc:1403] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.000s
I20260709 13:15:36.834982  4163 tablet_bootstrap.cc:654] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.837625  4161 tablet_bootstrap.cc:492] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.838120  4161 ts_tablet_manager.cc:1403] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.008s
I20260709 13:15:36.837740  4162 raft_consensus.cc:359] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.838548  4162 raft_consensus.cc:385] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.838833  4162 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.839874  4162 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.840927  4161 raft_consensus.cc:359] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.841578  4161 raft_consensus.cc:385] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.841827  4161 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.841936  4162 ts_tablet_manager.cc:1434] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:36.842132  4163 tablet_bootstrap.cc:492] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.842656  4163 ts_tablet_manager.cc:1403] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 13:15:36.842499  4161 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.843047  4162 tablet_bootstrap.cc:492] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.845314  4163 raft_consensus.cc:359] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.846007  4163 raft_consensus.cc:385] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.846313  4163 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.846982  4163 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.847821  4161 ts_tablet_manager.cc:1434] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:36.848737  4161 tablet_bootstrap.cc:492] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.849352  4163 ts_tablet_manager.cc:1434] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:15:36.850293  4163 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.854696  4161 tablet_bootstrap.cc:654] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.856920  4163 tablet_bootstrap.cc:654] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.856926  4239 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.857666  4239 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.859699  4239 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.863286  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.864219  3969 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.865928  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:36.867113  4239 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.867499  4239 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.867859  4239 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.870281  4163 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.870852  4163 ts_tablet_manager.cc:1403] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.006s
I20260709 13:15:36.873267  4163 raft_consensus.cc:359] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.873906  4163 raft_consensus.cc:385] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.874169  4163 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.876034  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.876638  4163 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:36.877791  4086 leader_election.cc:343] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.878690  4163 ts_tablet_manager.cc:1434] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:15:36.879575  4163 tablet_bootstrap.cc:492] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.881188  4239 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.885033  4162 tablet_bootstrap.cc:654] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.889658  4163 tablet_bootstrap.cc:654] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.889958  4162 tablet_bootstrap.cc:492] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.890615  4162 ts_tablet_manager.cc:1403] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.004s
I20260709 13:15:36.890990  4161 tablet_bootstrap.cc:492] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.891424  4161 ts_tablet_manager.cc:1403] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.012s
I20260709 13:15:36.894838  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:36.896443  4086 leader_election.cc:343] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.899814  4161 raft_consensus.cc:359] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.900555  4161 raft_consensus.cc:385] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.898339  4162 raft_consensus.cc:359] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:36.900844  4086 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:36.900874  4161 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.894731  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.901208  4162 raft_consensus.cc:385] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.901602  3969 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.901732  4162 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.901914  4161 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.902899  4162 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.904615  4162 ts_tablet_manager.cc:1434] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:15:36.914625  3969 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:36.916525  4239 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.917207  4272 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.917145  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.917747  4272 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.920220  4272 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.921762  4161 ts_tablet_manager.cc:1434] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 13:15:36.924052  4162 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:36.925222  4217 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:36.925734  4217 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:36.926111  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.926731  4117 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:36.926546  4217 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.928030  4012 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.929966  4264 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.930667  4264 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.930989  4264 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.931936  4046 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.939668  4161 tablet_bootstrap.cc:492] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:36.941551  4272 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.941874  4163 tablet_bootstrap.cc:492] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.942404  4163 ts_tablet_manager.cc:1403] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.018s
I20260709 13:15:36.942046  4272 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.942229  4264 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.943558  4240 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.945858  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.946089  4272 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.947225  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.948124  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:36.953238  4168 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.953855  4168 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.955904  4168 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.948283  3969 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:36.958627  4161 tablet_bootstrap.cc:654] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.959189  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.959370  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:36.960366  4163 raft_consensus.cc:359] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.961041  4163 raft_consensus.cc:385] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.961339  4163 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.962317  4264 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:36.963143  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.962005  4163 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:36.964604  3937 leader_election.cc:343] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.959345  4162 tablet_bootstrap.cc:654] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.966123  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:36.966456  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:36.967020  4121 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.968197  4163 ts_tablet_manager.cc:1434] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:15:36.968923  4264 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:36.969285  3937 leader_election.cc:343] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:36.969724  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:36.970041  4163 tablet_bootstrap.cc:492] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.971097  4200 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:36.974133  4162 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:36.975056  4162 ts_tablet_manager.cc:1403] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.002s
I20260709 13:15:36.977900  4163 tablet_bootstrap.cc:654] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:36.979681  4161 tablet_bootstrap.cc:492] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:36.980476  4161 ts_tablet_manager.cc:1403] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.010s
I20260709 13:15:36.987088  4239 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:36.987362  4218 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.987877  4218 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.988207  4162 raft_consensus.cc:359] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.988997  4163 tablet_bootstrap.cc:492] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:36.989615  4162 raft_consensus.cc:385] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.988868  4161 raft_consensus.cc:359] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.989814  4163 ts_tablet_manager.cc:1403] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:15:36.989859  4218 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:36.990286  4161 raft_consensus.cc:385] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.990670  4161 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.991933  4161 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.992734  4163 raft_consensus.cc:359] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.993608  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:36.993983  4163 raft_consensus.cc:385] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:36.990118  4162 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.994225  4045 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:36.994416  4163 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:36.995040  4163 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.995280  4162 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.996134  4264 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:36.996781  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:36.996556  4264 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:36.997145  4163 ts_tablet_manager.cc:1434] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:36.997774  4240 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.998107  4240 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:36.998189  4163 tablet_bootstrap.cc:492] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:36.998459  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:36.999002  4047 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.999981  4200 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:37.001202  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:37.001784  3968 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:37.003036  4011 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:37.003826  4272 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:36.999081  3971 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:37.004168  4163 tablet_bootstrap.cc:654] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.004204  4272 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.004742  4272 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:36.998492  4240 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.009867  4264 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.013525  4272 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.014103  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:37.016021  4168 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:37.017014  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:37.017624  3971 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:37.017434  4012 leader_election.cc:343] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.017369  4161 ts_tablet_manager.cc:1434] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:15:37.022450  4161 tablet_bootstrap.cc:492] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:37.030333  4161 tablet_bootstrap.cc:654] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.031386  4200 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.037125  4200 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.039945  4200 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.033159  4272 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.033417  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:37.034062  4162 ts_tablet_manager.cc:1434] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.058s	user 0.009s	sys 0.000s
I20260709 13:15:37.041608  4162 tablet_bootstrap.cc:492] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:37.025641  3971 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:37.045132  3868 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:37.045809  4011 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:15:37.047104  4012 leader_election.cc:343] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.048514  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:37.048972  4163 tablet_bootstrap.cc:492] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:37.049413  4163 ts_tablet_manager.cc:1403] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.019s
I20260709 13:15:37.049299  4116 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:37.049959  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:37.050532  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:37.053455  4162 tablet_bootstrap.cc:654] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.034797  4121 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:37.058101  4012 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:37.012622  4240 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.061676  4200 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:37.061775  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:37.062140  4200 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.062350  3971 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.062493  4200 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.068866  4200 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:37.069298  3937 leader_election.cc:343] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.070262  3971 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:37.071578  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:37.073431  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:37.074007  4161 tablet_bootstrap.cc:492] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:37.074653  4161 ts_tablet_manager.cc:1403] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.021s
W20260709 13:15:37.076086  3937 leader_election.cc:343] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.076900  4217 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.077561  4217 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:37.077831  4161 raft_consensus.cc:359] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.078671  4161 raft_consensus.cc:385] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.078406  4217 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.070835  4200 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.079027  4161 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.079843  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:37.079947  4161 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.076283  4163 raft_consensus.cc:359] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.081502  4163 raft_consensus.cc:385] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.080525  4121 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.081786  4163 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.086082  4161 ts_tablet_manager.cc:1434] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:37.087103  4161 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:37.091229  4121 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:37.094465  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:37.110220  4200 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.110872  4200 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.118964  4168 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.119930  4168 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:37.134958  4168 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.137291  4200 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.138648  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:37.139288  4161 tablet_bootstrap.cc:654] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.167920  4342 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:15:37.176446  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 130704us
I20260709 13:15:37.177033  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:37.177634  4045 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.163733  4239 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:15:37.183444  3868 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:37.140906  4240 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:37.548928  4163 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.550892  4162 tablet_bootstrap.cc:492] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:37.551467  4162 ts_tablet_manager.cc:1403] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.510s	user 0.015s	sys 0.037s
I20260709 13:15:37.554240  4162 raft_consensus.cc:359] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.554951  4162 raft_consensus.cc:385] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.555217  4162 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.555874  4162 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.200685  4342 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:15:37.392028  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 333999us
I20260709 13:15:37.557881  4342 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.264360  4045 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:37.144812  4121 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:37.208437  4264 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:37.267347  4201 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.267539  4333 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:37.394052  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 123103us
I20260709 13:15:37.506201  4168 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.240978  4200 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.605589  4162 ts_tablet_manager.cc:1434] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.012s
I20260709 13:15:37.606779  4162 tablet_bootstrap.cc:492] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:37.587141  4333 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.624881  4333 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.625105  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:37.586952  4201 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.588965  4200 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.641888  4163 ts_tablet_manager.cc:1434] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.568s	user 0.041s	sys 0.041s
W20260709 13:15:37.643146  4163 ts_tablet_manager.cc:1467] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Tablet startup took 568ms
I20260709 13:15:37.590292  4168 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:37.643455  4163 ts_tablet_manager.cc:1469] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Trace:
0709 13:15:33.202609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:33.582538 (+379929us) service_pool.cc:224] Handling call
0709 13:15:33.584245 (+  1707us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:15:33.584336 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:15:33.711771 (+127435us) tablet_metadata.cc:665] Metadata flushed
0709 13:15:33.860265 (+148494us) tablet_replica.cc:206] Creating consensus instance
0709 13:15:33.860723 (+   458us) inbound_call.cc:177] Queueing success response
0709 13:15:36.997901 (+3137178us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:15:37.073572 (+ 75671us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:15:37.074443 (+   871us) tablet_replica.cc:261] Starting instrumentation
0709 13:15:37.074943 (+   500us) tablet_replica.cc:280] Starting consensus
Metrics: {"tablet-open.queue_time_us":3137260,"thread_start_us":55454,"threads_started":1}
I20260709 13:15:37.663442  4163 tablet_bootstrap.cc:492] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
W20260709 13:15:37.664951  4384 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:15:37.683024  4264 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:37.711257  4201 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.713594  4387 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:37.715422  3937 leader_election.cc:343] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:37.714659  4395 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 13:15:37.714233  4371 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:15:37.700119  4264 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:37.713598  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.018s	sys 0.018s
I20260709 13:15:37.714115  4387 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:37.735679  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.021s
W20260709 13:15:37.744690  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 645447us
I20260709 13:15:37.754912  4200 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.762511  4161 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:37.762887  4161 ts_tablet_manager.cc:1403] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.676s	user 0.047s	sys 0.055s
I20260709 13:15:37.767933  4387 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.777460  4394 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.777354  4408 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.763926  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:37.782507  4161 raft_consensus.cc:359] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.782981  4161 raft_consensus.cc:385] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.783187  4161 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:37.786445  4161 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.788376  4162 tablet_bootstrap.cc:654] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.781263  4044 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.792579  4163 tablet_bootstrap.cc:654] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.797091  4161 ts_tablet_manager.cc:1434] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:15:37.797797  4161 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:37.777985  4394 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.801491  4391 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.801992  4391 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.815841  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:37.834342  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:37.799568  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:37.843715  3937 leader_election.cc:343] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:37.844385  3937 leader_election.cc:343] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.847147  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:37.847934  3970 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:37.785493  4408 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.836372  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:37.841545  4200 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:37.871455  3937 leader_election.cc:343] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:37.867745  4200 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:37.879588  4200 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:37.901712  4161 tablet_bootstrap.cc:654] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:37.902792  4408 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:37.903571  4200 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:37.888859  4264 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:15:37.887753  4391 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:37.917804  3937 leader_election.cc:343] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:37.918550  3937 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:37.917593  4410 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:37.897925  4383 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:15:37.920068  4410 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.081308  4162 tablet_bootstrap.cc:492] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:37.921976  4394 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.087517  4162 ts_tablet_manager.cc:1403] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.481s	user 0.024s	sys 0.023s
I20260709 13:15:38.041545  4168 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:37.939105  4163 tablet_bootstrap.cc:492] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.085191  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:38.077566  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 157231us
W20260709 13:15:38.082816  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:38.090534  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:38.012045  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48824.2us
I20260709 13:15:38.103658  4163 ts_tablet_manager.cc:1403] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.446s	user 0.052s	sys 0.013s
I20260709 13:15:38.105194  4162 raft_consensus.cc:359] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.107909  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.113423  4162 raft_consensus.cc:385] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:37.950444  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.114614  4162 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.115160  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.118852  4162 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.120030  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.120718  4120 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:38.121131  4162 ts_tablet_manager.cc:1434] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:15:38.122110  4162 tablet_bootstrap.cc:492] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:38.025090  4278 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:15:38.127096  3937 leader_election.cc:343] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:37.922962  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56364.1us
I20260709 13:15:37.953446  4200 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.131764  4402 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:38.139348  4410 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.142777  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:38.143337  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:38.144068  4121 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.143324  4163 raft_consensus.cc:359] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.147230  4163 raft_consensus.cc:385] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.147506  4163 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
W20260709 13:15:38.153250  3937 leader_election.cc:343] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.153631  4421 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:15:38.158142  4163 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.160292  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.160962  3966 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:38.128734  4278 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.163091  4116 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:38.170008  4163 ts_tablet_manager.cc:1434] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260709 13:15:38.171195  4121 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:38.173641  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.174744  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.175801  4161 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:38.181797  4163 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:38.185534  4161 ts_tablet_manager.cc:1403] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.388s	user 0.023s	sys 0.008s
I20260709 13:15:38.200271  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:38.201471  3970 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:38.210879  4421 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.201591  3969 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:38.220216  4421 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.218012  4394 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:15:38.231570  4045 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.232643  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:38.233108  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:38.233763  4162 tablet_bootstrap.cc:654] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.233866  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:38.235616  4044 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:38.228796  4421 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.237187  4163 tablet_bootstrap.cc:654] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.234454  4161 raft_consensus.cc:359] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.238083  4161 raft_consensus.cc:385] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.238270  4161 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.238685  4161 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.240857  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:38.242872  3937 leader_election.cc:343] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.243258  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:38.244105  3937 leader_election.cc:343] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.244372  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.245038  4168 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:38.245683  4086 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.246781  4401 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.249234  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.249286  4161 ts_tablet_manager.cc:1434] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.000s
I20260709 13:15:38.250701  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:38.252960  4161 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
W20260709 13:15:38.253712  4086 leader_election.cc:343] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.255734  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.256699  4390 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.257156  4390 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.257488  4390 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:38.259248  4086 leader_election.cc:343] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.254305  4168 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:15:38.265298  4333 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.265683  4333 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.266021  4333 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.268983  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:38.270888  4419 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.271654  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.273216  4419 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.273765  4419 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.277256  4406 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:15:38.282374  4278 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.283669  3867 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.284276  4400 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:15:38.284929  4387 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.285382  3867 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:38.291412  4012 consensus_peers.cc:597] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.293066  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.297837  4387 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.286541  4421 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.277972  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.308235  4406 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.308668  4406 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.309027  4406 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.299211  4419 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.315328  4394 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.321259  4399 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.321774  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.340900  4399 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:15:38.323346  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46366.5us
I20260709 13:15:38.343103  4333 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.344007  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:38.345062  4400 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:38.346354  3937 leader_election.cc:343] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.347121  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.339164  4406 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.344998  4333 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.341722  4399 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.349612  4390 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.367995  4413 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.368470  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:38.369902  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.370456  4421 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.371572  3972 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.398130  4419 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.399253  4390 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.401811  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:38.402472  3965 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.403105  4163 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.403604  4163 ts_tablet_manager.cc:1403] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.003s
I20260709 13:15:38.376416  4406 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.383095  4116 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.383406  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.414443  4162 tablet_bootstrap.cc:492] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:38.414820  4162 ts_tablet_manager.cc:1403] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.293s	user 0.017s	sys 0.004s
I20260709 13:15:38.415810  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.416790  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:38.430958  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:38.447395  4163 raft_consensus.cc:359] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.448324  4163 raft_consensus.cc:385] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.448693  4163 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.457883  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.458549  4041 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.458423  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.447938  3970 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:38.459990  4440 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.003s
I20260709 13:15:38.457850  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:38.463038  4119 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:38.466842  3967 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:38.474447  4161 tablet_bootstrap.cc:654] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.476266  3970 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:38.476311  4387 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:38.479374  4162 raft_consensus.cc:359] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.480029  4162 raft_consensus.cc:385] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.480298  4162 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
W20260709 13:15:38.466174  4086 leader_election.cc:343] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:38.489300  4086 leader_election.cc:343] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.489650  4116 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:38.490886  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.485194  4162 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.498400  4043 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.501565  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:38.503917  4200 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.504405  4200 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:38.505213  4200 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.507902  4162 ts_tablet_manager.cc:1434] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.093s	user 0.006s	sys 0.001s
I20260709 13:15:38.508730  4162 tablet_bootstrap.cc:492] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:38.496603  3965 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:38.514308  4406 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.525882  4041 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:38.537413  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.538839  4394 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.539314  4394 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:38.540091  4394 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.543375  4163 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.546489  3870 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.548081  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:38.548856  4401 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.541929  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.549572  4401 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:38.552996  4401 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.555111  4163 ts_tablet_manager.cc:1434] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.151s	user 0.015s	sys 0.018s
I20260709 13:15:38.551422  4406 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.559144  4163 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:38.564352  4406 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:38.565274  4406 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.573750  4163 tablet_bootstrap.cc:654] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.575538  4043 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:38.596541  4401 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.599212  4161 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:38.599702  4161 ts_tablet_manager.cc:1403] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.347s	user 0.020s	sys 0.000s
I20260709 13:15:38.597204  4401 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.609269  4161 raft_consensus.cc:359] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.609954  4161 raft_consensus.cc:385] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.610211  4161 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.610889  4161 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.613356  4162 tablet_bootstrap.cc:654] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.614053  4161 ts_tablet_manager.cc:1434] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:15:38.618911  4161 tablet_bootstrap.cc:492] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:38.623667  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:38.627826  3937 leader_election.cc:343] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.634204  4200 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.636039  4200 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.638024  4200 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.638325  4401 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.640125  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:38.642553  4161 tablet_bootstrap.cc:654] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.642714  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:38.644680  3937 leader_election.cc:343] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.645099  4163 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.645527  4163 ts_tablet_manager.cc:1403] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.087s	user 0.029s	sys 0.008s
I20260709 13:15:38.645031  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.648355  4163 raft_consensus.cc:359] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.649175  4163 raft_consensus.cc:385] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.649425  4163 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.650098  4163 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.651996  4163 ts_tablet_manager.cc:1434] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:38.652861  4163 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:38.654076  4162 tablet_bootstrap.cc:492] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:38.654500  4162 ts_tablet_manager.cc:1403] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.146s	user 0.020s	sys 0.005s
I20260709 13:15:38.657142  4162 raft_consensus.cc:359] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.657761  4162 raft_consensus.cc:385] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.658026  4162 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.658609  4162 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.660498  4162 ts_tablet_manager.cc:1434] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:15:38.661295  4162 tablet_bootstrap.cc:492] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
W20260709 13:15:38.670954  3937 leader_election.cc:343] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.671380  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.676029  4399 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.674556  4162 tablet_bootstrap.cc:654] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:38.677268  3937 leader_election.cc:343] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.677800  3937 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.679205  4399 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.679642  4163 tablet_bootstrap.cc:654] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.687500  4161 tablet_bootstrap.cc:492] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:38.688179  4161 ts_tablet_manager.cc:1403] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.006s
I20260709 13:15:38.691449  4161 raft_consensus.cc:359] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.692409  4161 raft_consensus.cc:385] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.692920  4161 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.693701  4161 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.694228  4162 tablet_bootstrap.cc:492] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:38.694952  4162 ts_tablet_manager.cc:1403] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.007s
I20260709 13:15:38.697780  4161 ts_tablet_manager.cc:1434] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 13:15:38.698992  4161 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:38.700969  4162 raft_consensus.cc:359] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.701838  4162 raft_consensus.cc:385] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.702172  4162 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.702931  4162 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.705717  4162 ts_tablet_manager.cc:1434] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:38.707345  4162 tablet_bootstrap.cc:492] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:38.719873  4162 tablet_bootstrap.cc:654] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.721016  3870 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.722699  3870 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.727305  4161 tablet_bootstrap.cc:654] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.733135  4162 tablet_bootstrap.cc:492] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:38.733487  4163 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.733636  4162 ts_tablet_manager.cc:1403] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.010s
I20260709 13:15:38.739274  4163 ts_tablet_manager.cc:1403] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.087s	user 0.044s	sys 0.012s
I20260709 13:15:38.744024  4163 raft_consensus.cc:359] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.744112  4162 raft_consensus.cc:359] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.745415  4163 raft_consensus.cc:385] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.745489  4162 raft_consensus.cc:385] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.745854  4163 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.745854  4162 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.746793  4163 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.747225  4162 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.749014  4163 ts_tablet_manager.cc:1434] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:38.750514  4163 tablet_bootstrap.cc:492] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:38.743498  3870 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:38.756822  4163 tablet_bootstrap.cc:654] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.759876  4162 ts_tablet_manager.cc:1434] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 13:15:38.768415  4163 tablet_bootstrap.cc:492] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.769045  4163 ts_tablet_manager.cc:1403] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 13:15:38.772096  4162 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:38.775475  4163 raft_consensus.cc:359] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.776228  4163 raft_consensus.cc:385] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.776506  4163 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.777493  4161 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:38.778177  4161 ts_tablet_manager.cc:1403] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.026s
I20260709 13:15:38.777794  4163 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.779906  4163 ts_tablet_manager.cc:1434] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:15:38.780964  4163 tablet_bootstrap.cc:492] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:38.781509  3867 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.783609  4161 raft_consensus.cc:359] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.784197  3867 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:38.784940  4161 raft_consensus.cc:385] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.786012  4161 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.789312  4161 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.787778  4163 tablet_bootstrap.cc:654] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.789747  4162 tablet_bootstrap.cc:654] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.794628  4161 ts_tablet_manager.cc:1434] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:15:38.795770  4161 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:38.801666  4272 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.802189  4272 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.803419  4161 tablet_bootstrap.cc:654] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.805737  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.807842  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.808630  3972 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:38.813153  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:38.813635  4163 tablet_bootstrap.cc:492] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.813978  4278 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.814538  4218 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.815124  4218 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.814085  4163 ts_tablet_manager.cc:1403] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:15:38.818094  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.818689  3965 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:38.820327  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:38.820237  4163 raft_consensus.cc:359] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.820942  4163 raft_consensus.cc:385] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.821213  4406 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.821596  4406 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.821921  4406 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.822865  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:38.824199  4086 leader_election.cc:343] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.824738  4218 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.804201  4272 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.838582  4218 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.839077  4218 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.841065  4218 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.842182  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:38.844094  4086 leader_election.cc:343] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.844636  4387 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.845139  4387 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.821218  4163 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.857494  4163 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.849005  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.872156  3965 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:38.854283  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.872669  4163 ts_tablet_manager.cc:1434] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 13:15:38.860385  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.873401  3972 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:38.873731  4163 tablet_bootstrap.cc:492] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:38.869040  4162 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:38.874701  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.875185  4162 ts_tablet_manager.cc:1403] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.007s
I20260709 13:15:38.875137  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:38.875790  4239 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:38.876160  4239 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:38.876204  4400 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.876576  4239 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.878345  4162 raft_consensus.cc:359] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.879055  4162 raft_consensus.cc:385] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.879314  4162 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.880712  4278 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.870934  4406 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.847127  4387 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.883226  4400 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.884147  4406 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.884390  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:38.886989  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:38.887562  3972 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.879988  4162 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.893095  4041 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:38.893879  4401 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.900404  4041 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:38.901180  4401 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:38.903455  4162 ts_tablet_manager.cc:1434] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:15:38.904316  4162 tablet_bootstrap.cc:492] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:38.913003  3972 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:38.914678  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:38.913506  4163 tablet_bootstrap.cc:654] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.917368  4406 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.917869  4406 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:38.918709  4406 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.930162  4399 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:15:38.935851  4239 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.936437  4161 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:38.940018  4161 ts_tablet_manager.cc:1403] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.144s	user 0.078s	sys 0.043s
I20260709 13:15:38.946367  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:38.947062  3972 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:38.950609  3937 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:38.954998  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:38.957195  4086 leader_election.cc:343] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:38.959748  4239 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:38.961745  4400 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:38.962275  4161 raft_consensus.cc:359] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.962996  4161 raft_consensus.cc:385] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.962971  3972 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:38.963406  4161 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.964046  4161 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.965098  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:38.966032  4161 ts_tablet_manager.cc:1434] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.003s
I20260709 13:15:38.966182  4239 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:38.962298  4400 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.966755  4239 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:38.967648  4239 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.968323  4400 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:38.971184  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:38.971457  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:38.973587  4161 tablet_bootstrap.cc:492] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:38.976804  4162 tablet_bootstrap.cc:654] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.976298  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:38.978037  4400 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:38.978576  4163 tablet_bootstrap.cc:492] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:38.979060  4163 ts_tablet_manager.cc:1403] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.014s
I20260709 13:15:38.985613  4163 raft_consensus.cc:359] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.986238  4163 raft_consensus.cc:385] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:38.986505  4163 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:38.987396  4163 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:38.995723  4163 ts_tablet_manager.cc:1434] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.003s
I20260709 13:15:38.997123  4163 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:39.002672  4163 tablet_bootstrap.cc:654] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:38.995915  4161 tablet_bootstrap.cc:654] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.003084  3867 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.007825  4399 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.008279  4399 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.010193  4399 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.011051  4410 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.011451  4410 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.013204  4410 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.020670  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.023041  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.029189  4163 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:39.024652  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.029775  4163 ts_tablet_manager.cc:1403] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.004s
W20260709 13:15:39.024989  3937 leader_election.cc:343] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:39.030722  3937 leader_election.cc:343] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.027096  4162 tablet_bootstrap.cc:492] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.031075  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.031565  4162 ts_tablet_manager.cc:1403] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.127s	user 0.008s	sys 0.004s
I20260709 13:15:39.032085  4410 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.032220  4163 raft_consensus.cc:359] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.032932  4163 raft_consensus.cc:385] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.033185  4163 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
W20260709 13:15:39.033305  3937 leader_election.cc:343] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.033811  4163 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.034003  4162 raft_consensus.cc:359] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.035583  4162 raft_consensus.cc:385] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.035856  4163 ts_tablet_manager.cc:1434] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:39.023762  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.036882  4163 tablet_bootstrap.cc:492] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
W20260709 13:15:39.037482  3937 leader_election.cc:343] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.035662  3868 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.037881  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.038630  4410 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.035871  4162 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.039815  4162 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.045030  4161 tablet_bootstrap.cc:492] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:39.045989  4161 ts_tablet_manager.cc:1403] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.010s
I20260709 13:15:39.048053  4162 ts_tablet_manager.cc:1434] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:15:39.048409  4161 raft_consensus.cc:359] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.049096  4161 raft_consensus.cc:385] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.049299  4162 tablet_bootstrap.cc:492] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.049561  4163 tablet_bootstrap.cc:654] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.049345  4161 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.052903  4161 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.054785  4162 tablet_bootstrap.cc:654] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.054873  4161 ts_tablet_manager.cc:1434] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:15:39.056442  4161 tablet_bootstrap.cc:492] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:39.058462  4040 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.061847  4161 tablet_bootstrap.cc:654] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.065864  4162 tablet_bootstrap.cc:492] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.066313  4162 ts_tablet_manager.cc:1403] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:15:39.069536  4162 raft_consensus.cc:359] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.070295  4162 raft_consensus.cc:385] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.070571  4162 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.076438  4239 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:39.076912  4163 tablet_bootstrap.cc:492] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:39.077378  4163 ts_tablet_manager.cc:1403] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 13:15:39.080164  4163 raft_consensus.cc:359] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.080909  4163 raft_consensus.cc:385] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.081164  4163 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.081588  4117 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.081736  4163 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.083715  4163 ts_tablet_manager.cc:1434] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:39.084619  4239 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.071182  4162 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.085141  4239 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.086625  4163 tablet_bootstrap.cc:492] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:39.086805  4162 ts_tablet_manager.cc:1434] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:15:39.088583  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.091197  4162 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.092649  4239 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.094940  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:39.096959  4086 leader_election.cc:343] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.104176  4162 tablet_bootstrap.cc:654] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.110809  4161 tablet_bootstrap.cc:492] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:39.111272  4161 ts_tablet_manager.cc:1403] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.055s	user 0.015s	sys 0.001s
I20260709 13:15:39.112866  4239 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.116847  4163 tablet_bootstrap.cc:654] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.119663  4161 raft_consensus.cc:359] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.120424  4161 raft_consensus.cc:385] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.120687  4161 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.124078  4161 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.104624  3972 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:39.126137  4161 ts_tablet_manager.cc:1434] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:15:39.127106  4161 tablet_bootstrap.cc:492] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:39.130645  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.131596  4162 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.131753  4239 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.132050  4162 ts_tablet_manager.cc:1403] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:15:39.132104  4239 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.132510  4239 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.132732  4161 tablet_bootstrap.cc:654] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.146072  4162 raft_consensus.cc:359] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.147993  4162 raft_consensus.cc:385] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.148265  4162 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.152451  4162 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.155400  4162 ts_tablet_manager.cc:1434] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:15:39.156280  4162 tablet_bootstrap.cc:492] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.170243  4162 tablet_bootstrap.cc:654] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.179193  4401 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.180903  4412 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.182490  4162 tablet_bootstrap.cc:492] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.182955  4162 ts_tablet_manager.cc:1403] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:15:39.184419  4217 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.185542  4162 raft_consensus.cc:359] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.186185  4162 raft_consensus.cc:385] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.186455  4162 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.187071  4162 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.188549  4162 ts_tablet_manager.cc:1434] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:15:39.189963  4406 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:39.190459  4406 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.193293  4239 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.194579  4406 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.197359  4239 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.197860  4162 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.198597  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:39.200179  4086 leader_election.cc:343] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.201376  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.205271  4162 tablet_bootstrap.cc:654] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.205914  4163 tablet_bootstrap.cc:492] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:39.206239  4163 ts_tablet_manager.cc:1403] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.019s
I20260709 13:15:39.208065  4163 raft_consensus.cc:359] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.208513  4163 raft_consensus.cc:385] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.208673  4163 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.209195  4162 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.209275  4163 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.209847  4162 ts_tablet_manager.cc:1403] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.003s
I20260709 13:15:39.210812  4161 tablet_bootstrap.cc:492] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:39.253367  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.257364  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.258359  3971 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.262701  4490 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.263568  4490 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.266897  4490 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.266995  4043 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.287686  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.291350  4085 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:39.305014  3937 leader_election.cc:343] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.306391  3971 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:39.312125  4163 ts_tablet_manager.cc:1434] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.001s
I20260709 13:15:39.313478  4161 ts_tablet_manager.cc:1403] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.186s	user 0.014s	sys 0.014s
I20260709 13:15:39.314409  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.313519  4217 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.314503  4163 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:39.327075  4406 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.327885  4406 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.327167  4484 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.344252  4406 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:39.345556  3937 leader_election.cc:343] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.346110  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.347510  4484 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.350637  4410 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.311189  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.350689  4484 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.364161  4484 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.364642  4484 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.366681  4484 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.369343  4162 raft_consensus.cc:359] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.370121  4162 raft_consensus.cc:385] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.370450  4162 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.359445  4161 raft_consensus.cc:359] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.374487  4161 raft_consensus.cc:385] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.374715  4161 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.373093  4162 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.378480  4161 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.384135  4493 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.384912  4493 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.390362  4278 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.391047  4278 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.391290  4493 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.382055  4406 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.394188  4278 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.397255  4163 tablet_bootstrap.cc:654] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.403676  4406 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:39.404989  4406 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.407351  4161 ts_tablet_manager.cc:1434] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.001s
I20260709 13:15:39.408949  4161 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
W20260709 13:15:39.412235  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101360us
I20260709 13:15:39.413458  4162 ts_tablet_manager.cc:1434] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.203s	user 0.009s	sys 0.000s
I20260709 13:15:39.413671  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.414460  3972 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:39.415907  4162 tablet_bootstrap.cc:492] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.419704  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.420595  3965 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:39.445370  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.446189  4218 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.438138  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.435089  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:39.449021  4272 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.449499  4272 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.449934  4272 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.447124  3970 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:39.447117  4218 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.455173  4218 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.456575  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:39.458503  4239 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.458884  4239 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.473428  4239 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.497049  4495 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.497759  4495 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.501041  4495 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.503692  4278 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.504241  4278 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.520359  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.521171  4045 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:39.524614  4239 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.543727  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.548835  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.549582  3971 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:39.556702  4239 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.539839  4494 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.127s
I20260709 13:15:39.565495  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:39.573632  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.581658  4163 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:39.581700  4412 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.584244  4163 ts_tablet_manager.cc:1403] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.270s	user 0.015s	sys 0.005s
I20260709 13:15:39.583762  4412 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.587100  4406 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:15:39.591454  4400 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.591925  4400 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.594836  4491 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:39.595374  4491 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.598162  4412 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.601538  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:39.603444  3937 leader_election.cc:343] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.589775  4278 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.593691  4040 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.618634  4400 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.619729  4491 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.625211  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.626266  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:39.616271  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:39.629382  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.629671  4494 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.636533  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.632622  4494 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.637409  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.637810  4494 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.621295  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.646095  4272 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:39.630656  4085 leader_election.cc:343] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.641150  3965 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:39.648154  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.649957  3971 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
W20260709 13:15:39.652276  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:39.653636  4161 tablet_bootstrap.cc:654] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.635079  4498 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.656809  4045 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:39.657222  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.658314  4162 tablet_bootstrap.cc:654] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.659636  4163 raft_consensus.cc:359] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.658121  3971 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:39.660363  4163 raft_consensus.cc:385] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.660470  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:39.662770  4278 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.663233  4278 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.660653  4163 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.655068  4498 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:39.669384  4086 leader_election.cc:343] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.663892  4278 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.671108  4272 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.672386  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:39.685863  4086 leader_election.cc:343] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.684494  4163 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.680709  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.686124  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.686599  3970 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.686892  4115 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:39.687961  4163 ts_tablet_manager.cc:1434] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.001s
I20260709 13:15:39.684146  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.686039  4116 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:39.678433  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.662921  4494 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.690346  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.690661  4120 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:39.689105  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.684242  4498 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.692467  3965 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.693269  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.701947  4239 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.701092  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:39.712617  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:39.719235  4119 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.727583  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.730443  4217 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.735924  3970 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:39.738505  4161 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:39.739336  4161 ts_tablet_manager.cc:1403] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.331s	user 0.018s	sys 0.017s
I20260709 13:15:39.729866  4494 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.730039  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:39.741273  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:15:39.740268  4086 leader_election.cc:343] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.742406  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.743162  4217 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.743522  4217 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.743680  4406 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.744554  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:39.744700  4278 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.747002  4465 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.747447  4465 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:39.750320  4163 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:39.750084  4217 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.751883  3965 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:39.748302  4465 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.759892  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.760454  3970 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.761749  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:39.763036  4400 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:39.765918  4278 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.766578  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.767176  3971 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.772717  4161 raft_consensus.cc:359] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.773434  4161 raft_consensus.cc:385] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.771873  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:39.773768  4161 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.774196  4115 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.774724  4161 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:39.774993  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49040.7us
I20260709 13:15:39.780068  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:39.783898  3970 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:39.774967  4217 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.785175  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.785966  4162 tablet_bootstrap.cc:492] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.785987  4161 ts_tablet_manager.cc:1434] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 13:15:39.786494  4162 ts_tablet_manager.cc:1403] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.371s	user 0.030s	sys 0.039s
I20260709 13:15:39.787199  4161 tablet_bootstrap.cc:492] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:39.788378  4505 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:39.788808  4505 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:39.789122  4505 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.789361  4162 raft_consensus.cc:359] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.790042  4162 raft_consensus.cc:385] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.790305  4162 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.790987  4162 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.792861  4161 tablet_bootstrap.cc:654] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.793179  4162 ts_tablet_manager.cc:1434] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:39.794216  4162 tablet_bootstrap.cc:492] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.805341  4217 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:39.807010  4200 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.807559  4200 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.798254  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:39.809921  4278 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.810456  4278 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:39.811407  4278 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.816900  3868 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:39.823041  4163 tablet_bootstrap.cc:654] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.823529  4200 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.827415  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:39.832413  4217 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.832650  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.832958  4217 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:39.834059  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.833788  4217 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.835953  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:15:39.839604  3937 leader_election.cc:343] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.827610  4115 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:39.840132  4218 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:39.846606  4218 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:15:39.847218  3937 leader_election.cc:343] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.847718  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.842008  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.837440  4119 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:39.855005  4494 raft_consensus.cc:2764] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:15:39.852304  4410 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:39.843346  4086 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:39.860034  4162 tablet_bootstrap.cc:654] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.846427  4505 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.863658  3972 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:39.864583  4505 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.847446  4218 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.870427  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:39.871193  4118 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:15:39.862771  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44931.6us
I20260709 13:15:39.874456  4161 tablet_bootstrap.cc:492] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:39.874938  4161 ts_tablet_manager.cc:1403] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.088s	user 0.031s	sys 0.015s
I20260709 13:15:39.883708  4161 raft_consensus.cc:359] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.884369  4161 raft_consensus.cc:385] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.883888  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:39.884610  4161 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.886293  4161 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.864593  4498 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.890556  4161 ts_tablet_manager.cc:1434] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:15:39.895077  4047 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 1: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:39.900441  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:39.907156  3937 leader_election.cc:343] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.907550  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.908443  4163 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:39.908809  4410 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.908923  4163 ts_tablet_manager.cc:1403] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.170s	user 0.016s	sys 0.003s
I20260709 13:15:39.913182  4272 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.913776  4168 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.913830  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:39.914709  3970 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:39.914417  4168 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.916837  4163 raft_consensus.cc:359] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.917480  4163 raft_consensus.cc:385] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.917610  4168 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.918047  4161 tablet_bootstrap.cc:492] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:39.917951  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:39.919719  4163 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.921731  4498 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.923360  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.925524  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:39.925848  4400 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.926039  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:39.929868  4162 tablet_bootstrap.cc:492] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:39.930230  4162 ts_tablet_manager.cc:1403] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.013s
I20260709 13:15:39.932669  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:39.931829  4163 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:39.933782  3937 leader_election.cc:343] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.943508  4163 ts_tablet_manager.cc:1434] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 13:15:39.931349  4400 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.944923  4498 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.946069  4400 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:39.947328  3937 leader_election.cc:343] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.947772  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.948437  4168 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:15:39.952716  4086 leader_election.cc:343] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.952963  4162 raft_consensus.cc:359] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.953615  4162 raft_consensus.cc:385] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:39.953876  4162 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:39.954492  4162 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.948386  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:39.958555  4217 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.959338  3970 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:15:39.960923  4086 leader_election.cc:343] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.961426  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:39.961417  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.963428  4495 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.964534  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:39.966717  4163 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:39.966915  4162 ts_tablet_manager.cc:1434] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:15:39.967916  4162 tablet_bootstrap.cc:492] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:39.966578  4498 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:39.979619  4161 tablet_bootstrap.cc:654] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.984994  4168 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:39.977051  4498 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:39.985509  4168 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:39.987916  4168 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:39.988953  4239 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:39.989256  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:39.989913  4118 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:39.991222  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:39.992213  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:39.993935  3937 leader_election.cc:343] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:39.980914  4163 tablet_bootstrap.cc:654] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.998098  4161 tablet_bootstrap.cc:492] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:39.998512  4161 ts_tablet_manager.cc:1403] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.005s
I20260709 13:15:39.982458  4162 tablet_bootstrap.cc:654] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:39.993937  4168 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.003798  4168 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.004180  4168 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.001348  4161 raft_consensus.cc:359] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.007311  4161 raft_consensus.cc:385] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.007606  4161 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.008302  4161 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.010625  4161 ts_tablet_manager.cc:1434] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:15:40.011631  4161 tablet_bootstrap.cc:492] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.014271  4162 tablet_bootstrap.cc:492] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.018949  4161 tablet_bootstrap.cc:654] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.014709  4162 ts_tablet_manager.cc:1403] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.002s
I20260709 13:15:40.021374  4239 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.022356  4239 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.023907  4162 raft_consensus.cc:359] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.024531  4162 raft_consensus.cc:385] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.024802  4162 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.025404  4162 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.025413  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.026446  3970 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:40.027441  4162 ts_tablet_manager.cc:1434] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:40.027894  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:40.029002  4239 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:40.030637  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.031041  4217 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.031430  4217 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.031739  4217 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:40.035936  4086 leader_election.cc:343] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.038595  4217 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.040112  4162 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.042448  3868 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.045085  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:40.045679  3972 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.045290  4217 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:40.046473  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:40.047964  4086 leader_election.cc:343] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.045547  4168 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.050727  4162 tablet_bootstrap.cc:654] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.044713  3868 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.058913  3972 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:40.060228  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.062510  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:40.062804  4217 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.063280  4217 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:40.063208  4040 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.064167  4217 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.079324  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:40.079968  4118 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.086423  3869 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.088343  3869 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.094318  4161 tablet_bootstrap.cc:492] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.094794  4161 ts_tablet_manager.cc:1403] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.083s	user 0.039s	sys 0.018s
I20260709 13:15:40.094913  4118 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:40.095331  4162 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.095750  4162 ts_tablet_manager.cc:1403] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.056s	user 0.006s	sys 0.026s
I20260709 13:15:40.095988  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:40.096728  4200 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.097254  4200 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:40.098075  4200 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.098152  4162 raft_consensus.cc:359] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.100231  4162 raft_consensus.cc:385] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.100494  4162 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.100862  4161 raft_consensus.cc:359] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.101496  4161 raft_consensus.cc:385] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.101751  4161 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.102618  4162 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.104398  4161 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.106480  4161 ts_tablet_manager.cc:1434] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:15:40.079972  4168 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.107448  4161 tablet_bootstrap.cc:492] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.107640  4162 ts_tablet_manager.cc:1434] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:40.108675  4162 tablet_bootstrap.cc:492] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.110926  4163 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.111438  4163 ts_tablet_manager.cc:1403] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.145s	user 0.012s	sys 0.019s
I20260709 13:15:40.114802  4162 tablet_bootstrap.cc:654] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.115240  4163 raft_consensus.cc:359] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.119544  4163 raft_consensus.cc:385] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.119983  4163 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.117419  4040 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:40.121098  4163 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.130980  4161 tablet_bootstrap.cc:654] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.133273  4163 ts_tablet_manager.cc:1434] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:40.134750  3867 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.137235  4163 tablet_bootstrap.cc:492] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.156647  4162 tablet_bootstrap.cc:492] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.157223  4162 ts_tablet_manager.cc:1403] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.010s
I20260709 13:15:40.159715  4162 raft_consensus.cc:359] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.160228  4162 raft_consensus.cc:385] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.160425  4162 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.160960  4162 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.162849  4161 tablet_bootstrap.cc:492] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.163293  4161 ts_tablet_manager.cc:1403] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 13:15:40.163146  3869 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.164515  4163 tablet_bootstrap.cc:654] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.166097  4161 raft_consensus.cc:359] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.166563  4161 raft_consensus.cc:385] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.166718  4161 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.163874  4162 ts_tablet_manager.cc:1434] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:40.167176  4161 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.168111  4162 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.169224  4161 ts_tablet_manager.cc:1434] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:15:40.170981  4161 tablet_bootstrap.cc:492] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.175930  4162 tablet_bootstrap.cc:654] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.176173  4161 tablet_bootstrap.cc:654] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.178068  4400 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.178514  4400 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.180544  4400 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.182736  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:40.184844  4011 leader_election.cc:343] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.186779  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.187414  4163 tablet_bootstrap.cc:492] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.187829  4163 ts_tablet_manager.cc:1403] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.010s
W20260709 13:15:40.188202  4012 leader_election.cc:343] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.188858  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:40.190641  4400 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.191799  4163 raft_consensus.cc:359] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.192478  4163 raft_consensus.cc:385] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.192724  4163 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.196684  4163 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.198553  4163 ts_tablet_manager.cc:1434] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 13:15:40.194327  4200 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.199352  4200 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.200242  4163 tablet_bootstrap.cc:492] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.201382  4200 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.202016  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.204711  4217 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.205081  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.205165  4217 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:40.206398  3937 leader_election.cc:343] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.207409  4217 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:40.208142  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.208806  3972 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:40.210311  4085 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:40.208142  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.214700  4217 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.215372  4217 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.205740  4119 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
W20260709 13:15:40.215629  4086 leader_election.cc:343] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.217103  4217 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.217973  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.222110  4040 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.225725  4200 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.226311  4200 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.226629  4200 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.228237  4400 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.228991  4217 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.236693  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:40.237356  3970 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.239064  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:40.239445  4217 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:40.240494  4086 leader_election.cc:343] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.241214  4163 tablet_bootstrap.cc:654] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.245054  4400 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.246460  4162 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.246917  4162 ts_tablet_manager.cc:1403] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.079s	user 0.011s	sys 0.011s
I20260709 13:15:40.249541  4162 raft_consensus.cc:359] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.250578  4162 raft_consensus.cc:385] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.250830  4162 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.255343  3970 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:40.251489  4162 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.261756  4085 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.263180  4494 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.263804  4494 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:40.264954  4161 tablet_bootstrap.cc:492] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.265416  4161 ts_tablet_manager.cc:1403] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.006s
I20260709 13:15:40.267915  4161 raft_consensus.cc:359] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.268524  4161 raft_consensus.cc:385] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.262858  4200 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.270820  4162 ts_tablet_manager.cc:1434] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:15:40.272866  4162 tablet_bootstrap.cc:492] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.272689  4406 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.272943  4161 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.273761  4161 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.274474  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:40.264575  4494 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:40.275612  3937 leader_election.cc:343] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.277007  4200 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.278151  4161 ts_tablet_manager.cc:1434] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:15:40.291266  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:40.301868  4161 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.315542  4168 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.316157  4168 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.326306  4168 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.293051  4115 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.328316  4278 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.338464  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:40.340507  3937 leader_election.cc:343] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.344913  4162 tablet_bootstrap.cc:654] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.343169  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:40.354032  3937 leader_election.cc:343] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.354468  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.360527  4163 tablet_bootstrap.cc:492] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.369678  3869 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.373749  4163 ts_tablet_manager.cc:1403] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.174s	user 0.028s	sys 0.027s
I20260709 13:15:40.379626  4272 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.380065  4494 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.395054  4410 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.395629  4410 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.398005  4410 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.400904  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.401611  4039 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:40.402195  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.365634  4115 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:40.403191  4465 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.403687  4465 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.405885  4465 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.356523  4168 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.373554  4161 tablet_bootstrap.cc:654] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.408385  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.409116  3970 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:40.410116  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.410784  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:40.411998  4168 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:15:40.412894  3937 leader_election.cc:343] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.413466  4168 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.413872  4168 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.388178  4163 raft_consensus.cc:359] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.414799  4163 raft_consensus.cc:385] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.415127  4163 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.415949  4163 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.413900  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.417635  4504 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.418076  4504 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:40.418808  4504 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.410833  4115 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:40.423465  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:40.419728  4163 ts_tablet_manager.cc:1434] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:15:40.425063  4163 tablet_bootstrap.cc:492] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.425463  4272 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.432281  4163 tablet_bootstrap.cc:654] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.435330  4272 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.438529  4162 tablet_bootstrap.cc:492] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.439003  4162 ts_tablet_manager.cc:1403] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.026s
I20260709 13:15:40.441498  4162 raft_consensus.cc:359] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.442118  4162 raft_consensus.cc:385] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.442377  4162 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.443058  4162 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.449913  4168 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.452658  4168 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.456354  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:40.465163  4039 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.465620  4161 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.466439  4161 ts_tablet_manager.cc:1403] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.180s	user 0.008s	sys 0.006s
I20260709 13:15:40.469368  4161 raft_consensus.cc:359] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.469766  4494 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.470054  4161 raft_consensus.cc:385] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.470353  4161 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.470948  4161 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.472900  4161 ts_tablet_manager.cc:1434] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:40.474159  4161 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.477025  4494 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.477483  4163 tablet_bootstrap.cc:492] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.478012  4163 ts_tablet_manager.cc:1403] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.053s	user 0.005s	sys 0.018s
I20260709 13:15:40.454860  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:40.480029  4040 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.480574  4039 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:40.484651  4163 raft_consensus.cc:359] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.475404  3868 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.485075  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:40.486953  4163 raft_consensus.cc:385] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.487293  4163 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.488461  4163 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.490299  4218 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.487313  4168 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.491386  4168 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:40.492069  4168 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.459522  4162 ts_tablet_manager.cc:1434] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:15:40.494709  4162 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
W20260709 13:15:40.497653  4086 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:40.499397  4119 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.499706  4163 ts_tablet_manager.cc:1434] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:15:40.501173  4163 tablet_bootstrap.cc:492] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.504207  4162 tablet_bootstrap.cc:654] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.499673  4161 tablet_bootstrap.cc:654] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.507831  4494 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.508070  4163 tablet_bootstrap.cc:654] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.508370  4494 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.511298  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.511938  3972 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:40.513075  4504 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.513576  4504 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.516970  4504 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.517345  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:40.518736  3937 leader_election.cc:343] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.518690  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:40.520290  3937 leader_election.cc:343] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.520663  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.521806  4410 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.522927  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:40.523635  4218 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.524137  4218 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.524523  4218 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.530712  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:40.532395  4086 leader_election.cc:343] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.533036  4218 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.548074  4161 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.555781  4161 ts_tablet_manager.cc:1403] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.005s
I20260709 13:15:40.557027  4218 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:40.558203  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:40.561678  4162 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.562129  4162 ts_tablet_manager.cc:1403] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.068s	user 0.011s	sys 0.000s
W20260709 13:15:40.562954  4086 leader_election.cc:343] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.563318  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:40.563885  3970 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.564421  4161 raft_consensus.cc:359] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.564607  4162 raft_consensus.cc:359] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.565212  4161 raft_consensus.cc:385] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.565805  4161 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.566468  4161 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.567894  4161 ts_tablet_manager.cc:1434] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:15:40.568822  4161 tablet_bootstrap.cc:492] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.565217  4162 raft_consensus.cc:385] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.569212  4162 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.570040  4162 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.571033  3970 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:40.571681  4162 ts_tablet_manager.cc:1434] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:15:40.572574  4162 tablet_bootstrap.cc:492] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.574949  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.581202  4217 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:40.581646  4217 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:40.582377  4217 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.585405  4162 tablet_bootstrap.cc:654] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.578321  4494 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:40.590603  4161 tablet_bootstrap.cc:654] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.593356  4162 tablet_bootstrap.cc:492] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.596848  4162 ts_tablet_manager.cc:1403] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 13:15:40.599437  4162 raft_consensus.cc:359] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.600047  4162 raft_consensus.cc:385] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.603652  4162 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.607726  4168 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.601104  3867 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:40.625411  4162 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.629787  4162 ts_tablet_manager.cc:1434] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.002s
I20260709 13:15:40.636406  4162 tablet_bootstrap.cc:492] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.642098  4119 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:40.643925  4410 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:40.649052  4162 tablet_bootstrap.cc:654] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.683246  4161 tablet_bootstrap.cc:492] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.683765  4161 ts_tablet_manager.cc:1403] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.115s	user 0.007s	sys 0.029s
I20260709 13:15:40.686836  4161 raft_consensus.cc:359] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.687515  4161 raft_consensus.cc:385] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.687772  4161 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.688438  4161 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.691659  4161 ts_tablet_manager.cc:1434] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:40.692585  4161 tablet_bootstrap.cc:492] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.705004  4161 tablet_bootstrap.cc:654] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.710140  4162 tablet_bootstrap.cc:492] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.710561  4163 tablet_bootstrap.cc:492] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.710896  4161 tablet_bootstrap.cc:492] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.711128  4163 ts_tablet_manager.cc:1403] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.210s	user 0.063s	sys 0.094s
I20260709 13:15:40.711313  4161 ts_tablet_manager.cc:1403] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.003s
W20260709 13:15:40.716843  3918 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:15:40.719696  4163 raft_consensus.cc:359] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.720191  4163 raft_consensus.cc:385] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.720345  4163 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.720832  4163 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.712019  4162 ts_tablet_manager.cc:1403] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.018s
I20260709 13:15:40.722744  4163 ts_tablet_manager.cc:1434] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:40.724175  4163 tablet_bootstrap.cc:492] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.725150  4162 raft_consensus.cc:359] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.725785  4162 raft_consensus.cc:385] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.726037  4162 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.715880  4161 raft_consensus.cc:359] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.727205  4161 raft_consensus.cc:385] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.727476  4161 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.728405  4161 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.730468  4161 ts_tablet_manager.cc:1434] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:15:40.726603  4162 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.732717  4162 ts_tablet_manager.cc:1434] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.001s
I20260709 13:15:40.733680  4162 tablet_bootstrap.cc:492] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.734170  4163 tablet_bootstrap.cc:654] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.739212  4162 tablet_bootstrap.cc:654] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.741536  4161 tablet_bootstrap.cc:492] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.750983  4161 tablet_bootstrap.cc:654] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.756577  4163 tablet_bootstrap.cc:492] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.757213  4163 ts_tablet_manager.cc:1403] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.000s
I20260709 13:15:40.762405  4163 raft_consensus.cc:359] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.763199  4163 raft_consensus.cc:385] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.763525  4163 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.761917  3869 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:40.764324  4163 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.766510  4163 ts_tablet_manager.cc:1434] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:15:40.767581  4163 tablet_bootstrap.cc:492] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.768322  4168 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.768826  4168 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.770699  4168 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.772117  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.773298  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:40.774689  3937 leader_election.cc:343] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:40.775353  3937 leader_election.cc:343] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.775712  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.777042  4504 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:40.780055  4163 tablet_bootstrap.cc:654] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.782943  4162 tablet_bootstrap.cc:492] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.783390  4162 ts_tablet_manager.cc:1403] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.026s
I20260709 13:15:40.786060  4162 raft_consensus.cc:359] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.786733  4162 raft_consensus.cc:385] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.787474  4162 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.788278  4162 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.790457  4162 ts_tablet_manager.cc:1434] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:40.791519  4162 tablet_bootstrap.cc:492] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.797828  4163 tablet_bootstrap.cc:492] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.798368  4163 ts_tablet_manager.cc:1403] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.012s
I20260709 13:15:40.798377  4162 tablet_bootstrap.cc:654] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.800969  4163 raft_consensus.cc:359] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.801636  4163 raft_consensus.cc:385] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.801966  4163 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.810366  4163 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.811753  4163 ts_tablet_manager.cc:1434] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:15:40.812330  4161 tablet_bootstrap.cc:492] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.812884  4161 ts_tablet_manager.cc:1403] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.011s
I20260709 13:15:40.816922  4161 raft_consensus.cc:359] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.817634  4161 raft_consensus.cc:385] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.821202  4161 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.821732  4161 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.823482  4161 ts_tablet_manager.cc:1434] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:15:40.820924  4504 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:15:40.825624  4161 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.818301  4163 tablet_bootstrap.cc:492] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.837131  4161 tablet_bootstrap.cc:654] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.838614  4163 tablet_bootstrap.cc:654] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.842082  4162 tablet_bootstrap.cc:492] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.842530  4162 ts_tablet_manager.cc:1403] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.051s	user 0.019s	sys 0.013s
I20260709 13:15:40.845019  4162 raft_consensus.cc:359] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.845670  4162 raft_consensus.cc:385] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.845988  4162 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.846571  4162 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.848723  4162 ts_tablet_manager.cc:1434] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:40.848789  4161 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:40.849298  4161 ts_tablet_manager.cc:1403] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.002s
I20260709 13:15:40.849713  4162 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.852289  4163 tablet_bootstrap.cc:492] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:40.852746  4163 ts_tablet_manager.cc:1403] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.005s
I20260709 13:15:40.855822  4163 raft_consensus.cc:359] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.856544  4162 tablet_bootstrap.cc:654] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.856570  4163 raft_consensus.cc:385] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.858306  4163 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.858439  4161 raft_consensus.cc:359] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.859115  4161 raft_consensus.cc:385] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.858953  4163 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.859380  4161 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.867856  4041 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.868052  4163 ts_tablet_manager.cc:1434] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:15:40.869730  4163 tablet_bootstrap.cc:492] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:40.869869  4161 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.870162  4504 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.868435  4162 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:40.870698  4504 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.871121  4162 ts_tablet_manager.cc:1403] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:15:40.871886  4161 ts_tablet_manager.cc:1434] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 13:15:40.872866  4161 tablet_bootstrap.cc:492] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Bootstrap starting.
I20260709 13:15:40.873050  4504 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.874594  4040 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.875168  4162 raft_consensus.cc:359] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.875813  4162 raft_consensus.cc:385] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:40.876067  4162 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:40.878378  4161 tablet_bootstrap.cc:654] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.878458  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.879101  4119 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:40.880908  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.882884  4200 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.883313  4200 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.887257  4163 tablet_bootstrap.cc:654] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.890338  4162 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.893095  4162 ts_tablet_manager.cc:1434] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:15:40.894243  4162 tablet_bootstrap.cc:492] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:40.895712  4200 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.896216  4494 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.900748  4162 tablet_bootstrap.cc:654] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:40.901484  4498 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:40.898044  3937 leader_election.cc:343] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.901933  4498 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.902390  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:40.903148  4410 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.903510  4410 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.903816  4410 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.903934  4498 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.907332  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.914295  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.914856  3972 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:40.914958  4465 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.915383  4465 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.918999  4465 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.920840  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.921187  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.921808  4116 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:40.921939  4494 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.922607  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:40.921836  4118 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:40.924023  4498 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.924441  4498 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.924842  4498 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.925601  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.926188  3970 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 0.
I20260709 13:15:40.927503  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:40.928220  4272 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:40.928576  4272 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:40.928901  4272 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:15:40.931144  3937 leader_election.cc:343] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:40.936118  4504 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:40.938988  4504 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.945012  4504 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.948683  4504 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.941567  4272 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:40.955329  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:40.955693  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:40.955902  4118 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.956188  3972 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.962399  4118 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:40.942492  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:40.966982  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:40.977021  4400 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:40.977985  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.000463  4400 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.002493  4400 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:40.979169  4200 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.003912  4200 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.005609  4200 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.006958  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.007767  3970 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:40.985193  4272 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.014385  4046 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:40.995918  4498 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.021960  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:41.022305  4272 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.022608  3970 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.022783  4272 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.025398  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:40.974646  4410 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.029644  4410 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.031898  4498 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.032958  3972 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:41.051306  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:41.054512  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.055210  4043 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:41.055755  4200 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.056185  4200 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.060351  4498 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.061084  4498 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:41.037320  4272 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.062251  4494 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.065478  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.066215  4118 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:41.068645  4163 tablet_bootstrap.cc:492] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:41.069208  4163 ts_tablet_manager.cc:1403] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.200s	user 0.056s	sys 0.106s
I20260709 13:15:41.071887  4163 raft_consensus.cc:359] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.072616  4163 raft_consensus.cc:385] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.072942  4163 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.073654  4163 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.075261  4163 ts_tablet_manager.cc:1434] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:41.067387  3970 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:41.077939  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:41.065541  4498 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.078608  4400 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.079054  4400 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:41.079804  4400 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.081545  4163 tablet_bootstrap.cc:492] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:41.087682  4163 tablet_bootstrap.cc:654] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.096415  4043 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.105072  4163 tablet_bootstrap.cc:492] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:41.105463  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.105708  4163 ts_tablet_manager.cc:1403] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.009s
I20260709 13:15:41.107478  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:41.108035  4116 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.109233  4163 raft_consensus.cc:359] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.109989  4163 raft_consensus.cc:385] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.110293  4163 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.110991  4163 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.113507  4163 ts_tablet_manager.cc:1434] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:15:41.114629  4163 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:41.117117  4217 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.120606  4163 tablet_bootstrap.cc:654] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.125361  4494 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.125839  4494 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.129263  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:41.129779  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.131481  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.133574  4163 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:41.134119  4163 ts_tablet_manager.cc:1403] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:15:41.057839  4200 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:41.135013  4086 leader_election.cc:343] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.137413  4116 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:41.137749  4163 raft_consensus.cc:359] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.138667  4163 raft_consensus.cc:385] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.138988  4163 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.139680  4163 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.141825  4163 ts_tablet_manager.cc:1434] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:15:41.142108  4577 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.142953  4163 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:41.137465  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.144728  3972 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
W20260709 13:15:41.145181  3937 leader_election.cc:343] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.145581  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.145713  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.146348  4217 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.146677  4217 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.146996  4217 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.150830  4163 tablet_bootstrap.cc:654] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.153411  4217 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.156061  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:41.156669  3966 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.163287  3966 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.164471  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.165815  4504 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.166815  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:41.167392  4118 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.168941  4217 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.171320  4163 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:41.171931  4163 ts_tablet_manager.cc:1403] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.020s
I20260709 13:15:41.174557  4163 raft_consensus.cc:359] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.175288  4163 raft_consensus.cc:385] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.175602  4163 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.176321  4163 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.178416  4163 ts_tablet_manager.cc:1434] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:41.179387  4163 tablet_bootstrap.cc:492] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:41.171355  4217 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.185124  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.185511  4494 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.175716  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.210716  4163 tablet_bootstrap.cc:654] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
W20260709 13:15:41.146564  3937 leader_election.cc:343] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:15:41.221391  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74849.2us
I20260709 13:15:41.222240  4163 tablet_bootstrap.cc:492] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:41.222136  4410 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.222869  4163 ts_tablet_manager.cc:1403] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.023s
I20260709 13:15:41.229549  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:41.230230  4162 tablet_bootstrap.cc:492] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.230744  4162 ts_tablet_manager.cc:1403] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.337s	user 0.039s	sys 0.104s
I20260709 13:15:41.231357  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.232028  4200 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.230677  4217 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:41.232347  4200 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.232672  4200 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.232939  4217 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.235435  4163 raft_consensus.cc:359] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.237177  4163 raft_consensus.cc:385] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.237489  4163 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.238272  4163 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.238646  4200 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.239029  4406 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.239471  4406 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.240358  4200 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.240733  4163 ts_tablet_manager.cc:1434] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:15:41.241725  4163 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Bootstrap starting.
I20260709 13:15:41.245047  4118 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:41.247157  4163 tablet_bootstrap.cc:654] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.250448  4406 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:41.251142  4086 leader_election.cc:343] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.254532  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.256925  4504 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.257383  4504 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:41.258100  4161 tablet_bootstrap.cc:492] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: No bootstrap required, opened a new log
I20260709 13:15:41.258706  4161 ts_tablet_manager.cc:1403] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Time spent bootstrapping tablet: real 0.386s	user 0.063s	sys 0.119s
I20260709 13:15:41.258168  4504 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.261437  4161 raft_consensus.cc:359] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.262113  4161 raft_consensus.cc:385] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.262387  4161 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.263126  4161 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:41.266428  3937 leader_election.cc:343] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.266834  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.267045  4161 ts_tablet_manager.cc:1434] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:15:41.269238  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.269901  3970 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:41.270277  4410 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.271015  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.271781  4586 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.272127  4586 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.272473  4586 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.276454  4498 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.277568  4162 raft_consensus.cc:359] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:41.278036  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48637.3us
I20260709 13:15:41.278403  4162 raft_consensus.cc:385] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.278728  4162 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.279605  4162 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.281623  4410 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.282186  4162 ts_tablet_manager.cc:1434] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:15:41.283015  4162 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:41.283732  3869 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:41.284403  3937 leader_election.cc:343] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.288239  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.288678  4162 tablet_bootstrap.cc:654] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.288858  4118 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 0.
I20260709 13:15:41.303581  4162 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.304193  4162 ts_tablet_manager.cc:1403] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.004s
I20260709 13:15:41.306923  4162 raft_consensus.cc:359] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.307183  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.310755  3867 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.318279  4162 raft_consensus.cc:385] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.318671  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.312662  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.322708  4046 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.329762  4162 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.330713  4588 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.331223  4588 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.332293  4162 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.333907  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:41.334117  4588 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.335950  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.337236  4116 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.336973  4046 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:41.337500  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:41.338611  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.339465  4406 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.339810  4406 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.340130  4406 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.342577  4163 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: No bootstrap required, opened a new log
I20260709 13:15:41.343025  4163 ts_tablet_manager.cc:1403] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.053s
I20260709 13:15:41.350534  4116 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:41.351089  4162 ts_tablet_manager.cc:1434] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
W20260709 13:15:41.354390  4086 leader_election.cc:343] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.355211  4162 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:41.360520  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.361156  4039 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:41.353080  4163 raft_consensus.cc:359] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.364357  4163 raft_consensus.cc:385] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.364632  4163 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.365379  4163 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:41.368218  3937 leader_election.cc:343] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.374015  4163 ts_tablet_manager.cc:1434] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:15:41.374132  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:41.360301  4406 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.376871  4504 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.379704  4504 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:41.380985  4406 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.380584  4504 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.380369  4586 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.382911  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.384716  4410 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.387665  4410 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.388015  4410 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.390297  4162 tablet_bootstrap.cc:654] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.394037  4586 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.394553  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.395432  4046 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.396606  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:41.397228  3972 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.384945  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:41.399477  3970 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.404538  4410 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.423341  4410 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.414901  3868 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.424580  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.424522  3868 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.428472  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.433053  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.434150  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:41.434612  4406 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.435624  4406 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:41.434785  4119 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.436411  4406 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:41.442041  3937 leader_election.cc:343] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.442857  4119 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:41.443250  4162 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.443648  4162 ts_tablet_manager.cc:1403] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.007s
I20260709 13:15:41.444312  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.417522  4046 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.406054  3972 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.446043  4162 raft_consensus.cc:359] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.446672  4162 raft_consensus.cc:385] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.446910  4162 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.447499  4162 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:41.449352  4086 leader_election.cc:343] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.450644  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.451776  4504 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.453581  4162 ts_tablet_manager.cc:1434] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:41.452368  4504 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:41.454494  4162 tablet_bootstrap.cc:492] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:41.454797  4504 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.460180  4162 tablet_bootstrap.cc:654] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.461859  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.466290  4588 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.466741  4588 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:41.467243  4586 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.467679  4586 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.470101  4586 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.470986  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.471683  3970 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:41.472903  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.475546  4406 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.475907  4406 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.476215  4406 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.467549  4588 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.486702  3869 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.490144  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.490783  4046 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:41.500478  3867 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.503338  4586 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.503825  4586 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.505793  4586 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.507808  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.508384  3972 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 0.
I20260709 13:15:41.509045  4162 tablet_bootstrap.cc:492] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.509516  4162 ts_tablet_manager.cc:1403] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.010s
I20260709 13:15:41.509423  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.510171  4586 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:15:41.510501  4586 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.510805  4586 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.511982  4162 raft_consensus.cc:359] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.512421  4162 raft_consensus.cc:385] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.512571  4162 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.513185  4162 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.514184  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.514542  4162 ts_tablet_manager.cc:1434] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
W20260709 13:15:41.515309  4086 leader_election.cc:343] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.515214  4406 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.517544  4162 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:41.517949  4406 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.518648  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.519124  4046 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.523696  4162 tablet_bootstrap.cc:654] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.531262  4046 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.532450  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:41.533205  4406 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.533821  4406 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:41.533829  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:41.535570  3972 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.538076  3868 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.539909  4400 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.534621  4406 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.544834  3972 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.545782  3869 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.555326  4586 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.558951  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:41.560376  4086 leader_election.cc:343] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:15:41.560873  4586 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:41.563347  4465 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.565359  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:41.565794  4162 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.565912  3972 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.566262  4162 ts_tablet_manager.cc:1403] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.020s
I20260709 13:15:41.568670  4162 raft_consensus.cc:359] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.568404  3869 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.569326  4162 raft_consensus.cc:385] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.569651  4162 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.570254  4162 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.572257  4162 ts_tablet_manager.cc:1434] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:15:41.573235  4162 tablet_bootstrap.cc:492] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:41.573199  3972 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:41.574244  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:41.579502  4586 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:15:41.579890  4162 tablet_bootstrap.cc:654] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.580014  4586 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:41.581065  4586 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.580021  4504 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.582314  4504 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.584252  4504 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.586108  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.586580  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:41.586782  4118 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:41.587178  4041 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:41.588191  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:41.589879  4504 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:41.590255  4504 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:41.590583  4504 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.603552  4504 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.606302  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:41.606694  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:41.606825  4041 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.612970  4119 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:41.614907  4041 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:41.616695  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:41.617368  4598 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:41.617820  4598 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:41.618571  4598 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.622808  4119 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:41.635370  3869 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:41.638886  4504 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.643129  4162 tablet_bootstrap.cc:492] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.643620  4162 ts_tablet_manager.cc:1403] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.071s	user 0.025s	sys 0.030s
I20260709 13:15:41.646574  3870 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:41.646070  4162 raft_consensus.cc:359] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.650157  4162 raft_consensus.cc:385] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.650453  4162 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.651079  4162 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.652701  4577 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.653148  4162 ts_tablet_manager.cc:1434] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:15:41.654074  4162 tablet_bootstrap.cc:492] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Bootstrap starting.
I20260709 13:15:41.660033  4162 tablet_bootstrap.cc:654] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Neither blocks nor log segments found. Creating new log.
I20260709 13:15:41.667819  4504 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.672677  4162 tablet_bootstrap.cc:492] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: No bootstrap required, opened a new log
I20260709 13:15:41.673157  4162 ts_tablet_manager.cc:1403] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:15:41.676074  4162 raft_consensus.cc:359] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.676716  4162 raft_consensus.cc:385] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:15:41.676988  4162 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Initialized, Role: FOLLOWER
I20260709 13:15:41.677783  4162 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.679665  4162 ts_tablet_manager.cc:1434] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:15:41.692152  4041 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.752925  4498 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.755733  4498 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.756182  4498 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.760425  4498 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.762434  4046 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.764979  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.774323  4406 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.774647  4504 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.773674  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.777535  4119 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:41.778620  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:41.779670  4498 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.788142  4498 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:41.801641  4588 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:15:41.814860  4073 tablet.cc:2406] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:15:41.899061  4410 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.902470  4272 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.902977  4272 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.903219  4504 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:41.906481  4272 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.906757  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.907437  3972 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:41.907439  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.908787  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:41.909765  4272 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.914942  4498 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:41.915525  4498 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:41.919113  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:41.919843  3972 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 1: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:41.931030  4410 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:41.959878  4043 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:15:41.972558  4498 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:41.974922  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:41.976222  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:41.976572  4272 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.008555  4494 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:15:42.010046  4498 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:15:42.014808  4406 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.019845  4494 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.031576  4585 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.059567  4586 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.072131  4200 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.077744  4039 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:15:42.079464  4624 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.056s	user 0.000s	sys 0.003s
I20260709 13:15:42.084334  4586 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.091917  4410 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.109936  4588 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.122813  4116 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:15:42.137846  4598 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.192937  4588 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:15:42.927495  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:15:42.962424  4638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:42.962709  4641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:15:42.964247  4639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:15:42.965695  2851 server_base.cc:1061] running on GCE node
I20260709 13:15:42.967618  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:15:42.967844  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:15:42.968107  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783602942968086 us; error 0 us; skew 500 ppm
I20260709 13:15:42.968705  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:15:42.973435  2851 webserver.cc:533] Webserver started at http://127.2.200.196:42155/ using document root <none> and password file <none>
I20260709 13:15:42.974047  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:15:42.974408  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:15:42.974896  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:15:42.976040  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-3-root/instance:
uuid: "293c0ff21e6f4e9f93555aaba177566b"
format_stamp: "Formatted at 2026-07-09 13:15:42 on dist-test-slave-108k"
I20260709 13:15:42.981417  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:15:42.984886  4646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:42.985704  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:15:42.986012  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-3-root
uuid: "293c0ff21e6f4e9f93555aaba177566b"
format_stamp: "Formatted at 2026-07-09 13:15:42 on dist-test-slave-108k"
I20260709 13:15:42.986354  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:15:43.003677  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:15:43.005056  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:15:43.006460  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:15:43.011032  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:15:43.011314  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:43.011675  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:15:43.011871  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:15:43.091792  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.196:37407
I20260709 13:15:43.092528  4709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.196:37407 every 8 connection(s)
I20260709 13:15:43.097457  2851 auto_leader_rebalancer-test.cc:384] add a tserver: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:43.115728  4710 heartbeater.cc:344] Connected to a master server at 127.2.200.254:44439
I20260709 13:15:43.116142  4710 heartbeater.cc:461] Registering TS with master...
I20260709 13:15:43.116863  4710 heartbeater.cc:507] Master 127.2.200.254:44439 requested a full tablet report, sending...
I20260709 13:15:43.118613  3870 ts_manager.cc:194] Registered new tserver with Master: 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:43.119946  3870 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51840
I20260709 13:15:43.993104  4041 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.002029  3965 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.003475  4637 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.006645  4118 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.008221  4637 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.015105  4637 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.018842  3965 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.031392  4041 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:15:44.033043  4013 consensus_peers.cc:597] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e3ee0cd50984b8594b3c3f0dda39a22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.037454  4118 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.038437  3870 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:44.052397  4013 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a83d90df1f344e4bcaf5128f021d5a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.052506  4118 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.056077  3965 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.057471  4637 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.059518  4498 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.129179  4710 heartbeater.cc:499] Master 127.2.200.254:44439 was elected leader, sending a full tablet report...
I20260709 13:15:44.133246  4115 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.130810  4637 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
W20260709 13:15:44.139873  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53738us
I20260709 13:15:44.136932  3972 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.207772  3867 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.256249  4116 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.265661  3972 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.264874  4041 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.267530  4636 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:44.268910  4588 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:44.277967  4087 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fa0ecf853c3e4d398a5b18c0126a0448. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.280061  4636 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.281734  4041 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.284924  3972 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.302074  4116 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.302389  3867 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.315089  4043 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.316941  4714 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:44.318744  4087 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c86a274746124a40b574d2dfb4d0e34d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:44.319378  3972 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:44.322656  4729 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:44.335059  4714 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.348500  4043 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.350399  3965 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:44.368009  3869 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:44.577373  4742 ts_tablet_manager.cc:933] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:44.579366  4742 tablet_copy_client.cc:323] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:15:44.596434  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet 7e3ee0cd50984b8594b3c3f0dda39a22 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:15:44.597092  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet 7e3ee0cd50984b8594b3c3f0dda39a22 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-7e3ee0cd50984b8594b3c3f0dda39a22
I20260709 13:15:44.608253  4746 ts_tablet_manager.cc:933] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:44.608788  4057 tablet_copy_source_session.cc:215] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:44.613413  4742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3ee0cd50984b8594b3c3f0dda39a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:44.619665  4746 tablet_copy_client.cc:323] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:15:44.623245  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet 1a83d90df1f344e4bcaf5128f021d5a8 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:15:44.623790  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet 1a83d90df1f344e4bcaf5128f021d5a8 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-1a83d90df1f344e4bcaf5128f021d5a8
I20260709 13:15:44.631402  4057 tablet_copy_source_session.cc:215] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:44.635056  4746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a83d90df1f344e4bcaf5128f021d5a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:44.648646  4742 tablet_copy_client.cc:806] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:44.650024  4746 tablet_copy_client.cc:806] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:44.649765  4742 tablet_copy_client.cc:670] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:44.650586  4746 tablet_copy_client.cc:670] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:44.654771  4746 tablet_copy_client.cc:538] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:44.654871  4742 tablet_copy_client.cc:538] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:44.664017  4742 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:44.668700  4746 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:44.696436  4746 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.699970  4746 tablet_bootstrap.cc:492] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:44.700610  4746 ts_tablet_manager.cc:1403] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.032s	user 0.026s	sys 0.001s
I20260709 13:15:44.703572  4746 raft_consensus.cc:359] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.704396  4746 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:44.705036  4746 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.709010  4751 ts_tablet_manager.cc:933] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:44.711278  4742 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.712133  4742 tablet_bootstrap.cc:492] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:44.712778  4742 ts_tablet_manager.cc:1403] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.011s
I20260709 13:15:44.715587  4742 raft_consensus.cc:359] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.716383  4742 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:44.718067  4742 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.738337  4742 ts_tablet_manager.cc:1434] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:15:44.740054  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-7e3ee0cd50984b8594b3c3f0dda39a22 received from {username='slave'} at 127.0.0.1:41202
I20260709 13:15:44.740501  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-7e3ee0cd50984b8594b3c3f0dda39a22 on tablet 7e3ee0cd50984b8594b3c3f0dda39a22 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:44.740854  4746 ts_tablet_manager.cc:1434] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.026s
I20260709 13:15:44.742242  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-1a83d90df1f344e4bcaf5128f021d5a8 received from {username='slave'} at 127.0.0.1:41202
I20260709 13:15:44.742563  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-1a83d90df1f344e4bcaf5128f021d5a8 on tablet 1a83d90df1f344e4bcaf5128f021d5a8 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:44.743111  4751 tablet_copy_client.cc:323] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:15:44.763586  4131 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet fa0ecf853c3e4d398a5b18c0126a0448 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:15:44.764204  4131 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet fa0ecf853c3e4d398a5b18c0126a0448 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-fa0ecf853c3e4d398a5b18c0126a0448
I20260709 13:15:44.779232  4131 tablet_copy_source_session.cc:215] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:44.782506  4751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa0ecf853c3e4d398a5b18c0126a0448. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:44.798007  4751 tablet_copy_client.cc:806] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:44.798758  4751 tablet_copy_client.cc:670] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:44.804435  4751 tablet_copy_client.cc:538] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:44.811362  4751 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:44.835721  4751 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.836702  4751 tablet_bootstrap.cc:492] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:44.837236  4751 ts_tablet_manager.cc:1403] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.026s	user 0.024s	sys 0.004s
I20260709 13:15:44.839759  4751 raft_consensus.cc:359] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.840332  4751 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:44.840899  4751 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.843022  4751 ts_tablet_manager.cc:1434] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:15:44.845116  4131 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-fa0ecf853c3e4d398a5b18c0126a0448 received from {username='slave'} at 127.0.0.1:51850
I20260709 13:15:44.845537  4131 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-fa0ecf853c3e4d398a5b18c0126a0448 on tablet fa0ecf853c3e4d398a5b18c0126a0448 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:44.850071  4751 ts_tablet_manager.cc:933] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:44.861009  4751 tablet_copy_client.cc:323] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:15:44.862458  4131 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet c86a274746124a40b574d2dfb4d0e34d from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:15:44.862977  4131 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet c86a274746124a40b574d2dfb4d0e34d from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-c86a274746124a40b574d2dfb4d0e34d
I20260709 13:15:44.870559  4131 tablet_copy_source_session.cc:215] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:44.873441  4751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86a274746124a40b574d2dfb4d0e34d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:44.890179  4751 tablet_copy_client.cc:806] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:44.890779  4751 tablet_copy_client.cc:670] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:44.894428  4751 tablet_copy_client.cc:538] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:44.902148  4751 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:44.918431  4751 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:44.919281  4751 tablet_bootstrap.cc:492] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:44.919832  4751 ts_tablet_manager.cc:1403] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:15:44.921989  4751 raft_consensus.cc:359] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.922606  4751 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:44.923117  4751 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:44.926373  4751 ts_tablet_manager.cc:1434] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:15:44.927929  4131 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-c86a274746124a40b574d2dfb4d0e34d received from {username='slave'} at 127.0.0.1:51850
I20260709 13:15:44.928335  4131 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-c86a274746124a40b574d2dfb4d0e34d on tablet c86a274746124a40b574d2dfb4d0e34d with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:45.070577  4684 raft_consensus.cc:1217] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:45.088001  4684 raft_consensus.cc:1217] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:45.150780  4684 raft_consensus.cc:1217] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:45.304859  4684 raft_consensus.cc:1217] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:45.505852  4758 raft_consensus.cc:1064] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:45.508324  4758 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:45.517022  4684 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.519577  4119 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.520135  3965 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.520978  4715 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.521776  4637 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.523550  4758 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.548647  4715 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.551095  3965 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.557365  4119 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.558061  4684 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.574566  3867 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.615091  4041 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:45.627604  3972 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:45.627672  4684 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:45.629249  4758 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:45.630807  4715 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:45.640468  4758 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.649608  4683 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.652544  4755 raft_consensus.cc:1064] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:45.652077  3965 raft_consensus.cc:2955] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.657306  4755 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:45.674517  3868 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.688179  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a83d90df1f344e4bcaf5128f021d5a8 with delete_type TABLET_DATA_TOMBSTONED (TS 0f3fa9d459de485e824f023c55580bc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36870
I20260709 13:15:45.690387  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a83d90df1f344e4bcaf5128f021d5a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:45.697877  4637 raft_consensus.cc:1064] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:45.700394  4637 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:45.722554  3965 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.722918  4684 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.725036  4715 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:45.727295  4715 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.728207  4768 raft_consensus.cc:1064] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:45.738327  4115 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.741025  4043 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.742061  4682 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.742226  4771 tablet_replica.cc:333] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:15:45.743331  4588 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.744593  4773 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:45.746256  4729 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:45.749778  3972 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.752203  4755 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.754688  4768 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:45.776834  4588 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.743436  4771 raft_consensus.cc:2243] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:45.780090  4773 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.800334  4771 raft_consensus.cc:2272] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:45.854028  4683 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.840358  4684 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.914227  4771 ts_tablet_manager.cc:1916] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:45.919059  3972 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.925078  3971 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.924687  3965 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.935269  4755 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:45.944984  4771 ts_tablet_manager.cc:1929] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:45.947124  4771 log.cc:1199] T 1a83d90df1f344e4bcaf5128f021d5a8 P 0f3fa9d459de485e824f023c55580bc6: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/wals/1a83d90df1f344e4bcaf5128f021d5a8
I20260709 13:15:45.952225  3870 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.952296  4046 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.951884  3869 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:45.962522  4043 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.968465  4684 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:45.980916  4784 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:45.988310  4116 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:45.991119  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet 1a83d90df1f344e4bcaf5128f021d5a8 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:15:45.997978  4118 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:46.003109  4782 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:46.010295  4683 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:46.014000  4787 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.014931  3965 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:46.019448  4782 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.025863  4043 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:46.025573  4729 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.037288  4682 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:46.039197  4683 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.045662  4758 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.054488  4715 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.060891  4682 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.064366  4118 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:46.069120  4637 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.078814  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fa0ecf853c3e4d398a5b18c0126a0448 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:46.082345  4116 raft_consensus.cc:2955] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.082559  3965 raft_consensus.cc:2955] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.086952  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e3ee0cd50984b8594b3c3f0dda39a22 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:46.107918  3869 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 3 to 4, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New cstate: current_term: 1 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:46.126323  4782 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.143410  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e3ee0cd50984b8594b3c3f0dda39a22 with delete_type TABLET_DATA_TOMBSTONED (TS 1e032f02b0aa450384dda978641ba666 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45584
I20260709 13:15:46.147305  3868 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.146204  4682 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.152637  4044 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.147243  4792 tablet_replica.cc:333] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:15:46.157624  4792 raft_consensus.cc:2243] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:46.167543  4792 raft_consensus.cc:2272] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:46.168332  3965 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.177160  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet fa0ecf853c3e4d398a5b18c0126a0448 with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49084
I20260709 13:15:46.174197  4792 ts_tablet_manager.cc:1916] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:46.185560  3867 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.199659  4793 tablet_replica.cc:333] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:15:46.209266  4792 ts_tablet_manager.cc:1929] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:46.209837  4792 log.cc:1199] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 1e032f02b0aa450384dda978641ba666: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/wals/7e3ee0cd50984b8594b3c3f0dda39a22
I20260709 13:15:46.211700  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet 7e3ee0cd50984b8594b3c3f0dda39a22 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:15:46.214107  4793 raft_consensus.cc:2243] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:46.214943  4793 raft_consensus.cc:2272] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:46.218197  4116 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:46.221120  4793 ts_tablet_manager.cc:1916] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:46.227579  4682 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:46.228809  3971 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:15:46.229292  4782 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.230409  4729 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:15:46.239897  4793 ts_tablet_manager.cc:1929] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:46.240481  4793 log.cc:1199] T fa0ecf853c3e4d398a5b18c0126a0448 P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/fa0ecf853c3e4d398a5b18c0126a0448
I20260709 13:15:46.243191  4787 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.247874  4682 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.251616  3971 raft_consensus.cc:2955] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:46.256983  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet fa0ecf853c3e4d398a5b18c0126a0448 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:15:46.265754  3867 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 3 to 4, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:46.271567  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c86a274746124a40b574d2dfb4d0e34d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:15:46.284497  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet c86a274746124a40b574d2dfb4d0e34d with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49084
I20260709 13:15:46.285565  4793 tablet_replica.cc:333] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:15:46.286481  4793 raft_consensus.cc:2243] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:15:46.287002  4793 raft_consensus.cc:2272] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:15:46.290237  4793 ts_tablet_manager.cc:1916] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:15:46.301277  4793 ts_tablet_manager.cc:1929] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:15:46.301644  4793 log.cc:1199] T c86a274746124a40b574d2dfb4d0e34d P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/c86a274746124a40b574d2dfb4d0e34d
I20260709 13:15:46.302841  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet c86a274746124a40b574d2dfb4d0e34d (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:15:47.362756  3972 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:47.370451  4116 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.371410  4046 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.372471  4732 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.373373  4759 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:47.391885  3938 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d0ea046ec794443af9a7689d2920002. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.393596  4732 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.395206  4046 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.397291  4115 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.409811  3869 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.410843  4116 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:47.424356  4046 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.425179  3972 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.427342  4787 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:47.428360  4802 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:15:47.431599  4087 consensus_peers.cc:597] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b68b34d0f4bd480da49284d88135af8b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.440984  4802 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.445144  3971 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.450819  4046 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.488803  4116 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:15:47.500897  4087 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e20b6631af674e838a0accf36c31749f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.504218  4044 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.505391  3971 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.506906  3869 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:47.511035  4802 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.512888  4769 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.528362  4810 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.530397  4044 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.542689  4118 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:47.537299  3965 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.547063  3869 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:47.571511  4087 consensus_peers.cc:597] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e61a3a06f437423cad355c7951a460bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:15:47.573830  3971 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.574251  4044 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:15:47.576223  4810 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:47.582062  4787 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:47.599285  4810 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.601940  4046 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.609769  3965 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.619568  3869 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 2, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:15:47.879884  4818 ts_tablet_manager.cc:933] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:15:47.881760  4818 tablet_copy_client.cc:323] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.193:44737
I20260709 13:15:47.895025  3982 tablet_copy_service.cc:140] P 1e032f02b0aa450384dda978641ba666: Received BeginTabletCopySession request for tablet 2d0ea046ec794443af9a7689d2920002 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:34862)
I20260709 13:15:47.895597  3982 tablet_copy_service.cc:161] P 1e032f02b0aa450384dda978641ba666: Beginning new tablet copy session on tablet 2d0ea046ec794443af9a7689d2920002 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:34862: session id = 293c0ff21e6f4e9f93555aaba177566b-2d0ea046ec794443af9a7689d2920002
I20260709 13:15:47.906057  3982 tablet_copy_source_session.cc:215] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:47.913452  4818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0ea046ec794443af9a7689d2920002. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:47.928962  4818 tablet_copy_client.cc:806] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:47.929580  4818 tablet_copy_client.cc:670] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:47.933125  4818 tablet_copy_client.cc:538] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:47.941965  4818 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:47.962644  4818 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:47.963593  4818 tablet_bootstrap.cc:492] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:47.964814  4818 ts_tablet_manager.cc:1403] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.005s
I20260709 13:15:47.968894  4818 raft_consensus.cc:359] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:47.969798  4818 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:47.970433  4818 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:47.975428  4823 ts_tablet_manager.cc:933] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:47.981156  4818 ts_tablet_manager.cc:1434] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:15:47.985349  4823 tablet_copy_client.cc:323] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:15:47.985707  3982 tablet_copy_service.cc:342] P 1e032f02b0aa450384dda978641ba666: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-2d0ea046ec794443af9a7689d2920002 received from {username='slave'} at 127.0.0.1:34862
I20260709 13:15:47.986186  3982 tablet_copy_service.cc:434] P 1e032f02b0aa450384dda978641ba666: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-2d0ea046ec794443af9a7689d2920002 on tablet 2d0ea046ec794443af9a7689d2920002 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:47.987176  4131 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet b68b34d0f4bd480da49284d88135af8b from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:15:47.987561  4131 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet b68b34d0f4bd480da49284d88135af8b from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-b68b34d0f4bd480da49284d88135af8b
I20260709 13:15:47.996407  4131 tablet_copy_source_session.cc:215] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:48.006968  4818 ts_tablet_manager.cc:933] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:48.008939  4823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68b34d0f4bd480da49284d88135af8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:48.010128  4818 tablet_copy_client.cc:323] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:15:48.011714  4131 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet e61a3a06f437423cad355c7951a460bc from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:15:48.012223  4131 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet e61a3a06f437423cad355c7951a460bc from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-e61a3a06f437423cad355c7951a460bc
I20260709 13:15:48.020504  4131 tablet_copy_source_session.cc:215] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:48.023447  4818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e61a3a06f437423cad355c7951a460bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:48.025935  4823 tablet_copy_client.cc:806] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:48.026546  4823 tablet_copy_client.cc:670] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:48.030778  4823 tablet_copy_client.cc:538] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:48.041929  4818 tablet_copy_client.cc:806] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:48.042580  4818 tablet_copy_client.cc:670] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:48.047101  4818 tablet_copy_client.cc:538] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:48.049813  4823 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:48.061910  4818 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:48.097594  4818 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:48.098611  4818 tablet_bootstrap.cc:492] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:48.099814  4818 ts_tablet_manager.cc:1403] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.011s
I20260709 13:15:48.103363  4818 raft_consensus.cc:359] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:48.104210  4818 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:48.105223  4818 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:48.109560  4818 ts_tablet_manager.cc:1434] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.007s
I20260709 13:15:48.125804  4830 ts_tablet_manager.cc:933] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:48.126351  4131 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-e61a3a06f437423cad355c7951a460bc received from {username='slave'} at 127.0.0.1:51850
I20260709 13:15:48.126834  4131 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-e61a3a06f437423cad355c7951a460bc on tablet e61a3a06f437423cad355c7951a460bc with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:48.140976  4823 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:48.142004  4823 tablet_bootstrap.cc:492] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:48.142707  4823 ts_tablet_manager.cc:1403] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.093s	user 0.024s	sys 0.005s
I20260709 13:15:48.146399  4830 tablet_copy_client.cc:323] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:15:48.146067  4823 raft_consensus.cc:359] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:48.149102  4131 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet e20b6631af674e838a0accf36c31749f from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:15:48.149621  4131 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet e20b6631af674e838a0accf36c31749f from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-e20b6631af674e838a0accf36c31749f
I20260709 13:15:48.150130  4823 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:48.151398  4823 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:48.153534  4823 ts_tablet_manager.cc:1434] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:15:48.165668  4131 tablet_copy_source_session.cc:215] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:15:48.167860  4130 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-b68b34d0f4bd480da49284d88135af8b received from {username='slave'} at 127.0.0.1:51850
I20260709 13:15:48.168329  4130 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-b68b34d0f4bd480da49284d88135af8b on tablet b68b34d0f4bd480da49284d88135af8b with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:48.170547  4830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e20b6631af674e838a0accf36c31749f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:15:48.182087  4830 tablet_copy_client.cc:806] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:15:48.182579  4830 tablet_copy_client.cc:670] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:15:48.186893  4830 tablet_copy_client.cc:538] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:15:48.195752  4830 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:15:48.214550  4830 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:15:48.215270  4830 tablet_bootstrap.cc:492] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:15:48.215799  4830 ts_tablet_manager.cc:1403] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:15:48.218292  4830 raft_consensus.cc:359] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:48.219029  4830 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:15:48.219486  4830 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:48.221587  4830 ts_tablet_manager.cc:1434] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:15:48.223014  4130 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-e20b6631af674e838a0accf36c31749f received from {username='slave'} at 127.0.0.1:51850
I20260709 13:15:48.223395  4130 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-e20b6631af674e838a0accf36c31749f on tablet e20b6631af674e838a0accf36c31749f with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:48.286429  4682 raft_consensus.cc:1217] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:48.463814  4682 raft_consensus.cc:1217] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:48.567291  4682 raft_consensus.cc:1217] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:48.575332  4682 raft_consensus.cc:1217] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:15:48.796469  4811 raft_consensus.cc:1064] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:48.799175  4811 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:48.809305  4118 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:48.809342  4682 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:48.811255  4834 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:48.812688  4799 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:48.814810  4046 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:48.818009  4811 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:48.839978  4836 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:48.845961  4046 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:48.847066  4682 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:48.852905  4118 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:48.865021  3867 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:48.989876  4828 raft_consensus.cc:1064] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:48.992695  4828 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:50.552713  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 607) took 1202 ms. Trace:
I20260709 13:15:50.607625  3972 rpcz_store.cc:276] 0709 13:15:49.350164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.550766 (+1200602us) service_pool.cc:224] Handling call
0709 13:15:50.551628 (+   862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.552005 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.552061 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.552130 (+    69us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:50.552173 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.552255 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.552441 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.826404  4852 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:50.827751  4852 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.831995  4852 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.865234  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 608) took 1514 ms. Trace:
I20260709 13:15:50.885226  4850 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.886322  4850 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.889106  4851 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:50.889868  4850 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.644322  4854 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.890046  4851 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.890992  4854 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:50.892709  4851 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.881191  3968 rpcz_store.cc:276] 0709 13:15:49.350417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:50.863716 (+1513299us) service_pool.cc:224] Handling call
0709 13:15:50.864338 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:50.864650 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:50.864689 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:50.864747 (+    58us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:50.864803 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:50.864861 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:50.865048 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:50.893532  4854 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.902812  4851 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.903644  4851 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.908018  4851 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.901721  4858 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:50.914042  4855 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.914603  4858 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.914398  4851 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:50.917678  4850 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.918864  4850 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.915740  4855 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.932621  4858 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.934422  4850 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.923287  4851 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.934783  4853 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:50.940951  4853 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.943802  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 129) took 2082 ms. Trace:
I20260709 13:15:50.944039  4853 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.948681  4855 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.953389  4861 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:50.954252  4861 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:50.955616  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 1.60378e+06us
I20260709 13:15:50.960876  4861 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.948706  4851 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.969153  4811 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:50.970057  4811 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.962453  4853 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.996306  4853 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.997359  4836 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:50.998207  4836 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.998939  4799 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.028118  4841 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:50.999841  4799 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.998984  4853 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.029155  4841 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:51.077236  4865 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.150877  4864 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.151456  4865 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:50.979233  4850 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.160621  4871 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.161603  4871 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.168745  4854 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.169073  4862 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.169574  4854 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:51.169823  4862 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.176930  4834 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.177906  4834 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.151787  4864 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.077538  4852 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.129319  4863 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.184319  4852 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.075055  4811 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.185073  4863 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.187184  4852 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.139523  4855 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.074944  4799 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:50.944962  3867 rpcz_store.cc:276] 0709 13:15:48.860943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.861088 (+   145us) service_pool.cc:224] Handling call
0709 13:15:50.943518 (+2082430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:48.869065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:48.871809 (+  2744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:48.871843 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:15:48.871860 (+    17us) tablet.cc:662] Decoding operations
0709 13:15:48.872261 (+   401us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:48.872330 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:48.872357 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:48.872538 (+   181us) tablet.cc:701] Row locks acquired
0709 13:15:48.872555 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:15:48.872670 (+   115us) write_op.cc:270] Start()
0709 13:15:48.872784 (+   114us) write_op.cc:276] Timestamp: P: 1783602948872633 usec, L: 0
0709 13:15:48.872803 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:15:48.873371 (+   568us) log.cc:844] Serialized 598 byte log entry
0709 13:15:48.880332 (+  6961us) op_driver.cc:464] REPLICATION: finished
0709 13:15:48.881935 (+  1603us) write_op.cc:301] APPLY: starting
0709 13:15:48.882032 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:48.882140 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:48.882280 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:48.882512 (+   232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:48.882694 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:48.882737 (+    43us) write_op.cc:312] APPLY: finished
0709 13:15:48.882969 (+   232us) log.cc:844] Serialized 22 byte log entry
0709 13:15:48.883181 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:48.883275 (+    94us) write_op.cc:454] Released schema lock
0709 13:15:48.883314 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:48.884455 (+  1141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:48.884495 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":1349,"apply.run_cpu_time_us":1766,"apply.run_wall_time_us":2511,"num_ops":1,"prepare.queue_time_us":1144,"prepare.run_cpu_time_us":3954,"prepare.run_wall_time_us":10600,"raft.queue_time_us":1430,"raft.run_cpu_time_us":1415,"raft.run_wall_time_us":1567,"replication_time_us":7248,"spinlock_wait_cycles":57600,"thread_start_us":6728,"threads_started":4,"wal-append.queue_time_us":3263,"wal-append.run_cpu_time_us":3509,"wal-append.run_wall_time_us":1007030}]]}
I20260709 13:15:51.189618  4865 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.190586  4841 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.166738  4853 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.191541  4854 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.191567  4862 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.119096  4858 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.187609  4836 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.260545  4850 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.285686  4871 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.371927  4863 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.380573  4850 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.261495  4841 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.222088  4864 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.313315  4851 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.261073  4855 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.288092  4834 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.260182  4799 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.277839  4852 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.261768  4858 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.370898  4874 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.349642  4854 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.358875  4861 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.381444  4862 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.285491  4853 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:51.386530  4836 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.405522  4873 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.406567  4873 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.398708  4850 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.397637  4811 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.418388  4834 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.418601  4876 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.419109  4834 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.401599  4883 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.398574  4864 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.419302  4876 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.395149  4863 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.423435  4883 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.407351  4851 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.430308  4874 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.409315  4852 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.442495  4871 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.456034  4871 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.458802  4871 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.460923  4855 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.464356  4811 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:51.463779  4860 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.438766  4862 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.421108  4861 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.424928  4854 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.425422  4799 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.438011  4841 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:51.514568  4872 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.753819  4884 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.754599  4884 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.757335  4884 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.757973  4884 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.758615  4884 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.465389  4868 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.469802  4855 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.662396  4880 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.554737  4885 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.747686  4883 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.469630  4864 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.524708  4881 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.768819  4855 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.572552  4873 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.752166  4858 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.695091  4851 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.748051  4862 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.747550  4852 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.524367  4878 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.453495  4850 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.583029  4867 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.800177  4878 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.482962  4853 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:51.483846  4876 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.481923  4869 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.609995  4874 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.606595  4877 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.751287  4888 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.527948  4863 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.797789  4873 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.798804  4854 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.483584  4882 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.798944  4855 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.799393  4883 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.647624  4875 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.791297  4872 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.819283  4867 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.791000  4881 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.789428  4880 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.790910  4857 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.805387  4869 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.810357  4864 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.811388  4861 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.789590  4885 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.810230  4871 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.836452  4883 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.833887  4872 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.834422  4856 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.628746  4860 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.822149  4859 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.833905  4850 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.820485  4865 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.840932  4873 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:51.856338  4867 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.853660  4865 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.836562  4871 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.851650  4856 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.871568  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.897676  4881 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.898406  4881 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.899031  4881 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.872953  4113 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:51.821724  4868 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.861383  4865 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.857045  4872 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:51.868945  4859 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.870186  4867 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.840497  4877 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.836987  4875 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.864195  4888 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.868466  4882 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.944175  4885 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.927961  4878 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.901352  4857 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.941303  4881 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.921958  4856 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.959925  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.961768  4860 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.925906  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.938721  4868 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.964280  4869 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.935964  4867 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.973757  4883 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.934098  4874 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:51.976624  4880 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.947602  4872 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:51.979799  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.980129  4888 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.981208  4871 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.982192  4873 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:52.011301  4874 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.013382  4874 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.982888  4875 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.965593  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.986002  4882 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:51.987715  4877 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:51.974658  4868 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:51.997869  4857 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.000329  4872 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.022747  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.979256  4881 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:52.022919  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.009517  4888 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.025324  4888 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.025780  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.027526  4888 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.028108  4868 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.029628  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:52.013530  4867 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.030335  4868 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.030344  4683 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.031183  4884 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.015163  4859 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.016428  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.017128  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.018142  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.018427  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.019865  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.033597  4118 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.022596  4863 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.000933  4880 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.023515  4881 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.040789  4121 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.047508  4894 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.048152  4894 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.051326  4894 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.051726  4894 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.052093  4894 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.053190  4120 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.055675  4889 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.054375  4115 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.058274  4881 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.059134  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.059728  4118 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.062327  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.063024  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.021656  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.070276  4118 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.072497  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.073186  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.060745  4880 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.074940  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.056568  4889 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:15:52.076040  4010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.047s	sys 0.056s
I20260709 13:15:52.077948  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.080142  4046 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 1.
I20260709 13:15:52.080528  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.080662  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:52.081228  4112 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.081383  4683 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.082136  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.082590  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:51.453485  4836 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.083271  4121 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.079146  4118 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.080152  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.085888  4117 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 1.
I20260709 13:15:52.084192  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:52.089468  4010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.047s	sys 0.056s
I20260709 13:15:52.089021  4880 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.089056  4799 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.092228  4046 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.092511  4836 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.093503  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.083267  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.094229  4836 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.094502  3938 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:15:52.092276  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:52.098115  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.085050  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.110314  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.107707  4861 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.111516  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.131289  4878 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.129132  4885 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.132332  4893 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.129530  4881 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:52.135468  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.101245  4834 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.102759  4855 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.107831  4854 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.100976  4799 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:15:52.138793  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 44358.8us
I20260709 13:15:52.107443  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.108897  4876 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.129308  4850 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.129315  4880 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.098750  4877 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.141693  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.150406  4046 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.103549  4884 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.142454  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.142584  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.142561  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.146029  4682 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.145179  4895 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.141897  4859 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.147333  4854 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.153720  4897 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.153600  4892 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.153589  4901 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:52.145799  4893 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.148176  4894 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.140462  4836 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.142413  4887 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:52.130249  4898 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.146360  4885 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.146831  4121 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.215560  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.217067  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:52.147544  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56444.9us
I20260709 13:15:52.265362  4119 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.152639  4834 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.155447  4896 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.148806  4878 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.320730  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.219228  4890 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.266152  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.215925  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.265904  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.155704  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.339983  4902 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.270435  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.154235  4880 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:52.215823  4850 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.340386  4857 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:15:52.217025  4882 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.150552  4855 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.153141  4799 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.153631  4891 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.319243  4863 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.341529  4854 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.316655  4875 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.216884  4884 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.160466  4861 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.390182  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.301488  4876 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.152297  4881 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.265172  4877 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:52.388638  4896 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.217388  4895 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.416069  4043 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.389824  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.392678  4900 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:52.421617  3972 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.345129  4859 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.390486  4834 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.426740  4041 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.394248  4040 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.427661  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.395848  4902 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.431686  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 33) took 3525 ms. Trace:
I20260709 13:15:52.432085  3870 rpcz_store.cc:276] 0709 13:15:48.863681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.863818 (+   137us) service_pool.cc:224] Handling call
0709 13:15:52.339392 (+3475574us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":738074,"reported_tablets":1}
I20260709 13:15:52.432991  4836 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.336814  4887 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.422999  4896 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.427399  4811 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:52.419750  4882 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.420647  4863 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.339190  4901 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.444078  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:52.431716  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.423159  4875 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.414289  4890 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.339569  4897 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.435210  4902 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.392122  4892 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.460619  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.444186  4891 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.495980  4863 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.496080  4892 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.443962  4893 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:52.493788  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51800.5us
I20260709 13:15:52.489114  3971 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:52.488535  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.498402  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.498972  4046 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
W20260709 13:15:52.501610  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 163744us
I20260709 13:15:52.392331  4898 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.503957  4872 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.506779  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.499619  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.507476  3963 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.507948  3966 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 1.
I20260709 13:15:52.508428  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.508692  4872 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.489841  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.509119  4872 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.509668  4047 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.510634  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.441982  4889 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:52.443917  4799 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.443951  4841 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.511169  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.514783  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.438156  4900 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.508525  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.519894  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.524724  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.460230  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.509577  4859 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.509078  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.460290  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.527365  4850 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.511826  4885 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:52.537349  4010 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49112 dropped due to backpressure: service queue is full with 50 items
I20260709 13:15:52.536861  4876 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.518471  4897 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.544960  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.518447  4895 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.547318  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.547947  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.548357  4044 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.527680  4861 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.538185  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.538146  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.537147  4834 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.552016  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.543531  4880 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.543979  3966 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.552332  4878 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.519013  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:15:52.552466  4891 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.555177  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.557068  4047 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.554557  4041 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.555138  4887 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.555305  4881 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.562392  4894 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.562790  4894 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:52.563138  4894 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.559455  4900 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.563149  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.569351  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.569527  4877 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.569954  3963 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.570804  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.570956  4884 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.571835  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.572871  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.573895  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.574895  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.575407  3963 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.576239  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.577139  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.577198  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.581034  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:52.564504  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45585.1us
I20260709 13:15:52.557879  4855 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.585741  4872 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.586771  4120 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.568085  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.594457  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 134) took 3716 ms. Trace:
I20260709 13:15:52.594889  3868 rpcz_store.cc:276] 0709 13:15:48.878348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.878493 (+   145us) service_pool.cc:224] Handling call
0709 13:15:52.594273 (+3715780us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":298499,"reported_tablets":1}
I20260709 13:15:52.609246  4898 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.611029  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.612215  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.614634  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.615861  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.605259  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:52.618096  4859 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.618528  4859 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.618860  4859 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.621411  4896 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.622632  3972 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.616425  3970 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.622941  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.623698  4896 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:52.623833  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.624432  3970 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.626753  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.627305  3970 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.628041  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.543009  4010 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 573)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 617)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 622)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 631)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 574)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 559)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 579)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 594)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 595)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 596)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 598)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 551)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 552)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 599)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 554)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 602)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 604)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 608)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 609)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 610)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 555)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 556)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 557)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 558)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 626)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 627)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 575)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 630)
I20260709 13:15:52.628559  3970 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.621418  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.639009  4890 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.639235  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.642459  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:52.643865  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea060 after lost signal to thread 2854
I20260709 13:15:52.643698  4902 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.646521  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 124) took 3777 ms. Trace:
I20260709 13:15:52.646896  3869 rpcz_store.cc:276] 0709 13:15:48.869047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:48.869156 (+   109us) service_pool.cc:224] Handling call
0709 13:15:52.646316 (+3777160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7739,"reported_tablets":1,"spinlock_wait_cycles":26880}
I20260709 13:15:52.649117  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.685968  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:15:52.686918  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53724.4us
I20260709 13:15:52.687662  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:52.695983  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.696867  4039 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.698064  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.698738  4041 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.699066  4872 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.699863  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.700420  4042 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.643888  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.783480  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.786265  4890 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.786774  4890 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.796283  4890 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.813019  4902 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.814483  4901 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.881729  4890 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:52.888003  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea740 after lost signal to thread 3904
I20260709 13:15:52.889741  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:52.890275  4705 debug-util.cc:398] Leaking SignalData structure 0x7b0800316140 after lost signal to thread 3996
I20260709 13:15:52.890583  4875 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:52.891583  4705 debug-util.cc:398] Leaking SignalData structure 0x7b0800227260 after lost signal to thread 4071
I20260709 13:15:52.894877  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:52.895738  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002445e0 after lost signal to thread 4145
I20260709 13:15:52.896153  4116 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:52.896581  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.896806  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.890321  4043 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.894465  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.897293  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.898910  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.896158  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.903647  4882 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:52.903800  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4600 after lost signal to thread 4709
I20260709 13:15:52.605518  4894 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:52.922403  4859 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.923511  4114 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:52.926074  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 238473us
I20260709 13:15:52.926821  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:52.927377  4882 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.927987  4890 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.934940  4875 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.934984  4882 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.934927  4894 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:52.935487  4875 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.935986  4875 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.940579  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:52.941609  4872 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:52.941944  4872 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:52.942348  4872 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.943143  4875 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.945101  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.945288  4875 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.942005  4859 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:52.946692  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:52.942180  4882 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:52.949584  4872 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.952536  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.952849  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.953195  4039 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.953454  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.954093  4045 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.954389  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.954690  4040 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:52.958253  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.955706  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:52.960973  4882 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:52.961000  4039 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:52.973552  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:52.976682  3968 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:52.977707  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.778851  4859 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:53.779515  4859 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:53.782254  4859 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:53.811352  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.812098  3963 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:53.813680  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.922520  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.925503  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.927330  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.929423  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:53.930209  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 567) took 1598 ms (client timeout 2109 ms). Trace:
W20260709 13:15:53.930629  4046 rpcz_store.cc:269] 0709 13:15:52.336585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.929139 (+1592554us) service_pool.cc:224] Handling call
0709 13:15:53.930153 (+  1014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:53.952821  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.953617  4047 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:53.961679  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.962563  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.969214  4047 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:53.970539  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.971659  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.972229  4047 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:53.973199  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.974419  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.974488  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:53.964609  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.965003  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.975629  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.976833  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.977116  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.977689  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:53.963537  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89108.4us
I20260709 13:15:53.965668  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.978550  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.979671  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.965986  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.966343  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.965379  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:53.975584  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:53.982214  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:53.975847  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:53.983280  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:53.983469  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.984135  3968 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:53.984644  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:53.986791  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:53.987587  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:53.988724  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:53.991261  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.991796  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.991958  3967 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:53.992419  3972 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:53.992833  4799 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:53.993212  4799 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:53.993559  4799 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.995101  4907 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:53.995466  4907 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:53.995795  4907 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:53.997264  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.998230  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:53.998955  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 580) took 1211 ms (client timeout 1584 ms). Trace:
W20260709 13:15:53.999279  4043 rpcz_store.cc:269] 0709 13:15:52.787533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:53.997989 (+1210456us) service_pool.cc:224] Handling call
0709 13:15:53.998899 (+   910us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:54.000103  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7020 after lost signal to thread 2854
I20260709 13:15:54.000015  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:53.973140  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:54.001128  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5460 after lost signal to thread 3904
I20260709 13:15:53.980684  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.003379  3964 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:54.002765  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.004320  4841 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.004714  3965 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 1.
I20260709 13:15:54.005326  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 5) took 1116 ms. Trace:
I20260709 13:15:54.005604  3965 rpcz_store.cc:276] 0709 13:15:52.889419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.002527 (+1113108us) service_pool.cc:224] Handling call
0709 13:15:54.005274 (+  2747us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.006757  4648 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:15:54.007099  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 377) took 1396 ms. Trace:
I20260709 13:15:54.004727  4841 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.007831  4841 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.007565  3966 rpcz_store.cc:276] 0709 13:15:52.610220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.610328 (+   108us) service_pool.cc:224] Handling call
0709 13:15:52.702847 (+ 92519us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:15:54.006189 (+1303342us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed73327a5b 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:15:54.006399 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:54.006602 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:54.006630 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:54.006796 (+   166us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:54.006837 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.006917 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:54.007017 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2566427392}
I20260709 13:15:54.015054  4841 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.002157  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 387) took 1375 ms. Trace:
I20260709 13:15:54.009127  4896 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.016466  4896 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.017077  4896 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:54.018961  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 1.07748e+06us
I20260709 13:15:54.019289  4841 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.006616  4799 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.021598  4799 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.012322  4857 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.024148  4857 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.026274  4857 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.026836  4857 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.012614  4890 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.013674  4909 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.026351  4882 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.033238  4900 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.033669  4900 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.034034  4900 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.035138  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.035864  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 590) took 1089 ms. Trace:
I20260709 13:15:54.036170  4118 rpcz_store.cc:276] 0709 13:15:52.946604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.034877 (+1088273us) service_pool.cc:224] Handling call
0709 13:15:54.035806 (+   929us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.037086  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.037576  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.014199  4859 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.040653  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.039942  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.043460  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 135) took 1396 ms. Trace:
I20260709 13:15:54.043799  3868 rpcz_store.cc:276] 0709 13:15:52.646914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.647094 (+   180us) service_pool.cc:224] Handling call
0709 13:15:54.043408 (+1396314us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 13:15:54.022023  3969 rpcz_store.cc:276] 0709 13:15:52.626213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.697723 (+ 71510us) service_pool.cc:224] Handling call
0709 13:15:53.999858 (+1302135us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:15:54.000756 (+   898us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443314432}
I20260709 13:15:54.049463  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.004066  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:54.010557  4907 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:54.027237  4857 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.029018  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.032071  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.052003  4857 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.052350  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.039134  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.039233  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.039726  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.037163  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.040330  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.046609  4859 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.057133  4907 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.058099  4859 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:54.034704  4909 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.029847  4890 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.023072  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:54.038156  4115 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.060952  4882 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.068645  4882 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.068859  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 569) took 1271 ms. Trace:
I20260709 13:15:54.069096  4882 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.049331  4896 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.054397  4117 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.055176  4113 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.096043  4909 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.057163  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.097688  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.098555  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.099031  4896 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.058851  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.100550  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.100800  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:54.099082  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.101218  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:54.101643  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.101790  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.099710  4890 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.102414  3972 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.053236  4116 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.052603  4857 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:54.062321  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71758.1us
I20260709 13:15:54.103209  4857 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.103608  4857 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.103752  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:15:54.100677  4011 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.719s (SENT) [suppressed 3 similar messages]
I20260709 13:15:54.053236  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.069265  4114 rpcz_store.cc:276] 0709 13:15:52.797001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:52.798827 (+  1826us) service_pool.cc:224] Handling call
0709 13:15:52.898491 (+ 99664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:52.923858 (+ 25367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:54.068563 (+1144705us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5400080554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:54.068775 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57110912}
I20260709 13:15:54.104598  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:15:54.111140  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 1.41354e+06us
W20260709 13:15:54.111266  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58082.8us
I20260709 13:15:54.099254  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.118040  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.120188  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.121551  3970 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.110786  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.117413  4909 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.127664  4909 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.099671  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.128053  4909 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.128513  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.128954  4887 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.121165  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.127142  4907 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.130280  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:54.118769  4011 connection.cc:256] RPC call timeout handler was delayed by -1.4029377340000337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:15:54.133038  4011 connection.cc:256] RPC call timeout handler was delayed by -1.3760896929998125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260709 13:15:54.133543  4011 connection.cc:256] RPC call timeout handler was delayed by -1.2654561599999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:15:54.129338  4887 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.137302  4887 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.140926  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.119359  4896 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.118203  4898 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:54.142863  4011 connection.cc:256] RPC call timeout handler was delayed by -1.2447561599999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 13:15:54.137595  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.129776  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.127830  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.143527  4896 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.126591  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.101663  4038 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.146761  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.139748  4834 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.132550  4907 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.152114  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.154511  3972 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:15:54.153046  4011 connection.cc:256] RPC call timeout handler was delayed by -1.231363330000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21530000000000002s for a response
W20260709 13:15:54.155313  4011 connection.cc:256] RPC call timeout handler was delayed by -1.2240561599999182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22040000000000004s for a response
W20260709 13:15:54.155632  4011 connection.cc:256] RPC call timeout handler was delayed by -1.19457932899968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260709 13:15:54.155921  4011 connection.cc:256] RPC call timeout handler was delayed by -1.1917914719999771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 13:15:54.156194  4011 connection.cc:256] RPC call timeout handler was delayed by -1.1911115259997587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:15:54.156077  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:54.156569  4011 connection.cc:256] RPC call timeout handler was delayed by -1.1459295059996748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19440000000000002s for a response
W20260709 13:15:54.156909  4011 connection.cc:256] RPC call timeout handler was delayed by -1.1042904479998015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 13:15:54.157173  4011 connection.cc:256] RPC call timeout handler was delayed by -1.0844418239998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18320000000000003s for a response
I20260709 13:15:54.153908  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:15:54.160310  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.160943  3965 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:54.162447  4872 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.163177  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.163761  3970 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:54.143713  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.143916  4898 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:15:54.152915  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08002162a0 after lost signal to thread 3996
I20260709 13:15:54.149430  4896 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.145965  4902 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:15:54.167232  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46802.7us
I20260709 13:15:54.152885  4834 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.153455  3969 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.158892  4907 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.170333  4910 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.171414  4898 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.177538  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.181288  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.182001  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.174167  4834 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.171437  4859 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.192500  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:54.183157  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 389) took 1540 ms (client timeout 1944 ms). Trace:
W20260709 13:15:54.194207  3969 rpcz_store.cc:269] 0709 13:15:52.637166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.097160 (+1459994us) service_pool.cc:224] Handling call
0709 13:15:54.177958 (+ 80798us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:54.195780  3968 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.183604  4910 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.206648  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.202780  4887 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.208241  4116 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.176654  4902 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.211644  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.212407  4902 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.207460  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:15:54.205348  4068 debug-util.cc:398] Leaking SignalData structure 0x7b0800315f40 after lost signal to thread 4071
W20260709 13:15:54.218937  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003095a0 after lost signal to thread 4145
I20260709 13:15:54.202591  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.207778  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:54.224902  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb560 after lost signal to thread 4709
I20260709 13:15:54.218086  4682 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.209610  4910 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.227547  4683 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:15:54.228868  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.234246  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.237325  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.237979  4891 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.238606  4891 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.238945  4891 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.239288  4891 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.230252  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.240247  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.227880  4902 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.243040  4881 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.253037  4881 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.253703  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.254195  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.254463  3967 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.252545  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.255771  3966 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.256582  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.243444  4682 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:54.259968  3938 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:15:54.260607  4857 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.260991  4908 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.261634  4908 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:54.243933  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.232096  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.264262  4880 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.267241  4880 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.267634  4880 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.252252  4896 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.253715  4881 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.276063  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.273200  3964 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:15:54.280838  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95243.3us
I20260709 13:15:54.240846  4900 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.268282  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.246042  4909 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.285899  4841 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.288491  4841 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.280385  4902 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.293218  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.293490  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.282397  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.294269  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:54.294626  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66729.8us
I20260709 13:15:54.295715  4683 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:54.311461  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.312047  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.288875  4841 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.312666  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.299265  4857 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.300602  4909 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.304639  4896 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.300354  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.264343  4908 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.289227  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.320070  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.322870  4898 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.323760  4855 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:54.324752  4884 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.325002  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.325135  4884 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:54.329847  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.332065  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.333213  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.334435  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.337164  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.337544  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.337922  4910 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.338352  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.329763  4884 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.339872  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.340221  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.340549  4884 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.300462  4834 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:54.343037  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.347244  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.351511  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.347436  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.349901  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.363731  4120 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.363830  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.348686  4683 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:54.349118  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.366187  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.366315  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.367358  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.361258  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.368453  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.369203  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.369503  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.369709  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.348098  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.348410  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.348136  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.363226  4910 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.355046  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.385249  4041 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:54.359899  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.362331  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:54.386190  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.350009  4900 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.390324  4891 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.391176  3967 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.384233  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:54.315259  4882 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.390146  4682 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:54.393004  4907 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.394227  4882 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.377978  4880 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.384717  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.394371  4914 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:15:54.396871  3970 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.397791  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.400174  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.400511  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.400980  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.401176  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.401598  3969 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.402483  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.403914  3965 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.407083  4834 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.395053  4042 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.402541  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.410018  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.396162  4887 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.397740  4914 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.420377  4914 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:54.421236  4914 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:15:54.411149  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 255135us
W20260709 13:15:54.424633  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49171.7us
I20260709 13:15:54.390014  4881 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.432641  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.408533  4114 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:54.437752  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.388536  4841 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.447754  3966 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.449391  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.501009  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.451026  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.451352  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.451777  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:54.452489  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.502861  4040 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.451047  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.507115  4039 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.453083  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.509644  4046 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.453948  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.455539  4910 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:54.456516  4913 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.456951  4911 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.457203  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.459952  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.460987  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.518417  4841 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.518967  4913 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.519465  4039 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:54.462152  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.465109  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.522845  3963 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.448570  4881 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.431460  4914 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.467290  4898 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.455443  4857 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:15:54.474720  4912 raft_consensus.cc:1064] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:54.478487  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.484576  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.482656  4859 raft_consensus.cc:1064] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:15:54.444653  4042 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
W20260709 13:15:54.498512  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 127829us
I20260709 13:15:54.500202  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.500638  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:54.505178  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54301.3us
I20260709 13:15:54.408308  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.434110  4891 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.513361  4040 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:54.514760  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.532577  4120 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.533502  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.515396  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.516042  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.516780  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.514220  4915 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:15:54.524739  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 213624us
I20260709 13:15:54.526965  4118 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.515251  4047 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.534962  4119 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:54.517503  4911 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.533353  4912 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.537825  4875 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:15:54.537448  4121 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.539412  4116 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.539702  4115 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.534143  4120 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.543547  4046 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:54.547477  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.557327  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.549630  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.553591  4900 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.553778  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.554764  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.561059  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.565303  4118 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.566357  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.566411  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.537642  4857 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.566777  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.567390  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.526362  4872 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:15:54.548825  4907 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:54.589599  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.544629  4915 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.566476  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.585487  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:54.595527  4920 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:15:54.589105  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.578356  4117 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.568075  4913 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.593758  4915 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.594245  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.575564  4857 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:54.595480  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.597601  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.579325  4121 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.597026  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.584887  4112 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.599406  4119 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.597463  4118 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.600601  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:15:54.575340  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 167125us
I20260709 13:15:54.603868  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.585939  4114 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:15:54.604252  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.568130  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.605188  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.610265  4859 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.596599  4047 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:54.620347  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.620973  3965 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.620051  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.621846  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.622579  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.622954  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.623181  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.621526  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.623800  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.605724  4911 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:54.624402  3964 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.624544  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.624979  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.609371  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.625809  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.626078  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.626287  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.626580  3966 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.627131  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.627489  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.614699  4120 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.628098  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.629192  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.629971  4119 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.630722  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.631723  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.623569  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.633531  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.612501  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.615407  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.620062  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.625337  4113 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.632661  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.643067  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.643847  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.644937  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.649089  4044 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:15:54.644749  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45989.6us
I20260709 13:15:54.650350  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.650476  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.650709  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.651288  4045 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.651721  4114 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.651568  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.651178  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.598078  4918 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.652544  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.654577  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.655670  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:54.656155  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 88104.3us
W20260709 13:15:54.656584  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 128697us
I20260709 13:15:54.656147  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.658229  4115 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.659332  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.660386  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.660604  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.629357  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.630816  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.731323  4042 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.731979  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:54.640717  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.642673  4880 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:54.718855  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65173.2us
I20260709 13:15:54.651854  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.729372  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.650646  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:54.730360  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67846.5us
I20260709 13:15:54.651291  3966 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.733589  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.755628  3970 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.755503  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.730746  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.719234  4909 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.736842  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.737407  4857 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.765164  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.767395  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.767987  3970 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:15:54.738391  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85150.9us
W20260709 13:15:54.749311  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 90649us
I20260709 13:15:54.769263  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.658288  4911 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.770287  4926 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:54.770514  4900 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.750813  4121 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:54.771683  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:54.771750  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.771974  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.772887  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.774458  4911 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.776525  4841 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.768813  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.778097  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.778287  3969 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.779233  4834 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.779927  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.679721  4918 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:54.751515  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.752650  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.740675  4011 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.760982  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:54.762490  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.763439  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.731073  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:54.780663  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.794962  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.796011  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.786669  4041 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
I20260709 13:15:54.787334  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.797756  4085 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.787660  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:15:54.788898  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48277.8us
I20260709 13:15:54.778631  4926 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.799577  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.805616  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.806035  3970 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:54.805418  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.806828  4118 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.788928  4882 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.779196  4042 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:54.809974  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.786528  4834 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:54.812876  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.813403  4012 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.790616  4875 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.786711  4113 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.823925  4918 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:54.799274  4898 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:15:54.793963  4855 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.800238  4120 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:54.817800  4882 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.818123  4884 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.818497  4909 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.818804  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.819314  4908 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:54.816726  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.804689  4872 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.811498  4924 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.847361  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.808187  4927 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.814623  4923 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:54.839696  4855 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.849001  4923 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.808208  4913 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:54.849135  4884 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.849596  4913 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:54.827893  4857 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.850476  4913 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.804844  4911 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.825691  4875 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:54.815160  4919 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.852099  4919 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:54.852495  4919 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.833902  4684 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:54.825682  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:54.843545  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.810223  4926 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.844623  4882 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.854539  4923 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:54.845677  4925 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.824683  4834 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.800544  4045 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:54.820071  4928 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.817386  4922 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.858718  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.850534  4855 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.852526  4875 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.866521  4683 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:15:54.856469  4882 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.857218  4909 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:54.858004  4925 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.863682  4880 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:54.910411  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63105.2us
I20260709 13:15:54.911203  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.912981  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:15:54.915479  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72006.2us
I20260709 13:15:54.916359  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.915874  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.917464  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:54.906332  4898 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.906591  4928 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.907186  4925 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:54.924904  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66270.8us
I20260709 13:15:54.915287  4935 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.934104  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.931143  4926 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.914947  4934 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.937788  4938 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.938017  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:15:54.939291  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:54.940552  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.940394  3972 raft_consensus.cc:2410] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 13:15:54.941591  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 128800us
I20260709 13:15:54.874405  4927 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:15:54.939528  4834 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.943143  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.943424  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.943064  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.945020  4085 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.946959  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.948069  4890 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.948457  4890 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.948854  4890 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.955466  4890 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.959040  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.947561  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:54.940869  4898 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.940061  4934 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.957191  4891 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.971944  4934 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.942092  4928 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.943939  4914 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.957976  4896 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.963318  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.961397  4085 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:54.983283  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65872.5us
I20260709 13:15:54.960951  4935 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.957587  4912 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:54.974021  4930 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:15:54.960839  4922 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.988559  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.989723  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.990043  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.972654  4859 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.972169  4683 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:54.974206  4938 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.975394  4881 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:54.973799  4891 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:54.992122  4932 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:54.994001  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 188449us
I20260709 13:15:54.995098  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:54.976310  4928 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:54.996490  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.998399  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.987972  4896 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:55.015211  4882 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.987073  4936 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:54.994567  4922 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:54.964584  4909 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:54.997620  4887 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.001823  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:55.018013  4896 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:54.991922  4898 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:54.991114  4935 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:55.003958  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.038434  4935 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.039125  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.001271  4938 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:15:55.022605  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75091.6us
I20260709 13:15:55.000630  4881 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.028038  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.026141  4922 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.053707  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.054759  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:54.999583  4859 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:55.056597  4859 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.019460  4913 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.040635  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.002561  4928 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.007808  4910 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.068918  4855 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:55.020305  4799 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.080996  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.082194  4943 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.079006  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.021272  4890 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:55.085084  4943 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.052361  4918 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.039789  4912 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.027163  4936 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.089831  4855 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:55.090167  4943 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.090643  4941 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.094736  4942 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.077102  4908 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.052917  4938 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.076534  4884 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.080221  4887 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.079291  4857 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.076514  4859 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.104211  4912 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:55.096254  4799 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.114903  4834 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.115656  4942 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.098106  4936 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.114110  4683 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.105319  4913 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.079634  4891 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.108457  4855 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.130553  4881 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.123023  4926 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:55.131685  4881 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:55.157471  4944 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:15:55.157266  4896 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.145721  4882 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:55.166914  4896 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.152252  4943 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.177587  4859 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:55.156150  4948 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:55.208499  4935 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.209476  4948 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.209841  4948 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:55.210889  4935 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.210680  4948 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:55.212443  4948 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:55.184818  4931 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.243s	user 0.000s	sys 0.002s
I20260709 13:15:55.184178  4924 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.166915  4912 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:55.205391  4915 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.606s	user 0.004s	sys 0.006s
I20260709 13:15:55.221904  4915 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.225194  4915 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:55.226550  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 185971us
I20260709 13:15:55.227331  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.228111  4925 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.239104  4925 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.238904  4936 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:55.249296  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 254224us
I20260709 13:15:55.250399  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.262234  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.265103  4915 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.265722  4925 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.266549  4891 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.267520  4915 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:55.267982  4915 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.269347  4923 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.252434  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.306149  4923 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.319926  4928 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.321300  4934 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.323340  4934 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.328585  4936 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.335268  4943 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.337687  4926 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:55.340993  4922 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.344264  4922 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:55.345891  4682 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:55.312330  4919 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.355419  4919 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:55.360219  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 98074.3us
W20260709 13:15:55.360507  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108133us
I20260709 13:15:55.361155  4923 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.361732  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:55.362401  4928 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.362668  4925 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.363783  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:15:55.360569  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 281619us
I20260709 13:15:55.363117  4925 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:55.368789  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:15:55.369115  4925 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.368880  4938 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.371083  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.375154  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.376335  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.377660  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.361723  4948 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.381531  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:55.382499  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.383958  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.384487  3972 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.385389  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.388012  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.388549  3965 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.393654  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:55.395358  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 314396us
I20260709 13:15:55.396095  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.396548  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.396713  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.397208  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.397387  4841 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.398301  4924 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.398697  4924 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.398798  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.399148  4924 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.371192  4923 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.398731  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.411407  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.411952  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.412189  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:55.412382  4841 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.413049  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:55.414125  3966 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.409089  4923 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:55.435400  4923 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.414681  4956 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.415992  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.416152  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.404812  4953 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.441560  3963 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.379606  4919 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.380520  4934 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.441810  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.442191  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.442677  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:55.442900  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.443346  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.443819  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.416013  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.418992  3965 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:55.441066  3970 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:55.422508  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.379483  4936 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.399046  4942 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:55.428184  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.428555  4939 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.383618  4948 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:55.434861  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.441045  3967 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:55.443871  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:55.445780  3965 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.400205  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:55.458143  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:15:55.459134  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59001.5us
I20260709 13:15:55.444475  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.449082  3972 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:55.440203  4915 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.427134  4943 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.459189  3971 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.459944  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:55.464506  4046 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.466734  4041 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.446705  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.467017  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.467523  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.450796  4934 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.480013  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.481884  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.453068  4948 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.485266  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.481395  4118 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:55.487741  4116 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:55.488994  4117 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
W20260709 13:15:55.492195  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45562.8us
I20260709 13:15:55.493609  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.493353  4046 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.478619  4953 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.480551  4956 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.498142  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.460702  4938 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.496281  4044 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.505438  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.506654  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.507316  4115 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.511804  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:15:55.507687  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 442065us
I20260709 13:15:55.511786  4043 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:55.486433  4934 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.514684  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.517035  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.518100  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:55.520004  4115 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.495218  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:55.499102  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:55.481784  4925 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.536214  4012 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.512545  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.519091  4855 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.529213  4951 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.529551  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.548022  4859 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.551676  4112 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.551847  4859 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:55.552872  4859 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.546422  4945 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:55.502908  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 103113us
I20260709 13:15:55.543526  4012 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.521286  4039 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.556069  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.521145  4934 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.523259  4953 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.544343  4928 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.544454  4963 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.541858  3969 raft_consensus.cc:1813] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:55.576808  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.533324  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:55.558398  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.558543  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:55.580916  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49228.4us
I20260709 13:15:55.580964  4119 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:55.559406  3965 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.544606  4939 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:55.561472  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:55.581610  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:55.562606  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.562825  3964 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.563020  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.563565  4841 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.564157  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.567677  4935 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.564641  4045 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.549154  4959 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.541671  4936 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.585393  4114 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.570806  3971 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:55.571969  3970 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.572813  4799 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.573678  4914 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.573863  4881 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.581164  4117 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.559051  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.582113  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.550246  3967 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.584439  4938 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.520959  4880 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:15:55.586896  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:55.605846  4040 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:55.606165  3968 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.606652  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:55.582427  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.585103  4919 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:55.557071  4956 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.567553  4884 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.607167  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.586920  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.590598  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.591223  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.615080  3971 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.591735  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.623745  4119 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.584714  3969 raft_consensus.cc:2410] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:15:55.548800  4923 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.594379  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:55.631436  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.632203  4044 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:55.632387  4113 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.607862  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.633177  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.633724  3967 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.634090  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.634285  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.601976  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.635737  4045 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.636627  4898 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:55.590668  4935 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.637389  4935 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.637642  4898 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.638010  4898 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.638235  4891 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.638594  4891 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.638816  4898 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.639400  4891 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.640252  4898 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.583283  4924 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.641125  3967 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:55.641351  4038 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.642449  4924 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.560024  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:15:55.643615  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83671.2us
I20260709 13:15:55.645829  4957 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.646170  4957 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.646925  4957 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.648078  4957 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.633291  4044 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.611838  4011 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:55.609189  4938 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:55.624827  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.627282  4119 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:55.627550  4116 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:55.607184  4914 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.610814  4937 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:55.600589  3965 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.636334  4940 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.588621  4121 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:55.622802  4884 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.640623  4891 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.681154  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.685225  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.686770  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:55.667261  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.626209  4915 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:55.628894  4936 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.669008  4044 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.610633  4799 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:55.671924  3965 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.658604  4924 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:55.692116  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.673041  3967 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.670660  4940 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.657821  4937 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.655949  4914 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.670037  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.702430  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.695236  4882 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.704305  3967 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.704854  4942 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.700662  4875 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.684484  4884 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.706382  4891 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:55.740015  4891 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.707387  4047 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:55.694787  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.699713  4924 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:55.742352  4924 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.696868  4922 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:15:55.717254  4684 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:15:55.717547  4915 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:15:55.662744  4880 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:15:55.694262  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:55.719002  4855 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.734452  3964 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.721285  4959 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.721926  4045 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:15:55.723628  4936 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.739279  3963 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:55.698477  4911 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:55.730551  4925 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.720088  4896 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:55.674521  4953 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.739315  4951 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.748586  4881 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:15:55.782816  4041 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.785591  3965 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:55.793466  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 176477us
W20260709 13:15:55.790912  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 104238us
I20260709 13:15:55.748940  4938 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.747725  4956 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.786893  4914 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.781013  4940 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.767081  4937 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.790042  4880 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.997305  3972 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.856294  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.903183  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.895651  4041 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.872193  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:56.016978  4119 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:55.892951  4882 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.799494  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.850808  4045 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.877597  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.875413  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.902830  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.900902  4113 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.857214  4799 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.895165  4955 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.792449  4896 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:55.903198  4120 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.015952  4880 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:55.873805  4912 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.900875  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:55.906339  4114 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.020946  4799 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.022810  4896 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:55.895568  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:55.864066  4924 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.019855  4045 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.891188  4934 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:55.875365  4682 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 13:15:56.025249  4042 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.025462  4924 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:55.821421  3966 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:15:55.827342  4923 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.026904  4045 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.888952  4884 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.795044  4928 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.028523  4038 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.880641  4855 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.798493  4919 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.028913  4043 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.851102  3967 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.030352  4884 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.022302  4880 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:55.871027  4039 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.030931  4934 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:55.893124  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.031745  4880 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.032354  4039 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.875869  4950 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.033063  4950 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:15:56.033402  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.033859  4950 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.034910  4950 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.873987  4891 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.037722  4799 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.038806  4799 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.039453  3971 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.040999  4914 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.042650  4047 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.871213  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:56.043303  4855 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.022317  4912 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.044310  4855 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.044709  4912 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.045300  4937 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.045879  4912 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.029991  4919 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.044685  4855 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:15:56.047868  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.021061  4955 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.048519  4855 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.049883  4855 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.049638  4955 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.050644  4955 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.858069  4935 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.053607  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:56.054250  4684 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:56.052693  4891 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:15:56.050019  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:55.897256  3964 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:56.065855  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.066331  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:56.066560  4940 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.067274  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.068061  3971 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.068230  4115 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.028972  4045 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.798811  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:56.071460  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 272730us
I20260709 13:15:55.851115  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:56.053892  4040 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:56.060307  4119 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.061072  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:15:56.051482  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 352570us
I20260709 13:15:56.063823  3965 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.064448  4043 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.064327  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:56.064584  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:15:56.064612  4120 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.083165  4043 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:55.797148  4963 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:15:56.088387  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.087445  4882 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.089535  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.065166  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:56.091398  4038 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:56.091817  4684 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:15:56.066013  4118 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.093315  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.094302  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.094121  4963 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.094779  4118 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.096697  4898 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.080575  4884 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:15:56.098613  4970 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.097672  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.099284  4972 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.099661  4972 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:56.100023  4972 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.101763  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.100106  4882 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.110237  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.067391  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.114320  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:15:56.118202  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.076987  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:55.855242  4841 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:55.991664  4945 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:55.856840  4859 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.118971  4841 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.119148  4859 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.119925  4841 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.120050  4859 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.121074  4841 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.121266  4859 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:55.838806  4943 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.065289  4042 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.123560  4046 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.081561  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.086093  4949 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.086163  4971 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.099041  4970 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:56.097766  4898 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:15:56.098129  4881 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:15:56.125397  4959 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:15:56.130410  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.104413  4923 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:56.110363  4896 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.113583  4953 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.148478  4953 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.149278  4953 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.149917  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.148100  4970 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.151490  4881 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.080823  4891 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:56.071684  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:55.898445  4044 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.104826  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:56.156548  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52318.8us
I20260709 13:15:56.157375  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.075345  3938 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:15:56.158562  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.081890  4957 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:15:56.068610  4935 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:56.148874  4949 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.151049  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.153299  4043 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.087055  4112 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.146129  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:55.910575  4948 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:56.177419  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 100476us
I20260709 13:15:56.154759  4118 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.155160  4881 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.150444  4953 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.163861  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.148624  4882 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:15:56.202340  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44892.6us
I20260709 13:15:56.098850  4884 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.169222  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.167030  4972 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.172168  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.207120  4923 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.207574  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.208988  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.210054  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.152508  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:56.160138  4898 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.178452  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.145649  4038 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.214607  4116 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:56.167513  4949 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.214954  4040 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.203615  4117 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:56.160403  4924 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:15:56.177618  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.165112  4896 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.167901  4039 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.211779  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.213369  4118 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.206349  4115 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:56.218071  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.125257  4942 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:56.225039  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67742.5us
I20260709 13:15:56.316421  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:56.317862  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.320039  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.212560  4956 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.201843  4909 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.104655  4952 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.108s
W20260709 13:15:56.294824  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.216271  4938 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.216969  4045 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.090546  4975 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.092s
I20260709 13:15:56.193681  4113 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.324009  4956 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.322562  4118 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.206122  4884 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.167403  4947 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.111s
I20260709 13:15:56.389164  4924 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.389564  4924 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.390319  4924 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.391460  4924 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.193789  4928 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.100s
W20260709 13:15:56.305744  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.394582  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.396653  4982 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.397152  4982 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.397967  4982 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.398844  4799 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.399076  4982 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.399224  4799 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:15:56.327617  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115914us
I20260709 13:15:56.312847  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.217494  4923 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.216410  4935 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.402115  4841 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.402624  4935 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:15:56.216843  4971 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:15:56.402154  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89435.2us
I20260709 13:15:56.404949  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.406371  4942 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.406731  4939 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.311865  4896 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.338544  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:56.407431  4945 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.407886  4964 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.407902  4977 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.204576  4922 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 13:15:56.214165  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.378044  4115 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.321931  4891 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.414666  4948 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:56.415359  4112 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.416392  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.417447  4939 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.212939  4875 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:15:56.417889  4939 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.418618  4948 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.419013  4948 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.419836  4948 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.420707  4948 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.420928  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.421638  4935 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.423719  4120 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:56.424852  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.340225  4909 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.425257  4935 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:56.425941  4909 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.418737  4939 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:56.428493  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.433952  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:56.436162  4117 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:56.446846  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.202637  4882 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.402871  4841 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.407021  4925 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.337532  4042 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.333564  4919 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.399624  4799 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.413913  4896 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.382612  4911 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:15:56.408227  4964 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.401032  4956 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:56.383033  4881 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.383589  4970 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.409723  4915 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.409260  4942 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.428318  4943 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.431890  4972 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.473029  4915 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.473219  4942 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.475731  4881 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.475114  4896 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.456867  3868 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:15:56.482789  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.409258  4977 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.498214  4983 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.475145  4943 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.385210  4949 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.491430  4912 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.498749  4983 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.489840  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:56.503183  4964 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.506594  4841 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.476461  4942 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.510015  4912 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:15:56.525885  4979 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.139s	user 0.001s	sys 0.001s
I20260709 13:15:56.526608  4942 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.497169  4884 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.519362  4891 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.545182  4964 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.529294  4949 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.515900  4882 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.545843  4884 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.543903  3964 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.569972  4983 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.573776  4121 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.574257  4882 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:56.575942  4955 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.525s	user 0.004s	sys 0.003s
I20260709 13:15:56.576061  4799 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.579293  4915 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.566252  4919 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.582850  4940 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.002s
I20260709 13:15:56.584455  4970 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.586606  4934 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.590490  4977 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.600121  4919 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.601140  4915 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.604527  3970 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.608438  4799 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:56.603271  4934 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.546312  4943 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:56.616109  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 403824us
W20260709 13:15:56.625392  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.627425  4116 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
W20260709 13:15:56.637145  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.637643  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.639180  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:56.640422  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 320403us
I20260709 13:15:56.641227  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.578224  4912 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.645025  4950 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:15:56.650904  3969 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.651003  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.639659  4937 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.629745  4948 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:15:56.645244  4943 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.661824  3937 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:56.666766  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.668033  4984 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.670671  4112 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.672374  4969 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.672878  4969 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.673785  4969 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.675689  4984 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.648270  4875 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.642503  4971 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:15:56.676604  4880 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.644s	user 0.004s	sys 0.005s
W20260709 13:15:56.678220  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.678404  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:56.658409  4799 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:56.681682  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.660486  4937 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.677969  4875 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.687443  4875 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.688642  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:56.689579  4875 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.682296  4947 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.685081  4898 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:15:56.696956  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.656596  4934 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:56.700210  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.666275  4940 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.691861  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.706961  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:15:56.708873  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:56.714192  3964 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.715809  3970 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.710624  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.703505  4947 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:15:56.727473  3938 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.010s	sys 0.017s
I20260709 13:15:56.709035  4934 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.708082  4880 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.701642  4922 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:15:56.733174  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.734225  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:15:56.727890  3938 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.010s	sys 0.017s
W20260709 13:15:56.736742  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 661388us
W20260709 13:15:56.730198  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.002s	sys 0.010s
W20260709 13:15:56.740433  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.002s	sys 0.010s
W20260709 13:15:56.740792  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 527078us
W20260709 13:15:56.745059  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.745700  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:56.727692  4963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.012s	sys 0.026s
I20260709 13:15:56.754062  3972 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.724077  4919 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.711802  4881 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:15:56.726800  4985 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:56.728982  4983 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.707018  4937 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.763373  3967 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:56.756673  4963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.013s	sys 0.026s
I20260709 13:15:56.763689  4880 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.747097  4939 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:15:56.746945  4113 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.756331  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:56.770120  3968 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:15:56.772804  4799 consensus_queue.cc:1175] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3fa9d459de485e824f023c55580bc6" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:15:56.773932  4919 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.774426  4919 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.776409  4919 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.776460  4912 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.755059  4987 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.766649  4985 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:56.778666  4926 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.778530  4988 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:15:56.792424  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115459us
I20260709 13:15:56.757910  4955 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:56.782598  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:56.765166  4984 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.779384  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:15:56.784709  3967 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:56.767107  4948 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:56.773929  4909 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.787398  4940 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:56.789989  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56879.3us
I20260709 13:15:56.779490  4939 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.790264  3969 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.792485  4985 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:56.807734  3970 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.805099  4939 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.802953  4922 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.800338  4964 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:56.799046  4984 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:56.793335  4926 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.811606  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.798827  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:56.800258  4955 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.792091  4987 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.800271  4938 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:56.768930  4947 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:15:56.709520  4924 consensus_queue.cc:1175] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3fa9d459de485e824f023c55580bc6" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:15:56.807073  4909 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.820035  4085 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:56.828426  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.850580  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:56.822100  4683 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:15:56.908839  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58366.1us
I20260709 13:15:56.909790  4967 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:15:56.910830  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 82452.6us
I20260709 13:15:56.913060  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.914963  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:56.915540  4043 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:56.916060  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:15:56.917025  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108759us
I20260709 13:15:56.917796  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:56.919026  4043 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.916518  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:56.953195  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:56.844667  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:56.807022  4940 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.960546  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:56.960994  4855 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:56.921754  3968 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:56.961588  4984 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:56.962831  4982 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.007s
I20260709 13:15:56.982146  4987 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:56.847153  4963 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:56.984588  4963 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.985226  4121 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.963195  4956 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:56.841308  4928 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:56.822324  4964 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:56.968436  4118 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:56.922969  4115 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:56.843776  4112 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.874519  4919 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:56.954161  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:56.844122  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:56.823139  4950 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.843451  4993 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.975477  4952 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.976226  4992 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:56.981918  4855 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.008438  4955 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.833093  4939 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:56.983642  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.010510  4956 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:56.985626  4121 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:56.986194  4911 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.010913  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.011121  4997 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:15:56.837275  4972 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:56.822899  4922 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:56.960639  4942 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:15:56.987092  4114 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.005930  4926 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.002795  4950 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.006887  4935 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.009095  4855 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:56.938428  4967 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:57.034943  4922 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.011866  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:56.993908  4964 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:56.983623  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.014775  4940 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.030937  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.030864  4992 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.017028  4882 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.017767  3869 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.042236  4950 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:57.039549  4993 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.044271  3869 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.019487  3870 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 2, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 2 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:15:57.021270  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.028158  4972 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:56.993912  4112 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.022751  3966 raft_consensus.cc:2368] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:15:57.025550  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:15:57.026492  4963 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.031248  4911 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.031104  4952 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.035554  4967 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.037215  4924 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.027763  4938 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.007591  4919 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:56.995429  4928 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.040836  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.037889  4935 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.044669  4993 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.046384  4882 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.046173  4841 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.047761  3869 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:15:57.055756  3969 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:57.067814  4924 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:57.056284  4683 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.035156  4855 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.066883  4938 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.083045  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.089874  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.070497  4956 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.070645  4940 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.090463  4043 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:57.097824  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.099216  4993 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.117244  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:57.117789  4044 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.117913  4046 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.064867  4911 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.119241  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:15:57.120376  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 200796us
I20260709 13:15:57.119984  4043 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:57.073038  4970 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:57.129771  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.085193  4938 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.092855  4987 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:57.153272  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.130851  4038 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.053328  4992 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.080324  4841 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:57.185490  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 443971us
W20260709 13:15:57.178848  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57778.6us
I20260709 13:15:57.217123  4046 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:15:57.117370  4984 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.234579  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.096328  4982 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.086s
I20260709 13:15:57.172427  4993 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.084964  4112 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:57.285521  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48917.6us
I20260709 13:15:57.173312  4934 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:15:57.288514  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54102.6us
I20260709 13:15:57.133029  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.237299  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.287858  4990 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.131274  4880 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.178908  4987 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.304237  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67021.1us
I20260709 13:15:57.232044  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.129416  4940 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.230566  4898 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.096498  4985 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.230841  4983 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.320384  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.325925  4041 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.313308  4875 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.288368  4993 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.233688  4986 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.085s
I20260709 13:15:57.335841  4044 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:15:57.336755  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.117311  4972 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.338766  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.338732  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.179198  4882 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.318617  4880 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.363999  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43689.2us
I20260709 13:15:57.390563  4085 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.390684  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.287981  4971 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:15:57.326809  4987 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.326895  5001 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.319752  4045 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:57.365736  4983 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.320366  4990 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.336840  4112 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.320019  4954 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:15:57.391402  3971 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:15:57.392848  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:57.422335  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.335857  4039 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
W20260709 13:15:57.396404  5004 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:15:57.368057  4993 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.368088  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:57.396715  4928 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.302192  4984 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.396129  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.470877  4044 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.383821  5006 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.421638  4935 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.340178  4898 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.386907  4997 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.389954  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.427222  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.369735  4947 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.393198  4880 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.393844  3964 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.464818  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:57.320223  4934 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.334736  4924 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.421991  4982 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.422556  4949 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:57.428570  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.473807  4114 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
W20260709 13:15:57.485262  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58142.6us
W20260709 13:15:57.418430  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.418581  5002 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.082s
W20260709 13:15:57.491071  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.520644  5015 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.521081  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.467883  5009 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.467350  4964 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.475402  4928 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.474152  4922 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:57.420367  5001 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:57.481843  4911 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.498291  4935 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.486202  4986 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.521986  4992 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.533391  4046 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.488492  4942 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.548179  4942 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.524581  3963 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:57.537968  4967 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.519580  4982 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:57.540928  5011 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:15:57.541211  4935 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.525200  4875 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:57.524638  4045 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.564043  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.478856  5006 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.487282  4947 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.553450  5002 consensus_queue.cc:1243] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:15:57.552744  4986 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.557186  4992 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.552786  4967 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.559188  5014 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.535214  5009 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.561918  4985 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.549360  4940 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.560881  4949 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:15:57.570853  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.537092  4928 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.546679  5017 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.521160  5015 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:57.559894  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 220274us
I20260709 13:15:57.576298  4967 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.580037  4983 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.570410  4875 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.596458  5018 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:15:57.574170  4992 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.608942  4937 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.588075  4985 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.611493  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:57.593155  4940 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.612191  3965 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.616995  5019 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:15:57.617789  5016 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:57.594354  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.595310  4982 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.598130  4984 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.609473  4898 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.609522  4942 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:57.621363  5010 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.137s	user 0.001s	sys 0.001s
I20260709 13:15:57.632946  3970 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.584744  5014 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.604364  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:15:57.626576  5001 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:57.625869  4934 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.646741  3965 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:15:57.627615  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.647783  4942 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:57.628859  3963 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:57.618989  4940 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.614045  4985 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:57.672111  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.639752  4964 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:57.649379  5012 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:15:57.637948  5024 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:57.676384  5015 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:57.681759  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 183366us
I20260709 13:15:57.649770  5001 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:57.595204  5017 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.673844  4963 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.667409  4898 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.626219  4949 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:57.684031  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:15:57.676852  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 84169.1us
W20260709 13:15:57.688862  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 264791us
W20260709 13:15:57.692947  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:57.688256  3968 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:57.702415  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.703123  3965 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.619043  4986 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.708187  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.711913  3965 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.712859  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.693921  4963 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:57.703291  5007 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:15:57.722285  4947 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.705724  4984 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:15:57.704566  4982 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.722886  5009 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.705849  5016 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.704042  5015 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.703711  5006 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.696925  4928 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.689559  5001 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.723230  4982 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.715739  3965 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.722438  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:57.732028  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.710141  5022 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.728932  5026 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:57.703670  4926 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:15:57.721692  4963 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.703504  4898 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.734426  5015 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:57.725625  4875 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.733865  4992 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.742266  5026 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:57.684785  5024 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.762274  5014 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.758872  3968 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:57.757248  4875 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.766181  5020 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:57.737151  5016 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.760553  3963 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.772715  4998 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.777678  3970 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.759239  5026 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:57.777882  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.783354  3972 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.775308  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.784358  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.785704  4898 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.748181  5022 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.788395  4998 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.780391  4875 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.786840  5017 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.820991  4112 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.811735  4955 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.814369  4928 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.825006  4841 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:57.827013  4683 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
I20260709 13:15:57.794382  5015 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:57.829715  4683 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:15:57.820600  4875 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.842221  3867 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.849869  3867 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.841130  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:57.838581  4880 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.855728  3867 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.857136  4880 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.852429  5009 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.858220  5009 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.831933  4909 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.855325  3968 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.831372  5001 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.857642  3867 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.861963  5009 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.862323  4948 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.825172  4955 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.860445  3972 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:57.828621  4928 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:57.875959  4938 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.004s
I20260709 13:15:57.875828  4648 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.852892  5017 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.881922  4967 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.883579  3963 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.878039  4799 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.885193  4799 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.885556  4993 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.887246  4799 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.887394  4993 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.888100  5022 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.889987  5017 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.891937  5017 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.866359  3867 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:15:57.868592  4948 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.863893  3968 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.895912  4948 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.896801  5017 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.896526  4985 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.894546  3963 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.897341  5017 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.900825  5017 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.849697  5024 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:57.903856  4044 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.876423  4938 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.902558  4121 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.893276  5030 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.908129  4950 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:57.913770  5008 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.377s	user 0.000s	sys 0.004s
I20260709 13:15:57.897418  4919 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.921022  4040 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.905174  5020 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:57.917549  4915 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:57.841374  4998 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.925102  4121 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.906069  4987 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.929337  4967 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.926400  5020 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.926507  4915 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:57.917853  5030 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.934139  4967 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.937144  3971 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:57.937819  4940 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.938446  4938 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.939090  4955 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:57.949282  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 497) took 1878 ms (client timeout 1782 ms). Trace:
I20260709 13:15:57.950300  4915 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.951421  4915 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.952286  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 505) took 1149 ms. Trace:
W20260709 13:15:57.950403  3966 rpcz_store.cc:269] 0709 13:15:56.070966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.338250 (+267284us) service_pool.cc:224] Handling call
0709 13:15:57.948054 (+1609804us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b5400401854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:15:57.949213 (+  1159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1378645888}
I20260709 13:15:57.968832  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.973441  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:57.943814  4967 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.992201  3971 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.993597  3971 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.949479  4928 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:57.960628  4940 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.998124  4041 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:57.998642  5021 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:15:57.967465  5026 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:58.002961  3971 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:57.994676  4938 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:57.995321  5017 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.000820  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.003961  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:57.986670  4969 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.005299  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:57.977823  5024 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:57.999373  4884 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.008671  4041 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:57.952649  3964 rpcz_store.cc:276] 0709 13:15:56.802789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.805504 (+  2715us) service_pool.cc:224] Handling call
0709 13:15:56.820895 (+ 15391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.487963 (+667068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:57.952051 (+464088us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54003980d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:57.952225 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295495552}
I20260709 13:15:57.999804  4939 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:57.995822  4922 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:58.000555  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.010185  4969 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.026310  4969 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.026484  4947 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.026925  4947 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.028923  4947 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.004240  4928 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.011791  4121 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.024048  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:58.035408  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.031949  4922 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.036098  5027 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:15:58.022234  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 146495us
I20260709 13:15:58.011113  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:58.021742  5022 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.043373  5040 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:58.043411  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:58.044133  4949 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.002525  4940 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:57.999511  5001 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:15:58.044554  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.044222  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.045677  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:58.045631  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.049075  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:58.044080  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.051201  4115 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.054555  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.037559  5021 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:58.021858  4938 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.021770  5017 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.061389  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.062075  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.046160  4926 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.050480  4952 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.032696  4884 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.044876  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.065768  4120 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:58.024675  5024 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.066872  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.049468  4987 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.061282  5029 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:58.050107  4924 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:15:58.046249  3966 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:58.053540  5006 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:58.050206  4954 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:15:58.037150  4928 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.078135  4046 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:58.077276  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.122287  4119 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:58.078130  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.078979  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.123387  4041 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:58.056586  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 487) took 1145 ms. Trace:
I20260709 13:15:58.053884  3963 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:58.048354  4859 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:15:58.110399  4117 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:15:58.047909  4949 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.069193  4926 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.051074  5022 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.073285  4947 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.123332  4040 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:58.112357  4956 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:58.158671  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.115782  5038 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:58.118901  5006 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.115623  5029 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.064364  5040 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.161424  4928 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.124339  4121 rpcz_store.cc:276] 0709 13:15:56.911594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.921296 (+  9702us) service_pool.cc:224] Handling call
0709 13:15:56.982507 (+ 61211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.902134 (+919627us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b4c002c2900. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74718a20 00007fed74729a29 00007fed746ef644 00007fed74716f2d 00007fed74716b93 00007fed7644718b 00007fed76447cb5 00007fed76442f30 00007fed764447de 00007fed7644eb49 00007fed7644f416
0709 13:15:58.040087 (+137953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.053072 (+ 12985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13310848}
I20260709 13:15:58.162932  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.163475  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.188827  4119 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.163798  5043 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.159659  4987 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.165817  4969 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.170107  4040 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:58.171329  4956 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:15:58.123133  3964 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:15:58.121004  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.120805  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:58.162161  4926 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.188287  4041 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:58.192644  5037 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.165293  5026 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.077522  4952 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.197540  4040 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:15:58.129021  4909 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.172637  4967 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.176949  5006 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.167395  5020 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.193540  4039 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:58.185230  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.211982  4118 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:58.188390  4898 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.169332  5030 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.171859  5038 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.214404  5029 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.215003  5037 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.193303  4928 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:58.172298  5021 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.177435  4947 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.228089  5041 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:15:58.194953  4987 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.237915  4940 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.217669  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 643) took 1295 ms. Trace:
I20260709 13:15:58.237874  4041 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:15:58.222019  4909 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.239405  4114 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:15:58.216477  4922 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.238852  5037 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.288499  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.263145  4045 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:58.278407  4038 rpcz_store.cc:276] 0709 13:15:56.912894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.921047 (+  8153us) service_pool.cc:224] Handling call
0709 13:15:56.961255 (+ 40208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.178583 (+217328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.190670 (+1012087us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540035cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:58.208580 (+ 17910us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279840128}
I20260709 13:15:58.236029  4898 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.305747  4924 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.305189  4959 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.305361  4969 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.283766  4909 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.284468  5017 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.246214  4928 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.303889  4963 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.000s
W20260709 13:15:58.308285  5039 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:15:58.277537  4884 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.239593  4956 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.418793  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.425025  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 366376us
I20260709 13:15:58.300459  4967 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.308362  4940 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.401309  4942 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.407945  4949 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.461411  4967 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.426386  4922 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.407634  5026 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.430444  5017 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:15:58.452550  5022 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.456053  4940 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.461025  4993 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.462193  5024 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:58.473771  5036 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:15:58.426946  4924 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.427253  4959 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.455094  4963 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.462303  4969 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:15:58.466562  4912 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:15:58.466624  5029 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:15:58.463124  4942 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.482039  4940 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.467906  4950 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 13:15:58.499286  4915 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.547s	user 0.006s	sys 0.005s
I20260709 13:15:58.483870  5022 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.505929  4915 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:15:58.493145  5047 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:15:58.506608  4915 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.505815  4947 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.479658  5026 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.476904  4922 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.506006  5005 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:58.499967  5030 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:58.484108  4993 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.520898  4988 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:58.504072  5028 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:58.523769  5015 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.523222  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:58.511392  5029 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.481647  5017 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.531673  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.501057  5024 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:15:58.530244  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.513083  4952 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.502801  5049 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:15:58.509346  5022 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.551944  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:58.547955  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 486604us
I20260709 13:15:58.532992  5005 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:15:58.593372  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.528906  4987 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:58.601398  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.550374  5021 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.537273  5029 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:58.530786  5030 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.675479  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:58.591988  5038 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.591694  5058 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:58.545173  5015 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.619271  4898 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.735215  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.646888  5020 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:15:58.736316  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 204665us
I20260709 13:15:58.673789  4928 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.737711  4043 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:58.740669  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.742972  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.743608  4043 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.552107  5028 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.675654  4969 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.744318  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.674484  5059 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.752290  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.756587  4041 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.754662  4043 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.758080  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.532419  4988 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.725495  5021 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.758796  4043 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:58.730599  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 724) took 1029 ms. Trace:
I20260709 13:15:58.733484  5062 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.758780  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.763612  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.792742  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.733958  5040 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:58.733120  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57282.4us
I20260709 13:15:58.749452  4947 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:58.789968  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.754729  4967 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.793880  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.793782  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.760733  5018 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.761695  4928 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.743276  4987 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:15:58.759548  5053 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.794031  4912 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.805652  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:58.805519  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:15:58.799780  5042 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.313s	user 0.001s	sys 0.001s
I20260709 13:15:58.807386  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:58.726773  5051 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.325s
I20260709 13:15:58.808991  5061 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:58.785840  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55321.9us
I20260709 13:15:58.760424  4969 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.794267  4963 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.825807  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.801604  4975 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.799124  4924 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.732251  5058 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.806823  4950 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.753772  5005 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.823199  4915 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.799059  4898 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.838523  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:58.886018  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 145500us
I20260709 13:15:58.760365  5029 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.866950  5060 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:15:58.868862  5064 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.869261  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:58.873337  5056 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:15:58.823503  4038 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.827286  4935 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.830305  4993 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.791464  5059 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.826681  5038 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:15:58.832712  4990 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.836954  4882 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.798964  5062 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.834811  4922 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.914660  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.838676  4912 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.918394  4912 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.919752  5026 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.894356  5022 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.837635  4947 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:15:58.921700  4990 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.928642  4990 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.929069  4990 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.880879  4975 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.904870  5019 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.896672  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:15:58.898180  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:15:58.881428  5006 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.650s	user 0.009s	sys 0.001s
I20260709 13:15:58.864023  5061 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.829217  5065 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:58.902778  4011 leader_election.cc:400] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:15:58.884779  5017 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:58.893411  4898 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:58.835525  4928 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.825661  5018 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:15:58.914427  5029 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.940337  4011 leader_election.cc:403] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:15:58.941200  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.950726  4041 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:58.792429  3969 rpcz_store.cc:276] 0709 13:15:57.701237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.872733 (+171496us) service_pool.cc:224] Handling call
0709 13:15:57.901580 (+ 28847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.901991 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.902024 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.908255 (+  6231us) log.cc:844] Serialized 564 byte log entry
0709 13:15:58.054760 (+146505us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.059549 (+  4789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:58.067055 (+  7506us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:58.619196 (+552141us) raft_consensus.cc:1685] finished
0709 13:15:58.674526 (+ 55330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:58.726864 (+ 52338us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":137062,"threads_started":1,"wal-append.queue_time_us":302702}
I20260709 13:15:58.935667  4911 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:58.933990  4975 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.901599  4967 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:15:58.920642  5062 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.931717  4972 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:58.919803  5058 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.914659  5052 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.893780  4950 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.947693  4898 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.949685  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:58.927208  5030 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.937712  5015 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.939911  5022 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:58.948350  4926 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.002s
I20260709 13:15:58.935734  4912 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:58.878763  5053 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.969589  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82198.6us
I20260709 13:15:58.942689  5061 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:58.972831  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.943518  5068 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:58.939816  5019 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.912940  4875 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:15:58.963467  4911 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:58.970873  5062 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:15:58.979895  4947 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.980533  5018 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.944192  5065 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:58.951623  4988 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:58.980818  5052 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.981525  5072 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:15:58.967604  5021 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:58.943689  5006 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.984249  5043 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.773s	user 0.007s	sys 0.010s
I20260709 13:15:58.985859  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:58.910039  5064 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:58.990725  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 185271us
I20260709 13:15:58.994539  4926 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:58.995404  4912 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:58.996217  4928 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:58.996634  4117 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:15:59.000989  4116 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:58.981389  4997 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:15:58.991657  4982 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.015811  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 718) took 1316 ms. Trace:
I20260709 13:15:59.019140  4041 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:58.997859  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.297983  3965 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:59.175161  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:59.301246  3970 rpcz_store.cc:276] 0709 13:15:57.699716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.703495 (+  3779us) service_pool.cc:224] Handling call
0709 13:15:57.777462 (+ 73967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.782163 (+  4701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.012391 (+1230228us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b5400277750. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:15:59.015750 (+  3359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166131072}
W20260709 13:15:59.307355  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 132310us
W20260709 13:15:59.270534  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.301635  3937 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.744s (SENT) [suppressed 122 similar messages]
I20260709 13:15:59.019644  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 704) took 1695 ms. Trace:
I20260709 13:15:59.315035  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.070869  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:59.319195  4044 rpcz_store.cc:276] 0709 13:15:57.324611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.471588 (+146977us) service_pool.cc:224] Handling call
0709 13:15:57.832554 (+360966us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:15:57.832744 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:57.905845 (+ 73101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.019425 (+1113580us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b540003b454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:59.019588 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167270144}
W20260709 13:15:59.018131  4121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.028s
I20260709 13:15:59.014525  5068 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:15:59.071396  4940 consensus_meta.cc:287] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
W20260709 13:15:59.209052  5037 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.003s
W20260709 13:15:59.297900  4939 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.265s	user 0.011s	sys 0.000s
W20260709 13:15:59.303561  4909 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.875s	user 0.005s	sys 0.006s
I20260709 13:15:59.358721  4119 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:15:59.040058  5071 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.368264  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.019930  5029 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.213112  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.369318  4044 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:59.369026  5029 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:59.369174  4120 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:59.019470  5065 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.370427  5022 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.370626  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 695) took 1324 ms. Trace:
I20260709 13:15:59.371249  4040 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:59.177536  5067 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.143006  4969 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:59.098814  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 73397.3us
I20260709 13:15:59.097626  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.283334  5019 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.374971  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.303973  5072 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:15:59.456154  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 154529us
I20260709 13:15:59.372272  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.300868  5053 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.019502  5059 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.096024  4963 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:15:59.381999  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:59.140789  4898 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.313930  5043 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.014007  4967 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.345s
I20260709 13:15:59.382319  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:59.379326  4972 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:15:59.561764  4926 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.302910  4997 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:15:59.015424  4950 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:59.338455  5021 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.366312  4121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.012s	sys 0.038s
I20260709 13:15:59.296546  4990 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.422222  3969 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
I20260709 13:15:59.339442  4975 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.573257  4963 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:59.558337  4682 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:59.561417  5029 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:15:59.147516  5074 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:59.561682  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.572932  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.382718  5071 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.364879  4940 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.599395  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 734) took 1893 ms. Trace:
W20260709 13:15:59.590703  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.378537  5068 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.380034  4909 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.456638  5028 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.603467  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:15:59.608251  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 194616us
I20260709 13:15:59.607806  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.338500  5017 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.371965  5037 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.371184  4120 rpcz_store.cc:276] 0709 13:15:58.046272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.160222 (+113950us) service_pool.cc:224] Handling call
0709 13:15:59.212907 (+1052685us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:15:59.370535 (+157628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22211968}
I20260709 13:15:59.456523  5067 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:59.633731  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:59.634723  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 653) took 2204 ms. Trace:
I20260709 13:15:59.176208  4911 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.612123  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 685) took 1568 ms. Trace:
I20260709 13:15:59.614630  4684 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:59.611685  4042 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:59.632678  3970 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:59.633486  4041 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:15:59.617806  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.634397  3972 rpcz_store.cc:276] 0709 13:15:57.706185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.784081 (+ 77896us) service_pool.cc:224] Handling call
0709 13:15:59.599203 (+1815122us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b54002c8154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:15:59.599337 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167240448}
I20260709 13:15:59.636595  5052 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.620383  5021 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.636806  4898 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.612875  4972 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.635242  3964 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.642014  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:15:59.645226  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:15:59.666673  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.601730  5064 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.648191  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:15:59.642671  5061 consensus_meta.cc:287] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.623s	user 0.006s	sys 0.003s
I20260709 13:15:59.621887  5072 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.646122  5006 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.669414  4044 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.649765  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.653602  5020 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.678189  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.657656  4911 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.679592  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.661556  4648 leader_election.cc:400] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
I20260709 13:15:59.644731  5017 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.652697  4681 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
W20260709 13:15:59.683962  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.721817  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 742) took 1730 ms. Trace:
I20260709 13:15:59.665203  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.676898  5016 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:59.719257  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 115860us
I20260709 13:15:59.637646  4997 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.725889  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:59.722188  3971 rpcz_store.cc:276] 0709 13:15:57.991089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.008391 (+ 17302us) service_pool.cc:224] Handling call
0709 13:15:58.920955 (+912564us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:15:58.921151 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.921477 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.921511 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.932218 (+ 10707us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.301102 (+368884us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.301143 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.301206 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.677383 (+376177us) raft_consensus.cc:1685] finished
0709 13:15:59.677407 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.721749 (+ 44342us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3888,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":10157,"spinlock_wait_cycles":35245952,"thread_start_us":337546,"threads_started":1,"wal-append.queue_time_us":671033}
I20260709 13:15:59.720494  4041 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:15:59.638123  5074 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.728317  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:15:59.676215  5061 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.665056  4045 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
W20260709 13:15:59.724524  5081 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:15:59.675078  5029 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.682900  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:59.787182  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58932.8us
I20260709 13:15:59.788532  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:59.728286  4648 leader_election.cc:403] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:59.731060  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.740373  4940 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.650954  4114 rpcz_store.cc:276] 0709 13:15:58.043579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.043808 (+   229us) service_pool.cc:224] Handling call
0709 13:15:59.600142 (+1556334us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002071d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:15:59.609689 (+  9547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348761984}
I20260709 13:15:59.671574  5019 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.790019  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:15:59.739351  4909 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.791978  5021 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.671213  5023 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:15:59.725742  3968 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:59.795742  3971 raft_consensus.cc:2368] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:15:59.729147  5016 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.742429  4972 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.832882  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:59.746661  4942 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.833125  5016 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.829250  5023 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:15:59.834233  5023 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:15:59.834770  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 735) took 2128 ms (client timeout 1838 ms). Trace:
I20260709 13:15:59.835160  5016 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.826787  4943 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.835894  4943 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.649014  4047 rpcz_store.cc:276] 0709 13:15:57.426728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.521029 (+ 94301us) service_pool.cc:224] Handling call
0709 13:15:57.526475 (+  5446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:57.592007 (+ 65532us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:57.597062 (+  5055us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:57.625528 (+ 28466us) log.cc:844] Serialized 26 byte log entry
0709 13:15:57.869602 (+244074us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:57.895171 (+ 25569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.602051 (+1706880us) spinlock_profiling.cc:243] Waited 53.3 ms on lock 0x7b54003dc554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:59.609716 (+  7665us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.612197 (+  2481us) raft_consensus.cc:1685] finished
0709 13:15:59.614323 (+  2126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.623932 (+  9609us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21221,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":122686336,"thread_start_us":175173,"threads_started":1,"wal-append.queue_time_us":310954,"wal-append.run_cpu_time_us":1493,"wal-append.run_wall_time_us":1002397}
I20260709 13:15:59.836207  4938 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.797343  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 684) took 1754 ms. Trace:
I20260709 13:15:59.827332  4975 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:59.798035  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 687) took 1753 ms (client timeout 1744 ms). Trace:
I20260709 13:15:59.838449  5017 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:15:59.838734  4118 rpcz_store.cc:269] 0709 13:15:58.044134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.044347 (+   213us) service_pool.cc:224] Handling call
0709 13:15:59.797855 (+1753508us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400097c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:15:59.797979 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":366738816}
I20260709 13:15:59.798645  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.730610  5087 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:15:59.674105  4898 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.842020  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.720713  5020 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:59.804164  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 213797us
I20260709 13:15:59.756902  5002 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:15:59.787515  5091 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.744148  4963 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.841876  5043 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.739820  4990 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.790311  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 700) took 1742 ms. Trace:
I20260709 13:15:59.805011  4926 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:15:59.809669  5088 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:15:59.809509  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:15:59.810616  5083 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:15:59.786144  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 662) took 1048 ms. Trace:
I20260709 13:15:59.812008  5067 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:15:59.813069  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 494) took 1406 ms (client timeout 1727 ms). Trace:
I20260709 13:15:59.813922  5079 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:15:59.819412  5068 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.727509  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:59.823225  5071 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.824275  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:15:59.824792  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.825626  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.902361  4041 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:15:59.793712  5037 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:15:59.827385  4044 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:15:59.829771  4011 leader_election.cc:400] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:15:59.831278  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:59.902843  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 667) took 1165 ms. Trace:
I20260709 13:15:59.832026  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.903749  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 732) took 1156 ms. Trace:
I20260709 13:15:59.903877  3971 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.904104  4044 rpcz_store.cc:276] 0709 13:15:58.747098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.647901 (+900803us) service_pool.cc:224] Handling call
0709 13:15:59.903693 (+255792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.904860  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:59.832638  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 739) took 1842 ms (client timeout 2059 ms). Trace:
W20260709 13:15:59.840169  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 693) took 1794 ms (client timeout 1619 ms). Trace:
I20260709 13:15:59.794245  4949 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:15:59.903501  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72257.9us
I20260709 13:15:59.743467  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.906414  3964 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:59.907209  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.907320  5023 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:59.907699  5001 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:15:59.908344  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.851263  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 500) took 1333 ms. Trace:
I20260709 13:15:59.879316  5091 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.789016  5029 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.881306  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 36) took 2899 ms. Trace:
I20260709 13:15:59.913612  4990 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.913516  3964 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:15:59.835136  3965 rpcz_store.cc:269] 0709 13:15:57.706449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.731786 (+ 25337us) service_pool.cc:224] Handling call
0709 13:15:59.834588 (+2102802us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b540044b6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:15:59.834685 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3599963008}
I20260709 13:15:59.882355  4121 rpcz_store.cc:276] 0709 13:15:58.047450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.208629 (+161179us) service_pool.cc:224] Handling call
0709 13:15:58.230751 (+ 22122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.266869 (+ 36118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.270094 (+  3225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:58.426439 (+156345us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.622997 (+1196558us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:15:59.749784 (+126787us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b5400392220. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c7733 00007fed7644cdbf 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c
0709 13:15:59.749854 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.749978 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.750034 (+    56us) raft_consensus.cc:1685] finished
0709 13:15:59.750047 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.790243 (+ 40196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19037,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":9486,"spinlock_wait_cycles":14869888,"thread_start_us":1138191,"threads_started":1,"wal-append.queue_time_us":914068}
I20260709 13:15:59.836598  5061 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.856011  4940 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.836233  4943 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:15:59.887318  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98849.4us
I20260709 13:15:59.837831  4112 rpcz_store.cc:276] 0709 13:15:58.043249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.048254 (+  5005us) service_pool.cc:224] Handling call
0709 13:15:58.069061 (+ 20807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.193101 (+124040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.198713 (+  5612us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.205915 (+  7202us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:58.209309 (+  3394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.797078 (+1587769us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400081e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:59.797128 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.797282 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236900096}
I20260709 13:15:59.923133  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:59.923539  4087 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 491) took 1517 ms. Trace:
W20260709 13:15:59.841593  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 194937us
I20260709 13:15:59.856628  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:59.882504  5017 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.919502  4990 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:15:59.915346  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 232352us
I20260709 13:15:59.926985  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.927624  3964 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:15:59.914167  3870 rpcz_store.cc:276] 0709 13:15:56.982310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.982458 (+   148us) service_pool.cc:224] Handling call
0709 13:15:59.881233 (+2898775us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.415442 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.535858 (+120416us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.538884 (+  3026us) write_op.cc:435] Acquired schema lock
0709 13:15:57.538907 (+    23us) tablet.cc:662] Decoding operations
0709 13:15:57.561609 (+ 22702us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.561667 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.561695 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:57.565597 (+  3902us) tablet.cc:701] Row locks acquired
0709 13:15:57.568981 (+  3384us) write_op.cc:260] PREPARE: finished
0709 13:15:57.579391 (+ 10410us) write_op.cc:270] Start()
0709 13:15:57.581594 (+  2203us) write_op.cc:276] Timestamp: P: 1783602957578393 usec, L: 0
0709 13:15:57.583254 (+  1660us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.631468 (+ 48214us) log.cc:844] Serialized 535 byte log entry
0709 13:15:58.521374 (+889906us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.802512 (+281138us) write_op.cc:301] APPLY: starting
0709 13:15:58.805714 (+  3202us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.824623 (+ 18909us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.838570 (+ 13947us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.874499 (+ 35929us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.906693 (+ 32194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:58.906763 (+    70us) write_op.cc:312] APPLY: finished
0709 13:15:58.920033 (+ 13270us) log.cc:844] Serialized 22 byte log entry
0709 13:15:58.920228 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.920300 (+    72us) write_op.cc:454] Released schema lock
0709 13:15:58.920350 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.920698 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.920729 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":259,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":240127,"apply.run_cpu_time_us":2531,"apply.run_wall_time_us":130875,"num_ops":1,"prepare.queue_time_us":333334,"prepare.run_cpu_time_us":4013,"prepare.run_wall_time_us":253868,"replication_time_us":936286,"thread_start_us":95094,"threads_started":1}]]}
I20260709 13:15:59.925676  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.930184  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 497) took 1466 ms. Trace:
I20260709 13:15:59.930522  4112 rpcz_store.cc:276] 0709 13:15:58.463754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.925382 (+1461628us) service_pool.cc:224] Handling call
0709 13:15:59.930123 (+  4741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.927284  4990 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.931496  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.924041  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:15:59.932245  4112 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.932885  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 508) took 1128 ms. Trace:
I20260709 13:15:59.933229  4112 rpcz_store.cc:276] 0709 13:15:58.804392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.931216 (+1126824us) service_pool.cc:224] Handling call
0709 13:15:59.932830 (+  1614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.934598  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:15:59.936168  4998 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.937466  5017 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:15:59.939320  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 132) took 3845 ms. Trace:
I20260709 13:15:59.841454  5087 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.886775  4926 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.891687  4114 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.925601  5029 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:15:59.945457  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 501) took 1399 ms (client timeout 1846 ms). Trace:
W20260709 13:15:59.945873  4114 rpcz_store.cc:269] 0709 13:15:58.546166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.808880 (+1262714us) service_pool.cc:224] Handling call
0709 13:15:59.945393 (+136513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.946606  4948 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.946990  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.888273  4045 rpcz_store.cc:276] 0709 13:15:58.736253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.602299 (+866046us) service_pool.cc:224] Handling call
0709 13:15:59.784332 (+182033us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:59.891721  4120 rpcz_store.cc:269] 0709 13:15:58.406898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.656600 (+1249702us) service_pool.cc:224] Handling call
0709 13:15:59.812968 (+156368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.948203  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.948161  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.949093  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 509) took 1125 ms. Trace:
I20260709 13:15:59.949688  4120 rpcz_store.cc:276] 0709 13:15:58.824117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.947951 (+1123834us) service_pool.cc:224] Handling call
0709 13:15:59.949033 (+  1082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.949087  4045 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:59.951226  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.905211  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 507) took 2516 ms. Trace:
I20260709 13:15:59.905172  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:15:59.742568  4997 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.955251  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:15:59.909327  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:59.903386  4041 rpcz_store.cc:276] 0709 13:15:58.737433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.825364 (+1087931us) service_pool.cc:224] Handling call
0709 13:15:59.902789 (+ 77425us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:15:59.956080  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46811.5us
W20260709 13:15:59.905575  4115 rpcz_store.cc:269] 0709 13:15:58.045772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.054355 (+  8583us) service_pool.cc:224] Handling call
0709 13:15:59.798482 (+1744127us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:15:59.840101 (+ 41619us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6162304}
I20260709 13:15:59.839617  5074 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.916045  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.916214  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:15:59.956144  4044 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:59.885150  4898 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.905454  5037 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:15:59.902910  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:15:59.913844  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:15:59.911931  3968 rpcz_store.cc:269] 0709 13:15:57.990392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.994827 (+  4435us) service_pool.cc:224] Handling call
0709 13:15:59.644411 (+1649584us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:15:59.832573 (+188162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23744896}
I20260709 13:15:59.919982  4940 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.921708  4682 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:15:59.915033  5091 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.917547  4963 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:15:59.922765  4683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 56) took 1864 ms. Trace:
I20260709 13:15:59.928660  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:59.940541  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 136) took 3254 ms. Trace:
I20260709 13:15:59.826578  5019 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:15:59.903088  4011 leader_election.cc:403] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:15:59.961853  5037 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.952792  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:16:00.014147  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61463.9us
W20260709 13:15:59.927700  5065 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:15:59.911329  4118 rpcz_store.cc:276] 0709 13:15:58.517473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.839599 (+1322126us) service_pool.cc:224] Handling call
0709 13:15:59.851202 (+ 11603us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:00.016251  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 186627us
I20260709 13:15:59.912195  3971 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:00.016729  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:59.956351  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.017663  4041 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:15:59.957293  4121 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.957764  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.018615  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 510) took 1185 ms. Trace:
I20260709 13:16:00.018715  4044 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:15:59.905840  4949 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:15:59.958316  3965 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.952026  4120 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:15:59.959910  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.021131  4115 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.021629  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 492) took 1615 ms. Trace:
I20260709 13:16:00.021914  4115 rpcz_store.cc:276] 0709 13:15:58.406307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.956822 (+1550515us) service_pool.cc:224] Handling call
0709 13:16:00.021571 (+ 64749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:15:59.960876  5029 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:15:59.924854  5061 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.963670  4086 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:00.060508  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96903.2us
I20260709 13:16:00.061681  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:15:59.954260  4047 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.955142  4990 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:15:59.969183  3963 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:15:59.939718  3868 rpcz_store.cc:276] 0709 13:15:56.093937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.094086 (+   149us) service_pool.cc:224] Handling call
0709 13:15:59.939254 (+3845168us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:56.905885 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:56.958168 (+ 52283us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:56.958220 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:15:56.958242 (+    22us) tablet.cc:662] Decoding operations
0709 13:15:56.973140 (+ 14898us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:56.984545 (+ 11405us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:56.984578 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:15:56.984894 (+   316us) tablet.cc:701] Row locks acquired
0709 13:15:56.984939 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:15:56.985089 (+   150us) write_op.cc:270] Start()
0709 13:15:56.985240 (+   151us) write_op.cc:276] Timestamp: P: 1783602956985031 usec, L: 0
0709 13:15:56.985279 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.004205 (+ 18926us) log.cc:844] Serialized 540 byte log entry
0709 13:15:57.910836 (+906631us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:15:58.161907 (+251071us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.726981 (+565074us) write_op.cc:301] APPLY: starting
0709 13:15:58.737338 (+ 10357us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.760668 (+ 23330us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.767953 (+  7285us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.875527 (+107574us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.909184 (+ 33657us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:15:58.913904 (+  4720us) write_op.cc:312] APPLY: finished
0709 13:15:58.928551 (+ 14647us) log.cc:844] Serialized 22 byte log entry
0709 13:15:58.928738 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.928826 (+    88us) write_op.cc:454] Released schema lock
0709 13:15:58.928870 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.929225 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.929252 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":949437,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":417169,"apply.run_cpu_time_us":3001,"apply.run_wall_time_us":310125,"num_ops":1,"prepare.queue_time_us":397375,"prepare.run_cpu_time_us":55833,"prepare.run_wall_time_us":427091,"raft.queue_time_us":1117460,"raft.run_cpu_time_us":72858,"raft.run_wall_time_us":781349,"replication_time_us":1134234,"spinlock_wait_cycles":2582272,"thread_start_us":916896,"threads_started":4,"wal-append.queue_time_us":436565}]]}
I20260709 13:15:59.997270  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:15:59.954347  5087 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:15:59.923828  4087 rpcz_store.cc:276] 0709 13:15:58.406060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.923493 (+1517433us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:15:59.948378  4943 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.088346  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 522) took 1081 ms. Trace:
W20260709 13:16:00.088388  4087 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36886 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:00.007475  4882 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:15:59.998776  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:00.010306  4898 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:15:59.997685  5017 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:00.011173  5019 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.011878  4959 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.015875  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.019447  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 526) took 1011 ms. Trace:
I20260709 13:16:00.017277  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 533) took 1007 ms. Trace:
I20260709 13:16:00.018982  4121 rpcz_store.cc:276] 0709 13:15:58.833432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.916015 (+1082583us) service_pool.cc:224] Handling call
0709 13:16:00.018562 (+102547us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.019776  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.103163  3965 rpcz_store.cc:276] 0709 13:15:59.008416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.915794 (+907378us) service_pool.cc:224] Handling call
0709 13:16:00.019394 (+103600us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.104209  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:00.104900  4044 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.063285  4970 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:00.057021  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:00.116632  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59705.9us
I20260709 13:16:00.056885  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.117857  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:15:59.967338  4940 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.083464  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.085332  5029 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:00.071087  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.097385  3968 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:15:59.967797  5068 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.015192  5037 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.008944  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.134054  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:00.134630  4045 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.089087  3970 rpcz_store.cc:276] 0709 13:15:59.007216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.315005 (+307789us) service_pool.cc:224] Handling call
0709 13:16:00.088153 (+773148us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b5400278654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.088294 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378445056}
I20260709 13:16:00.060663  5094 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.137115  5094 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.102667  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 521) took 1095 ms. Trace:
I20260709 13:16:00.137454  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.138103  3970 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.138573  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 549) took 1120 ms. Trace:
I20260709 13:16:00.138959  3970 rpcz_store.cc:276] 0709 13:15:59.017855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.137186 (+1119331us) service_pool.cc:224] Handling call
0709 13:16:00.138518 (+  1332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.140075  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:15:59.969679  4683 rpcz_store.cc:276] 0709 13:15:58.074554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.076923 (+  2369us) service_pool.cc:224] Handling call
0709 13:15:58.158785 (+ 81862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:15:58.218314 (+ 59529us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:15:58.221143 (+  2829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:15:58.226932 (+  5789us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:15:58.229659 (+  2727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.921610 (+1691951us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b54005f19d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:15:59.922570 (+   960us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.922690 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108958464}
I20260709 13:16:00.083660  5016 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:00.020423  4949 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.023307  5074 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.020725  4942 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.020635  4938 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.103245  3972 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.144169  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 529) took 1135 ms. Trace:
I20260709 13:15:59.969383  4684 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:00.083428  4975 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.020730  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.119783  3971 rpcz_store.cc:276] 0709 13:15:59.010131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.904596 (+894465us) service_pool.cc:224] Handling call
0709 13:16:00.017215 (+112619us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.091552  4882 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.146306  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.085147  4952 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.064181  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 505) took 1304 ms. Trace:
I20260709 13:16:00.085191  5006 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.126652  4959 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.121915  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 504) took 1388 ms. Trace:
I20260709 13:16:00.149842  4118 rpcz_store.cc:276] 0709 13:15:58.733686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.016682 (+1282996us) service_pool.cc:224] Handling call
0709 13:16:00.121852 (+105170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.100687  5034 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 13:16:00.074059  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.123916  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52979.9us
I20260709 13:16:00.124130  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 664) took 1387 ms. Trace:
I20260709 13:16:00.142134  4971 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.151757  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.125641  4044 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:00.125779  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.155876  3965 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:00.088954  4087 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36886 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 25)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 511)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 537)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 26)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 518)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 523)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 517)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 540)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 513)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 539)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
W20260709 13:16:00.157253  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:15:59.954322  3967 rpcz_store.cc:276] 0709 13:15:57.388746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.392002 (+  3256us) service_pool.cc:224] Handling call
0709 13:15:58.941904 (+1549902us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed73327a5b 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:15:58.942100 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:15:58.951215 (+  9115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:15:58.966963 (+ 15748us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:15:59.013403 (+ 46440us) log.cc:844] Serialized 26 byte log entry
0709 13:15:59.591146 (+577743us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:15:59.595594 (+  4448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:15:59.603726 (+  8132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:15:59.901500 (+297774us) raft_consensus.cc:1685] finished
0709 13:15:59.901520 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:15:59.905125 (+  3605us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":898,"raft.queue_time_us":5959,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":18852,"spinlock_wait_cycles":18412800,"thread_start_us":373305,"threads_started":1,"wal-append.queue_time_us":560133}
I20260709 13:16:00.142635  5061 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.104025  4985 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.140615  3970 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.144524  3972 rpcz_store.cc:276] 0709 13:15:59.009198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.654850 (+645652us) service_pool.cc:224] Handling call
0709 13:16:00.015630 (+360780us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:00.144100 (+128470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6443776}
I20260709 13:16:00.104497  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 540) took 1087 ms. Trace:
I20260709 13:16:00.121784  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.138866  5038 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:00.124879  4919 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:00.170652  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48939.7us
I20260709 13:16:00.058194  5065 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:00.157648  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.158100  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.159178  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.097606  4972 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:00.151824  4040 rpcz_store.cc:276] 0709 13:15:58.736719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.314627 (+577908us) service_pool.cc:224] Handling call
0709 13:16:00.123982 (+809355us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b540041c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.124079 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126972288}
I20260709 13:16:00.147420  4942 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:00.122303  4970 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.137511  5094 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.147691  4952 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.143762  5074 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:00.166657  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 502) took 1575 ms (client timeout 1523 ms). Trace:
I20260709 13:16:00.149061  5006 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.149772  4959 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.170259  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 528) took 1161 ms. Trace:
I20260709 13:16:00.150194  4975 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.218497  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.219158  3965 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:00.219628  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 517) took 1213 ms. Trace:
I20260709 13:16:00.219996  3965 rpcz_store.cc:276] 0709 13:15:59.006052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.187464 (+1181412us) service_pool.cc:224] Handling call
0709 13:16:00.219574 (+ 32110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.218647  3970 rpcz_store.cc:276] 0709 13:15:59.008970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.139824 (+1130854us) service_pool.cc:224] Handling call
0709 13:16:00.170169 (+ 30345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.009778  3869 rpcz_store.cc:276] 0709 13:15:56.694633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.700611 (+  5978us) service_pool.cc:224] Handling call
0709 13:15:59.940480 (+3239869us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.681792 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.736000 (+ 54208us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.738605 (+  2605us) write_op.cc:435] Acquired schema lock
0709 13:15:57.743766 (+  5161us) tablet.cc:662] Decoding operations
0709 13:15:57.788023 (+ 44257us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:57.791200 (+  3177us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:57.793366 (+  2166us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:15:57.818391 (+ 25025us) tablet.cc:701] Row locks acquired
0709 13:15:57.819416 (+  1025us) write_op.cc:260] PREPARE: finished
0709 13:15:57.825967 (+  6551us) write_op.cc:270] Start()
0709 13:15:57.831691 (+  5724us) write_op.cc:276] Timestamp: P: 1783602957824662 usec, L: 0
0709 13:15:57.831730 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:15:57.911610 (+ 79880us) log.cc:844] Serialized 1311 byte log entry
0709 13:15:58.721142 (+809532us) op_driver.cc:464] REPLICATION: finished
0709 13:15:58.921065 (+199923us) write_op.cc:301] APPLY: starting
0709 13:15:58.921130 (+    65us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:58.921262 (+   132us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:58.921354 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:58.974979 (+ 53625us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:58.991363 (+ 16384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:15:58.996942 (+  5579us) write_op.cc:312] APPLY: finished
0709 13:15:58.997213 (+   271us) log.cc:844] Serialized 34 byte log entry
0709 13:15:58.997395 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.997488 (+    93us) write_op.cc:454] Released schema lock
0709 13:15:58.997536 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:58.997911 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:58.997941 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":882156,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":194834,"apply.run_cpu_time_us":2422,"apply.run_wall_time_us":76809,"num_ops":3,"prepare.queue_time_us":538917,"prepare.run_cpu_time_us":5036,"prepare.run_wall_time_us":242121,"replication_time_us":803015,"thread_start_us":159904,"threads_started":1}]]}
I20260709 13:16:00.149016  4120 rpcz_store.cc:276] 0709 13:15:58.756239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.950792 (+1194553us) service_pool.cc:224] Handling call
0709 13:16:00.060945 (+110153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.171448  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.188659  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.221292  4043 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:00.153065  5023 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:00.154943  4971 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.160692  4990 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.175673  4114 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:00.231143  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 73114us
I20260709 13:16:00.161091  5068 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:00.177968  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.210997  4119 rpcz_store.cc:269] 0709 13:15:58.591739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.868873 (+277134us) service_pool.cc:224] Handling call
0709 13:16:00.166444 (+1297571us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54003a89d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.166588 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1051457920}
I20260709 13:16:00.141414  3963 rpcz_store.cc:276] 0709 13:15:59.006981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.913570 (+906589us) service_pool.cc:224] Handling call
0709 13:16:00.100948 (+187378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.186276  3938 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 530) took 1176 ms. Trace:
I20260709 13:16:00.183308  5038 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:00.147432  5016 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:00.221953  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:00.186955  5064 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:00.229956  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 658) took 1486 ms (client timeout 1792 ms). Trace:
W20260709 13:16:00.243856  4043 rpcz_store.cc:269] 0709 13:15:58.735331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.768897 (+ 33566us) service_pool.cc:224] Handling call
0709 13:16:00.171300 (+1402403us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:00.221697 (+ 50397us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39043968}
I20260709 13:16:00.244901  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:00.218533  4682 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:00.209565  4952 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.231603  4943 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.229735  4855 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.282021  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.236732  3938 rpcz_store.cc:276] 0709 13:15:59.009418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.186226 (+1176808us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:00.213618  5074 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.209357  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.240084  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.238247  5059 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:00.244465  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:00.294186  4040 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.186262  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.245584  4043 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:00.173676  5061 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.246062  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.296325  3965 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:00.296792  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 523) took 1289 ms. Trace:
I20260709 13:16:00.297113  3965 rpcz_store.cc:276] 0709 13:15:59.007440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.221916 (+1214476us) service_pool.cc:224] Handling call
0709 13:16:00.296713 (+ 74797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.223805  4959 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.218130  5006 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.213189  5029 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.235394  5068 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.230156  4971 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.250021  4942 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.243202  4684 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:00.203430  4972 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.234215  4990 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:00.253566  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.235978  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:00.325760  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.325799  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89893.2us
I20260709 13:16:00.293591  5016 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:00.186312  4985 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.280314  4970 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.241780  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.284677  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.337236  4119 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.337947  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 511) took 1473 ms. Trace:
I20260709 13:16:00.338577  4119 rpcz_store.cc:276] 0709 13:15:58.864685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.236686 (+1372001us) service_pool.cc:224] Handling call
0709 13:16:00.337886 (+101200us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:00.241652  5096 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:16:00.334089  4884 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.339865  4940 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.286818  5065 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.242672  5097 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:00.285043  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 642) took 3341 ms (client timeout 2128 ms). Trace:
I20260709 13:16:00.291209  5020 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.349148  3971 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:00.301983  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115802us
I20260709 13:16:00.349853  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.350782  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 531) took 1341 ms. Trace:
I20260709 13:16:00.352849  3971 rpcz_store.cc:276] 0709 13:15:59.009681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.146068 (+1136387us) service_pool.cc:224] Handling call
0709 13:16:00.350565 (+204497us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b5400398ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.350723 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464788864}
I20260709 13:16:00.353950  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.189110  3964 rpcz_store.cc:276] 0709 13:15:59.015076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.928388 (+913312us) service_pool.cc:224] Handling call
0709 13:16:00.102102 (+173714us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.301185  5059 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:00.302523  4955 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:00.242769  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 709) took 2233 ms. Trace:
I20260709 13:16:00.310166  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.339694  5043 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
I20260709 13:16:00.247330  5064 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.329960  5093 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.284021  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 19)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
I20260709 13:16:00.315019  5068 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.283692  5017 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.339717  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.340250  4884 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.344615  3966 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:00.348528  4940 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.333670  5098 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.372546  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:00.395390  5098 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.395828  5098 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.396212  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.397429  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.397971  4043 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:00.398692  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.401346  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.374571  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.375356  4956 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.365322  4970 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:00.377202  5020 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.379640  5064 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.391876  4119 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:00.334615  5006 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.361416  5097 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:00.357775  4955 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:00.423179  4955 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.423756  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.419104  4041 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:00.358070  4039 rpcz_store.cc:276] 0709 13:15:57.998691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.998847 (+   156us) service_pool.cc:224] Handling call
0709 13:16:00.217996 (+2219149us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b540041bc54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.232069 (+ 14073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376631040}
I20260709 13:16:00.326573  5038 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.425148  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.429857  4119 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
I20260709 13:16:00.361716  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:00.430773  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 69134.2us
I20260709 13:16:00.431640  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.432412  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.424506  4043 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:16:00.427886  4047 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:00.313863  4040 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:00.430562  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
I20260709 13:16:00.433951  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.434512  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
W20260709 13:16:00.439065  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 496) took 2031 ms (client timeout 1710 ms). Trace:
W20260709 13:16:00.349072  4042 rpcz_store.cc:269] 0709 13:15:56.912519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:56.920906 (+  8387us) service_pool.cc:224] Handling call
0709 13:16:00.253674 (+3332768us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b54000df054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.253795 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5442223360}
I20260709 13:16:00.390291  5093 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.419063  4963 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.387725  5059 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.418386  3964 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.470608  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 543) took 1454 ms. Trace:
I20260709 13:16:00.470964  3964 rpcz_store.cc:276] 0709 13:15:59.016460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.374288 (+1357828us) service_pool.cc:224] Handling call
0709 13:16:00.470548 (+ 96260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.472066  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.472728  4938 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:00.458899  4855 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.473680  4855 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.474016  4855 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:00.439716  4117 rpcz_store.cc:269] 0709 13:15:58.407490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.897924 (+490434us) service_pool.cc:224] Handling call
0709 13:16:00.437381 (+1539457us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54002ea754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.438984 (+  1603us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141427072}
I20260709 13:16:00.476558  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.448240  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 747)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
I20260709 13:16:00.405682  5017 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.418212  5020 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.446403  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.464546  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.419059  4970 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:00.469220  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:00.470096  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 690) took 2425 ms (client timeout 2775 ms). Trace:
I20260709 13:16:00.477159  4117 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.582576  3972 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.582732  4047 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:00.439064  4940 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.439590  5034 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:00.623524  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 177200us
I20260709 13:16:00.565335  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.439421  5065 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.439289  4915 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:00.626850  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:00.639683  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.640293  4117 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.640946  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:00.641112  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.569056  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:00.498636  4998 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.004s
W20260709 13:16:00.583109  4116 rpcz_store.cc:269] 0709 13:15:58.045002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.045373 (+   371us) service_pool.cc:224] Handling call
0709 13:16:00.469917 (+2424544us) spinlock_profiling.cc:243] Waited 948 ms on lock 0x7b540026b6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.470015 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2180935296}
I20260709 13:16:00.627004  4119 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:00.633522  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:00.636250  4926 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.423277  5097 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.641687  4117 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:00.694474  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.691256  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.708720  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.623744  5020 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.497277  4975 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.498168  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.676692  4043 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:00.496284  5091 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:16:00.463680  5038 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.737074  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:00.724212  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:00.738739  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.522423  5024 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.629509  4938 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.626194  4940 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:00.758330  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.573938  4681 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.763998  4855 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.630690  5034 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.627336  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.743328  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.567884  5059 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:00.470870  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:00.747957  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:00.769359  4046 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
W20260709 13:16:00.750349  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.749790  4113 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:00.761708  4940 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.752108  4117 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:00.775852  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.767572  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:00.639257  5065 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.576951  5098 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.718983  4942 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:00.629900  4963 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.721176  4915 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:00.774084  5003 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.723044  5061 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.759323  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.795096  4043 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:00.760493  4119 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.767679  4970 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:00.771203  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.797323  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.752743  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.771360  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 16) took 1432 ms (client timeout 1716 ms). Trace:
W20260709 13:16:00.801368  4046 rpcz_store.cc:269] 0709 13:15:59.339354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.642262 (+1302908us) service_pool.cc:224] Handling call
0709 13:16:00.771292 (+129030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.757436  4938 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:00.751209  5091 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.776497  4117 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:00.770229  4990 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.760514  5024 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.768725  5034 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.778174  5043 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:00.775876  5006 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:00.801069  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:00.826661  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.786813  5065 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.813596  4938 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.753690  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:00.953167  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50808.2us
I20260709 13:16:01.230696  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 683) took 1140 ms. Trace:
I20260709 13:16:00.499661  4045 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
W20260709 13:16:01.233801  4045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 674) took 1190 ms (client timeout 1546 ms). Trace:
W20260709 13:16:01.234241  4045 rpcz_store.cc:269] 0709 13:16:00.043081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.133772 (+ 90691us) service_pool.cc:224] Handling call
0709 13:16:01.233563 (+1099791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.236034  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:00.955690  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:01.236754  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.237730  4042 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:01.237694  5052 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:01.238430  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 759) took 1422 ms. Trace:
I20260709 13:16:01.238863  4042 rpcz_store.cc:276] 0709 13:15:59.815890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.955357 (+1139467us) service_pool.cc:224] Handling call
0709 13:16:01.238327 (+282970us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:00.882946  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.238607  5052 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.806615  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
I20260709 13:16:00.831815  4116 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:00.815233  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.337561  4087 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 520)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
W20260709 13:16:01.356024  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 539) took 1444 ms (client timeout 1727 ms). Trace:
W20260709 13:16:01.356392  4119 rpcz_store.cc:269] 0709 13:15:59.913065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.795807 (+882742us) service_pool.cc:224] Handling call
0709 13:16:01.355837 (+560030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.358161  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.359162  4119 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:01.359562  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 520) took 1470 ms (client timeout 1801 ms). Trace:
W20260709 13:16:01.359879  4119 rpcz_store.cc:269] 0709 13:15:59.889614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.357518 (+1467904us) service_pool.cc:224] Handling call
0709 13:16:01.359494 (+  1976us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:00.812086  4912 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:00.840984  4915 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.357398  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
W20260709 13:16:00.900787  4949 consensus_meta.cc:287] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.755s	user 0.024s	sys 0.011s
I20260709 13:16:01.369503  4949 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.371682  4949 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.367522  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
I20260709 13:16:01.374279  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
W20260709 13:16:00.886930  4971 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.566s	user 0.009s	sys 0.000s
I20260709 13:16:01.378670  4971 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:00.775246  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 304442us
I20260709 13:16:00.882659  5024 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.843750  5091 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:00.851457  5094 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
I20260709 13:16:01.193075  4884 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.870828  5068 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:01.415491  4120 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
I20260709 13:16:01.417117  5068 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:00.817720  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:00.958941  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.463979  4043 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:01.464562  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 758) took 1648 ms. Trace:
I20260709 13:16:01.464881  4043 rpcz_store.cc:276] 0709 13:15:59.815643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.958663 (+1143020us) service_pool.cc:224] Handling call
0709 13:16:01.464492 (+505829us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.465859  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:01.466498  4043 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.979066  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.469616  4039 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:01.470264  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 677) took 1385 ms. Trace:
I20260709 13:16:01.470644  4039 rpcz_store.cc:276] 0709 13:16:00.084434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.978736 (+894302us) service_pool.cc:224] Handling call
0709 13:16:01.470193 (+491457us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.471787  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:01.472477  4039 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:00.977752  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 515) took 1972 ms (client timeout 1919 ms). Trace:
W20260709 13:16:01.092137  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 451083us
W20260709 13:16:01.145196  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.148151  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:01.178400  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 503) took 2505 ms (client timeout 2101 ms). Trace:
I20260709 13:16:01.177707  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:01.189846  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 23) took 1887 ms (client timeout 1698 ms). Trace:
W20260709 13:16:01.203334  3938 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items [suppressed 5 similar messages]
I20260709 13:16:01.480333  4884 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.481330  4884 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:01.480072  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
I20260709 13:16:01.205783  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:01.207774  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 742) took 1399 ms. Trace:
I20260709 13:16:01.484928  4041 rpcz_store.cc:276] 0709 13:15:59.810297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.018235 (+207938us) service_pool.cc:224] Handling call
0709 13:16:01.207400 (+1189165us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54000299d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.207588 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":628431232}
I20260709 13:16:01.485674  5091 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.486127  5091 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:01.486230  4884 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:01.486490  5091 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.231117  4047 rpcz_store.cc:276] 0709 13:16:00.090350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.721145 (+630795us) service_pool.cc:224] Handling call
0709 13:16:01.230479 (+509334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.487730  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.475010  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:01.240217  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:01.489468  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:01.490338  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.490639  5054 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.242578  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:01.491130  5054 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:01.248546  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.491608  5054 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.265513  3963 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:01.270704  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.275372  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:01.283598  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 24) took 1970 ms (client timeout 1884 ms). Trace:
W20260709 13:16:01.294762  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:00.472675  3964 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:01.498409  3935 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
W20260709 13:16:01.307358  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 698) took 3260 ms (client timeout 2041 ms). Trace:
W20260709 13:16:01.319236  4012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.007s	sys 0.008s
I20260709 13:16:01.351898  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:01.353905  3968 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.211s	user 0.012s	sys 0.012s
I20260709 13:16:00.837952  4855 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.903293  5105 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:00.864806  4882 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.958807  4938 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.790791  4942 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:01.540126  4942 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.537789  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
I20260709 13:16:00.902031  4950 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:00.792755  4952 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.407428  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 126) took 3687 ms. Trace:
I20260709 13:16:01.542840  4950 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.545185  4952 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:01.545630  4950 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.847507  4955 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.796262  4963 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:01.386610  4971 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:01.552364  4963 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.550405  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
W20260709 13:16:00.884018  4959 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.003s
I20260709 13:16:01.228550  4972 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.219722  4985 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.800935  5003 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:01.560811  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 122200us
I20260709 13:16:01.561991  5003 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.872269  5017 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.956374  5020 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:01.567348  3963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 545) took 2550 ms (client timeout 2394 ms). Trace:
W20260709 13:16:01.567867  3963 rpcz_store.cc:269] 0709 13:15:59.016909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.281731 (+1264822us) service_pool.cc:224] Handling call
0709 13:16:01.567044 (+1285313us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b5400313dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.567257 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259413760}
I20260709 13:16:01.568884  5020 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:00.898909  5037 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.751s	user 0.005s	sys 0.008s
I20260709 13:16:01.570928  5037 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.572474  4117 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:01.573138  4046 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:01.573398  4043 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
W20260709 13:16:01.573493  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 490) took 3167 ms (client timeout 3257 ms). Trace:
I20260709 13:16:00.963481  5034 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.823915  5043 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:01.578480  5043 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.126480  5005 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.246707  5052 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:00.850728  5064 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.588433  5064 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:00.893419  5059 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:01.189810  5072 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:00.786499  5074 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.603586  5074 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:00.864581  5087 consensus_meta.cc:287] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.764s	user 0.002s	sys 0.008s
I20260709 13:16:01.606487  5087 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.315688  5093 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.384339  5094 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.811475  5098 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.141053  5097 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.378672  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
W20260709 13:16:01.454299  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 25) took 1778 ms (client timeout 1716 ms). Trace:
W20260709 13:16:01.474334  3966 rpcz_store.cc:269] 0709 13:15:59.005403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.012014 (+  6611us) service_pool.cc:224] Handling call
0709 13:16:00.186914 (+1174900us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:00.977562 (+790648us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b5400279a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:00.977686 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119369984}
W20260709 13:16:01.479287  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 331467us
I20260709 13:16:01.223721  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:00.485505  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.479835  4121 rpcz_store.cc:269] 0709 13:15:59.302045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.189508 (+1887463us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:01.189692 (+   184us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:01.491619  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 670) took 1449 ms. Trace:
I20260709 13:16:01.493959  3967 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:01.478964  4114 rpcz_store.cc:269] 0709 13:15:58.673284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.946688 (+1273404us) service_pool.cc:224] Handling call
0709 13:16:01.177776 (+1231088us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54001b1f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.178050 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486079744}
I20260709 13:16:01.489344  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 752) took 1675 ms. Trace:
I20260709 13:16:01.486277  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.488543  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 691) took 1370 ms. Trace:
I20260709 13:16:01.491201  4119 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:16:01.500679  4118 rpcz_store.cc:269] 0709 13:15:59.321904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.283265 (+1961361us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:01.283411 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:01.503180  3964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 536) took 2492 ms (client timeout 2665 ms). Trace:
W20260709 13:16:01.574112  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 728) took 2828 ms (client timeout 3342 ms). Trace:
W20260709 13:16:01.348680  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 538) took 1448 ms (client timeout 1710 ms). Trace:
W20260709 13:16:01.503729  4012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.009s
I20260709 13:16:01.615764  5097 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:01.625806  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 877873us
I20260709 13:16:01.627259  5097 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.617869  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:01.503611  4113 rpcz_store.cc:269] 0709 13:15:58.046996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:58.158836 (+111840us) service_pool.cc:224] Handling call
0709 13:16:01.304107 (+3145271us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b540026b1d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.307097 (+  2990us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5762141440}
I20260709 13:16:01.507557  3968 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:01.621399  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:01.629204  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 527) took 2620 ms (client timeout 1932 ms). Trace:
W20260709 13:16:01.629629  3968 rpcz_store.cc:269] 0709 13:15:59.008644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.969646 (+961002us) service_pool.cc:224] Handling call
0709 13:16:01.629122 (+1659476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.507685  3969 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:01.508049  4040 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:01.508519  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.619114  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 19) took 1652 ms (client timeout 1500 ms). Trace:
I20260709 13:16:01.504890  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
I20260709 13:16:01.512705  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:01.519304  4085 leader_election.cc:336] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.590s (SENT)
I20260709 13:16:01.524890  4884 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.529378  5054 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.534659  5091 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:00.890944  4940 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.543367  3867 rpcz_store.cc:276] 0709 13:15:57.730573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:57.735546 (+  4973us) service_pool.cc:224] Handling call
0709 13:16:01.407179 (+3671633us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:15:57.932359 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:15:57.994987 (+ 62628us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:15:57.997004 (+  2017us) write_op.cc:435] Acquired schema lock
0709 13:15:57.999532 (+  2528us) tablet.cc:662] Decoding operations
0709 13:15:58.076815 (+ 77283us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:15:58.079991 (+  3176us) write_op.cc:641] Partition lock acquired for write op
0709 13:15:58.110130 (+ 30139us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:15:58.223116 (+112986us) tablet.cc:701] Row locks acquired
0709 13:15:58.226487 (+  3371us) write_op.cc:260] PREPARE: finished
0709 13:15:58.235586 (+  9099us) write_op.cc:270] Start()
0709 13:15:58.245042 (+  9456us) write_op.cc:276] Timestamp: P: 1783602958233359 usec, L: 0
0709 13:15:58.249111 (+  4069us) op_driver.cc:348] REPLICATION: starting
0709 13:15:58.968969 (+719858us) log.cc:844] Serialized 2151 byte log entry
0709 13:15:58.999770 (+ 30801us) op_driver.cc:464] REPLICATION: finished
0709 13:15:59.042778 (+ 43008us) write_op.cc:301] APPLY: starting
0709 13:15:59.071439 (+ 28661us) tablet.cc:1367] starting BulkCheckPresence
0709 13:15:59.170920 (+ 99481us) tablet.cc:1370] finished BulkCheckPresence
0709 13:15:59.173696 (+  2776us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:15:59.294257 (+120561us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:15:59.294463 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:15:59.294509 (+    46us) write_op.cc:312] APPLY: finished
0709 13:15:59.294758 (+   249us) log.cc:844] Serialized 46 byte log entry
0709 13:15:59.294925 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:59.300353 (+  5428us) write_op.cc:454] Released schema lock
0709 13:15:59.303066 (+  2713us) write_op.cc:341] FINISH: Updating metrics
0709 13:15:59.903803 (+600737us) spinlock_profiling.cc:243] Waited 650 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76447e28 00007fed79e82581 00007fed79e81d58 00007fed79e869f1 00007fed79e869a9 00007fed79e86939 00007fed79e86901 00007fed79e85b2d 000000000038f354 000000000038f199
0709 13:15:59.904025 (+   222us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:15:59.904056 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1032184,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":2792,"apply.run_cpu_time_us":4285,"apply.run_wall_time_us":337482,"num_ops":5,"prepare.queue_time_us":19938,"prepare.run_cpu_time_us":66568,"prepare.run_wall_time_us":1975461,"replication_time_us":750519,"spinlock_wait_cycles":1495224192}]]}
W20260709 13:16:01.616878  4120 rpcz_store.cc:269] 0709 13:15:59.676104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.241523 (+565419us) service_pool.cc:224] Handling call
0709 13:16:01.453983 (+1212460us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002071d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.454193 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2466768768}
I20260709 13:16:01.622677  4042 rpcz_store.cc:276] 0709 13:15:59.814193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.239797 (+1425604us) service_pool.cc:224] Handling call
0709 13:16:01.489251 (+249454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.548589  4955 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.633060  4681 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:01.633178  5091 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.633782  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.555510  5105 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.640023  4940 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.557152  4942 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.628847  3966 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:01.641368  3972 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:01.642128  4942 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.558094  4959 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:01.642953  3972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 548) took 2625 ms (client timeout 2705 ms). Trace:
I20260709 13:16:01.564469  4039 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:01.573945  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 688) took 1481 ms. Trace:
W20260709 13:16:01.573894  4117 rpcz_store.cc:269] 0709 13:15:58.405822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.817450 (+2411628us) service_pool.cc:224] Handling call
0709 13:16:01.573288 (+755838us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400096d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.573440 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250400000}
I20260709 13:16:00.954650  5065 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.589227  4044 raft_consensus.cc:2368] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3.
I20260709 13:16:01.589473  5034 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.591008  5037 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:01.595934  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:01.554385  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
I20260709 13:16:01.605482  3971 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:01.631807  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:01.656390  3971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 532) took 2646 ms (client timeout 2537 ms). Trace:
W20260709 13:16:01.661119  3971 rpcz_store.cc:269] 0709 13:15:59.009898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.353694 (+1343796us) service_pool.cc:224] Handling call
0709 13:16:01.656157 (+1302463us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001edf54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.656323 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875803904}
I20260709 13:16:01.548650  4938 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.614120  3970 raft_consensus.cc:2368] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:01.621542  4045 rpcz_store.cc:276] 0709 13:16:00.042196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.235589 (+1193393us) service_pool.cc:224] Handling call
0709 13:16:01.491559 (+255970us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.623494  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 535) took 1724 ms (client timeout 1839 ms). Trace:
I20260709 13:16:01.623080  4041 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
W20260709 13:16:01.663257  4119 rpcz_store.cc:269] 0709 13:15:59.899212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.489967 (+1590755us) service_pool.cc:224] Handling call
0709 13:16:01.623425 (+133458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.663699  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 701) took 1285 ms. Trace:
I20260709 13:16:01.664043  4041 rpcz_store.cc:276] 0709 13:16:00.378221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.485911 (+1107690us) service_pool.cc:224] Handling call
0709 13:16:01.663644 (+177733us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.629767  4121 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:01.623202  4047 rpcz_store.cc:276] 0709 13:16:00.118637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.487374 (+1368737us) service_pool.cc:224] Handling call
0709 13:16:01.488473 (+  1099us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.634135  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.634368  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:01.621884  3967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 747) took 1462 ms (client timeout 1566 ms). Trace:
I20260709 13:16:01.618525  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:01.622540  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.612394  5094 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.638485  4042 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
W20260709 13:16:01.624431  4046 rpcz_store.cc:269] 0709 13:15:58.746116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.176914 (+2430798us) service_pool.cc:224] Handling call
0709 13:16:01.573919 (+397005us) spinlock_profiling.cc:243] Waited 93.2 ms on lock 0x7b540041cb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.574032 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214306176}
I20260709 13:16:01.639058  5054 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.634974  4884 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:01.634836  3965 rpcz_store.cc:269] 0709 13:15:59.966721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.223183 (+1256462us) service_pool.cc:224] Handling call
0709 13:16:01.618991 (+395808us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.671257  3970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 524) took 2663 ms (client timeout 2076 ms). Trace:
W20260709 13:16:01.630491  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 555) took 1612 ms (client timeout 1770 ms). Trace:
W20260709 13:16:01.668999  4044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 690) took 1575 ms (client timeout 1571 ms). Trace:
I20260709 13:16:01.608727  5087 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.644649  4043 rpcz_store.cc:276] 0709 13:16:00.092729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.465547 (+1372818us) service_pool.cc:224] Handling call
0709 13:16:01.573870 (+108323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.669953  4114 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:01.673190  4884 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.624001  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:01.637436  3935 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
W20260709 13:16:01.624555  4116 rpcz_store.cc:269] 0709 13:15:59.901510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.736685 (+835175us) service_pool.cc:224] Handling call
0709 13:16:01.348305 (+611620us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b54002ea754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.348495 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":183201024}
I20260709 13:16:01.647881  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 692) took 1527 ms. Trace:
W20260709 13:16:01.643447  3972 rpcz_store.cc:269] 0709 13:15:59.017540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.633212 (+1615672us) service_pool.cc:224] Handling call
0709 13:16:01.642669 (+1009457us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b54004074d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.642871 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125652864}
I20260709 13:16:01.674681  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:01.678534  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.666189  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.678857  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:01.675380  4038 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:01.679567  3972 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:16:01.616690  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 709)
I20260709 13:16:01.679787  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 694) took 1554 ms. Trace:
I20260709 13:16:01.680222  4042 rpcz_store.cc:276] 0709 13:16:00.119241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.633417 (+1514176us) service_pool.cc:224] Handling call
0709 13:16:01.672191 (+ 38774us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.676080  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 521) took 1781 ms (client timeout 1914 ms). Trace:
W20260709 13:16:01.624233  3964 rpcz_store.cc:269] 0709 13:15:59.010801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.471809 (+1461008us) service_pool.cc:224] Handling call
0709 13:16:01.502984 (+1031175us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.681162  4118 rpcz_store.cc:269] 0709 13:15:59.894957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.623641 (+1728684us) service_pool.cc:224] Handling call
0709 13:16:01.676023 (+ 52382us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.674955  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 56640.4us
I20260709 13:16:01.659171  5052 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:01.676712  5065 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:01.682492  3972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768) took 1517 ms (client timeout 1803 ms). Trace:
I20260709 13:16:01.678150  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:01.683292  5003 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:01.675101  4940 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:01.679584  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 542) took 1760 ms (client timeout 1875 ms). Trace:
I20260709 13:16:01.678784  4959 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:01.683751  4116 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.685634  4117 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:01.686105  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 498) took 3212 ms (client timeout 3343 ms). Trace:
W20260709 13:16:01.686416  4117 rpcz_store.cc:269] 0709 13:15:58.473325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.670062 (+3196737us) service_pool.cc:224] Handling call
0709 13:16:01.686031 (+ 15969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.675660  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:01.682984  3972 rpcz_store.cc:269] 0709 13:16:00.164721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.678583 (+1513862us) service_pool.cc:224] Handling call
0709 13:16:01.682420 (+  3837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.679250  3965 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:01.671633  3970 rpcz_store.cc:269] 0709 13:15:59.007930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.221259 (+1213329us) service_pool.cc:224] Handling call
0709 13:16:01.662945 (+1441686us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400407ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.671194 (+  8249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3034533632}
I20260709 13:16:01.657756  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
I20260709 13:16:01.667028  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:01.647922  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 757) took 1484 ms (client timeout 1672 ms). Trace:
W20260709 13:16:01.679579  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 543) took 1758 ms (client timeout 1893 ms). Trace:
W20260709 13:16:01.709486  4120 rpcz_store.cc:269] 0709 13:15:59.920723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.632879 (+1712156us) service_pool.cc:224] Handling call
0709 13:16:01.679491 (+ 46612us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.710417  4040 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
W20260709 13:16:01.710958  4040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 671) took 1668 ms (client timeout 2125 ms). Trace:
W20260709 13:16:01.711295  4040 rpcz_store.cc:269] 0709 13:16:00.042433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.274870 (+1232437us) service_pool.cc:224] Handling call
0709 13:16:01.710898 (+436028us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.678290  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:01.684864  4940 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:01.640296  5105 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:01.666998  3967 rpcz_store.cc:269] 0709 13:16:00.159838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.205085 (+1045247us) service_pool.cc:224] Handling call
0709 13:16:01.621820 (+416735us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.671895  3969 rpcz_store.cc:269] 0709 13:16:00.018088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.351438 (+1333350us) service_pool.cc:224] Handling call
0709 13:16:01.630435 (+278997us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.672053  4044 rpcz_store.cc:269] 0709 13:16:00.093617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.157788 (+ 64171us) service_pool.cc:224] Handling call
0709 13:16:01.664978 (+1507190us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000cab54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.668937 (+  3959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3221286272}
W20260709 13:16:01.670233  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 541) took 1748 ms (client timeout 1846 ms). Trace:
I20260709 13:16:01.682258  4087 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 28)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 29)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 27)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
I20260709 13:16:01.681221  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.677492  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
W20260709 13:16:02.123446  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 173889us
I20260709 13:16:02.144855  4940 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:01.896620  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.146778  4041 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:01.829945  4013 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:49112 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 686)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 680)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 685)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 672)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 676)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 19)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 18)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 700)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 776)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 708)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 724)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 725)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 726)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 727)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 729)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 736)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 747)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 748)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 757)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 760)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 678)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 684)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 771)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 17)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 774)
W20260709 13:16:02.147238  4041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 679) took 2060 ms (client timeout 2374 ms). Trace:
I20260709 13:16:01.683687  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:01.682914  5052 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:01.723367  4115 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.148862  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.150506  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
I20260709 13:16:01.682157  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:01.683192  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 163974us
I20260709 13:16:01.682421  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:01.857376  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:01.678297  4039 rpcz_store.cc:276] 0709 13:16:00.118914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.471467 (+1352553us) service_pool.cc:224] Handling call
0709 13:16:01.646555 (+175088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.684198  3963 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:01.833982  4043 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:01.708803  4045 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.149309  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.163807  4120 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:02.164398  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 536) took 2264 ms (client timeout 2255 ms). Trace:
W20260709 13:16:02.164781  4120 rpcz_store.cc:269] 0709 13:15:59.899465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.148955 (+2249490us) service_pool.cc:224] Handling call
0709 13:16:02.164312 (+ 15357us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:01.684800  4114 rpcz_store.cc:269] 0709 13:15:59.919618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.622258 (+1702640us) service_pool.cc:224] Handling call
0709 13:16:01.679528 (+ 57270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:01.808815  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:02.148389  4121 rpcz_store.cc:269] 0709 13:15:59.918628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.621058 (+1702430us) service_pool.cc:224] Handling call
0709 13:16:01.667150 (+ 46092us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.147163  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.713461  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:01.787673  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 773) took 1307 ms (client timeout 1540 ms). Trace:
W20260709 13:16:02.167057  3965 rpcz_store.cc:269] 0709 13:16:00.425931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.671710 (+1245779us) service_pool.cc:224] Handling call
0709 13:16:01.733540 (+ 61830us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.111984  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:01.809695  4116 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:01.682260  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.148236  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 751) took 1987 ms (client timeout 1889 ms). Trace:
I20260709 13:16:02.148730  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.152885  4041 rpcz_store.cc:269] 0709 13:16:00.086881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.780996 (+1694115us) service_pool.cc:224] Handling call
0709 13:16:02.147179 (+366183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.151019  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:01.802181  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 83484.7us
W20260709 13:16:01.678376  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 526) took 1781 ms (client timeout 1919 ms). Trace:
W20260709 13:16:02.168381  3969 rpcz_store.cc:269] 0709 13:16:00.161205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.148045 (+1986840us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.148163 (+   118us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:01.681306  4038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 738) took 2800 ms (client timeout 2244 ms). Trace:
I20260709 13:16:02.148411  4042 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:01.713580  4047 raft_consensus.cc:2376] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2. Re-sending same reply.
I20260709 13:16:02.159987  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.153738  4119 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.161408  4046 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:02.148011  3966 rpcz_store.cc:269] 0709 13:16:00.162452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.617499 (+1455047us) service_pool.cc:224] Handling call
0709 13:16:01.646582 (+ 29083us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.157161  5003 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:01.843164  4963 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:02.149847  3967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 753) took 1988 ms (client timeout 1897 ms). Trace:
I20260709 13:16:02.161435  5027 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.171518  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 764) took 2014 ms. Trace:
W20260709 13:16:02.171790  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 545) took 1978 ms (client timeout 1932 ms). Trace:
W20260709 13:16:02.169895  4113 rpcz_store.cc:269] 0709 13:15:59.896657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.633780 (+1737123us) service_pool.cc:224] Handling call
0709 13:16:01.678314 (+ 44534us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.194626  4046 rpcz_store.cc:276] 0709 13:16:00.157115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.833297 (+1676182us) service_pool.cc:224] Handling call
0709 13:16:02.171464 (+338167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.194653  5027 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.194741  4117 rpcz_store.cc:269] 0709 13:16:00.193762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.687033 (+1493271us) service_pool.cc:224] Handling call
0709 13:16:02.171678 (+484645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.195838  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.196597  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 680) took 2107 ms. Trace:
W20260709 13:16:02.170018  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 771) took 2004 ms (client timeout 1906 ms). Trace:
W20260709 13:16:02.173377  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 531) took 2273 ms (client timeout 1981 ms). Trace:
W20260709 13:16:02.197347  3965 rpcz_store.cc:269] 0709 13:16:00.165784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.167660 (+2001876us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.169957 (+  2297us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.197844  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.197992  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 512) took 3304 ms (client timeout 2045 ms). Trace:
I20260709 13:16:02.198458  4041 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
W20260709 13:16:02.198417  4115 rpcz_store.cc:269] 0709 13:15:58.893686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.022562 (+1128876us) service_pool.cc:224] Handling call
0709 13:16:02.197820 (+2175258us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54003d3954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:02.197933 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3693033856}
I20260709 13:16:02.189798  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 28)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 29)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 27)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 727)
I20260709 13:16:02.201102  5027 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:02.197455  4119 rpcz_store.cc:269] 0709 13:15:59.897846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.667279 (+1769433us) service_pool.cc:224] Handling call
0709 13:16:02.171319 (+504040us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.173589  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 461084us
I20260709 13:16:02.202840  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:02.174053  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 506) took 3383 ms (client timeout 3147 ms). Trace:
W20260709 13:16:02.203152  4884 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.003s
W20260709 13:16:02.203372  4116 rpcz_store.cc:269] 0709 13:15:58.784774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.677849 (+2893075us) service_pool.cc:224] Handling call
0709 13:16:02.168234 (+490385us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.174852  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 551) took 1834 ms (client timeout 1770 ms). Trace:
I20260709 13:16:02.196902  4046 rpcz_store.cc:276] 0709 13:16:00.089491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.195548 (+2106057us) service_pool.cc:224] Handling call
0709 13:16:02.196548 (+  1000us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.205327  4118 rpcz_store.cc:269] 0709 13:16:00.340160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.681931 (+1341771us) service_pool.cc:224] Handling call
0709 13:16:02.174788 (+492857us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.206176  3963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 764) took 2042 ms (client timeout 1630 ms). Trace:
I20260709 13:16:02.206625  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.206992  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.207260  4046 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:02.207888  4113 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.208184  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.208341  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704) took 1409 ms (client timeout 1532 ms). Trace:
W20260709 13:16:02.208798  4113 rpcz_store.cc:269] 0709 13:16:00.798962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.206678 (+1407716us) service_pool.cc:224] Handling call
0709 13:16:02.208263 (+  1585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.209385  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.210065  4117 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:16:02.169157  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.170883  4047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 697) took 1843 ms (client timeout 2128 ms). Trace:
I20260709 13:16:02.209749  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.176337  3971 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.179852  4040 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
W20260709 13:16:02.211748  4040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 766) took 1574 ms (client timeout 2067 ms). Trace:
W20260709 13:16:02.212086  4040 rpcz_store.cc:269] 0709 13:16:00.636963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.711977 (+1075014us) service_pool.cc:224] Handling call
0709 13:16:02.211695 (+499718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.212963  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.213784  4040 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:02.214979  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.215778  4040 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:16:02.216277  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.180357  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 681) took 2090 ms (client timeout 2371 ms). Trace:
W20260709 13:16:02.216925  4042 rpcz_store.cc:269] 0709 13:16:00.089833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.680902 (+1591069us) service_pool.cc:224] Handling call
0709 13:16:02.180286 (+499384us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.217971  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:02.218441  3971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 766) took 2054 ms (client timeout 1787 ms). Trace:
I20260709 13:16:02.197055  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
W20260709 13:16:02.211452  4047 rpcz_store.cc:269] 0709 13:16:00.327732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.678021 (+1350289us) service_pool.cc:224] Handling call
0709 13:16:02.170824 (+492803us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.211323  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.171164  4045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 699) took 1842 ms (client timeout 2059 ms). Trace:
W20260709 13:16:02.210963  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.181317  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 552) took 2373 ms (client timeout 2302 ms). Trace:
I20260709 13:16:02.219811  4121 raft_consensus.cc:2410] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:02.182862  5116 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.183207  3972 raft_consensus.cc:2368] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
W20260709 13:16:02.184692  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.189201  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.190887  5052 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:02.191324  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 509047us
W20260709 13:16:02.222409  3966 rpcz_store.cc:269] 0709 13:15:59.807428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.181126 (+2373698us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.181254 (+   128us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:02.227988  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 554) took 2210 ms (client timeout 2184 ms). Trace:
I20260709 13:16:02.228379  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.191452  5087 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.229415  5087 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:02.228384  3966 rpcz_store.cc:269] 0709 13:16:00.017399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.227753 (+2210354us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.227927 (+   174us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.229880  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.230695  4942 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:02.230908  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 546) took 3213 ms (client timeout 3189 ms). Trace:
I20260709 13:16:02.229841  5087 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.231940  4942 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.232275  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.230247  5091 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.234148  4942 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.231305  5116 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:02.193868  4043 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.172122  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.200910  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 726)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 28)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 29)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 724)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 30)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 27)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 727)
I20260709 13:16:02.199579  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.203528  4884 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.197540  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.204432  3968 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
W20260709 13:16:02.241811  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 748) took 2081 ms (client timeout 1758 ms). Trace:
I20260709 13:16:02.204643  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.242362  5116 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.242717  5094 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:01.781136  5097 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:01.715075  5043 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:02.210527  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 527) took 2313 ms (client timeout 2394 ms). Trace:
W20260709 13:16:02.170266  4038 rpcz_store.cc:269] 0709 13:15:58.880846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:00.497853 (+1617007us) service_pool.cc:224] Handling call
0709 13:16:01.681075 (+1183222us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b540041c154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:01.681244 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2126901120}
W20260709 13:16:02.217036  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 547) took 2011 ms (client timeout 2184 ms). Trace:
W20260709 13:16:02.218833  3971 rpcz_store.cc:269] 0709 13:16:00.164310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.668722 (+1504412us) service_pool.cc:224] Handling call
0709 13:16:02.218357 (+549635us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.182286  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.210585  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.163744  5117 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:02.219484  4045 rpcz_store.cc:269] 0709 13:16:00.328814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.665770 (+1336956us) service_pool.cc:224] Handling call
0709 13:16:02.171107 (+505337us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.182653  5072 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.584s	user 0.004s	sys 0.004s
W20260709 13:16:02.220526  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.216694  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.221791  4042 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.221879  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.253041  3971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 763) took 2089 ms (client timeout 2059 ms). Trace:
I20260709 13:16:02.247792  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.224570  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 544) took 2303 ms (client timeout 2302 ms). Trace:
I20260709 13:16:02.223397  4046 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:16:02.217952  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:02.225479  3972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 782) took 1785 ms (client timeout 1590 ms). Trace:
W20260709 13:16:02.226008  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 525) took 3217 ms (client timeout 3147 ms). Trace:
I20260709 13:16:02.226478  4039 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.255245  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 672) took 2212 ms. Trace:
W20260709 13:16:02.242187  3968 rpcz_store.cc:269] 0709 13:16:00.160073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.653164 (+1493091us) service_pool.cc:224] Handling call
0709 13:16:02.241740 (+588576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.242849  4884 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:02.239102  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.231292  3966 rpcz_store.cc:269] 0709 13:15:59.017134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.230728 (+3213594us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.230855 (+   127us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.192713  4963 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:02.244156  4117 rpcz_store.cc:269] 0709 13:15:59.896983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.209110 (+2312127us) service_pool.cc:224] Handling call
0709 13:16:02.210476 (+  1366us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.244966  4118 rpcz_store.cc:269] 0709 13:16:00.205368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.215999 (+2010631us) service_pool.cc:224] Handling call
0709 13:16:02.216982 (+   983us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.252830  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 546) took 2058 ms (client timeout 2066 ms). Trace:
W20260709 13:16:02.195835  3967 rpcz_store.cc:269] 0709 13:16:00.161630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.149662 (+1988032us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.149791 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:02.255057  4121 rpcz_store.cc:269] 0709 13:15:59.920988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.193324 (+2272336us) service_pool.cc:224] Handling call
0709 13:16:02.224514 (+ 31190us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.254859  3971 rpcz_store.cc:269] 0709 13:16:00.163710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.245237 (+2081527us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.252710 (+  7473us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:02.255823  3965 rpcz_store.cc:269] 0709 13:15:59.008188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.224250 (+3216062us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.225940 (+  1690us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:02.237406  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 763) took 2080 ms (client timeout 2240 ms). Trace:
I20260709 13:16:02.256481  4046 rpcz_store.cc:276] 0709 13:16:00.042651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.207916 (+2165265us) service_pool.cc:224] Handling call
0709 13:16:02.255185 (+ 47269us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.255636  3972 rpcz_store.cc:269] 0709 13:16:00.447734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.712993 (+1265259us) service_pool.cc:224] Handling call
0709 13:16:02.225403 (+512410us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.248354  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 685) took 2156 ms. Trace:
W20260709 13:16:02.257520  3935 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items [suppressed 20 similar messages]
W20260709 13:16:02.229013  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 553) took 2405 ms (client timeout 2255 ms). Trace:
W20260709 13:16:02.206640  3963 rpcz_store.cc:269] 0709 13:16:00.163905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.595482 (+1431577us) service_pool.cc:224] Handling call
0709 13:16:02.206109 (+610627us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.259418  4119 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:02.247196  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 548) took 2009 ms (client timeout 1991 ms). Trace:
I20260709 13:16:02.302907  4116 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:16:02.303455  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 557) took 1658 ms (client timeout 1752 ms). Trace:
I20260709 13:16:02.303791  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.244652  3964 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.261152  4040 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.269927  5097 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.307252  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 676) took 2244 ms. Trace:
I20260709 13:16:02.306519  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.304410  4116 rpcz_store.cc:269] 0709 13:16:00.645089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.241236 (+1596147us) service_pool.cc:224] Handling call
0709 13:16:02.303403 (+ 62167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.255712  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 710) took 1453 ms (client timeout 1546 ms). Trace:
I20260709 13:16:02.261386  4112 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:02.247269  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.258198  4047 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
W20260709 13:16:02.247154  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 553) took 1906 ms (client timeout 1911 ms). Trace:
W20260709 13:16:02.263736  4115 rpcz_store.cc:269] 0709 13:16:00.194095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.204321 (+2010226us) service_pool.cc:224] Handling call
0709 13:16:02.252742 (+ 48421us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.313830  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 552) took 1969 ms (client timeout 2201 ms). Trace:
W20260709 13:16:02.314321  4121 rpcz_store.cc:269] 0709 13:16:00.340509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.302329 (+1961820us) service_pool.cc:224] Handling call
0709 13:16:02.309522 (+  7193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.294301  4041 rpcz_store.cc:276] 0709 13:16:00.091450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.199300 (+2107850us) service_pool.cc:224] Handling call
0709 13:16:02.248287 (+ 48987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8064}
I20260709 13:16:02.259696  5065 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:16:02.294902  3969 rpcz_store.cc:269] 0709 13:15:59.823746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.219054 (+2395308us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.228954 (+  9900us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.304466  5072 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.328313  5072 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:16:02.328444  3972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770) took 2162 ms (client timeout 2150 ms). Trace:
I20260709 13:16:02.328753  5072 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:02.328907  3972 rpcz_store.cc:269] 0709 13:16:00.165538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.328254 (+2162716us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.328383 (+   129us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.329936  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.330852  5087 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.331764  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.327189  5117 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:02.332849  3963 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:02.333353  5087 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:02.300967  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 549) took 2005 ms (client timeout 2076 ms). Trace:
W20260709 13:16:02.349902  4119 rpcz_store.cc:269] 0709 13:16:00.296045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.210298 (+1914253us) service_pool.cc:224] Handling call
0709 13:16:02.300893 (+ 90595us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.301513  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 83624.2us
I20260709 13:16:02.327780  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.256819  4942 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:02.304150  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 101423us
I20260709 13:16:02.303982  3970 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
W20260709 13:16:02.352685  3970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 765) took 2188 ms (client timeout 1878 ms). Trace:
W20260709 13:16:02.353060  3970 rpcz_store.cc:269] 0709 13:16:00.164102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.844648 (+1680546us) service_pool.cc:224] Handling call
0709 13:16:02.197406 (+352758us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:02.352632 (+155226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3718400}
I20260709 13:16:02.308549  4045 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
W20260709 13:16:02.303902  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.308264  4040 rpcz_store.cc:276] 0709 13:16:00.063458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.216388 (+2152930us) service_pool.cc:224] Handling call
0709 13:16:02.307195 (+ 90807us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.311194  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.261706  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 762) took 2300 ms. Trace:
I20260709 13:16:02.307272  5043 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.295564  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.319550  4986 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.360589  4118 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:02.319768  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:02.361126  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 525) took 2465 ms (client timeout 2557 ms). Trace:
W20260709 13:16:02.361603  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 555) took 1896 ms (client timeout 2101 ms). Trace:
W20260709 13:16:02.362185  4115 rpcz_store.cc:269] 0709 13:16:00.465517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.313312 (+1847795us) service_pool.cc:224] Handling call
0709 13:16:02.361549 (+ 48237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.363226  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.363803  4115 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:02.364253  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 556) took 1791 ms (client timeout 2045 ms). Trace:
I20260709 13:16:02.320145  4038 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
I20260709 13:16:02.365654  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.366544  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.366923  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.367714  4038 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:02.315572  4120 rpcz_store.cc:269] 0709 13:16:00.341007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.181934 (+1840927us) service_pool.cc:224] Handling call
0709 13:16:02.247092 (+ 65158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.307344  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 769) took 2142 ms (client timeout 2064 ms). Trace:
I20260709 13:16:02.368783  4649 leader_election.cc:400] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
I20260709 13:16:02.369344  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.325860  4044 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
W20260709 13:16:02.371102  4044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 686) took 2279 ms (client timeout 2964 ms). Trace:
W20260709 13:16:02.371470  4044 rpcz_store.cc:269] 0709 13:16:00.091700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.148555 (+2056855us) service_pool.cc:224] Handling call
0709 13:16:02.371044 (+222489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.326376  5065 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:02.327809  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.334195  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.379261  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.334627  5117 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:02.302445  4114 rpcz_store.cc:269] 0709 13:16:00.237545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.171777 (+1934232us) service_pool.cc:224] Handling call
0709 13:16:02.247103 (+ 75326us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.337857  4112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 507) took 3540 ms (client timeout 1932 ms). Trace:
I20260709 13:16:02.341158  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:02.262595  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
I20260709 13:16:02.342240  4680 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.389051  3967 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.389139  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.390537  4038 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:02.389128  4042 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.391278  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.340996  5105 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:02.377681  3968 rpcz_store.cc:269] 0709 13:16:00.165194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.267428 (+2102234us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.305545 (+ 38117us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.392493  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:02.392839  4085 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.838s (SENT)
I20260709 13:16:02.393182  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:02.393275  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:02.394104  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.394871  3968 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.395262  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786) took 1192 ms. Trace:
I20260709 13:16:02.395599  3968 rpcz_store.cc:276] 0709 13:16:01.202524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.393846 (+1191322us) service_pool.cc:224] Handling call
0709 13:16:02.395206 (+  1360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.396976  5052 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.397135  4681 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.361048  4986 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.386071  4112 rpcz_store.cc:269] 0709 13:15:58.797888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:59.933901 (+1136013us) service_pool.cc:224] Handling call
0709 13:16:02.337609 (+2403708us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54003a84d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:02.337779 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5346250496}
I20260709 13:16:02.399448  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:02.400135  4112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 706) took 1600 ms (client timeout 2125 ms). Trace:
I20260709 13:16:02.398582  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.401368  4114 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:02.401779  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 705) took 1602 ms (client timeout 2066 ms). Trace:
W20260709 13:16:02.402148  4114 rpcz_store.cc:269] 0709 13:16:00.799180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.390955 (+1591775us) service_pool.cc:224] Handling call
0709 13:16:02.401725 (+ 10770us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.320633  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.345364  4884 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.404284  4884 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.406396  4884 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.349128  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.407119  4046 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.405414  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
W20260709 13:16:02.351183  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.355389  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.410513  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 532) took 2512 ms (client timeout 2705 ms). Trace:
W20260709 13:16:02.410851  4119 rpcz_store.cc:269] 0709 13:15:59.898049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.355134 (+2457085us) service_pool.cc:224] Handling call
0709 13:16:02.410459 (+ 55325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.411749  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.294451  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 21)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 786)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 789)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
I20260709 13:16:02.355389  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.412396  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.412717  4045 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.413241  4114 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.354815  4121 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:02.413661  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 529) took 2516 ms (client timeout 3189 ms). Trace:
I20260709 13:16:02.356025  4963 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:02.294893  4043 rpcz_store.cc:269] 0709 13:16:00.156845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.674731 (+1517886us) service_pool.cc:224] Handling call
0709 13:16:02.237307 (+562576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.352249  4942 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:02.327785  3971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 767) took 2163 ms (client timeout 2081 ms). Trace:
I20260709 13:16:02.357362  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:02.357383  4117 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.357138  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:02.330782  3972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 778) took 1903 ms (client timeout 2271 ms). Trace:
W20260709 13:16:02.361492  4118 rpcz_store.cc:269] 0709 13:15:59.896210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.267248 (+2371038us) service_pool.cc:224] Handling call
0709 13:16:02.361074 (+ 93826us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.367259  4040 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:02.311084  4113 rpcz_store.cc:269] 0709 13:16:00.800250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.209462 (+1409212us) service_pool.cc:224] Handling call
0709 13:16:02.253854 (+ 44392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.322286  5094 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:02.364560  4115 rpcz_store.cc:269] 0709 13:16:00.573143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.362917 (+1789774us) service_pool.cc:224] Handling call
0709 13:16:02.364201 (+  1284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.370210  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 708) took 1570 ms (client timeout 1917 ms). Trace:
W20260709 13:16:02.333284  3963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 774) took 1906 ms (client timeout 2215 ms). Trace:
I20260709 13:16:02.382669  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.385246  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.386509  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154295us
I20260709 13:16:02.386926  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.391440  5065 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:02.342590  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.398105  3970 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.342433  5097 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:02.318421  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 750) took 2157 ms (client timeout 2083 ms). Trace:
I20260709 13:16:02.359331  5072 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.458973  3966 rpcz_store.cc:269] 0709 13:16:00.160955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.305472 (+2144517us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.316614 (+ 11142us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.460156  4116 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:02.458993  4120 rpcz_store.cc:269] 0709 13:16:00.799818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.368753 (+1568935us) service_pool.cc:224] Handling call
0709 13:16:02.370152 (+  1399us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.458629  3970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 749) took 2298 ms (client timeout 2633 ms). Trace:
I20260709 13:16:02.413003  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 562)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
I20260709 13:16:02.396457  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.409211  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.461947  3968 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.462322  3965 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
W20260709 13:16:02.462817  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 760) took 2299 ms (client timeout 2244 ms). Trace:
W20260709 13:16:02.463188  3965 rpcz_store.cc:269] 0709 13:16:00.163063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.342302 (+2179239us) service_pool.cc:224] Handling call
0709 13:16:02.462757 (+120455us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.458861  3963 rpcz_store.cc:269] 0709 13:16:00.426456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.331467 (+1905011us) service_pool.cc:224] Handling call
0709 13:16:02.333229 (+  1762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.460559  4041 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:02.460242  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.465838  3966 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:02.413987  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 711) took 1613 ms (client timeout 1782 ms). Trace:
I20260709 13:16:02.462850  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.451627  5087 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.458489  5094 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.439844  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 791)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 794)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 20)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 793)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
W20260709 13:16:02.466758  4121 rpcz_store.cc:269] 0709 13:16:00.800459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.327468 (+1527009us) service_pool.cc:224] Handling call
0709 13:16:02.413933 (+ 86465us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.467211  4120 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:16:02.468102  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 713) took 1131 ms. Trace:
I20260709 13:16:02.468173  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.469501  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.470144  4121 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3.
W20260709 13:16:02.422909  4142 debug-util.cc:398] Leaking SignalData structure 0x7b080010bae0 after lost signal to thread 2854
I20260709 13:16:02.461971  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.459673  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.461043  4044 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
W20260709 13:16:02.446483  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49701.6us
I20260709 13:16:02.465519  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.467274  5087 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.455792  5052 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.403335  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.380162  5091 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:02.466816  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.470966  4986 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:02.472571  5120 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:02.488085  5120 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:02.488425  5120 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.489203  3968 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.490341  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.490780  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.491506  4040 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.456327  3964 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.473225  4115 raft_consensus.cc:2368] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3.
W20260709 13:16:02.493040  3964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 776) took 2066 ms (client timeout 1581 ms). Trace:
I20260709 13:16:02.493795  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.494879  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.495400  4115 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.474742  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.475174  5087 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.487541  4047 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.501168  4986 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.501343  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.501713  4986 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.502482  5052 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.500505  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.507606  4986 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.460561  5072 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:02.507870  5052 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:02.461428  3970 rpcz_store.cc:269] 0709 13:16:00.160297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.353614 (+2193317us) service_pool.cc:224] Handling call
0709 13:16:02.458547 (+104933us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.509071  5052 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.485515  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.509872  4118 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.479224  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
I20260709 13:16:02.510319  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 554) took 2136 ms. Trace:
I20260709 13:16:02.485030  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.379740  3867 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:02.510655  4118 rpcz_store.cc:276] 0709 13:16:00.373480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.485255 (+2111775us) service_pool.cc:224] Handling call
0709 13:16:02.510262 (+ 25007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.511231  3963 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:02.511790  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 746) took 2352 ms. Trace:
I20260709 13:16:02.512157  3963 rpcz_store.cc:276] 0709 13:16:00.159601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.484677 (+2325076us) service_pool.cc:224] Handling call
0709 13:16:02.511733 (+ 27056us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.512749  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.513082  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.473866  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.501195  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 709) took 1022 ms. Trace:
I20260709 13:16:02.514233  4047 rpcz_store.cc:276] 0709 13:16:01.486966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.466575 (+979609us) service_pool.cc:224] Handling call
0709 13:16:02.501139 (+ 34564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.515151  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.515718  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:02.488598  4942 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:02.486040  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 129012us
I20260709 13:16:02.486172  5065 raft_consensus.cc:2764] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:02.516732  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.519166  4047 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.518867  5094 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.516362  5120 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.520378  4047 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:02.479691  3971 rpcz_store.cc:269] 0709 13:16:00.164523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.327581 (+2163058us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:02.327720 (+   139us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.412412  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 719) took 1034 ms. Trace:
I20260709 13:16:02.521641  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.521982  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 724) took 3781 ms. Trace:
W20260709 13:16:02.414017  4114 rpcz_store.cc:269] 0709 13:15:59.897453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.402793 (+2505340us) service_pool.cc:224] Handling call
0709 13:16:02.413603 (+ 10810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.517746  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:02.522487  4047 rpcz_store.cc:276] 0709 13:15:58.741064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.519819 (+3778755us) service_pool.cc:224] Handling call
0709 13:16:02.520197 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.521733 (+  1536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.521911 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.511718  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.521648  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.358856  4039 rpcz_store.cc:276] 0709 13:15:59.959626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.188875 (+2229249us) service_pool.cc:224] Handling call
0709 13:16:02.259981 (+ 71106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.523753  3971 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.524586  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.525183  4039 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:16:02.486357  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 550) took 2164 ms (client timeout 2101 ms). Trace:
I20260709 13:16:02.481118  3969 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
W20260709 13:16:02.525674  4117 rpcz_store.cc:269] 0709 13:16:00.322090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.263395 (+1941305us) service_pool.cc:224] Handling call
0709 13:16:02.486294 (+222899us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.468526  4120 rpcz_store.cc:276] 0709 13:16:01.336404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.462585 (+1126181us) service_pool.cc:224] Handling call
0709 13:16:02.468048 (+  5463us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.526114  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 777) took 2099 ms (client timeout 2292 ms). Trace:
I20260709 13:16:02.402603  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:02.472344  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.492615  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:02.473425  4142 debug-util.cc:398] Leaking SignalData structure 0x7b080018c4e0 after lost signal to thread 3904
I20260709 13:16:02.482513  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 808)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 809)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 795)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 807)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
W20260709 13:16:02.474381  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 519) took 2591 ms (client timeout 2665 ms). Trace:
I20260709 13:16:02.475426  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:02.518710  3967 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.458945  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.486415  3972 rpcz_store.cc:269] 0709 13:16:00.427362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.329659 (+1902297us) service_pool.cc:224] Handling call
0709 13:16:02.330633 (+   974us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.493633  3964 rpcz_store.cc:269] 0709 13:16:00.426927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:01.681824 (+1254897us) service_pool.cc:224] Handling call
0709 13:16:02.492873 (+811049us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.400466  4112 rpcz_store.cc:269] 0709 13:16:00.799392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.399228 (+1599836us) service_pool.cc:224] Handling call
0709 13:16:02.400065 (+   837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.523577  4118 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:02.513765  3963 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.502977  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.508239  3968 raft_consensus.cc:2368] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:02.476258  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.484395  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.400677  4042 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.521560  4119 rpcz_store.cc:276] 0709 13:16:01.378057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.411497 (+1033440us) service_pool.cc:224] Handling call
0709 13:16:02.412359 (+   862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.523228  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.525297  3971 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.481815  4045 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.523445  5087 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.527242  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55001.4us
I20260709 13:16:02.526490  4044 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.527416  5097 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.544219  4045 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:02.529220  4116 rpcz_store.cc:269] 0709 13:15:59.882737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.313157 (+2430420us) service_pool.cc:224] Handling call
0709 13:16:02.474319 (+161162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.545521  5097 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:02.545886  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.546453  5097 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.546936  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.547942  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.548491  4116 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:02.549559  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.526765  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.545015  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.550868  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 745) took 2739 ms. Trace:
I20260709 13:16:02.551275  4045 rpcz_store.cc:276] 0709 13:15:59.811334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.542227 (+2730893us) service_pool.cc:224] Handling call
0709 13:16:02.542525 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.550540 (+  8015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.550790 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.484576  5091 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.527596  4040 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.550395  4116 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.551227  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.531769  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.532110  4047 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:02.534502  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.536406  3965 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.557253  3972 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.533897  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:02.526486  3969 rpcz_store.cc:269] 0709 13:16:00.427135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.358889 (+1931754us) service_pool.cc:224] Handling call
0709 13:16:02.526044 (+167155us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.535773  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.541535  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.530479  4041 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:02.550227  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:02.537149  4043 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:02.537557  4115 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:02.526822  5065 raft_consensus.cc:2764] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:02.561466  4940 raft_consensus.cc:2764] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:02.530772  4113 raft_consensus.cc:2376] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3. Re-sending same reply.
I20260709 13:16:02.562618  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 558) took 1818 ms. Trace:
I20260709 13:16:02.562712  5119 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.562985  4113 rpcz_store.cc:276] 0709 13:16:00.744367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.458617 (+1714250us) service_pool.cc:224] Handling call
0709 13:16:02.562560 (+103943us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.563598  3937 leader_election.cc:400] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3.
I20260709 13:16:02.563905  3937 leader_election.cc:403] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:02.564008  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.557596  4118 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:16:02.536891  3966 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.561756  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 725) took 3820 ms. Trace:
I20260709 13:16:02.535175  5072 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.531855  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.565181  4047 rpcz_store.cc:276] 0709 13:15:58.741319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.524001 (+3782682us) service_pool.cc:224] Handling call
0709 13:16:02.531885 (+  7884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.561490 (+ 29605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.561676 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.565517  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 727) took 3814 ms. Trace:
I20260709 13:16:02.561622  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.566699  4041 rpcz_store.cc:276] 0709 13:15:58.745828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.529943 (+3784115us) service_pool.cc:224] Handling call
0709 13:16:02.530274 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.560393 (+ 30119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.560580 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.567123  4115 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.567528  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707) took 1767 ms. Trace:
I20260709 13:16:02.535935  4046 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:02.542865  3970 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.470868  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.568876  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 700) took 2216 ms. Trace:
I20260709 13:16:02.566301  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.560627  3971 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.533432  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.568960  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 729) took 3814 ms. Trace:
I20260709 13:16:02.538053  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.569347  4046 rpcz_store.cc:276] 0709 13:16:00.352407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.318689 (+1966282us) service_pool.cc:224] Handling call
0709 13:16:02.568823 (+250134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.567799  4115 rpcz_store.cc:276] 0709 13:16:00.799602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.561351 (+1761749us) service_pool.cc:224] Handling call
0709 13:16:02.567478 (+  6127us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.570917  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.488334  4087 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:36872 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 733)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 740)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 728)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 736)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 737)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 564)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 735)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 729)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 567)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 744)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 569)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 570)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 34)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 741)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 563)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 561)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 730)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 33)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 731)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 742)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 738)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 32)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 31)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 566)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 743)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 560)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 745)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 739)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 559)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 727)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 562)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 565)
I20260709 13:16:02.526527  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.565171  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.535985  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 812)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 816)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 572)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 24)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 577)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.606791  4043 rpcz_store.cc:276] 0709 13:15:58.746364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.536650 (+3790286us) service_pool.cc:224] Handling call
0709 13:16:02.536995 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.560946 (+ 23951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.561120 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:02.580148  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44435us
W20260709 13:16:02.609711  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.528852  4142 debug-util.cc:398] Leaking SignalData structure 0x7b080033fce0 after lost signal to thread 3996
W20260709 13:16:02.614161  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50751.1us
I20260709 13:16:02.614625  5123 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3.
I20260709 13:16:02.612057  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.534999  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.618911  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.624377  5087 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.526957  4038 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.632022  4043 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:02.615515  4884 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:02.622434  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 748) took 2809 ms. Trace:
I20260709 13:16:02.622922  4684 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.623960  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 755) took 2809 ms. Trace:
W20260709 13:16:02.530817  3967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 772) took 2364 ms (client timeout 2336 ms). Trace:
I20260709 13:16:02.529845  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 726) took 3788 ms. Trace:
I20260709 13:16:02.619087  4116 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.626693  3935 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 744) took 2467 ms. Trace:
I20260709 13:16:02.624982  3971 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.625178  3963 raft_consensus.cc:2368] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:02.636029  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.636646  3971 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.539379  5052 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.634790  3967 rpcz_store.cc:269] 0709 13:16:00.166267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.333899 (+2167632us) service_pool.cc:224] Handling call
0709 13:16:02.530741 (+196842us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.637756  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.637957  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.626624  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.625842  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.634929  4039 rpcz_store.cc:276] 0709 13:15:58.741544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.524495 (+3782951us) service_pool.cc:224] Handling call
0709 13:16:02.524856 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.529551 (+  4695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.529769 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.626847  3965 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.638873  5052 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:02.639221  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.542083  4942 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.639811  4113 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.608850  5027 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.630278  4040 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.625557  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.641170  5027 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.641795  4119 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 2: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.642057  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 757) took 2826 ms. Trace:
I20260709 13:16:02.642407  4040 rpcz_store.cc:276] 0709 13:15:59.815418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.619125 (+2803707us) service_pool.cc:224] Handling call
0709 13:16:02.630111 (+ 10986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.641827 (+ 11716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.642008 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.638840  3969 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.643190  4046 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.635215  3935 rpcz_store.cc:276] 0709 13:16:00.159095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.626622 (+2467527us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:16:02.643798  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 747) took 2831 ms. Trace:
I20260709 13:16:02.644101  4942 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.640784  4986 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.538760  4042 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.537536  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.625288  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.634538  4041 rpcz_store.cc:276] 0709 13:15:59.812609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.618647 (+2806038us) service_pool.cc:224] Handling call
0709 13:16:02.621930 (+  3283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.622114 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.622141 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.622194 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:02.622220 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.622267 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.622382 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.644104  4046 rpcz_store.cc:276] 0709 13:15:59.812229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.611039 (+2798810us) service_pool.cc:224] Handling call
0709 13:16:02.642899 (+ 31860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.643565 (+   666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.643748 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.634655  4045 rpcz_store.cc:276] 0709 13:15:59.814942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.618886 (+2803944us) service_pool.cc:224] Handling call
0709 13:16:02.623463 (+  4577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.623686 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.623719 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.623755 (+    36us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:02.623780 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.623825 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.623910 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.644309  3935 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.641522  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.633028  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 761) took 2675 ms. Trace:
I20260709 13:16:02.645676  4117 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.670928  4043 rpcz_store.cc:276] 0709 13:15:59.958024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.631254 (+2673230us) service_pool.cc:224] Handling call
0709 13:16:02.631752 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.632620 (+   868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.632912 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.636667  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.672439  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.672969  3963 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
I20260709 13:16:02.639657  4120 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:02.673504  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800380740 after lost signal to thread 4071
I20260709 13:16:02.673095  4118 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.681393  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.682267  4940 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.682662  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.682821  4940 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:02.683429  5087 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.683848  5087 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.684254  5087 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.674499  3971 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.649152  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.687019  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.641621  5027 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.683890  4940 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.689226  4119 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:02.674880  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.675204  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.670953  5119 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:02.691973  4120 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
I20260709 13:16:02.675485  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 703) took 1876 ms. Trace:
I20260709 13:16:02.684474  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:02.693053  4117 rpcz_store.cc:276] 0709 13:16:00.798699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.533613 (+1734914us) service_pool.cc:224] Handling call
0709 13:16:02.675306 (+141693us) spinlock_profiling.cc:243] Waited 86.3 ms on lock 0x7b540034e254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:02.675434 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":198500736}
I20260709 13:16:02.628597  3964 raft_consensus.cc:2376] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3. Re-sending same reply.
I20260709 13:16:02.676265  4884 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:02.699641  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.565377  5072 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.646739  4112 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:02.677291  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.678658  5052 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:02.676651  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.673700  4038 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
W20260709 13:16:02.674042  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47514.7us
I20260709 13:16:02.538702  4114 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
W20260709 13:16:02.693604  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 143471us
I20260709 13:16:02.708946  4041 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:02.694310  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.709649  4115 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.698689  4044 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:02.711990  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:02.701033  4118 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:02.674640  4142 debug-util.cc:398] Leaking SignalData structure 0x7b08003664e0 after lost signal to thread 4145
I20260709 13:16:02.702095  3972 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.625011  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.705767  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.672717  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 736) took 3834 ms. Trace:
I20260709 13:16:02.700474  3965 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.712495  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 708) took 1234 ms. Trace:
I20260709 13:16:02.710310  3970 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.710423  4116 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.715514  4044 rpcz_store.cc:276] 0709 13:16:01.478153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.473640 (+995487us) service_pool.cc:224] Handling call
0709 13:16:02.526365 (+ 52725us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54000d19a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c3dc0 00007fed7644fe18 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6
0709 13:16:02.712441 (+186076us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24843136}
I20260709 13:16:02.705722  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.704550  5072 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.716925  4040 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:02.705610  5052 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:02.719799  4046 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.721266  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 771) took 1211 ms. Trace:
I20260709 13:16:02.716548  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.721618  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 678) took 2631 ms. Trace:
I20260709 13:16:02.721640  4046 rpcz_store.cc:276] 0709 13:16:01.509717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.688591 (+1178874us) service_pool.cc:224] Handling call
0709 13:16:02.713907 (+ 25316us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:02.714102 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.721008 (+  6906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.721206 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3679104}
I20260709 13:16:02.722515  4040 rpcz_store.cc:276] 0709 13:16:00.086447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.700358 (+2613911us) service_pool.cc:224] Handling call
0709 13:16:02.711368 (+ 11010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.717730 (+  6362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.717918 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.707803  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.714473  3963 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.724319  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.740738  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 684) took 2649 ms. Trace:
I20260709 13:16:02.743362  3971 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:02.744040  4119 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:02.744324  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.736018  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.745141  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.727980  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 787) took 1231 ms. Trace:
I20260709 13:16:02.728158  4113 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:02.758455  3971 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.759783  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784) took 1557 ms. Trace:
I20260709 13:16:02.713549  5003 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:02.761050  3972 rpcz_store.cc:276] 0709 13:16:01.496752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.716280 (+1219528us) service_pool.cc:224] Handling call
0709 13:16:02.727922 (+ 11642us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.722091  5120 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:02.729262  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800320920 after lost signal to thread 4709
I20260709 13:16:02.730130  4040 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:02.704648  4884 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.729079  4986 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:02.713778  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 27) took 1051 ms. Trace:
I20260709 13:16:02.734117  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:02.735136  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.735329  4012 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:02.774118  4012 leader_election.cc:403] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:02.735711  3966 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.738452  4115 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:02.743795  4038 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.736829  3967 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.716907  3968 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.741060  5119 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.741866  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57480.6us
I20260709 13:16:02.724459  5052 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:02.758570  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.760452  3971 rpcz_store.cc:276] 0709 13:16:01.201941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.744090 (+1542149us) service_pool.cc:224] Handling call
0709 13:16:02.759728 (+ 15638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.747167  4116 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:02.773263  4114 rpcz_store.cc:276] 0709 13:16:01.660678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.522898 (+862220us) service_pool.cc:224] Handling call
0709 13:16:02.711781 (+188883us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.795116  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:02.795362  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60171us
I20260709 13:16:02.795497  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.795935  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.796536  3966 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.797142  4043 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:02.743778  4041 rpcz_store.cc:276] 0709 13:16:00.091205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.676735 (+2585530us) service_pool.cc:224] Handling call
0709 13:16:02.708488 (+ 31753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.709372 (+   884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.740544 (+ 31172us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b540035cad0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:02.740683 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72116608}
I20260709 13:16:02.801326  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.802112  3967 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.802950  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.786393  4942 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:02.804020  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.806123  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.806846  4116 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.763586  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 17) took 1207 ms. Trace:
W20260709 13:16:02.770172  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.804889  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.773070  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 774) took 1109 ms. Trace:
I20260709 13:16:02.794387  4119 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.808418  4040 rpcz_store.cc:276] 0709 13:16:01.664024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.729546 (+1065522us) service_pool.cc:224] Handling call
0709 13:16:02.729839 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.772734 (+ 42895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.773015 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.774855  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.796680  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.809381  3972 raft_consensus.cc:2376] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3. Re-sending same reply.
I20260709 13:16:02.717239  4042 rpcz_store.cc:276] 0709 13:15:58.838169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.538112 (+3699943us) service_pool.cc:224] Handling call
0709 13:16:02.538425 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.645388 (+106963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.672640 (+ 27252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.776345  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:02.810307  4117 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.778384  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.807502  4046 rpcz_store.cc:276] 0709 13:16:01.556381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.723470 (+1167089us) service_pool.cc:224] Handling call
0709 13:16:02.761003 (+ 37533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.761190 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.761215 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.763348 (+  2133us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:02.763385 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.763441 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.763535 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.759888  5072 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.758421  5123 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:02.779320  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.736063  3938 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 784)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 820)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 579)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 23)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 804)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 822)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 823)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 580)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 811)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 22)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 805)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 589)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 576)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 818)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817)
I20260709 13:16:02.784910  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:02.785784  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:02.778613  4112 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.812107  3969 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:02.812458  4118 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.813115  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.813655  3969 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:02.816123  3970 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:02.816440  4115 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.817178  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.818499  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.819751  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.820453  3964 raft_consensus.cc:2368] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:02.786585  4986 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:02.824019  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 760) took 2866 ms. Trace:
I20260709 13:16:02.826284  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.829676  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.833523  5027 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.826994  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.835624  5027 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:02.835860  4114 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.836724  5027 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.837219  5027 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:02.838110  5027 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.841604  4884 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.842123  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.842717  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.844200  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.845155  4884 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.845746  4884 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:02.846645  4884 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:02.848112  3966 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:02.804962  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 772) took 1295 ms. Trace:
I20260709 13:16:02.837230  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.857076  3969 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:02.804582  3967 raft_consensus.cc:2376] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3. Re-sending same reply.
I20260709 13:16:02.855103  3965 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:02.843384  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.816089  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:02.869119  4113 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 1.
I20260709 13:16:02.870520  4113 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.871572  4120 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:02.873845  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:02.874503  4680 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.835369  3968 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:02.826609  4047 rpcz_store.cc:276] 0709 13:15:59.957704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.620300 (+2662596us) service_pool.cc:224] Handling call
0709 13:16:02.692492 (+ 72192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.706070 (+ 13578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.706106 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.711737 (+  5631us) log.cc:844] Serialized 26 byte log entry
0709 13:16:02.786672 (+ 74935us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:02.786712 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.786792 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:02.823808 (+ 37016us) raft_consensus.cc:1685] finished
0709 13:16:02.823827 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.823965 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8982,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6665,"thread_start_us":43498,"threads_started":1,"wal-append.queue_time_us":81387}
I20260709 13:16:02.862190  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:02.862418  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 489) took 4457 ms. Trace:
I20260709 13:16:02.863225  4115 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:02.878937  4119 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:02.884610  4116 rpcz_store.cc:276] 0709 13:15:58.405542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.807393 (+4401851us) service_pool.cc:224] Handling call
0709 13:16:02.821145 (+ 13752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.862070 (+ 40925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.862100 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.862146 (+    46us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:02.862175 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.862230 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.862331 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.886832  4116 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.880012  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 696) took 2644 ms. Trace:
I20260709 13:16:02.887454  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 528) took 2990 ms. Trace:
I20260709 13:16:02.887866  4116 rpcz_store.cc:276] 0709 13:15:59.897241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.886286 (+2989045us) service_pool.cc:224] Handling call
0709 13:16:02.886645 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.887190 (+   545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.887367 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.834164  5072 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:02.848788  5124 raft_consensus.cc:2764] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:02.893160  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:02.831035  5123 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:02.890882  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.831287  5065 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:02.884960  5105 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:02.902765  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.931123  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.935883  3972 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:02.901822  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57691us
I20260709 13:16:02.931005  3965 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.937614  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 515) took 3065 ms. Trace:
I20260709 13:16:02.938079  4118 rpcz_store.cc:276] 0709 13:15:59.866565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.814717 (+2948152us) service_pool.cc:224] Handling call
0709 13:16:02.877813 (+ 63096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.891120 (+ 13307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.909693 (+ 18573us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.931998 (+ 22305us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:02.932044 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.932105 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.932225 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:02.943657  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:02.948073  4011 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:02.950927  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.951845  4011 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:02.953953  4011 leader_election.cc:336] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:02.954952  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.958384  5087 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.958992  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:02.959529  4085 leader_election.cc:336] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.566s (SENT)
I20260709 13:16:02.959887  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:02.959829  5123 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:02.945641  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 91936.6us
I20260709 13:16:02.964433  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:02.948011  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 253144us
W20260709 13:16:02.974350  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 250342us
I20260709 13:16:02.975755  4086 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:02.982362  4115 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.997210  5120 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:02.997877  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.997972  4680 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:16:02.998525  4680 pending_rounds.cc:85] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 2
I20260709 13:16:02.998807  4680 pending_rounds.cc:107] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:16:02.999320  4680 raft_consensus.cc:2917] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:16:02.999802  4680 raft_consensus.cc:2889] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.000319  5135 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.000774  5135 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.001089  5135 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.997066  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:02.936740  5105 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.013136  5105 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:02.930186  4684 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:02.998775  3967 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:03.015717  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.016428  3967 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:03.016948  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52595.5us
I20260709 13:16:03.017551  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.017796  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.018392  3967 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:03.018711  4940 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.019064  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.019555  4113 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:02.937175  5065 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.022529  3971 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.024103  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 516) took 3116 ms. Trace:
W20260709 13:16:03.021385  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 56047.5us
W20260709 13:16:03.017035  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57560.9us
I20260709 13:16:03.020253  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.025175  4087 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:03.025120  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.025802  4115 rpcz_store.cc:276] 0709 13:15:59.866821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.817054 (+2950233us) service_pool.cc:224] Handling call
0709 13:16:02.863040 (+ 45986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.982797 (+119757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.983249 (+   452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.026835  3965 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.027384  4115 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:02.856576  4038 rpcz_store.cc:276] 0709 13:16:01.510006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.718773 (+1208767us) service_pool.cc:224] Handling call
0709 13:16:02.740572 (+ 21799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.784817 (+ 44245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.804906 (+ 20089us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.029582  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
W20260709 13:16:03.029356  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 186050us
I20260709 13:16:03.047151  4117 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:03.000052  3964 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 2: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:03.051725  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 70219us
I20260709 13:16:03.021811  5087 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.054067  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.056408  3964 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:02.963757  4942 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.056861  4115 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:03.060292  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.064038  4118 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:03.064644  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 534) took 3166 ms. Trace:
I20260709 13:16:03.066051  4118 rpcz_store.cc:276] 0709 13:15:59.898481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.947520 (+3049039us) service_pool.cc:224] Handling call
0709 13:16:03.061682 (+114162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.064405 (+  2723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.064591 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.020797  5091 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.020318  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 522) took 3125 ms. Trace:
W20260709 13:16:03.067054  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 91379.8us
I20260709 13:16:03.029996  5065 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.070003  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.028623  5072 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.019153  4940 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:16:03.074414  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 119528us
I20260709 13:16:02.999455  4112 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:03.068212  3972 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.069010  4117 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:03.068936  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.075347  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.072886  5120 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:03.059355  5124 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.060029  4942 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.076804  3965 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:03.075845  4117 pending_rounds.cc:85] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 1
W20260709 13:16:03.078347  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53255.8us
I20260709 13:16:03.087134  4117 pending_rounds.cc:107] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:03.087455  4117 raft_consensus.cc:2889] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.030386  4986 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:03.076778  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.059223  5097 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:16:03.085008  5138 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.085706  5027 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.083901  5135 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.076042  4940 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.105281  5136 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:03.106079  5139 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:03.078320  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 722) took 1397 ms. Trace:
I20260709 13:16:03.118734  4112 rpcz_store.cc:276] 0709 13:16:01.680440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.717203 (+1036763us) service_pool.cc:224] Handling call
0709 13:16:03.076683 (+359480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.111385  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.120113  3965 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:03.079656  5091 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:03.108969  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88781.2us
I20260709 13:16:03.075049  5127 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.090808  4942 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.127923  5120 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.069703  4113 rpcz_store.cc:276] 0709 13:15:59.895271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.870001 (+2974730us) service_pool.cc:224] Handling call
0709 13:16:02.870385 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.019984 (+149599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.020230 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.133438  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54431.4us
I20260709 13:16:03.146055  5094 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:02.887272  4045 rpcz_store.cc:276] 0709 13:16:00.236020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.687034 (+2451014us) service_pool.cc:224] Handling call
0709 13:16:02.690089 (+  3055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.690302 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:02.778952 (+ 88650us) log.cc:844] Serialized 14 byte log entry
0709 13:16:02.879575 (+100623us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:02.879630 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:02.879670 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:02.879800 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:02.879955 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":142708,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":31939,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4309,"thread_start_us":154708,"threads_started":2}
I20260709 13:16:03.151438  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.152082  3969 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 1.
I20260709 13:16:03.152357  5003 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:03.152822  5003 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.153784  5003 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:03.152941  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.155542  5003 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.155884  3969 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:03.157513  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.157563  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.158327  3971 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.158478  3969 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.159353  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.159811  3969 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.112915  5136 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.154286  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.166199  3969 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:03.170466  4085 leader_election.cc:336] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:03.175555  3972 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:03.176597  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.127992  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.177206  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:03.137779  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.180507  3971 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:03.196332  3972 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:03.144153  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 514) took 3271 ms. Trace:
I20260709 13:16:03.135041  5144 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.214805  5105 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.134286  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:03.219085  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.219458  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.221226  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 493) took 4814 ms. Trace:
I20260709 13:16:03.221650  4119 rpcz_store.cc:276] 0709 13:15:58.406629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.815015 (+4408386us) service_pool.cc:224] Handling call
0709 13:16:02.859687 (+ 44672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:02.891712 (+ 32025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.220971 (+329259us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54003a70d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:03.221161 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43794688}
I20260709 13:16:03.121193  4986 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:16:03.210203  5147 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:03.209683  4121 rpcz_store.cc:276] 0709 13:15:59.863405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.814781 (+2951376us) service_pool.cc:224] Handling call
0709 13:16:02.860683 (+ 45902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.875928 (+ 15245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.875960 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.876461 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.012753 (+136292us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.012818 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.026213 (+ 13395us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.134660 (+108447us) raft_consensus.cc:1685] finished
0709 13:16:03.134678 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.134797 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2484,"raft.queue_time_us":8297,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":19229,"thread_start_us":135832,"threads_started":1,"wal-append.queue_time_us":211750}
I20260709 13:16:03.244949  5091 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.233121  5144 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:03.245376  5147 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:03.246775  5144 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.211301  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.211612  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:03.212184  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:03.197063  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52111.6us
I20260709 13:16:03.141198  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.250839  3971 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.208119  5027 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.165179  5127 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.224977  3966 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.141374  5119 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260709 13:16:03.235103  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:03.235688  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65256.8us
I20260709 13:16:03.236186  3964 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:03.237317  5124 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:03.267400  5124 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.272172  4085 leader_election.cc:400] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:03.272503  4085 leader_election.cc:403] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:03.238181  3968 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.239472  5052 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.173391  5087 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:16:03.241672  5135 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.242383  5138 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.243279  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.243580  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 530) took 3345 ms. Trace:
I20260709 13:16:03.243934  4942 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.233095  5105 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.174086  5136 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.282506  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:03.283177  4649 leader_election.cc:336] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.698s (SENT)
I20260709 13:16:03.283587  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.283772  4942 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.284538  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.285362  4038 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:03.286224  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.286386  4085 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:03.288288  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.251817  3965 raft_consensus.cc:2376] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3. Re-sending same reply.
I20260709 13:16:03.289319  4942 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:03.289722  3965 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
W20260709 13:16:03.224133  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 171266us
I20260709 13:16:03.134099  5131 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.116s
I20260709 13:16:03.277935  5052 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:03.265651  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.294190  5154 raft_consensus.cc:2764] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:16:03.260238  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8356448580000233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:16:03.275219  3969 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:03.338976  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8230448580000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:16:03.276551  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63577.2us
I20260709 13:16:03.277091  5065 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.278855  4116 rpcz_store.cc:276] 0709 13:15:59.897628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:02.888600 (+2990972us) service_pool.cc:224] Handling call
0709 13:16:02.888999 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:02.889516 (+   517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:02.889541 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:02.890030 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.066369 (+176339us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.066408 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.066470 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.243379 (+176909us) raft_consensus.cc:1685] finished
0709 13:16:03.243397 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.243523 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":136,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":134528,"threads_started":1,"wal-append.queue_time_us":244759}
I20260709 13:16:03.341652  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.342449  4116 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:03.343205  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.344355  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 538) took 4328 ms. Trace:
I20260709 13:16:03.344782  3969 rpcz_store.cc:276] 0709 13:15:59.011238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.260627 (+4249389us) service_pool.cc:224] Handling call
0709 13:16:03.266783 (+  6156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.339211 (+ 72428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.339427 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.280612  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.281936  5135 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.282073  5127 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.284673  5149 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.252514  3972 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:03.250295  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 164523us
I20260709 13:16:03.291448  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 745) took 3131 ms. Trace:
I20260709 13:16:03.264050  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:03.291540  5138 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.295249  4119 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:03.289508  5151 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.295605  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:03.214695  5094 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:03.296360  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:03.361183  4113 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:03.362246  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.362798  4113 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:16:03.296860  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.369597  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.297053  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 752) took 3135 ms. Trace:
I20260709 13:16:03.371677  5065 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.371974  3963 rpcz_store.cc:276] 0709 13:16:00.161427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.296101 (+3134674us) service_pool.cc:224] Handling call
0709 13:16:03.296493 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.296672 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.296699 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:03.296743 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.296801 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.296856 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.296973 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.373389  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.373871  5094 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.374269  5094 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:03.374579  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.375183  3963 raft_consensus.cc:2376] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3. Re-sending same reply.
I20260709 13:16:03.376379  3963 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:03.297576  5145 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:03.377157  5145 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.297848  5105 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:03.288554  4085 leader_election.cc:400] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:03.377480  5145 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:03.377679  4085 leader_election.cc:403] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:03.298261  5119 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:03.300487  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.301666  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 537) took 4281 ms. Trace:
I20260709 13:16:03.379199  3964 rpcz_store.cc:276] 0709 13:15:59.011015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.235466 (+4224451us) service_pool.cc:224] Handling call
0709 13:16:03.235858 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.273781 (+ 37923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.291815 (+ 18034us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.369683  5147 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:03.350828  5149 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.380698  3964 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:03.381330  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 758) took 3218 ms. Trace:
I20260709 13:16:03.301342  5027 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.302111  5131 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.289789  4942 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:03.302325  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.385776  4117 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.302853  5150 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.303524  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.303916  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.304136  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:03.304404  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:03.306216  4649 leader_election.cc:336] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.716s (SENT)
W20260709 13:16:03.388912  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 82727.7us
I20260709 13:16:03.308001  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:03.389890  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.390444  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:03.391079  4680 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:03.389986  4038 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:03.295358  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:03.303450  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:03.309448  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 234128us
W20260709 13:16:03.413667  4011 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:03.304431  5124 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.414193  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.312677  4940 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:03.313390  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.314821  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:03.317061  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.422063  4115 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:03.330598  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 518) took 4267 ms. Trace:
I20260709 13:16:03.422397  3970 rpcz_store.cc:276] 0709 13:15:59.006291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.215403 (+4209112us) service_pool.cc:224] Handling call
0709 13:16:03.215765 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.216111 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:03.216138 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:03.216576 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:16:03.263892 (+ 47316us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:03.263931 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.263994 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:03.273931 (+  9937us) raft_consensus.cc:1685] finished
0709 13:16:03.273953 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.274083 (+   130us) inbound_call.cc:177] Queueing success response
0709 13:16:03.295543 (+ 21460us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
Metrics: {"mutex_wait_us":12698,"raft.queue_time_us":987,"raft.run_cpu_time_us":3374,"raft.run_wall_time_us":77628,"spinlock_wait_cycles":12700544,"thread_start_us":46950,"threads_started":1,"wal-append.queue_time_us":50845}
W20260709 13:16:03.339422  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8185448579999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:16:03.345830  4044 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.347183  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.348389  3969 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:03.340297  5139 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.425450  5139 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.413219  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 756) took 3251 ms. Trace:
I20260709 13:16:03.426689  3963 rpcz_store.cc:276] 0709 13:16:00.162234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.375804 (+3213570us) service_pool.cc:224] Handling call
0709 13:16:03.376148 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.376703 (+   555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.411623 (+ 34920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.427989  3963 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:03.393765  5003 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:03.430154  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.430724  4046 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.431201  5151 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:03.351152  3965 rpcz_store.cc:276] 0709 13:16:00.159347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.289193 (+3129846us) service_pool.cc:224] Handling call
0709 13:16:03.289560 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.290184 (+   624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.290351 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.352178  4121 raft_consensus.cc:2376] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3. Re-sending same reply.
I20260709 13:16:03.356863  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:03.424654  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 755) took 3262 ms. Trace:
I20260709 13:16:03.351027  5136 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.435325  5138 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.392755  5149 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.436053  4011 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.435562  4042 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:03.378451  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90009.3us
I20260709 13:16:03.441275  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:03.442260  5147 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.385871  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.437282  5149 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.387658  4942 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.387631  4043 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:03.308190  3971 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:03.354051  5135 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.393944  4040 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:03.312212  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.393151  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.457305  4038 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:03.383144  4986 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:16:03.423957  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8005448579999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:16:03.458082  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6448448579999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 13:16:03.458484  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6448448579999422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:16:03.458770  5135 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.378432  5145 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:03.461223  5145 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.462581  4680 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:16:03.464051  5087 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:16:03.464701  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 152538us
I20260709 13:16:03.465427  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.466470  5154 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.467063  5154 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.467473  5154 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.468345  4119 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:03.469452  4986 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:03.469913  4986 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.471132  4986 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.428524  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 759) took 3265 ms. Trace:
I20260709 13:16:03.473011  3963 rpcz_store.cc:276] 0709 13:16:00.162854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.427488 (+3264634us) service_pool.cc:224] Handling call
0709 13:16:03.427831 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.428315 (+   484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.428474 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.473963  5124 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.474516  3963 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:03.475072  4113 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
W20260709 13:16:03.478384  4649 leader_election.cc:336] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.884s (SENT)
I20260709 13:16:03.478866  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.480281  4963 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.480880  5072 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:03.483202  4046 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:03.483974  4043 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:03.486243  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 754) took 3287 ms. Trace:
I20260709 13:16:03.486625  3971 rpcz_store.cc:276] 0709 13:16:00.161832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.307721 (+3145889us) service_pool.cc:224] Handling call
0709 13:16:03.308028 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.448780 (+140752us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.448957 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.487833  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.433549  3969 rpcz_store.cc:276] 0709 13:16:00.162035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.345563 (+3183528us) service_pool.cc:224] Handling call
0709 13:16:03.348190 (+  2627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.424406 (+ 76216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.424602 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.458784  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6403448579999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:16:03.489642  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6106448579998869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 13:16:03.489915  3937 connection.cc:256] RPC call timeout handler was delayed by -1.596244858000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 13:16:03.490171  3937 connection.cc:256] RPC call timeout handler was delayed by -1.5719448580000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:16:03.490456  3937 connection.cc:256] RPC call timeout handler was delayed by -1.5692448580000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 13:16:03.490708  3937 connection.cc:256] RPC call timeout handler was delayed by -1.5608214689998476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260709 13:16:03.490957  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4891448579999178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1917s for a response
W20260709 13:16:03.491220  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4702448579998872s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
W20260709 13:16:03.491511  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4585448579998683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
W20260709 13:16:03.491766  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4558448580000913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:16:03.425498  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:03.434980  3965 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 3. Ops: []
W20260709 13:16:03.492038  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4396448580000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19720000000000001s for a response
I20260709 13:16:03.386957  5150 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:03.371013  4039 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:03.437417  4940 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:03.438067  4114 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:03.417487  4120 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:03.437193  3967 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:03.439894  3972 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:03.446319  3867 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 3, now has a pending config: VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:03.386307  5105 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:03.385418  5131 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.443735  4045 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:03.381659  3964 rpcz_store.cc:276] 0709 13:16:00.162663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.380086 (+3217423us) service_pool.cc:224] Handling call
0709 13:16:03.380476 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:03.381081 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.381276 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.441313  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:03.442591  4085 leader_election.cc:336] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items
I20260709 13:16:03.512307  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:03.447737  4117 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:03.495218  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 547) took 4477 ms. Trace:
I20260709 13:16:03.450299  4044 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:03.438917  5136 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.457470  3970 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:03.475093  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 783) took 2273 ms. Trace:
I20260709 13:16:03.436582  5065 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:03.493793  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4367059189999054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:16:03.532294  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3550448579999284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2066s for a response
W20260709 13:16:03.532618  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3406448579999051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
W20260709 13:16:03.532948  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3352448579998963s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:16:03.533223  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3019448580000699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 13:16:03.533492  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2479448579999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 13:16:03.533776  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2110448579999229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 13:16:03.534139  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0805448579999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2371s for a response
W20260709 13:16:03.534407  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0778448579999349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23740000000000003s for a response
W20260709 13:16:03.534677  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0704059189997679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20590000000000003s for a response
I20260709 13:16:03.431875  5151 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:03.541831  5151 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:03.542217  5151 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.543030  5151 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.544166  5151 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.495779  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:03.472556  4986 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:03.497942  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 114719us
I20260709 13:16:03.508721  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 762) took 3345 ms. Trace:
I20260709 13:16:03.375239  5094 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.513998  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 775) took 3087 ms. Trace:
I20260709 13:16:03.547392  3970 rpcz_store.cc:276] 0709 13:16:00.426710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.456931 (+3030221us) service_pool.cc:224] Handling call
0709 13:16:03.457283 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.513777 (+ 56494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.513948 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.548611  3970 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:03.549163  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 564) took 1353 ms. Trace:
I20260709 13:16:03.493316  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 761) took 3330 ms. Trace:
W20260709 13:16:03.516093  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 73519.6us
I20260709 13:16:03.549736  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.550381  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:03.516650  5003 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:03.518038  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76794.7us
I20260709 13:16:03.518775  3971 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:03.519729  5152 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.519884  5150 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:03.524444  3967 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:03.525245  5131 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.528429  5147 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.513018  3966 rpcz_store.cc:276] 0709 13:15:59.017339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.266077 (+4248738us) service_pool.cc:224] Handling call
0709 13:16:03.272707 (+  6630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.272979 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:03.341947 (+ 68968us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.416776 (+ 74829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:03.416835 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:03.416891 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.432565 (+ 15674us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.452095 (+ 19530us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68946,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":113,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":84,"spinlock_wait_cycles":22784,"thread_start_us":142878,"threads_started":2,"wal-append.queue_time_us":74697}
I20260709 13:16:03.511714  5105 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.545480  3969 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:03.509171  4115 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:16:03.546223  3972 rpcz_store.cc:276] 0709 13:16:00.163513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.433558 (+3270045us) service_pool.cc:224] Handling call
0709 13:16:03.439673 (+  6115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.508479 (+ 68806us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.508655 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.554824  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 560) took 1878 ms. Trace:
I20260709 13:16:03.580698  3971 rpcz_store.cc:276] 0709 13:16:01.676531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.510132 (+1833601us) service_pool.cc:224] Handling call
0709 13:16:03.510460 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.554549 (+ 44089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.554767 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.555521  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.549499  3970 rpcz_store.cc:276] 0709 13:16:02.196037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.548172 (+1352135us) service_pool.cc:224] Handling call
0709 13:16:03.548461 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.548937 (+   476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.549114 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.556219  3965 rpcz_store.cc:276] 0709 13:16:00.163269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.432999 (+3269730us) service_pool.cc:224] Handling call
0709 13:16:03.434812 (+  1813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.493068 (+ 58256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.493269 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.577597  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.564419  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:03.559432  3968 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:03.595022  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.468264  5154 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:03.685499  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:03.643795  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 88349.7us
I20260709 13:16:03.580255  4115 pending_rounds.cc:85] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:03.644392  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.688335  4115 pending_rounds.cc:107] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:16:03.688935  4043 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:03.611654  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.688970  4011 leader_election.cc:400] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:03.565433  4940 raft_consensus.cc:1064] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:16:03.591003  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.596748  4040 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:03.610337  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60112.8us
I20260709 13:16:03.687876  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 799) took 1494 ms. Trace:
W20260709 13:16:03.688699  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 222432us
I20260709 13:16:03.694988  3969 rpcz_store.cc:276] 0709 13:16:02.193153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.544857 (+1351704us) service_pool.cc:224] Handling call
0709 13:16:03.545174 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.687622 (+142448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.687819 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:03.690697  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.560242  5152 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.595222  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.565264  5003 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.573436  5131 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.579582  5138 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.119s
I20260709 13:16:03.698971  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.699774  4115 raft_consensus.cc:2917] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:16:03.691591  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.564678  5094 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.729854  4115 raft_consensus.cc:2889] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:03.732461  5065 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.733008  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:03.736296  4684 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:03.519214  3963 rpcz_store.cc:276] 0709 13:16:01.201536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.473856 (+2272320us) service_pool.cc:224] Handling call
0709 13:16:03.474195 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.474852 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.475040 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.688480  5139 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:03.561507  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55251.2us
I20260709 13:16:03.739123  5146 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:03.642930  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 798) took 1433 ms. Trace:
I20260709 13:16:03.730098  3972 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:03.740914  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 817) took 1208 ms. Trace:
I20260709 13:16:03.741308  3972 rpcz_store.cc:276] 0709 13:16:02.534598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.699139 (+1164541us) service_pool.cc:224] Handling call
0709 13:16:03.729788 (+ 30649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.740630 (+ 10842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.740854 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.690642  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:03.749569  4039 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:03.565160  4942 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.753307  4047 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:03.754320  4942 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:03.573155  5027 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.129s
I20260709 13:16:03.754722  3967 rpcz_store.cc:276] 0709 13:16:02.161714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.523946 (+1362232us) service_pool.cc:224] Handling call
0709 13:16:03.524266 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.561595 (+ 37329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.595258 (+ 33663us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:03.757253  3966 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:03.565623  5150 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:03.771930  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 80403us
I20260709 13:16:03.772956  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:03.563021  5127 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.774026  4047 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:03.774586  5174 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.585532  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 563) took 1423 ms. Trace:
I20260709 13:16:03.778385  3964 rpcz_store.cc:276] 0709 13:16:02.166229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.529332 (+1363103us) service_pool.cc:224] Handling call
0709 13:16:03.529689 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.529947 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:03.530247 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:16:03.584814 (+ 54567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:03.584878 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:03.585216 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.585309 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:03.585476 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10848,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":134,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":54080,"threads_started":1,"wal-append.queue_time_us":197991}
I20260709 13:16:03.743237  4045 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:03.700603  4940 raft_consensus.cc:1068] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:03.573482  5052 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.155s
W20260709 13:16:03.783773  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53524.6us
I20260709 13:16:03.573005  5149 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.157s
W20260709 13:16:03.786245  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 90533.4us
I20260709 13:16:03.787842  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:03.787817  4012 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.758246  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 18) took 4309 ms. Trace:
W20260709 13:16:03.790724  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.573346  5163 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.198s
W20260709 13:16:03.804805  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.790728  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:03.740603  5139 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.822109  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:03.822465  4046 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
W20260709 13:16:03.826836  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.829754  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:03.829727  4115 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:03.786456  4942 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:16:03.827932  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:03.833925  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43547.6us
I20260709 13:16:03.836068  4047 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:03.794826  5136 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.794569  5174 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:03.790903  5127 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:03.828970  5065 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:03.843845  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.830921  4884 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:03.789453  3968 rpcz_store.cc:276] 0709 13:15:59.448604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:03.273316 (+3824712us) service_pool.cc:224] Handling call
0709 13:16:03.545839 (+272523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:03.690675 (+144836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:03.758039 (+ 67364us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400307d50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:03.758175 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588689152}
I20260709 13:16:03.863940  4940 raft_consensus.cc:1064] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:16:03.864339  4940 raft_consensus.cc:1068] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:03.852675  5065 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:03.854893  5136 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.855581  5173 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:03.887280  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.890313  4942 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.890867  5181 raft_consensus.cc:2764] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:03.891314  4942 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.892848  4884 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:03.893882  4884 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:03.905982  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.852528  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:03.930517  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.871755  5065 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:03.865299  5174 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:03.854368  5152 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.869218  5151 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:16:03.871007  4963 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:16:03.889017  5003 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:03.888604  5173 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:03.957676  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 166988us
I20260709 13:16:03.961113  5175 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:03.968214  5165 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:16:03.967890  5175 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:03.970227  5175 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:03.986958  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:03.953254  5186 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:03.960846  5173 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.005659  5105 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.007882  5105 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:04.012166  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 182473us
I20260709 13:16:04.013579  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:16:03.964700  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 123928us
I20260709 13:16:03.888621  5139 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.009303  5177 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:04.026224  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.021584  5105 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.030054  5105 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:04.030164  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.030484  5105 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.030694  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:03.963177  5127 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.032150  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.030378  4884 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.028347  5147 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.027048  5177 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:04.044699  5135 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.046003  5181 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.047410  5181 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:04.048375  5161 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.500s	user 0.008s	sys 0.000s
I20260709 13:16:04.048597  5180 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:04.049312  5179 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:04.049708  5179 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:04.050261  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:04.050529  5179 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.051384  4047 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.051723  5179 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.049903  5180 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:16:04.053282  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:04.054097  4942 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:04.054529  4942 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.055371  4942 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.029300  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.057199  5135 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.025302  5136 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.058533  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.054086  4038 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.074213  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:04.077664  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:16:04.078223  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51656us
I20260709 13:16:04.078855  5147 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:04.079375  5147 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.079102  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.042959  5052 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:04.079031  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:04.047683  4884 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:16:04.117614  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.074898  5135 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.108027  5052 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:16:04.108605  5192 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:16:04.067472  5181 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 13:16:04.120813  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51330.4us
I20260709 13:16:04.040526  5182 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:16:04.074447  5151 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
W20260709 13:16:04.135092  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89254us
W20260709 13:16:04.142161  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 581450us
W20260709 13:16:04.146113  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67100.4us
I20260709 13:16:04.135172  5027 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:16:04.126677  5190 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.154811  3937 leader_election.cc:400] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3.
I20260709 13:16:04.155154  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.157101  5195 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.158399  5181 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.124385  5052 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.173817  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.174918  4942 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.175956  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.178126  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.149094  4042 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.184507  5094 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:04.189028  5173 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.191177  5065 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.161343  5027 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:04.177590  5135 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.177013  5150 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.176857  5091 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:04.194695  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44934.6us
I20260709 13:16:04.118376  5177 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:04.195533  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.197350  5195 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.146979  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.202603  5052 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:04.212711  5193 raft_consensus.cc:2771] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEARNER]: Leader pre-election decision while not in active config. Result: Term 4: won. RaftConfig: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:04.213303  5195 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.217793  5065 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:04.192756  5145 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.731s	user 0.011s	sys 0.000s
I20260709 13:16:04.204120  4038 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.176753  5105 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.161374  4963 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.222206  4963 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:04.222590  4963 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.207677  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:04.222754  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.183907  5181 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.186733  5138 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:04.205334  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:04.224010  5105 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:04.223699  5027 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.194093  5173 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:04.223745  5181 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:04.236182  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 157200us
I20260709 13:16:04.237208  4011 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.205005  5150 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:04.238489  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.239646  5193 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:04.239830  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 92933.7us
I20260709 13:16:04.243635  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.244189  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.244359  4115 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.244755  4119 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.245919  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.246941  4116 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.248735  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:04.249331  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 62150.2us
I20260709 13:16:04.249737  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:04.250854  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.252025  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.252189  5072 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.252945  5193 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:04.253435  5172 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.254108  5172 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:16:04.253862  5193 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.254473  5172 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:04.254859  5172 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.257117  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:04.257265  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:04.257941  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.258394  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.258819  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.259271  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.260035  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:04.260494  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:04.261073  4681 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.261291  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.261860  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:04.261963  4112 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.262997  5173 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.252702  5072 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.260002  4117 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.252048  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.267747  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.268479  4118 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.245513  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:04.236925  5177 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.242017  5150 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.237779  5190 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.278549  4121 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:04.279284  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.280124  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.284987  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.286995  5205 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.287218  5136 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:04.287890  5146 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.538s	user 0.004s	sys 0.010s
W20260709 13:16:04.288410  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53388.4us
I20260709 13:16:04.258813  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.290843  4120 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:04.327802  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.291299  5173 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.329361  5173 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:04.330281  5173 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.291754  5151 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.296672  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:04.334367  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.274449  5027 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.298305  3867 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted, no longer has a pending config: VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:04.337724  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:04.338954  4047 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.301661  5197 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:04.304008  4963 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.286144  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.343941  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.344709  4117 raft_consensus.cc:2368] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.307314  4115 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:04.307962  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:04.308810  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.309764  4116 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.260661  4113 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:04.361171  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 102433us
I20260709 13:16:04.290997  5072 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:04.363364  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.340035  4119 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.344875  4121 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.350835  5190 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.311888  5136 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.353207  3867 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:04.358274  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.358862  5203 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:04.359270  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.373389  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:04.373621  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.374209  4940 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:16:04.374621  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56883.9us
I20260709 13:16:04.375420  5205 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.376287  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:04.341589  5197 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:04.376818  5205 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:04.377526  5197 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.378757  5197 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.378978  5065 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.352138  5147 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:04.381917  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74030.5us
I20260709 13:16:04.384477  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.337529  5179 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:04.389261  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.314368  4112 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:04.401583  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.404497  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46299.9us
I20260709 13:16:04.405234  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.406486  4012 leader_election.cc:400] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.406797  4012 leader_election.cc:403] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.389739  3968 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:16:04.408231  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.414834  4012 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:04.418654  5003 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.407723  5105 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:04.419674  5105 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.420086  5105 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.387773  5091 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.421591  5091 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.422174  5135 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
W20260709 13:16:04.422585  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49300us
I20260709 13:16:04.407765  5145 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.424882  5199 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:04.425287  5199 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:04.425683  4681 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.425894  5200 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.426971  5151 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.429323  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.383706  5147 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:04.430192  4012 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.430639  3971 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.442814  4012 leader_election.cc:403] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:04.431411  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.431526  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:04.432571  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.444473  3965 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.433570  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.434841  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:04.435806  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.437031  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.438123  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:04.461357  3970 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 1.
I20260709 13:16:04.461655  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.439139  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.427009  5145 raft_consensus.cc:1064] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:04.407692  4038 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.425627  5199 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:04.448829  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.462304  3969 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.407792  5127 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.443859  5135 raft_consensus.cc:2764] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:04.464208  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:04.465935  5065 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.463019  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.481282  3965 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.481351  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.482091  3970 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.403673  5206 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:16:04.460675  5200 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.483349  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:04.486451  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.469231  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:04.477095  5145 raft_consensus.cc:1068] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:04.490633  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.492337  5135 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.509171  3972 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.472328  3967 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.414196  5203 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:16:04.476622  5072 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.484887  4942 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.404019  5154 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:16:04.522104  4045 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.475787  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.483793  5003 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:16:04.523065  4011 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.543439  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.544536  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:04.537801  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67742.5us
I20260709 13:16:04.518477  3963 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:04.535816  3971 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.541617  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.545588  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.547344  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.548589  3971 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.476987  5172 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.524041  5175 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.491287  5182 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:16:04.524377  3966 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:04.557152  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.559123  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.559707  3970 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.560086  3969 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.564787  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:04.526274  5186 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.514s	user 0.000s	sys 0.010s
I20260709 13:16:04.572116  5186 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:04.546870  4942 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.575235  5177 raft_consensus.cc:2764] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:04.577430  5072 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.577948  5072 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.578330  5094 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.578950  5094 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.559007  5145 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.581296  4085 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.581471  5094 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:04.582152  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:04.582405  5052 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.583038  5052 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.584885  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.585614  5094 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.586076  5094 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.587100  5177 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:04.587617  5177 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:04.588487  5177 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.589066  5094 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:04.589936  4942 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.590752  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.591346  4940 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:04.594452  5052 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.596160  4114 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.596011  5105 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.597827  5052 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.598316  5052 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.564780  3968 raft_consensus.cc:2368] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:04.604137  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:04.604676  3968 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.605371  3966 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.603098  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:04.597191  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.606689  3969 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.548637  5127 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.550042  5138 raft_consensus.cc:2764] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:04.606829  4047 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:04.621939  5091 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:04.617218  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71701.1us
I20260709 13:16:04.625736  4963 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:04.627342  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.628410  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:04.631016  3965 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.645229  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:04.645996  3968 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:04.647784  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.638736  3971 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:04.622030  5196 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:04.628962  5179 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:04.633780  5210 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:16:04.642215  5052 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:04.661880  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.662642  4120 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:04.633948  5149 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.656201  5105 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:04.665000  4116 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:04.669549  4117 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.640230  5150 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.656994  5138 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.685454  3970 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.640627  4114 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:04.694933  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.691247  5145 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:04.691563  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:04.692065  5138 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:04.693760  4117 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:04.660374  5003 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:04.697378  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 69063.3us
I20260709 13:16:04.699187  4117 pending_rounds.cc:85] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 1
I20260709 13:16:04.699535  4117 pending_rounds.cc:107] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:04.699905  4117 raft_consensus.cc:2889] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:04.701951  4116 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:04.707718  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.634431  5199 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:04.690152  5179 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:04.702286  5138 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:04.700995  5127 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:04.716354  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:04.690366  5149 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.706523  4684 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:04.731237  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:04.714421  3963 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:04.703007  5145 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.728928  5181 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:04.768039  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.713243  5152 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 13:16:04.789983  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.742660  5091 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:04.798561  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69268.4us
I20260709 13:16:04.730842  5203 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:16:04.814026  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.821048  5150 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:04.821556  4940 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:04.814312  5179 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:04.843529  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:04.817862  4112 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:16:04.853302  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.853513  5220 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:16:04.795717  5147 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:04.856033  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:04.857564  5219 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:16:04.858547  5215 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:16:04.860221  5172 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:04.860445  4115 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:04.861827  4115 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.863014  4115 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:04.838567  4940 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:04.865639  4940 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:04.869498  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 209720us
W20260709 13:16:04.872728  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:04.874892  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:04.837965  5094 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:04.983651  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 140202us
W20260709 13:16:04.985136  5161 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:16:04.971302  5181 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:04.984263  5091 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:16:05.003535  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 124293us
W20260709 13:16:05.052973  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57759.5us
I20260709 13:16:04.986339  5094 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.008000  4119 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:04.990901  5052 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.056562  5199 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.066665  5152 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.063666  5149 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.071746  5091 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.073052  5145 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.108915  5230 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.121218  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:05.131496  4038 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:05.132145  5150 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:05.133037  5150 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.133373  5150 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:05.134168  5150 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.135344  5150 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.113994  5182 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:05.138170  5094 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:05.122512  4112 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:16:05.143553  5217 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:16:05.143800  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:05.168640  4684 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:05.124042  5152 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.146500  5211 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.582s	user 0.008s	sys 0.013s
I20260709 13:16:05.147323  4940 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.147996  5181 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.150766  5224 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 13:16:05.151578  5227 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:16:05.153909  5094 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.153925  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.155917  4680 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:05.115191  5052 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:05.112514  5206 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:16:05.161664  5200 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.641s	user 0.010s	sys 0.000s
I20260709 13:16:05.114210  4942 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:16:05.143805  5212 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.114s	user 0.003s	sys 0.000s
I20260709 13:16:05.168854  5177 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:16:05.127343  5149 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.201498  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72750.7us
W20260709 13:16:05.204082  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.173375  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 110243us
W20260709 13:16:05.223325  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 60528.7us
W20260709 13:16:05.222991  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:05.224160  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.225620  3968 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:05.130302  5091 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.229806  3965 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:05.231022  3971 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: [1.3-2.4]
I20260709 13:16:05.231956  3970 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.233471  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.142539  5230 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.237437  3968 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:05.238348  3969 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.223240  5200 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:05.226660  5152 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.199321  5163 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:16:05.244966  5233 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.260051  5247 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:05.261718  4940 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.216980  5094 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.250542  5230 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.252162  5052 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.254031  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.237072  5206 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:16:05.247248  5138 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:16:05.262617  3970 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.260960  5174 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.265167  5091 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.232932  5149 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.271338  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44127.6us
I20260709 13:16:05.282269  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.284209  5177 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.285439  5146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.007s	sys 0.009s
I20260709 13:16:05.258762  5199 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:16:05.290123  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.290369  3968 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:05.291657  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.292716  5246 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.293308  5094 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.293756  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.290761  5177 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.280447  4940 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:05.295452  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 59261.5us
I20260709 13:16:05.296077  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.298216  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.299021  3968 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:05.299813  3969 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 2. Ops: []
I20260709 13:16:05.303006  3971 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:05.308645  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.309695  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.310266  3968 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:05.290985  5146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.939s	user 0.007s	sys 0.010s
I20260709 13:16:05.311036  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.311411  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.312300  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:05.313669  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.310979  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.290936  5091 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.316238  3971 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:05.293270  5246 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:05.318660  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.306906  4940 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:05.286262  5138 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.316188  5094 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.331317  4115 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.338038  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:05.339913  4117 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:05.346411  5091 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:05.347628  5091 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.352269  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:05.352643  5246 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.359973  5255 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:16:05.353870  3969 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 1. Current term is 3. Ops: []
I20260709 13:16:05.362048  3971 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.329732  4940 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.369176  5251 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:05.369839  5251 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.372228  5251 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.330753  5181 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.375484  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.331102  5145 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.380134  3971 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.383050  5146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45584 (request call id 60) took 11234 ms. Trace:
I20260709 13:16:05.383409  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.384025  3969 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.360667  5094 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:05.374320  4940 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.390568  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.376194  4114 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:05.381049  5181 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:05.392705  5175 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:05.337505  5230 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:16:05.379456  5145 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:05.383520  5236 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.408983  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 98018.3us
I20260709 13:16:05.410118  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.411631  3969 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:05.413555  5250 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.414289  5250 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.417193  5138 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:05.417440  3966 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:05.417821  3966 pending_rounds.cc:85] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:05.418028  3966 pending_rounds.cc:107] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:05.418238  3966 raft_consensus.cc:2889] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.418553  5179 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.419246  5179 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.420153  4940 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.421265  5094 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.424625  4114 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.401328  5175 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.425498  5149 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.426090  5236 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.427011  4115 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:05.428200  5236 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.396073  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:05.409832  5145 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.429283  4113 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:05.404130  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.385696  5146 rpcz_store.cc:276] 0709 13:15:54.144749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:15:54.148938 (+  4189us) service_pool.cc:224] Handling call
0709 13:15:54.198897 (+ 49959us) log.cc:844] Serialized 501 byte log entry
0709 13:15:54.390728 (+191831us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b18003066a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed763a5b0b 00007fed7642ab63 00007fed76452752 00007fed7644a9fa
0709 13:15:54.441866 (+ 51138us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18003066a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:16:05.374723 (+10932857us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6795,"raft.queue_time_us":15289,"raft.run_cpu_time_us":1359,"raft.run_wall_time_us":1359,"spinlock_wait_cycles":61079552,"thread_start_us":176492,"threads_started":1,"wal-append.queue_time_us":180703,"wal-append.run_cpu_time_us":1371,"wal-append.run_wall_time_us":1006365}
I20260709 13:16:05.433092  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.442632  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.443914  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.444571  3969 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.445936  3965 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.449916  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:05.451272  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.458246  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.450618  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.461030  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.461793  3966 raft_consensus.cc:2368] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:05.458415  5247 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.469213  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.416680  5250 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:05.449669  5138 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.450129  5174 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.482055  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.482892  4040 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.435416  4940 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:05.487154  5094 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.489459  5179 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.473802  5247 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.490006  5174 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.491976  5247 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.492383  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:05.492974  4039 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.493424  5245 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.494553  5072 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:05.495065  5257 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:16:05.496197  3967 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.497040  5223 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.497510  5223 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.497895  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.486806  5138 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.499502  5223 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.499878  5175 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.500589  5138 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.497545  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.501709  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.485258  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.502935  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:05.497252  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.504029  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.489351  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 23) took 1071 ms. Trace:
I20260709 13:16:05.505867  4045 rpcz_store.cc:276] 0709 13:16:04.417516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.458628 (+ 41112us) service_pool.cc:224] Handling call
0709 13:16:04.458970 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.539809 (+ 80839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.489114 (+949305us) spinlock_profiling.cc:243] Waited 61.4 ms on lock 0x7b540002add4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:05.489293 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141136128}
I20260709 13:16:05.507845  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.413467  5181 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.508895  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.473080  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:05.516005  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.517288  4045 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.518023  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.519196  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.533665  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.521623  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.486616  5246 raft_consensus.cc:2764] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:05.537940  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.532401  3968 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.539417  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.541522  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.492061  5174 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.542109  4045 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.539294  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.543381  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.543933  3971 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.542974  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.543315  4040 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.546586  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.467391  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.509016  5147 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.516126  5105 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.549537  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.507635  5261 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.553424  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.554806  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.538681  5131 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.559878  3855 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d0ea046ec794443af9a7689d2920002 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:05.560226  5202 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.561100  3965 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:05.561800  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.562198  5258 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:05.539220  5150 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.526058  5091 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.557940  3972 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:05.552188  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.537388  5236 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.548521  5149 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.577052  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.577914  4011 leader_election.cc:400] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 2 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3.
I20260709 13:16:05.579412  4011 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.556844  5182 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.580312  5174 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.581995  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.598017  5131 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:05.597970  5175 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.582316  5261 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.602008  5261 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:05.603012  5261 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.604089  4039 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.578992  5236 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.607435  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.608119  4040 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:05.582711  5146 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:16:05.587062  5241 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 13:16:05.580467  5202 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.582007  5152 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:05.580942  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.557391  5105 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:05.626129  5105 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.623227  5146 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:05.627398  5146 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.619482  3964 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.621872  5145 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.631080  5145 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.589898  5147 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:16:05.633404  5202 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.633919  5202 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:05.634052  5136 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.635632  5136 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.591527  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.555841  5259 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.564525  5094 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.600265  5246 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.572816  4113 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:05.621696  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 600) took 1233 ms. Trace:
W20260709 13:16:05.572288  5173 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.995s	user 0.003s	sys 0.045s
I20260709 13:16:05.624526  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.637149  3938 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:16:05.637300  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45862.2us
I20260709 13:16:05.644204  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.640064  4119 rpcz_store.cc:276] 0709 13:16:04.386533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.648744 (+262211us) service_pool.cc:224] Handling call
0709 13:16:04.651002 (+  2258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.071142 (+420140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:05.619389 (+548247us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b540034dd54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:05.619577 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820416256}
I20260709 13:16:05.640915  5094 raft_consensus.cc:1064] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:16:05.635660  5209 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.286s	user 0.004s	sys 0.012s
I20260709 13:16:05.639827  5091 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:05.642042  3967 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:05.639226  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:05.638728  5027 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.639902  4113 pending_rounds.cc:85] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 1
I20260709 13:16:05.648600  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:05.650281  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.650962  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:05.646169  5173 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.069s	user 0.003s	sys 0.045s
I20260709 13:16:05.654443  4119 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:05.648212  5147 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.651268  5145 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:16:05.646265  5259 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.648281  5236 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.652370  5003 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:05.661405  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.660069  5259 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.655118  5027 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:05.657899  4113 pending_rounds.cc:107] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:05.664196  4085 leader_election.cc:400] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:05.669499  4085 leader_election.cc:403] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:16:05.660372  5147 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:05.664216  5258 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.672062  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.657691  5205 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:16:05.652395  5127 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:05.659628  5182 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:16:05.667403  5003 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:05.668013  5259 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.681262  5065 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.669433  4113 raft_consensus.cc:2889] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:05.681805  5273 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.657473  5202 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.668351  4942 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:05.683061  5174 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.669561  5027 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.683911  5243 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.684291  5243 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:05.674777  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 225616us
I20260709 13:16:05.665396  5230 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:16:05.686494  5205 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.666218  5200 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:05.666165  5131 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:05.672526  5175 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3.
I20260709 13:16:05.685513  5149 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.690831  5147 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.695631  5127 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.686384  5003 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.696395  4986 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.700037  4986 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.702297  4986 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:05.687615  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.688287  5205 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:05.708101  5205 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.690243  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.703663  4113 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:05.703330  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:05.709517  4085 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.713768  4045 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:05.726217  5175 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.726711  5175 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.727053  5175 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.731554  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:05.686043  5243 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.722271  4986 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.735349  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:05.737255  3972 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:05.732452  5003 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:05.746167  3969 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:05.738565  4986 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.741463  5003 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.754134  5105 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.756915  4047 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:05.763790  4047 pending_rounds.cc:85] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 1
I20260709 13:16:05.764052  4047 pending_rounds.cc:107] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:05.764284  4047 raft_consensus.cc:2889] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:05.775701  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 107346us
I20260709 13:16:05.733330  5027 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.784348  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.749568  5243 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.764786  5136 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.765136  5280 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.763355  5003 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:05.756551  5175 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.793852  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.793740  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.734798  3967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45584
I20260709 13:16:05.764873  4986 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:05.798347  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }.
  Pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.798694  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.799932  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.795619  5136 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:05.801491  5253 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.447s	user 0.002s	sys 0.002s
I20260709 13:16:05.802897  5136 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.795775  5280 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.806568  5027 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.807838  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:05.784067  5202 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.829676  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.784214  5147 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:05.817296  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.818989  5242 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.819476  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:05.839394  4119 raft_consensus.cc:606] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.820425  5105 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.809016  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:05.821523  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:05.810496  4681 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:05.811333  4113 raft_consensus.cc:2410] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:05.821498  5259 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:05.826045  5175 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:05.795909  5172 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:05.827615  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:05.827919  5149 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:05.828346  5027 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:05.833039  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:05.837391  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.839804  4119 raft_consensus.cc:614] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:05.841539  5245 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:05.872990  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:05.842650  5242 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.884976  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:05.885643  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48333.9us
I20260709 13:16:05.886009  3966 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.842120  5263 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:16:05.885864  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:05.863538  5273 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:05.862946  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:16:05.886950  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 225582us
I20260709 13:16:05.862903  5172 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:05.887319  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:05.864241  5258 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:05.862857  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:05.863828  5246 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.839085  5202 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.841287  5223 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:16:05.902976  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:05.842828  5147 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.883777  5245 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:05.883929  5152 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.999075  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:05.964993  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77739.6us
W20260709 13:16:05.951969  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49067.8us
I20260709 13:16:05.901526  5139 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:05.888484  5242 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.948577  4684 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.026209  4043 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.012953  5127 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.014607  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:06.031035  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:06.031554  3972 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:05.950278  5287 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.949270  5258 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:06.022665  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 87575.1us
I20260709 13:16:06.011406  5246 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.037953  5287 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.040200  5287 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:05.999794  5152 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.040937  5152 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.042500  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 591) took 1739 ms. Trace:
I20260709 13:16:06.042856  4120 rpcz_store.cc:276] 0709 13:16:04.302643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.328630 (+ 25987us) service_pool.cc:224] Handling call
0709 13:16:04.328917 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:04.664030 (+335113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.042245 (+1378215us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54002ac6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:06.042424 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766768896}
W20260709 13:16:05.889719  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96627.8us
I20260709 13:16:06.045957  5202 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:06.046985  5147 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:06.005571  5138 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:05.954720  5259 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:05.949308  5172 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:05.884086  5136 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.126s
I20260709 13:16:05.952162  5145 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:06.034650  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.033625  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:05.951865  5277 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:05.963398  5280 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:06.071377  5145 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:06.072386  5145 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:05.903378  5271 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:06.049345  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.053346  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:06.054085  3966 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:06.053539  4045 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.010547  5052 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.055017  3972 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:06.078120  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:06.079090  3972 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:06.024925  5139 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.081795  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:06.047927  5138 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:05.929973  5230 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:16:06.057142  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.058542  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:06.059288  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:06.062906  4044 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:06.063577  4043 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:05.950122  5182 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.103s
I20260709 13:16:06.076086  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:06.074435  3968 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:06.001052  5245 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.023382  5003 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.084649  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:06.057720  4012 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:06.086928  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:06.094118  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 95130.9us
I20260709 13:16:06.077064  5271 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.098798  4046 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.098873  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.077250  5052 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:06.083508  5139 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.106452  4116 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:06.106861  4116 pending_rounds.cc:85] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 1
I20260709 13:16:06.107069  4116 pending_rounds.cc:107] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:06.107286  4116 raft_consensus.cc:2889] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:06.106364  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.108944  4044 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:06.109230  4119 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.110728  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.111265  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:06.113130  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55501.6us
W20260709 13:16:06.113303  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.114769  4120 raft_consensus.cc:606] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:06.115211  4120 raft_consensus.cc:614] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:06.115428  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.116056  4116 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.116518  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.117168  4043 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.118016  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.119107  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.098057  4680 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.041119  5258 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:06.102365  3963 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:06.121361  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:06.121810  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.100420  4986 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.127556  4986 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:06.128327  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:06.130080  5003 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:06.104789  5271 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.129765  5138 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:06.115002  5182 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:06.122409  5105 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:06.134625  4121 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.165597  5105 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.166474  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.167155  4121 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.167742  5105 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:06.104236  5172 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.168015  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.135493  4115 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.122505  5200 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:06.136116  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.136848  5290 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:06.169924  4119 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.170737  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.171733  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.080965  5277 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:06.168620  4121 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.169627  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.176156  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.141834  4680 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:06.122711  5190 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:06.125312  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:16:06.186643  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61427.2us
I20260709 13:16:06.189666  4119 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.190812  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.157292  4681 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:06.147024  4116 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.130525  5052 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:06.192205  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 190789us
I20260709 13:16:06.124930  5202 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:06.168547  5172 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.184255  5277 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:06.184669  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.142235  5206 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.185304  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.154279  5152 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.193070  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.293066  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:06.169615  5200 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.294366  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.299189  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.301043  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 841) took 1012 ms. Trace:
I20260709 13:16:06.301388  3970 rpcz_store.cc:276] 0709 13:16:05.288388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.290601 (+  2213us) service_pool.cc:224] Handling call
0709 13:16:06.300892 (+1010291us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54002c9f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:06.300989 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":266196864}
I20260709 13:16:06.301512  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:06.185451  4684 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
W20260709 13:16:06.300225  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.293279  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.305677  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:06.338523  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.318912  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:06.354023  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.318377  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:06.342481  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.363617  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.381601  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.382958  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.383272  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.384301  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:06.294904  5190 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:06.294559  5180 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:06.388293  3970 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:06.386868  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.388890  4115 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.300793  5052 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.306547  5173 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.402228  5173 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.402602  5173 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.300642  5200 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:06.304898  4114 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:06.392132  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.392369  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:06.302717  5003 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:06.368742  5242 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:06.388531  5182 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.292243  5105 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:16:06.312274  5152 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:06.394152  4121 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.300487  5206 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:06.316617  5245 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.396883  5138 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.306525  5271 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.389640  4039 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.401407  3970 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.401800  5301 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.306593  5177 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:06.423502  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.544308  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:06.547334  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.624262  4115 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:06.476522  5181 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:06.629251  5138 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.537611  5291 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.627552  5163 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.418073  4986 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.668423  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.414276  5172 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.626770  5206 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.421460  5072 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.430353  3964 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.391330  5294 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.260s
I20260709 13:16:06.477468  5149 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.671007  3966 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:06.691345  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.638243  5152 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.475378  5154 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:06.672526  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:06.659206  5181 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:06.448526  5136 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:06.609037  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 628) took 1162 ms. Trace:
I20260709 13:16:06.417187  5297 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.536895  5173 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:06.631124  5287 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.019s	sys 0.017s
I20260709 13:16:06.454360  5200 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.655359  5150 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:06.626109  5182 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:06.694679  5277 raft_consensus.cc:670] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:06.673146  3970 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.409138  4648 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:06.416071  5139 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.701184  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.713826  3966 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.655546  5003 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:06.694806  4116 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.716977  4120 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:06.694583  5154 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:06.530758  5301 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.701509  5136 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.676018  4986 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.715240  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:06.416620  5190 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.680939  5172 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.713519  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.734016  4044 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:06.735586  4041 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:06.720072  3966 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.747466  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.755580  4116 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:06.697117  5149 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.755903  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:06.691622  5072 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:06.715857  5287 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.020s	sys 0.018s
I20260709 13:16:06.677170  5163 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.696915  5152 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.700042  4114 rpcz_store.cc:276] 0709 13:16:05.446337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.449525 (+  3188us) service_pool.cc:224] Handling call
0709 13:16:06.184508 (+734983us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:06.556614 (+372106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50392448}
I20260709 13:16:06.701937  5297 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:06.761703  5151 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.045s	sys 0.112s
I20260709 13:16:06.678109  5291 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.750561  5289 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:06.719982  5150 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.773419  5277 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:06.772476  4039 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.828197  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:06.795006  5271 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:06.831625  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:06.901343  4041 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:06.889351  4120 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:06.827777  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 831) took 1250 ms. Trace:
W20260709 13:16:06.822407  5027 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.044s	sys 0.046s
W20260709 13:16:06.846657  5151 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.045s	sys 0.112s
I20260709 13:16:06.923825  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:06.924274  5298 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 13:16:06.924052  4116 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:06.936715  5294 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:06.847462  5245 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:06.753659  5181 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:06.966956  4084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.037s	sys 0.068s
W20260709 13:16:06.967409  4084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.037s	sys 0.068s
W20260709 13:16:06.958489  5027 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.045s	sys 0.046s
I20260709 13:16:06.903147  5242 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:06.976889  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.006s
W20260709 13:16:06.977231  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.005s	sys 0.006s
W20260709 13:16:06.972421  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.973104  3971 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.013s	sys 0.034s
I20260709 13:16:06.973229  4116 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:06.977622  4119 raft_consensus.cc:1217] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:16:06.978103  4119 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:16:06.803318  5154 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.896023  5277 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:06.978595  3971 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.014s	sys 0.034s
W20260709 13:16:06.986033  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.966585  5138 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:06.992841  5131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.038s
W20260709 13:16:06.993281  5131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.012s	sys 0.038s
W20260709 13:16:06.994125  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.011s
W20260709 13:16:06.996172  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:06.997740  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.000s	sys 0.012s
W20260709 13:16:06.998102  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 539716us
I20260709 13:16:06.998268  4116 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:06.894024  5289 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.007968  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 643) took 1226 ms. Trace:
I20260709 13:16:06.981505  5277 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:07.014142  5306 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:16:07.014602  5151 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.015108  5151 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:06.941857  4038 rpcz_store.cc:276] 0709 13:16:05.573018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.573146 (+   128us) service_pool.cc:224] Handling call
0709 13:16:06.802514 (+1229368us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54000b8454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:06.823519 (+ 21005us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581643520}
I20260709 13:16:07.017067  5151 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.017838  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 883) took 1278 ms. Trace:
I20260709 13:16:07.018855  5291 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.018184  3968 rpcz_store.cc:276] 0709 13:16:05.739383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.129231 (+389848us) service_pool.cc:224] Handling call
0709 13:16:06.129579 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.129944 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.129975 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.132020 (+  2045us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.634319 (+502299us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:06.634359 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.634427 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.017602 (+383175us) raft_consensus.cc:1685] finished
0709 13:16:07.017625 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.017783 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3313,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":31545,"thread_start_us":448834,"threads_started":1,"wal-append.queue_time_us":622066}
I20260709 13:16:07.014376  5242 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.021546  5150 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.021414  5242 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.022410  5301 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.008401  3970 rpcz_store.cc:276] 0709 13:16:05.781561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.717608 (+936047us) service_pool.cc:224] Handling call
0709 13:16:06.719721 (+  2113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.738359 (+ 18638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.738394 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.768736 (+ 30342us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.007650 (+238914us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.007704 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.007764 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.007803 (+    39us) raft_consensus.cc:1685] finished
0709 13:16:07.007813 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.007917 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2736,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10761,"spinlock_wait_cycles":20224,"thread_start_us":183259,"threads_started":1,"wal-append.queue_time_us":194752}
I20260709 13:16:06.982435  5181 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.025635  5200 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.026556  5242 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:07.027647  5149 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.029444  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 40) took 2818 ms. Trace:
W20260709 13:16:07.029405  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:06.988864  5154 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:06.968907  5294 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.007396  4114 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:06.999564  5173 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.033136  3869 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.071615  3869 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.073378  3869 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.036412  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 880) took 1299 ms. Trace:
I20260709 13:16:06.990212  5182 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:06.983511  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 574526us
I20260709 13:16:07.006359  5138 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.037959  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 728) took 1015 ms. Trace:
I20260709 13:16:07.074695  3971 rpcz_store.cc:276] 0709 13:16:05.737372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.737595 (+   223us) service_pool.cc:224] Handling call
0709 13:16:05.738164 (+   569us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.840089 (+101925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.840124 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.840610 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:16:06.043934 (+203324us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18004250e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:16:06.296921 (+252987us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:06.982493 (+685572us) log.cc:844] Serialized 14 byte log entry
0709 13:16:06.982669 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:06.982734 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.036112 (+ 53378us) raft_consensus.cc:1685] finished
0709 13:16:07.036214 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.036338 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101220,"raft.queue_time_us":124408,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":8766,"spinlock_wait_cycles":9426816,"thread_start_us":873957,"threads_started":2,"wal-append.queue_time_us":849095}
I20260709 13:16:07.082790  3971 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.081892  4045 rpcz_store.cc:276] 0709 13:16:06.022465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.022579 (+   114us) service_pool.cc:224] Handling call
0709 13:16:06.022858 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:06.073898 (+ 51040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.037723 (+963825us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b5400029ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:07.037904 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59138304}
I20260709 13:16:07.076803  3970 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:07.084290  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 648) took 1301 ms. Trace:
I20260709 13:16:07.084584  3970 rpcz_store.cc:276] 0709 13:16:05.782732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.029204 (+1246472us) service_pool.cc:224] Handling call
0709 13:16:07.076568 (+ 47364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.084055 (+  7487us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.084241 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.065511  3867 rpcz_store.cc:276] 0709 13:16:04.218509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.218669 (+   160us) service_pool.cc:224] Handling call
0709 13:16:07.029342 (+2810673us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:04.573761 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:04.635744 (+ 61983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:04.635776 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:16:04.635794 (+    18us) tablet.cc:662] Decoding operations
0709 13:16:04.636212 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:04.636262 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:04.636293 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:16:04.636627 (+   334us) tablet.cc:701] Row locks acquired
0709 13:16:04.636646 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:16:04.652235 (+ 15589us) write_op.cc:270] Start()
0709 13:16:04.657495 (+  5260us) write_op.cc:276] Timestamp: P: 1783602964636738 usec, L: 0
0709 13:16:04.659699 (+  2204us) op_driver.cc:348] REPLICATION: starting
0709 13:16:04.723240 (+ 63541us) log.cc:844] Serialized 981 byte log entry
0709 13:16:04.785147 (+ 61907us) op_driver.cc:464] REPLICATION: finished
0709 13:16:05.005299 (+220152us) write_op.cc:301] APPLY: starting
0709 13:16:05.008266 (+  2967us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:05.057488 (+ 49222us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:05.109489 (+ 52001us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:05.170833 (+ 61344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:05.206731 (+ 35898us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:16:05.219114 (+ 12383us) write_op.cc:312] APPLY: finished
0709 13:16:05.230349 (+ 11235us) log.cc:844] Serialized 28 byte log entry
0709 13:16:05.239600 (+  9251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.242644 (+  3044us) write_op.cc:454] Released schema lock
0709 13:16:05.257641 (+ 14997us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:05.263352 (+  5711us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:05.263378 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":199962,"apply.run_cpu_time_us":2911,"apply.run_wall_time_us":263111,"num_ops":2,"prepare.queue_time_us":161927,"prepare.run_cpu_time_us":3539,"prepare.run_wall_time_us":166004,"replication_time_us":122669,"thread_start_us":112792,"threads_started":2}]]}
I20260709 13:16:07.085696  3971 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:07.028810  5072 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.081341  4046 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.078351  3869 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.088657  4045 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:07.029311  5172 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.091354  3869 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.044734  5139 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.066653  5233 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.095530  3970 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:07.090408  4045 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.081012  5136 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.074656  5245 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.094489  3971 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.103348  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 650) took 1320 ms. Trace:
I20260709 13:16:07.098376  3869 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:07.105449  3970 rpcz_store.cc:276] 0709 13:16:05.783174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.085251 (+1302077us) service_pool.cc:224] Handling call
0709 13:16:07.095356 (+ 10105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.096588 (+  1232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.103279 (+  6691us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.108933  3970 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:07.109622  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 651) took 1326 ms. Trace:
I20260709 13:16:07.110129  3970 rpcz_store.cc:276] 0709 13:16:05.783402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.106295 (+1322893us) service_pool.cc:224] Handling call
0709 13:16:07.108781 (+  2486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.109350 (+   569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.109570 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.110845  3971 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.103606  5072 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.103482  4986 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.091624  5138 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.107081  5314 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.104558  5172 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:07.125800  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.119164  5072 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.134006  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 646) took 1351 ms. Trace:
I20260709 13:16:07.134364  3966 rpcz_store.cc:276] 0709 13:16:05.782303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.755316 (+973013us) service_pool.cc:224] Handling call
0709 13:16:06.822197 (+ 66881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.995414 (+173217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.995463 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.996454 (+   991us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.107607 (+111153us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.107663 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.107737 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.133779 (+ 26042us) raft_consensus.cc:1685] finished
0709 13:16:07.133798 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.133945 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79413,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":40046,"thread_start_us":276392,"threads_started":2,"wal-append.queue_time_us":135800}
I20260709 13:16:07.135464  5072 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.136030  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.127785  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 743) took 1090 ms. Trace:
I20260709 13:16:07.136605  3966 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:07.136840  3967 raft_consensus.cc:606] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:16:07.137574  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:07.131412  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.128849  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:07.133087  5094 raft_consensus.cc:1068] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:16:07.145942  4042 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:07.146409  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 818) took 1709 ms (client timeout 2002 ms). Trace:
W20260709 13:16:07.146775  4042 rpcz_store.cc:269] 0709 13:16:05.437288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.442692 (+  5404us) service_pool.cc:224] Handling call
0709 13:16:07.128697 (+1686005us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327eee 0000000000375939 00007fed7b39b1e0 00007fed7b4640c4 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:07.146348 (+ 17651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6404352}
I20260709 13:16:07.148252  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.149123  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.149926  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:07.134558  4118 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:16:07.097426  5233 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:07.142616  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.137072  4041 rpcz_store.cc:276] 0709 13:16:06.037566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.964837 (+927271us) service_pool.cc:224] Handling call
0709 13:16:06.979285 (+ 14448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.979606 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.979630 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.986564 (+  6934us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.074180 (+ 87616us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.074218 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.074282 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.127558 (+ 53276us) raft_consensus.cc:1685] finished
0709 13:16:07.127594 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.127728 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2203,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4946,"thread_start_us":29643,"threads_started":1,"wal-append.queue_time_us":98756}
I20260709 13:16:07.144536  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.144830  5277 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:07.151170  4085 leader_election.cc:336] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.555s (SENT)
I20260709 13:16:07.108819  5245 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.151180  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:07.152266  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 37) took 1701 ms. Trace:
I20260709 13:16:07.161857  4118 rpcz_store.cc:276] 0709 13:16:05.451020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.488530 (+ 37510us) service_pool.cc:224] Handling call
0709 13:16:07.134060 (+1645530us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:07.134247 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.151992 (+ 17745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.152214 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43597696}
I20260709 13:16:07.154488  3971 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:07.121071  5152 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.164363  3971 pending_rounds.cc:85] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:07.164682  3971 pending_rounds.cc:107] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:07.165031  3971 raft_consensus.cc:2889] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.170889  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.159019  5195 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.158933  5139 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.158975  5136 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.177137  5094 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.157584  5309 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.179180  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:07.197337  5206 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:16:07.198252  4684 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:07.198904  5246 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:07.180428  5322 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:07.185359  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d0ea046ec794443af9a7689d2920002 with delete_type TABLET_DATA_TOMBSTONED (TS 0f3fa9d459de485e824f023c55580bc6 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36870
I20260709 13:16:07.168648  5280 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:07.168985  5230 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:07.150532  5314 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.189946  4681 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:07.177078  5311 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.192283  5289 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.176060  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 649) took 1393 ms. Trace:
I20260709 13:16:07.157104  5182 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:07.193302  5195 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.215538  5072 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.194980  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.240657  3966 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.167798  5190 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.195742  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.143615  5172 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:07.246160  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50503us
I20260709 13:16:07.247390  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.197824  5206 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.181317  4118 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:07.197326  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:07.247901  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:07.249118  4045 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.200085  5094 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.167742  5291 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:16:07.167562  5105 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:07.193922  5136 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.197722  5139 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:07.228720  4039 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
W20260709 13:16:07.235286  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69001.3us
I20260709 13:16:07.239347  3971 rpcz_store.cc:276] 0709 13:16:05.782962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.082410 (+1299448us) service_pool.cc:224] Handling call
0709 13:16:07.082682 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.175809 (+ 93127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.176001 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.253944  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.253837  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.248536  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 652) took 1464 ms. Trace:
I20260709 13:16:07.233306  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 744) took 1184 ms. Trace:
I20260709 13:16:07.220465  5336 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:07.239830  5173 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.254585  4039 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:07.254834  3970 rpcz_store.cc:276] 0709 13:16:05.783660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.110993 (+1327333us) service_pool.cc:224] Handling call
0709 13:16:07.117979 (+  6986us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.118325 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.118357 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.126363 (+  8006us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.216952 (+ 90589us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.216997 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.217083 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.248304 (+ 31221us) raft_consensus.cc:1685] finished
0709 13:16:07.248327 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.248482 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1365,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8082,"thread_start_us":90160,"threads_started":1,"wal-append.queue_time_us":120421}
I20260709 13:16:07.256639  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.254520  3971 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:07.255910  4041 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:07.241947  5195 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.246091  5190 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:07.262285  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:07.265275  4039 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:07.267668  5327 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:16:07.250509  4986 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.268831  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 867) took 1775 ms. Trace:
I20260709 13:16:07.273437  3965 rpcz_store.cc:276] 0709 13:16:05.493424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.496875 (+  3451us) service_pool.cc:224] Handling call
0709 13:16:05.497171 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.561448 (+ 64277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.268461 (+1707013us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b5400277254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:07.268730 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146488704}
I20260709 13:16:07.274689  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.275339  3965 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:07.270812  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.253268  5136 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.267551  5131 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:07.276669  3965 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.254087  5333 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.289794  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 887) took 1331 ms. Trace:
I20260709 13:16:07.283440  4118 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.202896  5309 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.243563  5182 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.292752  3965 rpcz_store.cc:276] 0709 13:16:05.958430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.276059 (+1317629us) service_pool.cc:224] Handling call
0709 13:16:07.276342 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.289533 (+ 13191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.289739 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.261320  5027 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:07.252940  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55235.2us
W20260709 13:16:07.315646  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.294175  4039 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:07.269191  5190 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.353318  4086 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:07.240837  5311 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.261075  5301 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:16:07.252799  5072 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.297258  5242 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.261176  5151 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:16:07.358971  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.335222  5340 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.361550  3966 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:07.374802  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.353941  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.264457  5173 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:07.351998  5326 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:16:07.365710  4045 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:07.375377  3966 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:07.366727  5182 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.367102  5149 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.367493  5338 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.349956  5230 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.331976  5163 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.254896  4038 rpcz_store.cc:276] 0709 13:16:06.049142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.016155 (+967013us) service_pool.cc:224] Handling call
0709 13:16:07.016548 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.016938 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.016971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.017536 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.168561 (+151025us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.170584 (+  2023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.184495 (+ 13911us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.233072 (+ 48577us) raft_consensus.cc:1685] finished
0709 13:16:07.233098 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.233241 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2511,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":141011,"threads_started":1,"wal-append.queue_time_us":204869}
I20260709 13:16:07.379820  5340 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.380926  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.416726  3966 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:07.414796  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 161011us
I20260709 13:16:07.381597  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.418751  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.420284  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.382524  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 843) took 1052 ms. Trace:
W20260709 13:16:07.383008  5334 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:16:07.384987  5151 consensus_queue.cc:1243] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:07.386281  4040 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:07.386838  5195 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:07.387825  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.388408  5174 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.428988  5174 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.430187  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 730) took 1402 ms. Trace:
I20260709 13:16:07.430539  4040 rpcz_store.cc:276] 0709 13:16:06.023537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.023636 (+    99us) service_pool.cc:224] Handling call
0709 13:16:06.023885 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.386055 (+1362170us) spinlock_profiling.cc:243] Waited 79.3 ms on lock 0x7b54001746a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c3dc0 00007fed7644e1c0 00007fed7644f231 00007fed7644bd8f 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c
0709 13:16:07.425765 (+ 39710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.425962 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182478208}
I20260709 13:16:07.431681  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.431878  5340 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.392100  4112 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.393651  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 30) took 1345 ms. Trace:
I20260709 13:16:07.433156  3972 rpcz_store.cc:276] 0709 13:16:06.048204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.392910 (+1344706us) service_pool.cc:224] Handling call
0709 13:16:07.393186 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.393349 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.393374 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.393413 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:07.393442 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.393490 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.393590 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.432670  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:07.397058  4115 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:07.434597  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 652) took 1020 ms. Trace:
I20260709 13:16:07.434916  4115 rpcz_store.cc:276] 0709 13:16:06.414101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.396454 (+982353us) service_pool.cc:224] Handling call
0709 13:16:07.396717 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.434377 (+ 37660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.434545 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.436117  4115 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:07.400719  5205 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.334944  5297 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:07.410696  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:07.364755  5245 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.416596  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.420918  4046 rpcz_store.cc:276] 0709 13:16:06.330416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.100912 (+770496us) service_pool.cc:224] Handling call
0709 13:16:07.101206 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.101511 (+   305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.101539 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.109579 (+  8040us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.214965 (+105386us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.215001 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.215068 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.382178 (+167110us) raft_consensus.cc:1685] finished
0709 13:16:07.382206 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.382407 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5523,"thread_start_us":83595,"threads_started":1,"wal-append.queue_time_us":155838}
I20260709 13:16:07.441253  4045 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:07.441610  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.382328  5145 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.422886  4039 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:07.427299  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:07.427742  5315 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.428081  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.394912  5309 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:07.377923  5233 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.437547  3972 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.436298  3966 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:07.450593  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 659) took 1310 ms. Trace:
I20260709 13:16:07.451224  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.412307  5027 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:07.442143  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.453905  4045 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:07.412966  5230 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:07.443845  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:07.442207  4046 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:07.453473  5027 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:07.456099  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:07.456720  4680 raft_consensus.cc:1813] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:07.457317  4680 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:07.457100  5230 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.444864  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 654) took 1024 ms. Trace:
I20260709 13:16:07.458298  4115 rpcz_store.cc:276] 0709 13:16:06.414604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.435600 (+1020996us) service_pool.cc:224] Handling call
0709 13:16:07.435898 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.438694 (+  2796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.439009 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.458262  5230 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.445583  5280 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:07.436685  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 650) took 1023 ms. Trace:
I20260709 13:16:07.332512  5333 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.423065  5139 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.452085  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:07.485755  4040 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.450978  3972 rpcz_store.cc:276] 0709 13:16:06.140453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.437016 (+1296563us) service_pool.cc:224] Handling call
0709 13:16:07.437264 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.450323 (+ 13059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.450535 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.451874  3966 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:07.434783  5277 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.487172  3972 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.487730  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 660) took 1323 ms. Trace:
I20260709 13:16:07.488023  3972 rpcz_store.cc:276] 0709 13:16:06.164626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.486595 (+1321969us) service_pool.cc:224] Handling call
0709 13:16:07.486865 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.487509 (+   644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.487679 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.425375  4942 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:07.456234  5027 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.414654  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 644) took 1632 ms. Trace:
I20260709 13:16:07.444450  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.415539  5149 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:07.479764  5280 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:07.482221  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 123315us
I20260709 13:16:07.446769  5291 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:16:07.504084  5149 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.495091  4039 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:07.423230  5338 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.502682  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.492122  5172 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.494231  3966 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:07.497406  4648 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:07.484032  5206 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.449009  5145 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.504201  5339 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.479993  4112 rpcz_store.cc:276] 0709 13:16:06.413648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.391374 (+977726us) service_pool.cc:224] Handling call
0709 13:16:07.391715 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.432939 (+ 41224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.436624 (+  3685us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.475402  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 885) took 1688 ms. Trace:
I20260709 13:16:07.510987  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 664) took 1109 ms. Trace:
I20260709 13:16:07.490083  5182 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:16:07.512852  4045 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:16:07.493211  5200 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:16:07.481956  5233 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:07.484485  5180 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:16:07.514586  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50234.2us
I20260709 13:16:07.509234  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.522967  4086 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.502995  5094 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.511934  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 890) took 1489 ms. Trace:
I20260709 13:16:07.452622  5315 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.524932  5172 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.525413  5172 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:07.525784  5315 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.526503  3972 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.526258  5172 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.527534  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 662) took 1349 ms. Trace:
I20260709 13:16:07.527855  3972 rpcz_store.cc:276] 0709 13:16:06.178474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.488692 (+1310218us) service_pool.cc:224] Handling call
0709 13:16:07.489340 (+   648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.526822 (+ 37482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.527333 (+   511us) spinlock_profiling.cc:243] Waited 36.9 ms on lock 0x7b54002c8654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:07.527480 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84775680}
I20260709 13:16:07.528903  5309 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:07.518086  3966 rpcz_store.cc:276] 0709 13:16:06.401123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.493493 (+1092370us) service_pool.cc:224] Handling call
0709 13:16:07.494070 (+   577us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.510750 (+ 16680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.510932 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:07.529625  5258 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.529909  3966 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.530263  3966 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:07.530931  3966 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.533012  3966 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:07.533515  3972 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:07.517980  3971 rpcz_store.cc:276] 0709 13:16:05.786957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.257910 (+1470953us) service_pool.cc:224] Handling call
0709 13:16:07.258233 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.258537 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.258564 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.258961 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.409176 (+150215us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.426504 (+ 17328us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.426800 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.426870 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.475147 (+ 48277us) raft_consensus.cc:1685] finished
0709 13:16:07.475172 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.475334 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15335,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":4667,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":11624,"thread_start_us":76020,"threads_started":1,"wal-append.queue_time_us":182322}
I20260709 13:16:07.512364  5301 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.534572  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.492796  5343 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:16:07.537755  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.539526  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.540804  3972 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:07.541527  5349 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.541982  5349 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.542322  5349 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.542943  5338 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.540042  3965 rpcz_store.cc:276] 0709 13:16:06.022498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.332773 (+1310275us) service_pool.cc:224] Handling call
0709 13:16:07.359795 (+ 27022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.359988 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:07.360368 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.511636 (+151268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.511686 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.511723 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.511778 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.511885 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":250,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":36,"raft.queue_time_us":3354,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2418,"spinlock_wait_cycles":3328,"thread_start_us":149332,"threads_started":1}
I20260709 13:16:07.523084  5277 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.528020  5072 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.554801  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 653) took 1140 ms. Trace:
I20260709 13:16:07.555137  4116 rpcz_store.cc:276] 0709 13:16:06.414330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.403231 (+988901us) service_pool.cc:224] Handling call
0709 13:16:07.403566 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.416463 (+ 12897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.416493 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.425275 (+  8782us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.502555 (+ 77280us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.502597 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.502666 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.554574 (+ 51908us) raft_consensus.cc:1685] finished
0709 13:16:07.554595 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.554730 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13605,"raft.queue_time_us":10457,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8774,"thread_start_us":70296,"threads_started":1,"wal-append.queue_time_us":111121}
I20260709 13:16:07.553227  5309 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.554113  5342 tablet_replica.cc:333] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:16:07.521699  4038 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:07.560669  4040 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
W20260709 13:16:07.561241  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.564265  3966 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:16:07.564533  3966 pending_rounds.cc:85] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
W20260709 13:16:07.573866  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.564755  3966 pending_rounds.cc:107] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:07.581796  3966 raft_consensus.cc:2889] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:07.545336  5301 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:07.557439  5173 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.559580  5297 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.560433  5309 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.585036  5340 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.550794  4942 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:07.599300  5131 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:07.600694  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79307.2us
I20260709 13:16:07.559864  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:07.583710  5277 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:16:07.603629  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63830.3us
I20260709 13:16:07.550087  5314 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.605823  4942 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:07.602139  5340 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.606396  4112 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:07.608106  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.610142  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 889) took 1594 ms. Trace:
I20260709 13:16:07.616369  4039 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:07.622222  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.623427  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.622364  3970 rpcz_store.cc:276] 0709 13:16:06.015572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.277610 (+1262038us) service_pool.cc:224] Handling call
0709 13:16:07.351708 (+ 74098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.352065 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.352092 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.354360 (+  2268us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.461080 (+106720us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.461117 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.461178 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.609948 (+148770us) raft_consensus.cc:1685] finished
0709 13:16:07.609967 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.610086 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19333,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":30400,"thread_start_us":106381,"threads_started":1,"wal-append.queue_time_us":167393}
I20260709 13:16:07.624449  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.624814  5340 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.625228  5206 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.625422  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.625638  5206 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:07.625998  4039 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:07.627631  4040 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.626016  5206 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.601329  5309 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.631315  5315 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:07.636420  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.637449  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.641536  5243 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.641999  5243 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.642304  5243 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:07.621867  4942 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:07.603411  5297 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.604454  5338 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:07.614621  5131 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:07.655506  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.670436  4011 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.769449  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:07.497501  3964 rpcz_store.cc:276] 0709 13:16:05.781821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.718161 (+936340us) service_pool.cc:224] Handling call
0709 13:16:06.758940 (+ 40779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.819264 (+ 60324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:06.825145 (+  5881us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:06.974643 (+149498us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.108202 (+133559us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.111684 (+  3482us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.116907 (+  5223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.374784 (+257877us) raft_consensus.cc:1685] finished
0709 13:16:07.376461 (+  1677us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.411682 (+ 35221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34718,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":50012,"thread_start_us":66196,"threads_started":1,"wal-append.queue_time_us":169314}
I20260709 13:16:07.727249  5245 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.669950  5182 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 13:16:07.777335  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.818713  3969 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:07.819226  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 637) took 2039 ms (client timeout 1936 ms). Trace:
W20260709 13:16:07.819576  3969 rpcz_store.cc:269] 0709 13:16:05.779466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.800709 (+ 21243us) service_pool.cc:224] Handling call
0709 13:16:07.777169 (+1976460us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:07.819157 (+ 41988us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29228800}
I20260709 13:16:07.779421  5195 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:07.762014  5354 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:07.793915  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 778) took 1649 ms. Trace:
I20260709 13:16:07.607405  5311 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:07.813400  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 143028us
I20260709 13:16:07.857697  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.858511  4119 rpcz_store.cc:276] 0709 13:16:06.144165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.405436 (+261271us) service_pool.cc:224] Handling call
0709 13:16:06.405731 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.978384 (+572653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.793678 (+815294us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b5400096d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:07.793847 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314930560}
W20260709 13:16:07.783645  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.822647  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.824734  4041 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.816529  4039 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.876118  4039 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.877259  4039 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:07.824043  5145 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.860584  5131 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.861501  5243 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.881150  4113 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:07.881531  5243 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.881758  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 766) took 1773 ms. Trace:
I20260709 13:16:07.882162  4113 rpcz_store.cc:276] 0709 13:16:06.108159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.114928 (+  6769us) service_pool.cc:224] Handling call
0709 13:16:07.880565 (+1765637us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:07.880811 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.881523 (+   712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.881704 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4334464}
I20260709 13:16:07.883320  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 848) took 1464 ms. Trace:
I20260709 13:16:07.883729  4042 rpcz_store.cc:276] 0709 13:16:06.418838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.158625 (+739787us) service_pool.cc:224] Handling call
0709 13:16:07.176893 (+ 18268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.364697 (+187804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.373008 (+  8311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.378346 (+  5338us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.406139 (+ 27793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.883072 (+476933us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540035d9d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:07.883125 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:07.883261 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410351872}
I20260709 13:16:07.885030  5261 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.875247  5195 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:16:07.885881  5317 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.886368  5317 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.888347  5317 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:07.889333  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:07.889768  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.863708  5309 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.890982  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 741) took 1853 ms. Trace:
I20260709 13:16:07.891708  5309 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.891928  3970 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:07.824981  5245 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.863690  5355 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.865660  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 866) took 2372 ms. Trace:
I20260709 13:16:07.866362  5065 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:07.866756  5152 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.867965  5181 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:07.869474  5138 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.627694  5277 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:07.642784  5315 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.907709  5150 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:07.908016  5145 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.891328  4044 rpcz_store.cc:276] 0709 13:16:06.037089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.138282 (+101193us) service_pool.cc:224] Handling call
0709 13:16:06.148862 (+ 10580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.753086 (+604224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.890751 (+1137665us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b540011add4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:07.890923 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1345115392}
I20260709 13:16:07.878052  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.904632  3963 rpcz_store.cc:276] 0709 13:16:05.493039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.507473 (+ 14434us) service_pool.cc:224] Handling call
0709 13:16:06.040967 (+533494us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327eee 0000000000375939 00007fed7b39b1e0 00007fed7b4640c4 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:06.081765 (+ 40798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:06.125505 (+ 43740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.865403 (+1739898us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b54001caa50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:07.865574 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101209856}
I20260709 13:16:07.907783  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:07.911197  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:07.908142  3938 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:07.909790  5145 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.917817  5297 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:07.918296  5145 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.918851  5350 raft_consensus.cc:2764] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:07.919474  5350 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:07.919875  5350 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:07.920825  5180 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:07.921125  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.921761  3966 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:07.922454  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.923389  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.925223  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:07.917717  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.822085  5291 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:07.925915  3965 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:07.926662  3972 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:07.927199  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.822942  5263 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:07.923909  3966 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:07.932854  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.927721  4043 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:07.909699  5315 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:07.905179  5065 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:07.920442  5206 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.765411  5301 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:07.910509  5195 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:16:07.906351  5317 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
W20260709 13:16:07.971513  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53849.8us
I20260709 13:16:08.325424  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:07.975514  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:08.011574  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:07.934002  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:08.421674  5180 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.038525  5190 consensus_meta.cc:287] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.001s
I20260709 13:16:08.422201  5180 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:08.423025  5205 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.423780  5358 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:16:08.423533  5205 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.345338  5172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.017s	sys 0.063s
W20260709 13:16:08.424809  5172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.019s	sys 0.066s
I20260709 13:16:07.990335  5258 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.425737  5205 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.018291  5342 raft_consensus.cc:2243] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:08.038614  5263 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.427551  5342 raft_consensus.cc:2272] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:08.428246  5180 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:07.905304  5355 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:07.904997  5181 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:08.429665  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:08.420468  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:08.422746  5190 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.355301  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.432621  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.431177  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:08.433851  3969 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.434186  4011 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.936s (SENT) [suppressed 112 similar messages]
W20260709 13:16:08.085956  5136 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
I20260709 13:16:08.447279  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:08.352487  5357 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 13:16:08.433954  4119 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:08.422803  5341 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.018579  5330 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.683s	user 0.001s	sys 0.003s
W20260709 13:16:08.366945  4684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.009s	sys 0.045s
I20260709 13:16:08.451753  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:08.018576  5027 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.516s	user 0.006s	sys 0.002s
W20260709 13:16:08.080099  5174 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.651s	user 0.006s	sys 0.003s
I20260709 13:16:08.453426  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:08.461820  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.463020  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:07.915218  5333 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:08.336838  5230 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.877s	user 0.009s	sys 0.002s
I20260709 13:16:08.431509  5296 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:08.456887  4119 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:08.021904  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:08.232326  5297 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.319491  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:07.975421  5340 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:08.351177  5339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.011s	sys 0.063s
I20260709 13:16:08.339134  5245 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:08.459683  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:08.422253  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 649) took 2008 ms. Trace:
I20260709 13:16:08.429469  5065 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.428831  5263 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.467819  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:08.469312  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.430825  5291 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:08.467516  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:08.471002  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.431097  5355 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.458133  4684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.011s	sys 0.048s
I20260709 13:16:08.453761  5315 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.464582  5258 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:08.464664  5317 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.470433  5145 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.472288  5343 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.464998  5027 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.484874  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:08.473992  5297 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.487054  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45584 (request call id 61) took 2777 ms. Trace:
I20260709 13:16:08.507503  4681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 73) took 1016 ms. Trace:
I20260709 13:16:08.473711  5174 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.500957  5149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.023s	sys 0.015s
I20260709 13:16:08.491901  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:07.920660  5350 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:08.477154  5339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.011s	sys 0.065s
W20260709 13:16:08.528581  3970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.011s	sys 0.015s
I20260709 13:16:08.465932  5296 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:08.453347  5136 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.502123  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:08.535125  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.475306  5340 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.488046  4119 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:08.501873  4113 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:08.503405  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 629) took 3039 ms. Trace:
I20260709 13:16:07.971139  5349 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.478093  5181 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.491302  4121 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:08.492622  5263 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.496796  5315 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:08.455467  5341 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.496248  3937 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.508074  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:08.529886  3970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.012s	sys 0.015s
W20260709 13:16:08.510524  5277 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.005s	sys 0.047s
I20260709 13:16:08.532159  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:08.502794  5258 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:08.540436  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:08.503054  3969 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:08.507378  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:08.542412  4115 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:08.544667  4117 rpcz_store.cc:276] 0709 13:16:05.459234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.565037 (+105803us) service_pool.cc:224] Handling call
0709 13:16:05.573445 (+  8408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:05.573839 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:05.573867 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:05.574355 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.090857 (+1516502us) spinlock_profiling.cc:243] Waited 2.49 ms on lock 0x7b18000bb9c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:16:07.208788 (+117931us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:07.208833 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.209658 (+   825us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:07.876076 (+666418us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:08.498611 (+622535us) raft_consensus.cc:1685] finished
0709 13:16:08.498630 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.498783 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9691,"spinlock_wait_cycles":14272768,"thread_start_us":117692,"threads_started":1,"wal-append.queue_time_us":1677794}
W20260709 13:16:08.510720  5243 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.010s	sys 0.008s
W20260709 13:16:08.512221  5149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.024s	sys 0.015s
I20260709 13:16:08.507242  3967 rpcz_store.cc:276] 0709 13:16:05.723293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.730809 (+  7516us) service_pool.cc:224] Handling call
0709 13:16:08.486869 (+2756060us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54003971d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:08.486968 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3025603840}
I20260709 13:16:08.554363  4119 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.564838  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:08.499958  5245 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.553269  4040 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:08.547447  4112 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:08.527630  5280 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:08.543292  5340 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:08.565019  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68854.7us
I20260709 13:16:08.571439  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.574003  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:08.483379  4114 rpcz_store.cc:276] 0709 13:16:06.413435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.221671 (+808236us) service_pool.cc:224] Handling call
0709 13:16:07.222034 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.269487 (+ 47453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.273360 (+  3873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.289737 (+ 16377us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.297903 (+  8166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.422033 (+1124130us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b54002076d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:08.422080 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.422200 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78214016}
W20260709 13:16:08.553877  5277 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.005s	sys 0.048s
I20260709 13:16:08.562285  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:08.580982  5349 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:08.581455  5263 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:08.561092  5243 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.010s	sys 0.008s
I20260709 13:16:08.552736  5315 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.586812  4119 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:08.564534  5242 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:08.557049  5246 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.603716  4121 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.604895  4116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.032s	sys 0.050s
W20260709 13:16:08.605201  4116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.032s	sys 0.050s
I20260709 13:16:08.605878  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 657) took 2190 ms. Trace:
I20260709 13:16:08.606292  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.606488  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.608081  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.608383  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.608608  4047 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:08.591606  4119 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:08.574412  5245 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.578579  5163 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.597318  3967 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.609493  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.559316  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:08.610153  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 795) took 1094 ms. Trace:
I20260709 13:16:08.616506  4119 rpcz_store.cc:276] 0709 13:16:07.515684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.589787 (+1074103us) service_pool.cc:224] Handling call
0709 13:16:08.591453 (+  1666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.609864 (+ 18411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.610097 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:08.612185  4116 rpcz_store.cc:276] 0709 13:16:06.415290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.586240 (+1170950us) service_pool.cc:224] Handling call
0709 13:16:07.600953 (+ 14713us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.601136 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:07.606982 (+  5846us) log.cc:844] Serialized 14 byte log entry
0709 13:16:08.605569 (+998587us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.605621 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:08.605660 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.605731 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.605832 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7447,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":5378,"thread_start_us":998264,"threads_started":1}
I20260709 13:16:08.508376  5343 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.615891  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.623936  4044 raft_consensus.cc:1813] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:08.624433  4044 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:08.600596  5190 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.600443  5145 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:08.629881  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.625506  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:08.630486  4047 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.630604  4044 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:08.626005  4118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.014s	sys 0.034s
I20260709 13:16:08.613770  5245 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.631074  4118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.014s	sys 0.034s
I20260709 13:16:08.566617  5175 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
W20260709 13:16:08.637267  3968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.051s	sys 0.102s
W20260709 13:16:08.637537  3968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.051s	sys 0.102s
I20260709 13:16:08.642899  4041 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:08.645838  4047 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:08.620496  5242 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:08.638463  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.599980  5280 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:08.672125  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.579838  5296 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.636951  5206 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.632742  5246 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:08.586555  5291 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.684449  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.717700  5296 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.719951  5242 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.721262  5342 ts_tablet_manager.cc:1916] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:08.507932  4681 rpcz_store.cc:276] 0709 13:16:07.502374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.506277 (+  3903us) service_pool.cc:224] Handling call
0709 13:16:07.518186 (+ 11909us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.543535 (+ 25349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.543578 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.544108 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:16:07.704639 (+160531us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:07.759588 (+ 54949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:07.761209 (+  1621us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.507250 (+746041us) raft_consensus.cc:1685] finished
0709 13:16:08.507274 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.507423 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7301,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":31397,"thread_start_us":101775,"threads_started":1,"wal-append.queue_time_us":543658}
I20260709 13:16:08.726331  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 659) took 2049 ms. Trace:
I20260709 13:16:08.636116  5258 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.726742  4118 rpcz_store.cc:276] 0709 13:16:06.676598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.870747 (+1194149us) service_pool.cc:224] Handling call
0709 13:16:07.871129 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.871476 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:07.871503 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.872035 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.633405 (+761370us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:08.633441 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.633503 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:08.726080 (+ 92577us) raft_consensus.cc:1685] finished
0709 13:16:08.726098 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.726254 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3486,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":760998,"threads_started":1,"wal-append.queue_time_us":852297}
I20260709 13:16:08.730160  5343 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.733978  4047 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:16:08.638808  5145 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:08.692499  4044 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:08.701407  5136 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.702661  5280 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.684710  5263 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.696729  5246 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.746423  4121 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:08.763944  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 329758us
I20260709 13:16:08.740754  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:08.767174  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:08.768096  4047 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.767367  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 193439us
I20260709 13:16:08.695796  5027 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:08.767521  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:08.771562  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:08.773257  4086 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.776371  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:08.779927  5309 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.780409  5309 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.780755  5309 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:08.785296  4086 raft_consensus.cc:2686] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:16:08.786231  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:08.787287  5175 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:08.787742  5175 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:08.788359  5315 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:08.788661  5175 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.790140  5246 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.766758  5263 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.791360  5027 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:08.791882  4986 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:08.792307  5263 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:08.792830  5027 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:08.793184  5027 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:08.793244  5315 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:08.794094  5027 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.822757  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:08.824529  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.762518  5340 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:08.839459  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.841208  4047 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:08.796829  5317 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:08.845975  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57907.6us
I20260709 13:16:08.848492  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:08.854238  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.855571  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:08.798818  5350 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:16:08.831686  5315 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.868351  4044 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:08.846911  5317 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.873238  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:08.867230  5246 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.868112  5263 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:08.871874  5315 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:08.867499  5349 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:08.853174  5373 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.879395  5317 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.880831  5350 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:08.892927  4682 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:08.845414  5145 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:08.926453  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70967.4us
I20260709 13:16:08.894642  5315 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.895102  5175 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:08.931846  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:08.894515  5386 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:08.934950  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 674) took 1028 ms. Trace:
I20260709 13:16:08.915678  5246 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:08.940485  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.939518  4116 rpcz_store.cc:276] 0709 13:16:07.906719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.619639 (+712920us) service_pool.cc:224] Handling call
0709 13:16:08.635579 (+ 15940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.635785 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:08.846472 (+210687us) log.cc:844] Serialized 14 byte log entry
0709 13:16:08.934379 (+ 87907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.934454 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:08.934516 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.934637 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:08.934849 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":414,"prepare.queue_time_us":217475,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3574,"raft.queue_time_us":562,"thread_start_us":248185,"threads_started":2}
I20260709 13:16:08.914939  5350 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:08.884974  5355 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.914857  5242 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:08.941887  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.926375  5349 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:08.935724  5373 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:08.959163  5386 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:08.973033  5386 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.943993  5246 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.944084  5350 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.967828  5258 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:08.994616  3967 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:08.996912  5065 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
W20260709 13:16:08.991731  5387 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.001s
W20260709 13:16:09.014546  5377 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:09.015671  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 671) took 1120 ms. Trace:
I20260709 13:16:09.016093  4119 rpcz_store.cc:276] 0709 13:16:07.895554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.617338 (+721784us) service_pool.cc:224] Handling call
0709 13:16:08.617647 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.617975 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.618003 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.618458 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.821360 (+202902us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:08.821418 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.821497 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.015438 (+193941us) raft_consensus.cc:1685] finished
0709 13:16:09.015462 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.015602 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2292,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3964,"thread_start_us":156102,"threads_started":1,"wal-append.queue_time_us":261714}
I20260709 13:16:09.019033  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.020249  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.021992  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.024547  5355 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.025264  5355 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:08.972608  5309 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.025733  5355 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:09.026656  5355 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.027308  5309 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.012313  5190 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:09.029357  5190 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:08.971676  5373 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.031540  5190 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.031997  5373 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:09.033339  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.946851  5242 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.040124  5242 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:09.008821  5374 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:16:09.041569  5065 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.043172  5294 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.043579  5065 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:09.008515  5372 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:16:09.044337  4119 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:09.045662  4119 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:08.992368  5370 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:16:09.048131  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:09.009559  5375 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:16:09.057013  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.057484  4119 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:09.059085  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:08.943017  5175 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:16:09.061220  5293 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 2.974s	user 0.007s	sys 0.022s
I20260709 13:16:09.062791  5175 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.015558  5340 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.065474  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.066547  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.067051  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:09.067737  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.068198  3970 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.069833  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.070469  4118 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
W20260709 13:16:09.060774  5382 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:16:09.071986  5317 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.073719  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:09.069763  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.075068  3966 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:09.075947  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.080257  4119 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:09.085505  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.086122  3966 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:08.997829  5349 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.049002  3967 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.091084  5294 raft_consensus.cc:2764] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:09.092149  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 675) took 1170 ms. Trace:
I20260709 13:16:09.088979  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:09.097378  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.110316  4039 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.115751  3966 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:09.117370  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.118881  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.119828  3966 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:09.099373  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 167763us
I20260709 13:16:09.121506  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.122220  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.123370  5094 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.128960  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.068472  5350 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.129989  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.130254  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.135375  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.135453  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.105192  3970 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:09.138128  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.138965  4039 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:16:09.135926  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:09.139765  5094 raft_consensus.cc:2764] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:16:09.142691  3966 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.145927  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.146566  4044 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.150811  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 660) took 1965 ms. Trace:
I20260709 13:16:09.151160  4117 rpcz_store.cc:276] 0709 13:16:07.185276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.555737 (+1370461us) service_pool.cc:224] Handling call
0709 13:16:08.556095 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.570006 (+ 13911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.570042 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.582951 (+ 12909us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.760729 (+177778us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:08.760808 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.760986 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.150622 (+389636us) raft_consensus.cc:1685] finished
0709 13:16:09.150643 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.150756 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15910,"raft.queue_time_us":5036,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11096,"thread_start_us":135393,"threads_started":1,"wal-append.queue_time_us":259250}
I20260709 13:16:09.111475  5175 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:09.161749  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 645) took 2749 ms. Trace:
I20260709 13:16:09.165820  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.166468  4117 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.166864  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.162194  4120 rpcz_store.cc:276] 0709 13:16:06.412505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.079261 (+666756us) service_pool.cc:224] Handling call
0709 13:16:07.092837 (+ 13576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.158171 (+ 65334us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:07.168832 (+ 10661us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.224614 (+ 55782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:07.224670 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:07.224714 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.161505 (+1936791us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.161557 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.161687 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9181,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2753,"raft.queue_time_us":91,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5053,"spinlock_wait_cycles":151100672,"thread_start_us":54768,"threads_started":1,"wal-append.queue_time_us":52013,"wal-append.run_cpu_time_us":2072,"wal-append.run_wall_time_us":1216066}
I20260709 13:16:09.140975  5353 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:09.143023  5154 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.142854  5136 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.177839  4044 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:09.149686  5190 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.196065  5190 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:09.196929  5263 raft_consensus.cc:1064] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:09.181054  5136 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:09.198709  5136 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.160022  5301 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:09.182189  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.187239  5154 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:09.191300  5350 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.172293  5353 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.194388  5391 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:09.208814  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.141680  5373 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:09.226914  4120 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:09.223963  4117 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:09.232465  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 65665.4us
I20260709 13:16:09.226086  5353 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.233462  5258 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:09.237021  5190 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.196127  5317 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.242161  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.169214  5175 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:09.228495  5245 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.003s
I20260709 13:16:09.244746  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.257336  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.226188  5391 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.261170  4119 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.266287  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.270017  4120 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.259598  5245 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.236323  5154 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.107474  4113 rpcz_store.cc:276] 0709 13:16:07.914887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.701407 (+786520us) service_pool.cc:224] Handling call
0709 13:16:08.701825 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.702216 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.702247 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:08.702714 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.877460 (+174746us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:08.881110 (+  3650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:08.883866 (+  2756us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.072834 (+188968us) raft_consensus.cc:1685] finished
0709 13:16:09.072855 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.084880 (+ 12025us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1017,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":166942,"threads_started":1,"wal-append.queue_time_us":229066}
I20260709 13:16:09.269260  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.248481  5301 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.263518  5145 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.241024  5350 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 13:16:09.301402  5403 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:16:09.305447  4684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 62) took 2106 ms. Trace:
I20260709 13:16:09.306466  5245 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.307793  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.258745  5258 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:16:09.263770  5317 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:09.308812  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 855) took 2058 ms. Trace:
I20260709 13:16:09.327549  4045 rpcz_store.cc:276] 0709 13:16:07.250592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.458631 (+208039us) service_pool.cc:224] Handling call
0709 13:16:07.458910 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.520484 (+ 61574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.308553 (+1788069us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b54001199d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.308737 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123222912}
I20260709 13:16:09.328667  3965 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:09.328713  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.329264  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 905) took 1398 ms. Trace:
I20260709 13:16:09.329713  3965 rpcz_store.cc:276] 0709 13:16:07.931270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.307525 (+1376255us) service_pool.cc:224] Handling call
0709 13:16:09.329198 (+ 21673us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.330111  4116 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:09.331146  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.331307  3965 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:16:09.314476  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.262255  5391 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:09.317705  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77528.6us
I20260709 13:16:09.325779  4120 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:09.325876  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 143760us
I20260709 13:16:09.334581  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.336896  4046 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:16:09.333786  4085 connection.cc:256] RPC call timeout handler was delayed by -1.7251089289998163s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:16:09.338183  4039 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:09.338322  4085 connection.cc:256] RPC call timeout handler was delayed by -1.4712164519999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2195s for a response
W20260709 13:16:09.338730  4085 connection.cc:256] RPC call timeout handler was delayed by -1.310351743999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 13:16:09.314203  5145 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:09.341156  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.316249  5242 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.346067  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.349941  4045 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.318212  4684 rpcz_store.cc:276] 0709 13:16:07.199355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.216941 (+ 17586us) service_pool.cc:224] Handling call
0709 13:16:07.242015 (+ 25074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:07.482789 (+240774us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:07.490066 (+  7277us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:07.558276 (+ 68210us) log.cc:844] Serialized 26 byte log entry
0709 13:16:08.500939 (+942663us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:08.503090 (+  2151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.269760 (+766670us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b54005f19d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.289616 (+ 19856us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.305095 (+ 15479us) raft_consensus.cc:1685] finished
0709 13:16:09.305112 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.305358 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104785,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":7945984,"thread_start_us":1022727,"threads_started":2,"wal-append.queue_time_us":817170}
I20260709 13:16:09.340384  5317 consensus_queue.cc:1243] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:09.351199  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.316100  5301 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:16:09.356444  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.357295  4119 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:09.355809  5175 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.359946  5175 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.360391  5175 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:09.341467  5271 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.341799  5373 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.366004  5373 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.366441  5145 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.369727  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.369921  4045 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:09.370703  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.367548  5175 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.372452  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.359124  5408 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.356624  5409 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:16:09.376600  5317 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:09.381778  5409 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.382275  5409 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:09.383195  5409 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.384223  5341 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.384479  5409 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.387414  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 748) took 1771 ms. Trace:
I20260709 13:16:09.386118  5317 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.387950  5317 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:09.349852  5342 ts_tablet_manager.cc:1929] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 13:16:09.358526  4038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 861) took 2098 ms (client timeout 2155 ms). Trace:
I20260709 13:16:09.389003  5317 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.389833  4041 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.390187  5317 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.390609  3967 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:09.392084  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.368973  5271 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.354455  5242 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.393461  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:09.394141  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.394942  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 899) took 1473 ms. Trace:
I20260709 13:16:09.395483  5242 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.396970  5340 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:09.379765  5408 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:09.398069  5408 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.399315  5408 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.400949  4116 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
W20260709 13:16:09.388937  4038 rpcz_store.cc:269] 0709 13:16:07.260263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.427835 (+167572us) service_pool.cc:224] Handling call
0709 13:16:09.352107 (+1924272us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b540003b954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:09.356712 (+  4605us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150283520}
I20260709 13:16:09.403007  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.403678  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:09.403826  5206 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.404363  4116 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:09.406376  5271 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.407570  5136 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.409710  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:09.387796  4040 rpcz_store.cc:276] 0709 13:16:07.616313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.774063 (+157750us) service_pool.cc:224] Handling call
0709 13:16:07.774348 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.566434 (+792086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.387149 (+820715us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54000b8e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.387353 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790930688}
I20260709 13:16:09.395231  3972 rpcz_store.cc:276] 0709 13:16:07.921937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.393896 (+1471959us) service_pool.cc:224] Handling call
0709 13:16:09.394886 (+   990us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.411929  3972 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:09.413661  3972 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:09.415747  4120 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:09.417595  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:09.419764  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:09.396852  5342 log.cc:1199] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/wals/2d0ea046ec794443af9a7689d2920002
I20260709 13:16:09.431969  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.433502  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.439538  4116 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:09.415191  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 38) took 1782 ms. Trace:
I20260709 13:16:09.440743  4114 rpcz_store.cc:276] 0709 13:16:07.599544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.609155 (+1009611us) service_pool.cc:224] Handling call
0709 13:16:08.630640 (+ 21485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.689744 (+ 59104us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:08.868702 (+178958us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.097095 (+228393us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.164732 (+ 67637us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.181328 (+ 16596us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:09.194050 (+ 12722us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.362162 (+168112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.372412 (+ 10250us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.373369 (+   957us) raft_consensus.cc:1685] finished
0709 13:16:09.375892 (+  2523us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.381252 (+  5360us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31138,"prepare.queue_time_us":185411,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":47731,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":17783,"thread_start_us":339428,"threads_started":3,"wal-append.queue_time_us":275465}
I20260709 13:16:09.442314  5163 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.442763  5163 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.378788  5373 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.393548  3963 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.403688  4038 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.409094  5174 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.419157  5291 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.432504  5341 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.466207  5341 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.456319  5355 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:09.467587  5355 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:09.469475  5411 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:09.470399  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.471117  3963 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:09.404392  5206 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.474826  5206 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:09.475152  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.378782  5353 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.453676  5301 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.461105  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.462066  5136 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.445197  5172 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.437485  5343 raft_consensus.cc:2764] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:16:09.485363  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.486595  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.487521  4119 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.469509  5297 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:09.495005  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.519068  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.506731  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4098772950001148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 13:16:09.527666  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:09.529615  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:09.530494  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 735) took 3491 ms (client timeout 2176 ms). Trace:
W20260709 13:16:09.531035  4043 rpcz_store.cc:269] 0709 13:16:06.035597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.117791 (+ 82194us) service_pool.cc:224] Handling call
0709 13:16:09.526887 (+3409096us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b540035d4d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:09.527003 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4146905984}
I20260709 13:16:09.528249  3970 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.488345  5340 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:09.529175  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.485476  5172 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.525548  5353 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.539394  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.553871  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.564958  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.548298  5258 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.538491  5342 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36870 (request call id 63) took 2366 ms. Trace:
W20260709 13:16:09.577867  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 223784us
I20260709 13:16:09.569418  4119 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:16:09.571907  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 152198us
I20260709 13:16:09.489769  5263 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:09.563233  5419 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:16:09.581807  5315 consensus_meta.cc:287] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.640s	user 0.018s	sys 0.001s
I20260709 13:16:09.582260  5315 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.588420  5391 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:09.590441  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.590613  5391 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.591078  5340 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:09.579658  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.579761  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:09.598023  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.584499  5315 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.599856  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.603183  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.604648  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.605444  4119 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:09.611123  5410 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:16:09.612601  4119 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:09.613409  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 684) took 1075 ms. Trace:
I20260709 13:16:09.613982  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.614567  4119 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:09.615727  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.616433  4119 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:09.617432  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:09.618088  5172 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:09.618887  4119 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.620376  4119 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.613746  3966 rpcz_store.cc:276] 0709 13:16:08.538131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.144429 (+606298us) service_pool.cc:224] Handling call
0709 13:16:09.144688 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.157355 (+ 12667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.157390 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.165552 (+  8162us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.272862 (+107310us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.272908 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.272982 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.613223 (+340241us) raft_consensus.cc:1685] finished
0709 13:16:09.613243 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.613359 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23770,"raft.queue_time_us":10096,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":14805,"thread_start_us":45749,"threads_started":1,"wal-append.queue_time_us":180928}
I20260709 13:16:09.621910  4119 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.577577  5289 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:09.620560  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 690) took 1063 ms. Trace:
I20260709 13:16:09.571779  5258 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:09.604592  5027 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.623513  5258 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.617466  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.624572  3969 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:09.624804  4119 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.578275  5342 rpcz_store.cc:276] 0709 13:16:07.184872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.185075 (+   203us) service_pool.cc:224] Handling call
0709 13:16:07.507220 (+322145us) ts_tablet_manager.cc:1151] Deleting tablet 2d0ea046ec794443af9a7689d2920002
0709 13:16:07.512404 (+  5184us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:16:08.962295 (+1449891us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:09.340635 (+378340us) tablet_metadata.cc:665] Metadata flushed
0709 13:16:09.534016 (+193381us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":240273,"tablet-delete.queue_time_us":268004,"thread_start_us":110659,"threads_started":1}
I20260709 13:16:09.626154  4119 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.627359  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 680) took 1090 ms. Trace:
I20260709 13:16:09.627619  3969 rpcz_store.cc:276] 0709 13:16:08.537225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.555951 (+ 18726us) service_pool.cc:224] Handling call
0709 13:16:09.617346 (+1061395us) spinlock_profiling.cc:243] Waited 6.95 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:09.627313 (+  9967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15975168}
W20260709 13:16:09.630581  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.631889  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.596627  5296 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
W20260709 13:16:09.633787  5363 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.943s	user 0.002s	sys 0.000s
I20260709 13:16:09.639827  5163 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.640383  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 658) took 3101 ms. Trace:
I20260709 13:16:09.640846  4112 rpcz_store.cc:276] 0709 13:16:06.539479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.624033 (+1084554us) service_pool.cc:224] Handling call
0709 13:16:07.624334 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:08.579405 (+955071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.640112 (+1060707us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b54003a75d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.640323 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2080389376}
I20260709 13:16:09.642565  4112 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:09.622674  5289 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.644534  4112 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.645097  5289 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.646612  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 672) took 1750 ms. Trace:
I20260709 13:16:09.646979  4121 rpcz_store.cc:276] 0709 13:16:07.895771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.547353 (+651582us) service_pool.cc:224] Handling call
0709 13:16:09.646462 (+1099109us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400096854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:09.646560 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87068416}
I20260709 13:16:09.622372  3966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:09.648233  4112 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.648473  3966 raft_consensus.cc:606] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:09.648883  3966 raft_consensus.cc:614] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:09.649748  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.651973  4119 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.645432  5105 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.633181  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:09.657871  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57622.4us
I20260709 13:16:09.598459  5353 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.652480  5246 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:09.652612  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:09.654958  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 210688us
I20260709 13:16:09.655382  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.656710  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.660131  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.660283  4043 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:09.660230  3966 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:09.659308  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.662096  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.662521  4046 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:09.663654  4046 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.681113  3970 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:09.681628  3970 pending_rounds.cc:85] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:09.681845  3970 pending_rounds.cc:107] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:09.682073  3970 raft_consensus.cc:2889] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:09.682390  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.684134  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.684947  4044 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:09.690229  4043 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.692994  4043 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.695133  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:09.698030  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.700157  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.657958  5105 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:09.709828  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.660856  5296 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.723344  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.724814  4114 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.726797  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 694) took 1058 ms. Trace:
I20260709 13:16:09.729024  4044 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:09.681352  5163 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:09.733143  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46691us
I20260709 13:16:09.729950  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.735760  4043 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.735745  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.737352  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 901) took 1815 ms. Trace:
I20260709 13:16:09.737679  3971 rpcz_store.cc:276] 0709 13:16:07.922418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.735457 (+1813039us) service_pool.cc:224] Handling call
0709 13:16:09.737292 (+  1835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:09.738587  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.743505  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.722596  5291 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:09.708417  5353 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:09.728531  5386 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.009s	sys 0.002s
I20260709 13:16:09.744930  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.750204  5294 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.753840  3971 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:09.790197  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.791153  4043 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:09.791899  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.722123  5343 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:09.722332  5190 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:16:09.745352  5301 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:16:09.798849  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 228674us
W20260709 13:16:09.753712  5386 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.009s	sys 0.002s
I20260709 13:16:09.806134  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.751332  5291 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.802767  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:09.809280  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 214386us
I20260709 13:16:09.753558  5294 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:09.811735  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.813045  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.787590  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:09.815093  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:09.734252  5296 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:09.798079  5349 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.748112  5206 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:16:09.798975  5172 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.835603  4121 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:16:09.838770  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 699) took 1018 ms. Trace:
I20260709 13:16:09.845218  3970 rpcz_store.cc:276] 0709 13:16:08.820255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.535463 (+715208us) service_pool.cc:224] Handling call
0709 13:16:09.538071 (+  2608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.682489 (+144418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.838447 (+155958us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b540044c0d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.838702 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327884544}
I20260709 13:16:09.846539  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:09.847455  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 113658us
I20260709 13:16:09.849083  4117 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:09.810464  5291 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.859691  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.852236  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 655) took 3437 ms. Trace:
I20260709 13:16:09.860848  4115 rpcz_store.cc:276] 0709 13:16:06.414837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.459130 (+1044293us) service_pool.cc:224] Handling call
0709 13:16:07.459427 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.555001 (+1095574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.851975 (+1296974us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003d2554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:09.852179 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2489329536}
I20260709 13:16:09.861941  3970 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:09.813828  5294 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.871412  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.873174  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.873934  3970 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.871016  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.876021  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.876406  3971 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:09.877426  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:09.878639  4121 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:09.798566  5297 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.041s
W20260709 13:16:09.837083  5428 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:16:09.747886  4942 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.623199  3964 rpcz_store.cc:276] 0709 13:16:08.563963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.398128 (+834165us) service_pool.cc:224] Handling call
0709 13:16:09.398593 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.399037 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.399082 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.399664 (+   582us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.540014 (+140350us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.551530 (+ 11516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.565782 (+ 14252us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.620325 (+ 54543us) raft_consensus.cc:1685] finished
0709 13:16:09.620350 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.620501 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5808,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":111571,"threads_started":1,"wal-append.queue_time_us":219216}
I20260709 13:16:09.793123  5105 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.826620  5174 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.914934  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.915175  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.833930  5149 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:09.920914  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 105888us
I20260709 13:16:09.824623  4986 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 13:16:09.917527  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:09.923719  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.921355  5353 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:09.924237  5149 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:09.920507  5343 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:09.924784  5310 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:09.925318  3966 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:09.727365  3963 rpcz_store.cc:276] 0709 13:16:08.668011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.471827 (+803816us) service_pool.cc:224] Handling call
0709 13:16:09.472195 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.472599 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.472638 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.522811 (+ 50173us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.653856 (+131045us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed733420ac 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b
0709 13:16:09.726222 (+ 72366us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.726322 (+   100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.726402 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.726440 (+    38us) raft_consensus.cc:1685] finished
0709 13:16:09.726455 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.726725 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8345,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":6193,"spinlock_wait_cycles":29556480,"thread_start_us":156378,"threads_started":1,"wal-append.queue_time_us":184993}
I20260709 13:16:09.926524  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.834900  5296 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:09.941138  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.927495  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:09.929937  3971 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:09.936371  3970 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:09.927469  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79292.9us
I20260709 13:16:09.928148  5409 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.913550  5386 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:09.952946  5317 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:09.953454  5424 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 13:16:09.922325  5136 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:09.953761  4112 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:16:09.955219  5430 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:16:09.970939  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 693) took 1337 ms. Trace:
W20260709 13:16:09.955812  5429 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:16:09.971290  3972 rpcz_store.cc:276] 0709 13:16:08.633981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.414429 (+780448us) service_pool.cc:224] Handling call
0709 13:16:09.414698 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.415029 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.415059 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.415537 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.742543 (+327006us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.742589 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.742651 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.970738 (+228087us) raft_consensus.cc:1685] finished
0709 13:16:09.970758 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.970884 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":15596,"thread_start_us":289701,"threads_started":1,"wal-append.queue_time_us":371571}
I20260709 13:16:09.972954  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.973380  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 687) took 1434 ms. Trace:
I20260709 13:16:09.973641  5447 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.934715  5027 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:09.955744  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.974159  5447 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:09.974969  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:09.976680  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:09.976742  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.956274  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:09.956959  5245 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:09.959996  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.961076  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 700) took 1125 ms. Trace:
I20260709 13:16:09.979218  4041 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:09.947330  5174 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:09.935022  5413 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:09.935205  5343 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:09.947480  5105 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.964928  5301 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
W20260709 13:16:10.044196  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 88512.8us
I20260709 13:16:09.955266  5427 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:09.979946  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:09.979372  3969 rpcz_store.cc:276] 0709 13:16:08.835595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.628238 (+792643us) service_pool.cc:224] Handling call
0709 13:16:09.628461 (+   223us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:09.628728 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.628755 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:09.638308 (+  9553us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.806623 (+168315us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.806671 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.806746 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.960849 (+154103us) raft_consensus.cc:1685] finished
0709 13:16:09.960870 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.961020 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":167820,"threads_started":1,"wal-append.queue_time_us":317679}
I20260709 13:16:09.980666  4043 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:10.049665  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.050051  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.955174  4680 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:09.982384  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:09.950754  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:09.952206  5309 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.983937  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:09.973062  5310 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:09.997223  5203 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:09.978222  3967 rpcz_store.cc:276] 0709 13:16:08.538810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.391357 (+852547us) service_pool.cc:224] Handling call
0709 13:16:09.391727 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.392093 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.392125 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.392672 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.551487 (+158815us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:09.562473 (+ 10986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.570743 (+  8270us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.973165 (+402422us) raft_consensus.cc:1685] finished
0709 13:16:09.973184 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:09.973323 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12484,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":97426,"threads_started":1,"wal-append.queue_time_us":266610}
I20260709 13:16:09.981523  5258 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.001549  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.001984  5271 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.964564  5419 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:09.997890  5149 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.048565  5427 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:09.981384  5409 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:09.987414  5174 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.040584  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 695) took 1372 ms. Trace:
I20260709 13:16:09.973672  5440 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:09.965029  5391 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:10.041512  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:10.041844  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.041030  5317 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.040532  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.047742  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.084041  3972 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:10.050248  3969 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.080476  3965 rpcz_store.cc:276] 0709 13:16:08.668319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.501506 (+833187us) service_pool.cc:224] Handling call
0709 13:16:09.501955 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:09.503608 (+  1653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:09.503641 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.521297 (+ 17656us) log.cc:844] Serialized 26 byte log entry
0709 13:16:09.722490 (+201193us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:09.745192 (+ 22702us) log.cc:844] Serialized 14 byte log entry
0709 13:16:09.745572 (+   380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.745639 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:09.986890 (+241251us) raft_consensus.cc:1685] finished
0709 13:16:09.986911 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.040519 (+ 53608us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22450,"prepare.run_cpu_time_us":9061,"prepare.run_wall_time_us":39808,"raft.queue_time_us":4073,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":5676,"spinlock_wait_cycles":5648640,"thread_start_us":184155,"threads_started":1,"wal-append.queue_time_us":257507}
I20260709 13:16:10.085457  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.086396  3965 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:10.087452  5440 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.087883  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.088500  3972 raft_consensus.cc:1813] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:10.086915  5409 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.089290  5409 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.090361  5440 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:10.047153  5301 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:10.090860  5317 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.054060  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:10.092326  4121 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 2.
I20260709 13:16:10.093243  5317 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.094058  4040 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
I20260709 13:16:10.094727  3972 raft_consensus.cc:2368] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:10.095237  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.051726  4043 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.095975  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.097908  5258 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.099351  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 701) took 1249 ms. Trace:
I20260709 13:16:10.099706  3964 rpcz_store.cc:276] 0709 13:16:08.850213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.098568 (+1248355us) service_pool.cc:224] Handling call
0709 13:16:10.098872 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.099042 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.099069 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.099115 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.099146 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.099198 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.099297 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.060039  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.100879  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.097940  3972 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:10.102016  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:10.050755  5368 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.383s	user 0.007s	sys 0.000s
I20260709 13:16:10.070586  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.106390  4044 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:10.003609  3963 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:10.048527  5245 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:10.057900  5422 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.083423  4041 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.090056  5409 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.058715  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.077728  5427 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.103190  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.103941  3965 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:10.074990  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:10.134275  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.109344  3969 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:10.127322  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.137825  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.103166  3972 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:10.138309  5245 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.083495  5419 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.096606  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:10.111613  4043 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:10.139899  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.150291  4044 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:10.073364  5271 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.153295  4043 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:10.135660  5412 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.093345  5391 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.142987  3972 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:10.071228  5343 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.103559  5154 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.108320  3963 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.143661  5386 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.145341  5420 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:10.126250  5301 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.140055  3969 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.192958  5420 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.193356  5420 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:10.193883  5271 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:10.194145  5420 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.195397  5420 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.198622  3969 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:10.200129  5291 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.105304  5443 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:16:10.149017  5094 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.151623  5409 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.172580  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.173069  5203 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.172962  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:10.172616  5422 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:10.175410  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:10.175606  5027 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:10.176291  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:10.180565  4043 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.076637  5447 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:10.182999  3972 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:10.184365  3963 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.224983  4121 raft_consensus.cc:606] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.225529  4121 raft_consensus.cc:614] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:10.171068  4041 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:10.172861  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:10.223798  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48445.2us
I20260709 13:16:10.232283  3969 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.204777  5343 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.234261  3972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45584
I20260709 13:16:10.207984  5094 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.238597  5094 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.180123  5391 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.204540  4942 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.242376  4041 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:10.208081  5301 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:10.239742  5094 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.223300  5271 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:10.244283  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 647) took 4461 ms. Trace:
I20260709 13:16:10.229223  5386 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.235520  5203 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.240336  5340 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:16:10.262015  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e20b6631af674e838a0accf36c31749f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:10.270028  4121 raft_consensus.cc:606] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.270422  4121 raft_consensus.cc:614] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:10.262203  5271 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.274703  5291 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.274890  5203 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.229633  4684 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:10.234565  5412 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.276243  5412 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:10.248986  4041 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:10.250334  3968 rpcz_store.cc:276] 0709 13:16:05.782522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:07.019708 (+1237186us) service_pool.cc:224] Handling call
0709 13:16:07.020007 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:07.045113 (+ 25106us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:07.159246 (+114133us) log.cc:844] Serialized 14 byte log entry
0709 13:16:07.896230 (+736984us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b180011af40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:16:08.639051 (+742821us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:08.639099 (+    48us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:08.639140 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:09.948572 (+1309432us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b180011af40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419
0709 13:16:10.244083 (+295511us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b540044cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:10.244126 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.244232 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1036,"prepare.queue_time_us":74240,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":1215,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":20339,"spinlock_wait_cycles":81332096,"thread_start_us":818021,"threads_started":2,"wal-append.queue_time_us":1566454,"wal-append.run_cpu_time_us":986,"wal-append.run_wall_time_us":1001022}
I20260709 13:16:10.250926  5301 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.278426  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.279188  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.285802  3966 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:10.287351  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.288389  3968 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:10.288502  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.290056  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:10.291036  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:10.291438  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.249493  5391 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.247537  5294 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.270696  5386 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.245370  5422 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:10.274987  5271 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:10.256851  5349 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:16:10.248055  3969 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:10.324110  4046 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:10.308908  5386 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.286518  5414 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:10.328032  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:10.328346  3968 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:10.329763  4121 raft_consensus.cc:606] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.330111  4121 raft_consensus.cc:614] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:10.269703  3963 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.324657  5391 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:10.329201  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.327867  5349 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:10.277508  5412 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:10.345263  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 361393us
I20260709 13:16:10.309768  5427 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.364718  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 888) took 1509 ms. Trace:
I20260709 13:16:10.347604  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:10.378422  4047 rpcz_store.cc:276] 0709 13:16:08.855214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.855459 (+   245us) service_pool.cc:224] Handling call
0709 13:16:08.855837 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:08.856057 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:08.856080 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:09.975272 (+1119192us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b2c000a5238. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:16:09.975837 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.312251 (+336414us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:10.312292 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.312376 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:10.364395 (+ 52019us) raft_consensus.cc:1685] finished
0709 13:16:10.364411 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.364647 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13356288,"thread_start_us":335833,"threads_started":1,"wal-append.queue_time_us":386689}
I20260709 13:16:10.380288  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.364579  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 708) took 1431 ms. Trace:
I20260709 13:16:10.365248  5452 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:10.383697  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.384842  4047 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:10.369207  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 389291us
W20260709 13:16:10.373170  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46304us
I20260709 13:16:10.376012  5399 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.391292  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:10.354528  3963 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:10.395741  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.394754  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:10.401599  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:10.390898  5412 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.404321  5447 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.395823  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.405638  5258 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.392887  5291 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:10.408646  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.408035  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.411871  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.412618  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.416711  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.417018  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.396618  5453 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:10.419296  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:10.421730  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.421725  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:10.422580  3968 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:10.408493  5454 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:10.407994  5317 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:10.421501  5453 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:10.395365  5399 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.436606  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.428304  5301 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:10.422871  5139 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.445279  5454 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:10.446448  5454 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.450032  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.417045  5291 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.453522  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.431743  5353 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:10.457165  5449 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:16:10.435381  5203 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:16:10.432461  5294 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.433749  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 712) took 1293 ms. Trace:
W20260709 13:16:10.541937  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79833.4us
I20260709 13:16:10.550740  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.439954  5453 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.557366  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.567078  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:10.568150  4045 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:10.577911  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.578599  3968 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:10.583921  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.553663  5452 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:10.626971  5465 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:16:10.628599  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.629850  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:10.630071  5463 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:16:10.630879  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:10.631500  5461 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:16:10.631597  3966 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:10.635365  3966 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:10.635859  3966 pending_rounds.cc:85] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:10.636193  3966 pending_rounds.cc:107] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:10.636629  3966 raft_consensus.cc:2889] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.569571  5353 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:10.570329  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 73048.7us
I20260709 13:16:10.642872  3966 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:16:10.632900  5460 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.114s	user 0.001s	sys 0.005s
I20260709 13:16:10.634152  5105 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:10.646525  5399 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:10.670035  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.643959  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.656265  5420 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:16:10.666656  5105 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:10.684294  5353 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.382725  3964 rpcz_store.cc:276] 0709 13:16:08.933648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.103035 (+1169387us) service_pool.cc:224] Handling call
0709 13:16:10.107616 (+  4581us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.107817 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:10.108110 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.364127 (+256017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.364193 (+    66us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.364250 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.364327 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.364472 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":97,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":84,"spinlock_wait_cycles":39168,"thread_start_us":255640,"threads_started":1,"wal-append.queue_time_us":255940}
I20260709 13:16:10.685420  5309 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.678285  3972 raft_consensus.cc:606] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:16:10.685109  5105 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.689199  5150 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.691566  5150 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.692940  5150 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.698403  5242 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:10.698930  5242 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:10.699761  5242 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:10.703600  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 687) took 1571 ms (client timeout 1985 ms). Trace:
W20260709 13:16:10.706535  4117 rpcz_store.cc:269] 0709 13:16:09.132295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.244114 (+111819us) service_pool.cc:224] Handling call
0709 13:16:10.703261 (+1459147us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54002ea254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:10.703533 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1356061952}
I20260709 13:16:10.633996  5452 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.705111  3971 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:10.710158  3971 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.711983  3971 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:10.714151  3971 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.718604  4042 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
W20260709 13:16:10.703992  4682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 64) took 2208 ms (client timeout 2778 ms). Trace:
W20260709 13:16:10.719314  4682 rpcz_store.cc:269] 0709 13:16:08.504892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.507716 (+  2824us) service_pool.cc:224] Handling call
0709 13:16:10.703773 (+2196057us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400562554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:10.703914 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699350272}
I20260709 13:16:10.700734  5242 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:10.720173  5236 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.724133  5236 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.736960  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 685) took 1627 ms. Trace:
I20260709 13:16:10.737351  4120 rpcz_store.cc:276] 0709 13:16:09.109536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.337862 (+228326us) service_pool.cc:224] Handling call
0709 13:16:10.736797 (+1398935us) spinlock_profiling.cc:243] Waited 63.8 ms on lock 0x7b5400096354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:10.736902 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146826496}
I20260709 13:16:10.709949  5420 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:10.748484  3968 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
W20260709 13:16:10.735751  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 91903.2us
I20260709 13:16:10.716730  5386 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.494443  3967 rpcz_store.cc:276] 0709 13:16:09.137239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.101839 (+964600us) service_pool.cc:224] Handling call
0709 13:16:10.102113 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.102303 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:10.102603 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 13:16:10.399512 (+296909us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:10.407753 (+  8241us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:10.411128 (+  3375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.422364 (+ 11236us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:10.430538 (+  8174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9681,"prepare.queue_time_us":137,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":2145,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4931,"spinlock_wait_cycles":5859584,"thread_start_us":290288,"threads_started":1,"wal-append.queue_time_us":315728}
I20260709 13:16:10.748266  4684 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:10.739665  5420 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:10.759080  5420 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.741982  5301 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:10.756297  5413 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.760546  5386 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:10.761994  5301 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.762869  4112 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 3.
W20260709 13:16:10.763978  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 345094us
W20260709 13:16:10.770670  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.771219  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.775698  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:10.772432  5409 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.778753  3963 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:10.778637  5409 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.779140  3963 pending_rounds.cc:85] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:10.779425  3963 pending_rounds.cc:107] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:10.778923  5456 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.779690  3963 raft_consensus.cc:2889] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:10.780086  5456 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.770272  5317 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:16:10.780630  5409 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.781379  5409 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.781751  5409 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.787457  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:10.789861  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:10.780699  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 927) took 1132 ms. Trace:
I20260709 13:16:10.752562  5453 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.793512  5419 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:10.809008  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.811640  3969 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:10.806057  5391 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:10.780869  5289 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:16:10.814661  5474 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.795852  5317 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:16:10.827335  5453 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.829433  5301 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:10.830264  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 871) took 2223 ms (client timeout 1822 ms). Trace:
W20260709 13:16:10.831051  4042 rpcz_store.cc:269] 0709 13:16:08.606986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:08.610437 (+  3451us) service_pool.cc:224] Handling call
0709 13:16:10.830065 (+2219628us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400119ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:10.830193 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4704288640}
I20260709 13:16:10.833464  5420 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.836167  5420 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.837407  5317 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.838586  5317 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.838950  5317 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.840137  5391 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.842483  5453 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:10.842929  5453 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:10.843719  5453 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.805698  3963 rpcz_store.cc:276] 0709 13:16:09.648810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.107879 (+459069us) service_pool.cc:224] Handling call
0709 13:16:10.108191 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.780454 (+672263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:10.780647 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:10.845559  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:10.821221  5447 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:10.848301  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:10.852480  4041 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.849341  4040 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:10.794375  5409 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.856406  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.856429  5245 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:10.857573  4047 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:16:10.839819  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:10.855931  4013 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:10.864348  5453 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.859858  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:10.860348  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:10.862057  4118 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:10.872663  4117 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:10.863072  4041 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:10.841130  5391 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.864078  5444 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:10.866849  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:10.873831  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:10.863996  5399 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:10.875330  4113 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:10.875552  5447 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:10.875978  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:10.877208  4121 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:16:10.879113  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:10.887082  4120 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:10.883103  4045 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:10.839735  5317 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.885066  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:10.884845  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:10.881001  5444 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.900830  4118 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.866554  5349 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:10.907521  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:10.908329  4120 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:10.909627  4115 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:10.823585  5474 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.891505  5409 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.925202  4120 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:10.876389  5456 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:10.877343  5245 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.910141  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:10.935806  4118 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:10.929699  5458 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.349s	user 0.003s	sys 0.000s
I20260709 13:16:10.891119  5399 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:10.931998  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:10.935959  4121 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:16:10.936822  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:10.918308  5474 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:10.927356  5317 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.920212  5419 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.950749  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45584 (request call id 62) took 1098 ms. Trace:
I20260709 13:16:10.912679  5349 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.951596  3972 rpcz_store.cc:276] 0709 13:16:09.850577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.234139 (+383562us) service_pool.cc:224] Handling call
0709 13:16:10.949180 (+715041us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b54003971d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:10.949276 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019865856}
I20260709 13:16:10.942567  3964 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.950841  5301 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:10.971712  5181 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:10.972735  3972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45584
I20260709 13:16:10.961298  4113 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:10.951114  5419 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:10.978675  5419 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.979528  5236 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:10.981472  5399 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:10.982045  5291 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:10.996754  5384 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.930s	user 0.005s	sys 0.000s
I20260709 13:16:11.020906  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 801) took 1716 ms. Trace:
I20260709 13:16:11.021371  4114 rpcz_store.cc:276] 0709 13:16:09.304274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:09.619162 (+314888us) service_pool.cc:224] Handling call
0709 13:16:09.619488 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:09.725360 (+105872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.020607 (+1295247us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54001b1a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:11.020829 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":241431808}
I20260709 13:16:11.025264  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:11.025975  4680 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:11.028971  4113 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:11.032883  5441 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:10.995621  5419 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:11.033411  5441 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.044292  5340 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:11.044888  5340 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:11.045521  5427 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:11.046232  5452 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:11.046952  5340 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:11.034996  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:11.048331  5427 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.048712  5427 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:16:11.053331  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.040802  5289 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.034073  5444 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:11.049090  5427 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:11.069898  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 185742us
I20260709 13:16:11.071970  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:11.073020  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.073459  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:11.073907  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.077246  5301 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.078804  5301 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.079309  5301 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:11.081660  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:11.041361  5419 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.053642  5245 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:11.084278  5419 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:11.059281  5289 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.096393  4117 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:11.100451  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:11.101028  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:11.101260  4117 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:11.102305  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:11.103271  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:11.103799  4117 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.086342  3964 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:11.052810  5413 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.080209  5301 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.086342  5289 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:11.109647  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 319827us
W20260709 13:16:11.112216  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 307480us
I20260709 13:16:11.114292  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:11.095906  5399 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.123153  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:11.116276  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:11.130684  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:11.117931  5399 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:11.144423  5399 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.136940  5409 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.109814  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:11.153303  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44314.1us
I20260709 13:16:11.153469  5340 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:11.154496  5340 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.155100  5340 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.137123  5289 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.129163  5413 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.166499  5340 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:11.167896  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:11.168792  4113 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 2.
I20260709 13:16:11.169826  5340 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:11.176705  5399 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.179239  5399 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:11.231081  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 93882.3us
I20260709 13:16:11.231891  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:11.233342  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:11.236722  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:11.249094  4042 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:11.250165  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.256031  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:11.261595  4113 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.267567  5105 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.268585  5105 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.278697  5489 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.282786  5301 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:11.283375  5489 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.283911  5489 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:11.286046  5105 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:11.184221  5427 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:11.290285  5427 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:11.292565  5289 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:11.293356  5413 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:11.294235  5489 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.296355  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:16:11.296677  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.305244  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:11.304723  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:11.306352  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:11.309690  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:11.322031  4119 raft_consensus.cc:2376] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4. Re-sending same reply.
I20260709 13:16:11.328279  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:11.328591  5444 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.345100  5136 raft_consensus.cc:2764] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:16:11.348089  5489 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.363899  4682 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:11.366094  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:11.369501  5301 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.370064  5301 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:11.371300  5301 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:11.367959  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.379638  4045 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
W20260709 13:16:11.383615  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55676.6us
I20260709 13:16:11.385025  5444 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:11.386297  5287 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:11.386687  5150 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.387759  4986 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:11.388197  4986 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:11.389358  4986 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.390798  4986 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.386749  5287 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:11.393285  5287 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.395087  5287 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:11.398454  4117 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:11.396306  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:11.400647  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:11.412849  4040 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:11.413487  4040 pending_rounds.cc:85] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 1
I20260709 13:16:11.414062  4040 pending_rounds.cc:107] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:11.414666  4040 raft_consensus.cc:2889] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:11.415869  5466 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.416478  5466 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:11.426106  5349 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:11.420394  5466 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:11.431809  5349 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:11.432076  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:11.432456  5349 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:11.434978  5349 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:11.439416  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:11.442075  5441 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:11.443059  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:11.443253  5301 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:11.453660  5294 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:11.454078  5294 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:11.454416  5294 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:11.457540  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:11.458436  4047 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
W20260709 13:16:11.459391  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:11.465225  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:11.442408  5473 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.690s	user 0.003s	sys 0.000s
I20260709 13:16:11.449620  5301 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:11.463580  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 39) took 1410 ms. Trace:
I20260709 13:16:11.469377  4120 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:12.934293  5414 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.938314  5414 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:12.938997  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 709) took 2075 ms. Trace:
I20260709 13:16:11.490717  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 133) took 7062 ms. Trace:
I20260709 13:16:11.500685  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 944) took 1089 ms. Trace:
I20260709 13:16:11.470974  5301 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:12.940325  3869 rpcz_store.cc:276] 0709 13:16:04.419124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:04.423642 (+  4518us) service_pool.cc:224] Handling call
0709 13:16:11.473745 (+7050103us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:07.219418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:07.239413 (+ 19995us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:07.241148 (+  1735us) write_op.cc:435] Acquired schema lock
0709 13:16:07.242208 (+  1060us) tablet.cc:662] Decoding operations
0709 13:16:07.368988 (+126780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:07.369080 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:07.369116 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:16:07.369732 (+   616us) tablet.cc:701] Row locks acquired
0709 13:16:07.369753 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:07.369914 (+   161us) write_op.cc:270] Start()
0709 13:16:07.370043 (+   129us) write_op.cc:276] Timestamp: P: 1783602967369864 usec, L: 0
0709 13:16:07.370069 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:16:07.444752 (+ 74683us) log.cc:844] Serialized 2481 byte log entry
0709 13:16:08.762199 (+1317447us) op_driver.cc:464] REPLICATION: finished
0709 13:16:08.998108 (+235909us) write_op.cc:301] APPLY: starting
0709 13:16:08.998199 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:08.998401 (+   202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:09.016971 (+ 18570us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:09.017799 (+   828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:09.018012 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:16:09.018154 (+   142us) write_op.cc:312] APPLY: finished
0709 13:16:09.018436 (+   282us) log.cc:844] Serialized 52 byte log entry
0709 13:16:09.018619 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.018750 (+   131us) write_op.cc:454] Released schema lock
0709 13:16:09.018799 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:09.019737 (+   938us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:09.019775 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":585975,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":233240,"apply.run_cpu_time_us":3185,"apply.run_wall_time_us":21486,"num_ops":6,"prepare.queue_time_us":90838,"prepare.run_cpu_time_us":23800,"prepare.run_wall_time_us":367410,"raft.queue_time_us":605743,"raft.run_cpu_time_us":27302,"raft.run_wall_time_us":297013,"replication_time_us":1320762,"thread_start_us":826022,"threads_started":4,"wal-append.queue_time_us":184674,"wal-append.run_cpu_time_us":26436,"wal-append.run_wall_time_us":2395423}]]}
I20260709 13:16:12.939407  4120 rpcz_store.cc:276] 0709 13:16:10.863109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.925898 (+ 62789us) service_pool.cc:224] Handling call
0709 13:16:10.926178 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:12.937587 (+2011409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.938666 (+  1079us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b5400081454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:12.938919 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1239637376}
I20260709 13:16:11.449882  5349 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:16:11.502802  5294 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.023545  5294 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:12.112075  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:12.477423  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.030018  3970 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:13.030396  3970 pending_rounds.cc:85] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:13.030607  3970 pending_rounds.cc:107] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:13.030805  3970 raft_consensus.cc:2889] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.032068  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:12.574699  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.574944  5520 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:12.639185  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 1.17783e+06us
I20260709 13:16:12.645308  5317 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:12.653991  5289 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:12.654572  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.663200  4684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 42) took 1966 ms. Trace:
I20260709 13:16:12.668691  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:16:12.674352  4113 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.412s	user 0.009s	sys 0.017s
W20260709 13:16:12.677903  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 1.28311e+06us
I20260709 13:16:12.707325  4038 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:11.463538  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:12.854358  5510 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.493s	user 0.008s	sys 0.012s
W20260709 13:16:12.865423  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 1.61825e+06us
I20260709 13:16:11.470136  4112 rpcz_store.cc:276] 0709 13:16:10.053389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.056857 (+  3468us) service_pool.cc:224] Handling call
0709 13:16:11.463129 (+1406272us) spinlock_profiling.cc:243] Waited 630 ms on lock 0x7b5400097254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:11.463377 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1449042816}
W20260709 13:16:12.879565  4039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 904) took 2897 ms (client timeout 1569 ms). Trace:
I20260709 13:16:12.908360  5027 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:12.929740  5175 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:16:12.933362  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:12.934122  5427 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:12.936200  4942 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:12.940449  5414 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:12.947566  3969 rpcz_store.cc:276] 0709 13:16:10.411063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.455709 (+ 44646us) service_pool.cc:224] Handling call
0709 13:16:11.500195 (+1044486us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400279054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:11.500476 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591584512}
W20260709 13:16:12.952383  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 915) took 2820 ms (client timeout 2155 ms). Trace:
W20260709 13:16:12.974939  5309 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.221s	user 0.010s	sys 0.033s
I20260709 13:16:12.982805  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 918) took 2830 ms. Trace:
I20260709 13:16:12.988719  5422 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:12.991961  5523 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.000167  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.003104  5301 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.004258  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.017680  5145 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:09.632640  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet 2d0ea046ec794443af9a7689d2920002 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:16:13.033124  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:13.061600  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.052987  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 1.59066e+06us
I20260709 13:16:13.064728  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 708) took 2201 ms. Trace:
I20260709 13:16:13.047276  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 916) took 2905 ms. Trace:
I20260709 13:16:13.074190  3969 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
W20260709 13:16:13.038952  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.038528  3965 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:16:13.070850  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.045382  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.032739  3970 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:13.065409  4039 rpcz_store.cc:269] 0709 13:16:09.981819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:12.879192 (+2897373us) service_pool.cc:211] Skipping call since client already timed out
0709 13:16:12.879369 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:16:13.074342  4046 rpcz_store.cc:269] 0709 13:16:10.132352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.135604 (+  3252us) service_pool.cc:224] Handling call
0709 13:16:12.951944 (+2816340us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b540003b954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:12.952189 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423389952}
I20260709 13:16:13.039104  5150 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.034528  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.080842  5246 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.079416  5149 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:13.074539  5309 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.323s	user 0.011s	sys 0.033s
I20260709 13:16:13.081523  5094 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.067691  5175 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.035831  3963 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:13.079869  5340 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.040635  5373 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.138343  4086 connection.cc:256] RPC call timeout handler was delayed by -1.1423002649999034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
I20260709 13:16:13.072933  4942 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:13.039867  5258 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.104471  4044 rpcz_store.cc:276] 0709 13:16:10.141880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.208724 (+ 66844us) service_pool.cc:224] Handling call
0709 13:16:10.209053 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.209437 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.209467 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.224665 (+ 15198us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.304827 (+1080162us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b18001df740. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:16:11.442575 (+137748us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:11.442993 (+   418us) log.cc:844] Serialized 14 byte log entry
0709 13:16:11.749068 (+306075us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b18001df740. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:16:13.046651 (+1297583us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b18001df740. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:16:13.046844 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.046925 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:13.046979 (+    54us) raft_consensus.cc:1685] finished
0709 13:16:13.046989 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.047127 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9449,"prepare.queue_time_us":4772,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":65,"raft.queue_time_us":1606250,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":8482,"spinlock_wait_cycles":28770432,"thread_start_us":50242,"threads_started":1,"wal-append.queue_time_us":1205220,"wal-append.run_cpu_time_us":2833,"wal-append.run_wall_time_us":1043822}
I20260709 13:16:13.044216  4113 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:13.166302  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 44) took 1920 ms. Trace:
I20260709 13:16:13.166661  4113 rpcz_store.cc:276] 0709 13:16:11.245852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.255322 (+  9470us) service_pool.cc:224] Handling call
0709 13:16:13.166242 (+1910920us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:13.089430  3856 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 3.45635e+06us
I20260709 13:16:13.067502  5027 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.104537  4115 rpcz_store.cc:276] 0709 13:16:10.862863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.930618 (+ 67755us) service_pool.cc:224] Handling call
0709 13:16:10.930957 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.931296 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.931324 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.934515 (+  3191us) log.cc:844] Serialized 26 byte log entry
0709 13:16:11.382442 (+447927us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:11.392428 (+  9986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:11.393507 (+  1079us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.853615 (+1460108us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:13.064225 (+210610us) raft_consensus.cc:1685] finished
0709 13:16:13.064245 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:13.064528 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2076,"raft.queue_time_us":821,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5948,"spinlock_wait_cycles":12540160,"thread_start_us":413877,"threads_started":1,"wal-append.queue_time_us":426200}
I20260709 13:16:13.039511  5263 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.154243  3963 pending_rounds.cc:85] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:13.081784  5146 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:16:13.155690  3968 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:13.159633  5145 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.074656  4043 rpcz_store.cc:276] 0709 13:16:10.152240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.227188 (+ 74948us) service_pool.cc:224] Handling call
0709 13:16:10.227448 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:10.275974 (+ 48526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:10.276112 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:10.276810 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:16:10.371113 (+ 94303us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:10.371155 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.982108 (+2610953us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b540028c154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:12.982191 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:12.982281 (+    90us) raft_consensus.cc:1685] finished
0709 13:16:12.982293 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:12.982601 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2216,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":33455,"spinlock_wait_cycles":110634368,"thread_start_us":93863,"threads_started":1,"wal-append.queue_time_us":94171,"wal-append.run_cpu_time_us":1853,"wal-append.run_wall_time_us":1008404}
I20260709 13:16:13.036526  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.039316  5350 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:16:13.075660  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 75757.4us
I20260709 13:16:13.033835  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.159904  5287 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.175853  5443 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.175557  5271 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.187693  5263 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.187814  5287 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.188274  5271 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.188861  5246 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.190585  5271 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.181200  3963 pending_rounds.cc:107] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:13.191258  3963 raft_consensus.cc:2889] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:13.177274  5426 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.165516  5341 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.195386  5426 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:13.168094  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 104230us
I20260709 13:16:13.166913  4046 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
W20260709 13:16:13.170424  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.072794  5427 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.075109  5422 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.075948  5301 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.042814  5289 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.171612  5190 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.172063  4682 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.172737  4045 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:13.042479  5317 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.155617  5172 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.153997  5175 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.211410  5317 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.212308  5317 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.045897  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 941) took 1947 ms. Trace:
I20260709 13:16:13.213151  4038 rpcz_store.cc:276] 0709 13:16:11.098547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.105927 (+  7380us) service_pool.cc:224] Handling call
0709 13:16:12.706489 (+1600562us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:12.706823 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.045556 (+338733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.045813 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12816256}
I20260709 13:16:13.039088  5520 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.216606  5520 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:13.173015  4011 connection.cc:256] RPC call timeout handler was delayed by -1.5754008399999293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 13:16:13.217201  4011 connection.cc:256] RPC call timeout handler was delayed by -1.511500839999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
I20260709 13:16:13.216894  5190 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.165580  5258 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.219049  5190 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:13.176352  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 131142us
I20260709 13:16:13.222030  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.220952  3972 raft_consensus.cc:606] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 13:16:13.222781  3972 raft_consensus.cc:614] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:13.223875  5289 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.224383  5289 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.169524  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.224929  5289 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.162456  5340 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.159633  5484 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.226446  5484 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.226857  5399 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.228148  3971 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:13.228525  3971 pending_rounds.cc:85] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:13.227783  5399 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.075214  5523 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.186179  3969 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:13.163334  5310 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.229903  5310 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.230852  5294 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.231628  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.232231  5310 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.075623  5456 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.226307  5340 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.233227  5456 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.233587  5426 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.235272  5456 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.224931  5145 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.193511  5315 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.193218  3868 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.165891  4942 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.154721  5150 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.194199  5146 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.173326  5414 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.222414  5427 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.183516  5373 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.237071  5294 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:13.195019  5526 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.043478  4684 rpcz_store.cc:276] 0709 13:16:10.696667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.711372 (+ 14705us) service_pool.cc:224] Handling call
0709 13:16:10.724806 (+ 13434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:10.757423 (+ 32617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:12.662671 (+1905248us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b5400600254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:12.663021 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21565824}
W20260709 13:16:13.196590  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51154.9us
I20260709 13:16:13.187870  5443 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.192010  5094 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.191401  5246 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.208725  3964 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:13.208595  5172 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.199934  5333 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.210861  5301 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.199240  5441 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:13.217557  4011 connection.cc:256] RPC call timeout handler was delayed by -1.3385282540000389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:16:13.262810  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:13.263219  5441 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.228727  3971 pending_rounds.cc:107] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:13.230487  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.241631  5521 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:13.242033  4942 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.267876  5172 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.243068  4042 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:13.266059  5528 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.240214  5350 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.268735  5528 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.270473  5350 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.270888  5528 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.265026  5317 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.244351  5150 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.195474  5341 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.242452  5146 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.239866  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.272675  5441 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:13.273568  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65345.9us
I20260709 13:16:13.273303  5526 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.274155  5341 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.274390  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.275177  5246 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.275708  5526 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.220846  5422 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.245092  5414 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.220530  5258 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.242560  5263 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.277815  5258 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.258005  5094 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.258083  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:13.279206  4682 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:13.279604  5146 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.258446  5373 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.236886  5315 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.281279  5443 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.230549  5523 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.222879  5287 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:13.282243  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51956.9us
I20260709 13:16:13.282620  4042 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.283090  5315 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.283725  5341 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:13.284377  5425 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.285585  5425 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.285753  5341 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:13.260618  5445 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.286094  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.286836  4115 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.286660  5445 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.177637  4113 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:13.287983  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.258850  5294 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:13.265466  3971 raft_consensus.cc:2889] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:13.264055  4011 connection.cc:256] RPC call timeout handler was delayed by -1.0883282540000891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 13:16:13.289541  4011 connection.cc:256] RPC call timeout handler was delayed by -1.0609593989997848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
I20260709 13:16:13.290237  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 945) took 2878 ms. Trace:
I20260709 13:16:13.267799  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.290658  3971 rpcz_store.cc:276] 0709 13:16:10.411291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.715163 (+303872us) service_pool.cc:224] Handling call
0709 13:16:10.715468 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:13.289360 (+2573892us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:13.289974 (+   614us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b54001edf54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:13.290162 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5777379072}
I20260709 13:16:13.291925  4085 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.293011  5422 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.292465  5294 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.265054  5333 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.293964  5422 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.294824  5445 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.290609  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:13.296006  5333 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.285727  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:13.282431  5287 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.259266  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45584 (request call id 63) took 2279 ms. Trace:
I20260709 13:16:13.276167  5246 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.278069  5414 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.295902  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:13.297793  5441 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.298368  4113 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.298336  5441 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.300475  5441 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.296994  5287 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:13.304539  4684 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:13.304961  5341 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:13.310202  5341 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.303259  4115 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.297297  3972 rpcz_store.cc:276] 0709 13:16:10.972440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:10.972591 (+   151us) service_pool.cc:224] Handling call
0709 13:16:13.249449 (+2276858us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b54003971d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:13.251408 (+  1959us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5168745216}
I20260709 13:16:13.259742  3868 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.313541  3868 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.314546  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.315443  3868 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.311893  5246 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.293694  4085 leader_election.cc:400] T 2d0ea046ec794443af9a7689d2920002 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:13.332589  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:13.330265  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.333464  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.335265  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:13.336228  4112 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:13.276490  5317 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.307276  5412 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:13.303361  4042 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.337208  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.337846  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.337182  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.311228  5175 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.311592  5289 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.318727  5399 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.251751  5484 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.305521  5287 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.349220  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.349967  4045 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:13.325187  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:13.303295  4011 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:13.316412  4044 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:13.328583  4113 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.323973  3967 raft_consensus.cc:2410] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:13.328299  3868 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.352907  5172 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.353863  5414 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.355374  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.356001  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.357270  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.357838  4042 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.358695  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.359321  4043 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.361212  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.329177  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.328702  5145 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.316305  5523 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:13.330025  5341 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.330006  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.371413  4120 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.330490  5441 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:13.316741  5423 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:13.312320  5340 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.336040  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:13.296546  5190 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.293373  5425 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:13.345717  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58450.2us
I20260709 13:16:13.346415  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.345753  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.338315  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.348232  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.351301  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.363351  4115 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.364075  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.364246  4121 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:13.361851  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08000351e0 after lost signal to thread 2854
I20260709 13:16:13.345191  4942 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.353808  3868 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 2, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.364588  5172 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:16:13.375330  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:13.390516  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53436.1us
I20260709 13:16:13.389703  4942 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.392882  4942 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.391644  4045 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:13.394170  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.396338  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.399538  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.400429  4047 raft_consensus.cc:2410] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:13.371134  5289 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.401575  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.377610  5294 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.377934  5317 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.378228  5315 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.378358  5150 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.404264  5310 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.392556  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:13.408783  5150 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.378126  5246 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.378201  5529 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.404552  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.405635  4040 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:13.380543  5535 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.407869  4120 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.408037  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:13.373688  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 117756us
I20260709 13:16:13.412691  5317 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.418709  5535 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.419416  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:13.419574  5246 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.412942  3868 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.387885  5484 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.420548  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.421205  4119 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.421043  5484 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.421610  5246 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.421368  3868 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:13.422173  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.422822  4115 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.423092  5484 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.423683  5484 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.424525  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:13.420140  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:13.424736  3901 debug-util.cc:398] Leaking SignalData structure 0x7b080003a900 after lost signal to thread 3904
W20260709 13:16:13.425911  3901 debug-util.cc:398] Leaking SignalData structure 0x7b080003a9c0 after lost signal to thread 3918
I20260709 13:16:13.375063  5412 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.408808  5310 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.377249  5340 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.419281  5315 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.408346  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.377808  5441 consensus_queue.cc:1243] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:13.414762  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.408905  4112 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:13.378717  5190 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:13.415956  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.409504  3967 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.423870  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.423460  5525 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:13.425140  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.410224  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.425087  3972 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.380709  5526 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.429454  3966 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:13.426841  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.435360  3971 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:13.436017  4121 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:13.431679  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.417726  4046 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.423628  5529 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:13.427184  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800386240 after lost signal to thread 3996
I20260709 13:16:13.426764  5310 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.431515  4118 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.434267  3970 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:13.406512  5294 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.437368  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.434244  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:13.419741  5317 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.425380  4114 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 2.
I20260709 13:16:13.441869  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.425966  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:13.447472  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.423120  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:13.427510  5412 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.410081  5289 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.449141  5333 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.442113  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.460466  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.441923  5525 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:16:13.464264  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.450336  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 147101us
I20260709 13:16:13.449658  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.454174  3971 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:13.426208  5521 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:16:13.462100  5333 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.507798  5333 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.508224  5373 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.508499  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.508746  5317 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.454936  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:13.509315  5317 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.509780  5145 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.510344  5145 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.510684  5373 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:13.443511  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08003863c0 after lost signal to thread 3997
I20260709 13:16:13.512663  4041 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
W20260709 13:16:13.512817  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08003bca20 after lost signal to thread 4071
W20260709 13:16:13.514091  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800372c40 after lost signal to thread 4145
W20260709 13:16:13.514379  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800351280 after lost signal to thread 4146
W20260709 13:16:13.515616  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08000884c0 after lost signal to thread 4709
W20260709 13:16:13.515918  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800061680 after lost signal to thread 4710
I20260709 13:16:13.459601  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.446002  5399 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.446380  5294 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.446295  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:13.477795  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 79230.2us
I20260709 13:16:13.503895  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:13.505537  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55924.1us
I20260709 13:16:13.508945  5246 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.509162  4040 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:13.518291  4115 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:13.557837  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.567637  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.517351  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:13.569455  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.563283  4942 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.565544  4047 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.571295  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.572299  4118 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.574374  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.576581  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.577775  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:13.494491  5526 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:13.579147  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61886.7us
I20260709 13:16:13.563537  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.582079  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:13.579684  4942 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.595257  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.595913  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.596645  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.577833  5175 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.600265  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.601581  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.571300  4684 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.605219  4118 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.596916  5263 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:16:13.606720  5538 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:16:13.606884  5263 consensus_queue.cc:1243] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:13.607422  5263 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.607748  5263 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:13.601186  5341 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.604519  5414 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.609750  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.608657  5263 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.611995  5263 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.580329  5246 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.602941  5258 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.607100  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.615017  5258 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.583024  5484 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:13.594870  5525 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.616653  5484 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.617637  5150 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.621448  5535 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.621959  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.622845  3971 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:13.622889  4120 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:16:13.595692  5146 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:13.624722  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.621490  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.633510  3972 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
W20260709 13:16:13.625530  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46997.8us
W20260709 13:16:13.604900  5536 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:16:13.633570  3970 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:13.596103  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.636282  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:13.646642  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:13.646010  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77037.8us
I20260709 13:16:13.655573  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.637039  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:13.637953  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:13.659550  3972 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:13.639716  4682 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:16:13.640729  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:13.682920  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.684151  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.684814  4119 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.685155  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.686501  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.598943  5190 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.661168  5271 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.665114  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.691864  4112 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.692130  5526 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.681413  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.635023  5146 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.661955  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.662213  3971 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:13.650259  5373 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.647426  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:13.648577  5532 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:13.699237  5532 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:13.700776  5532 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.702054  5412 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.702247  5532 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.702626  5146 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.702785  5333 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.703940  4047 raft_consensus.cc:2368] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4.
I20260709 13:16:13.651785  5317 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.646162  5289 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.665452  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.666195  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.706274  4121 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:13.666898  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.707137  4113 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:13.667537  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.708094  4116 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.669828  5294 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.702064  5310 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.673715  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:13.709980  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75772.4us
I20260709 13:16:13.710814  5294 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:13.710937  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.711753  5373 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.675128  5441 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.657239  3970 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:13.675881  5425 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:13.696682  4115 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:13.716240  5246 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:13.692159  5534 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:16:13.705470  5333 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.654243  5529 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.671052  5263 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:13.719033  5263 consensus_queue.cc:1243] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:13.719578  5263 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:13.719883  5263 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:13.681354  5258 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.720736  5263 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:13.712113  5373 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.721745  5373 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.721990  5263 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.705587  4118 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:13.718954  5529 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.725333  5529 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.725698  5529 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.729749  5145 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.712081  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.731283  5145 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:13.731827  5145 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:13.732800  5145 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.718936  5315 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:13.737123  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90618.5us
I20260709 13:16:13.738181  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.734974  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.747417  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:13.756383  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:13.757570  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 81839.5us
I20260709 13:16:13.649535  3967 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:13.765946  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:13.768352  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.766218  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.772948  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.754364  5315 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:13.771934  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 172714us
I20260709 13:16:13.771994  4039 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:13.757097  5246 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.783442  4086 leader_election.cc:400] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4.
I20260709 13:16:13.783849  4086 leader_election.cc:403] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:16:13.784263  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.785465  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.762090  5484 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.756476  5412 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.777163  5258 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:13.794402  5258 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.795028  5258 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:13.771032  5526 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.782049  5246 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.770439  5271 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.792970  4114 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:13.792974  5297 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.793351  5412 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.774241  5317 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.782368  5315 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.791203  5289 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.790563  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.810344  5550 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:13.807056  5246 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.820367  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.815966  4038 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:13.846985  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:13.852288  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 61426.6us
I20260709 13:16:13.811100  5445 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:13.816912  5315 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.849689  5412 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.817523  5289 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.864303  5289 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.869608  5310 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:13.870956  5146 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.847558  5263 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:13.873525  5263 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.873907  5263 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.824941  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:16:13.851215  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.819691  5550 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.814477  5317 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.819876  5526 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.861483  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.859601  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.808872  5373 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.861459  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:13.879078  5297 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4.
I20260709 13:16:13.887208  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:13.862792  5484 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.818998  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:13.888950  5175 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:13.889473  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70610.6us
I20260709 13:16:13.824288  5529 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.891786  5529 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.880314  5526 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.892572  5526 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:13.894975  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:13.899467  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 109155us
I20260709 13:16:13.900789  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.901908  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.888507  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:13.905512  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 126651us
I20260709 13:16:13.907600  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:13.880401  5317 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:13.932036  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53246.7us
I20260709 13:16:13.889756  5175 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.906531  5094 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:13.931986  4684 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:13.931543  5297 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.888991  5484 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.926859  5529 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:13.937163  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48730.9us
I20260709 13:16:13.937465  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:13.945503  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:13.946200  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:13.946769  4046 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:13.931802  5146 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.931770  5150 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:13.949549  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:13.940589  5094 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:13.928932  5289 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:13.962059  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.943301  5484 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:13.962496  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.960003  4115 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:13.983377  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.943486  5529 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.948593  5310 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:13.997684  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.999161  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:13.990363  5529 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.001623  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:13.989042  5523 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:13.949282  5150 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:13.992321  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.947208  5545 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:14.010185  4117 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:13.961645  4114 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:14.002883  5146 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:13.953186  5550 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:13.948390  5423 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:16:13.948722  5190 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:13.981950  5094 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:14.025281  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90761.1us
I20260709 13:16:14.027539  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.032274  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.032212  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.010205  5150 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.034250  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:13.958583  5559 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 13:16:14.040894  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.041169  4120 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:13.955523  5246 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:14.042706  4118 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:16:14.045077  4119 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:14.030669  5545 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:14.053830  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.057657  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.046998  5289 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.071221  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:14.076043  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.037339  5145 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:16:14.038146  5297 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:16:14.102119  5297 consensus_queue.cc:1243] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:14.102385  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.050401  5545 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:14.108001  5550 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.109786  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:14.110750  5294 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.111150  5294 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:14.111485  5294 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.112833  4119 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.081880  5373 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.109845  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:14.114514  4684 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 3 LEARNER]: Advancing to term 5
I20260709 13:16:14.115433  5094 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.115833  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:14.102702  4121 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.118244  5263 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.119238  4046 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:14.120229  5263 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.120908  5445 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.122604  5294 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.090402  5172 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.091413  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.095036  5246 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:14.095945  5529 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.098256  5399 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:14.100123  5315 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.083845  5258 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.118183  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:14.084800  4115 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:14.131475  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 128638us
I20260709 13:16:14.123693  5172 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:14.065872  5190 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.163786  4118 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.170337  5172 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.171765  5172 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.117141  5443 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.174877  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:14.183790  5258 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.109963  5550 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
W20260709 13:16:14.190227  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88292.2us
I20260709 13:16:14.190678  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:14.193141  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75022.9us
I20260709 13:16:14.210448  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:14.204979  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.213869  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:14.215186  5094 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.215922  5294 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.165331  5445 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:16:14.224112  5484 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.133625  5526 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.185324  5563 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.241549  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:14.193588  5333 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.244266  4942 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.212966  5287 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:14.174034  5190 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:14.251349  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 160038us
I20260709 13:16:14.252213  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:14.225963  5556 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.226284  5175 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:14.253093  4046 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:14.255172  5150 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.256059  5529 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.226070  5341 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:16:14.257961  5532 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:14.258080  5550 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:14.258630  4684 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:14.253986  5287 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.263772  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.264513  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:14.247583  5333 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:14.305058  5333 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.247920  5315 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.253824  5094 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:14.276489  3967 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:16:14.277037  5294 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:14.277568  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93001.1us
I20260709 13:16:14.317276  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:14.279422  5317 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.281543  5150 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.285109  5175 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:14.321266  5172 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:14.307093  5287 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.321667  5175 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.322633  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.295194  5426 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:16:14.323910  5426 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.324286  5426 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:14.249820  5443 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:14.255205  5567 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:14.307037  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:14.311630  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47208.8us
I20260709 13:16:14.312417  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.314693  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.324218  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.315961  3967 pending_rounds.cc:85] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 4
I20260709 13:16:14.273905  5399 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:16:14.337117  5573 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:14.338229  4047 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:14.339614  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:14.340454  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76751.6us
I20260709 13:16:14.338619  5172 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:14.343976  5172 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.344465  5317 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.345363  4038 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:14.330554  5315 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.341622  5258 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:14.333885  5294 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:14.353247  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 44051.2us
I20260709 13:16:14.338963  3967 pending_rounds.cc:107] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:16:14.339337  5145 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.340441  5529 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:14.366510  5529 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:14.367000  5529 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.346805  5190 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.369297  5526 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.363951  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.364810  5484 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.374559  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.365383  5271 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.364712  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.381371  4047 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:14.387377  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.362998  3967 raft_consensus.cc:2889] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.413918  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.413731  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:14.461548  3970 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:14.442497  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59419.9us
I20260709 13:16:14.449813  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.463721  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:14.361559  5301 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:16:14.389171  5315 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.468897  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.467105  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:14.467188  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:14.466648  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.469605  3972 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:14.470638  5094 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:14.388803  5535 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:14.471071  5094 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:14.468225  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 106946us
I20260709 13:16:14.439618  5145 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.448796  3967 pending_rounds.cc:107] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:16:14.439446  5246 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.381371  5414 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.082s
I20260709 13:16:14.385509  5271 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:14.464736  5150 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.463557  5484 raft_consensus.cc:2764] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:16:14.439826  5149 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.501232  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.505765  3963 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:14.505916  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.506771  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:14.507045  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:14.507537  3963 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:14.507697  3970 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:14.508903  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.494077  5294 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.509509  3971 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:14.472146  5569 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:14.512086  5569 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:14.512190  3965 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.512501  5569 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.477100  5094 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.477368  4112 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:14.517159  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.517876  3964 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:14.471424  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.501442  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.471335  5535 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:14.479308  3967 raft_consensus.cc:2889] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:14.527272  3972 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:14.531059  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52198.2us
I20260709 13:16:14.532874  4041 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.535396  5271 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:14.537423  5271 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:14.542013  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.542412  5535 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.543392  5535 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:14.546314  5586 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:16:14.546792  5584 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:16:14.497125  5414 consensus_queue.cc:1243] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:16:14.550371  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79005.8us
I20260709 13:16:14.551069  4047 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:14.552335  3966 raft_consensus.cc:2410] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:14.552940  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.385586  5426 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.538894  5559 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:16:14.557200  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.573585  3972 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:16:14.554848  5333 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.578573  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.549610  5484 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.582473  4119 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:14.556915  5340 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:14.589154  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.590219  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.585240  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.587486  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.590764  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.592338  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.594190  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.596493  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:14.597088  3918 auto_rebalancer.cc:893] Removing replace marker failed: Replica 1e032f02b0aa450384dda978641ba666 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:14.597626  3918 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:16:14.597803  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.588946  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.600811  4942 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:14.572731  5150 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.579902  5145 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:14.600998  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:14.604274  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.548707  5545 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
W20260709 13:16:14.602290  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:16:14.606680  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.607290  3968 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.607385  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.609014  4117 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
W20260709 13:16:14.609221  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59922.2us
I20260709 13:16:14.610564  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.605623  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.612236  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.615408  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.622394  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.622641  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.623641  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.625592  3968 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.625633  4045 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:16:14.631465  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.605142  5315 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:14.636684  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.632920  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.637665  4044 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.605917  5289 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:14.601584  5258 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:14.634269  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.635644  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.600782  5412 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:16:14.615499  5526 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.643393  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.644090  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.646529  4120 raft_consensus.cc:2410] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:14.647503  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.629536  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.630426  5427 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:16:14.662374  5526 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.616580  5529 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.673844  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.674772  3963 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:14.675678  3967 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:14.676017  3963 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:14.676595  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.676728  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:14.677276  3967 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.677551  3963 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:14.680186  3970 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:14.686321  3967 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:14.710291  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.647374  5546 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:16:14.719146  3970 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:14.719802  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.674690  3964 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:14.672361  4114 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:16:14.642702  5315 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.722443  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.655515  5289 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.655377  5258 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.742583  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:14.743278  4044 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:14.746017  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.751230  5289 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.737782  5525 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:16:14.754179  5258 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.756110  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:14.722111  5590 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:14.720197  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.772434  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.773051  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:14.776077  5333 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.790680  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.791556  3963 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.771070  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:14.802270  5340 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:14.802394  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100360us
I20260709 13:16:14.808851  5258 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:14.811069  5258 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:14.821256  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:14.822786  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:14.824723  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:14.826226  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:14.826962  3963 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.822402  5246 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:14.829707  5556 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.830174  5596 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:14.863229  5258 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:14.869987  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.870721  4117 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:14.852550  5529 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.865303  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.844741  5246 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:14.861235  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50788.5us
I20260709 13:16:14.897955  5246 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.910476  5569 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:14.911653  3970 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:14.898715  5287 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.000s
I20260709 13:16:14.915755  5287 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.915889  5094 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:14.916395  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.917026  4112 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:14.917845  5287 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.918077  5094 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.915000  3963 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:14.918661  4040 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:14.898356  5601 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:14.927199  5563 consensus_meta.cc:287] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
I20260709 13:16:14.927636  5563 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:14.932168  4112 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:14.934002  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.934238  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:14.943810  5607 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.003s
I20260709 13:16:14.935663  5535 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:14.954243  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:14.956429  5576 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.494s	user 0.003s	sys 0.003s
I20260709 13:16:14.957077  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:14.945304  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.944131  5563 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:14.945050  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115671us
I20260709 13:16:14.949849  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.965764  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.002657  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.002997  4117 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.003855  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.005728  4113 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:15.008322  4113 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:14.966177  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.009073  4116 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.010483  5615 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:15.011525  5609 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.011880  5609 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:15.012691  5609 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:14.965595  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.963397  4114 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.017346  5609 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:14.973054  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:14.963482  5535 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.022053  5535 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.974584  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:14.976150  5599 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 13:16:14.978979  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.981515  4121 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:14.984001  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:15.023880  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44980.4us
I20260709 13:16:14.986078  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:15.024753  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.025285  5591 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:15.025727  5591 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:15.025857  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:15.026178  5258 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.026490  5535 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.026697  5591 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.026841  5443 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:15.028580  5535 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.028275  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.029968  5094 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.030380  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.031492  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.031319  5258 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.002693  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.032261  5094 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.032840  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.033012  4112 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:14.989889  5569 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:14.966547  5563 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.033937  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.034636  5569 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.035480  5563 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:14.990995  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:14.992156  5315 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:15.035931  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.036648  5315 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.037048  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.037722  5315 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.038117  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.038846  5315 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.033586  5258 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.039245  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:14.994436  5294 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.040542  5294 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.041402  5294 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.042495  5294 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.045560  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:15.050034  3970 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:15.050037  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.051195  5258 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.051811  5258 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.052549  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.053330  5094 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.053674  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.054415  5094 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.056388  5591 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.057698  5526 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:15.060523  5426 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:15.061774  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 421024us
I20260709 13:16:15.093952  4684 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:15.090685  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:15.062302  5412 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.095081  5412 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:15.095891  5412 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.097108  5412 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.103440  4042 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:15.113521  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.065814  5310 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.114291  5310 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:15.066565  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 356331us
I20260709 13:16:15.066747  5559 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:15.069495  5608 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:15.069344  3971 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:15.079007  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 127) took 9765 ms. Trace:
I20260709 13:16:15.089107  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.062703  5427 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:15.105010  4116 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:15.105705  4117 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:15.106454  4043 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:15.109283  4047 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.111150  4038 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.110448  3870 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 3 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:15.113034  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.064160  3968 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.109138  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:15.120961  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.136394  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.119827  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.136883  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:15.138157  4042 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:15.138689  4041 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:15.139429  3965 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.140405  4040 raft_consensus.cc:2410] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:15.123298  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:15.139770  3967 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:15.141501  3967 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:15.141782  3967 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:15.142002  3967 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.141515  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.126809  3963 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:15.143105  3966 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.140404  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.143889  3965 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:15.124635  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.148245  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.145594  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.150210  3963 pending_rounds.cc:85] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:15.148414  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.134343  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:15.151292  4117 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:15.150501  3963 pending_rounds.cc:107] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:15.151769  3963 raft_consensus.cc:2889] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.151249  3968 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.127377  3972 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:16:15.141146  4045 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.151479  3970 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:15.153481  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.154251  3964 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.155330  3964 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:15.154955  3870 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.126322  5559 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:15.156960  5559 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.158629  5591 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:15.161248  5427 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.165138  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.165874  5569 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:15.128187  4114 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
W20260709 13:16:15.168020  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.167038  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:15.156682  3870 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.170397  3969 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:15.170296  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.170584  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:15.171379  3967 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.171903  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.172488  3966 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 2.
I20260709 13:16:15.152346  3972 pending_rounds.cc:85] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:15.173097  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.173794  4115 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.173396  3972 pending_rounds.cc:107] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:15.174549  3972 raft_consensus.cc:2889] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.154105  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.186102  4011 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:15.189311  4046 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:15.189734  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.156649  3964 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:16:15.191215  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.167639  5094 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.194322  3966 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.196733  3870 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.195307  4115 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:15.196055  4119 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:15.175809  5569 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:15.178118  5315 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.209868  4045 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:15.206864  4119 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:15.195217  4011 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:15.129626  3868 rpcz_store.cc:276] 0709 13:16:05.313190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:05.317509 (+  4319us) service_pool.cc:224] Handling call
0709 13:16:15.078915 (+9761406us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:13.868862 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:13.869603 (+   741us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:13.869662 (+    59us) write_op.cc:435] Acquired schema lock
0709 13:16:13.869675 (+    13us) tablet.cc:662] Decoding operations
0709 13:16:13.870585 (+   910us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:13.870669 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:13.870695 (+    26us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:16:13.871415 (+   720us) tablet.cc:701] Row locks acquired
0709 13:16:13.871462 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:16:13.871621 (+   159us) write_op.cc:270] Start()
0709 13:16:13.871757 (+   136us) write_op.cc:276] Timestamp: P: 1783602973871560 usec, L: 0
0709 13:16:13.871790 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:16:13.872506 (+   716us) log.cc:844] Serialized 3315 byte log entry
0709 13:16:14.165784 (+293278us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800108d60. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:16:14.470684 (+304900us) op_driver.cc:464] REPLICATION: finished
0709 13:16:14.646475 (+175791us) write_op.cc:301] APPLY: starting
0709 13:16:14.648466 (+  1991us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:14.648679 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:14.648719 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:14.673889 (+ 25170us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:14.674163 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:16:14.674226 (+    63us) write_op.cc:312] APPLY: finished
0709 13:16:14.674536 (+   310us) log.cc:844] Serialized 64 byte log entry
0709 13:16:14.674715 (+   179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:14.674841 (+   126us) write_op.cc:454] Released schema lock
0709 13:16:14.674908 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:14.675249 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:14.675275 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1718843,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":144074,"apply.run_cpu_time_us":3074,"apply.run_wall_time_us":44532,"num_ops":8,"prepare.queue_time_us":298836,"prepare.run_cpu_time_us":58212,"prepare.run_wall_time_us":210465,"raft.queue_time_us":132052,"raft.run_cpu_time_us":18139,"raft.run_wall_time_us":107543,"replication_time_us":598717,"spinlock_wait_cycles":6138112,"thread_start_us":525088,"threads_started":4,"wal-append.queue_time_us":163158}]]}
I20260709 13:16:15.206050  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.181603  5310 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:15.212284  3969 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 3: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.193774  5526 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.214172  3870 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.192983  5561 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.212745  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.214232  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.206658  4112 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:15.215107  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:15.199853  5294 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:15.219800  3972 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.220569  3967 raft_consensus.cc:2410] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:15.222061  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.217060  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.226769  3963 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.211941  5315 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.231592  5341 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.232396  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:15.214104  5426 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.213790  5569 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:15.233036  3870 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.234302  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:15.253918  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:15.265679  3969 raft_consensus.cc:2368] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4.
W20260709 13:16:15.245450  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.200011  5591 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:16:15.254521  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:15.269137  3972 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:15.263798  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.270080  4045 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:15.271263  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.258561  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:15.225085  5294 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:15.217689  5619 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.273017  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:15.268576  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.275192  5590 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:15.275449  5441 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:15.272094  5094 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:16:15.240700  5315 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.280898  5094 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:15.281255  5094 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:15.273209  5596 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:16:15.275872  5246 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:15.282672  5246 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:15.260083  5443 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:16:15.283710  5443 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.283491  5246 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:15.284076  5443 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.276302  3967 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:15.260241  5333 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:16:15.285018  5443 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.271878  5317 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:15.286196  5443 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.276636  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:15.279067  4119 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:15.278059  3870 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.252960  5341 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:15.253203  5190 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.292184  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.267912  5445 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.297508  4119 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.276211  5294 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.277258  5619 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.285625  5333 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.278056  5563 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.311329  4942 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:15.313181  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.280503  5441 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.316084  5271 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:15.296427  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.233434  5561 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.297331  5341 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.268133  5587 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:15.323413  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.281454  5550 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:16:15.331615  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.327733  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.344444  5271 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:15.299789  5532 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.278236  5613 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:15.351562  3870 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 2, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.345804  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.350546  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.350673  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.346355  3967 pending_rounds.cc:85] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:15.354880  3967 pending_rounds.cc:107] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:15.326015  5441 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.282090  5094 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.355139  3967 raft_consensus.cc:2889] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.324193  5333 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.323995  5619 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.326620  5556 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:16:15.356689  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:15.343544  5317 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.357918  4117 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:15.397521  4117 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:15.397828  4117 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:15.398152  4117 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.324239  3970 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:15.357621  3870 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 3 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:15.307402  5588 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:16:15.351977  5258 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.353490  5271 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.381127  4942 consensus_queue.cc:1243] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 13:16:15.379623  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 81380.2us
I20260709 13:16:15.324698  5563 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.382711  5550 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.383303  5532 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.357728  4038 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:15.419328  4942 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.423336  4942 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.422508  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:15.373970  5529 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 13:16:15.387475  5591 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:15.427664  4942 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:15.432071  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 114111us
I20260709 13:16:15.357575  5569 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.429141  5591 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:15.438866  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.418394  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:15.436425  4942 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.439728  4113 raft_consensus.cc:606] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:15.422358  5550 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.424350  5588 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:16:15.453747  5550 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:15.458959  5625 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:16:15.459923  5561 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:15.460664  5627 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:16:15.463966  5559 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.464604  5615 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:15.466522  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:15.466162  5563 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.466879  5315 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.467412  5591 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.428157  5258 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:16:15.469579  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44446.5us
I20260709 13:16:15.451306  5532 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.473474  4119 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:15.473658  3965 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
W20260709 13:16:15.512308  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79543.8us
I20260709 13:16:15.516673  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:15.517989  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.518410  4942 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.484503  5310 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.522023  4942 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.521220  4121 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
W20260709 13:16:15.523413  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 170684us
I20260709 13:16:15.521816  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.524547  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.524915  3965 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:15.526230  3970 pending_rounds.cc:85] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:15.526415  4942 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.526495  3970 pending_rounds.cc:107] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:15.527464  3970 raft_consensus.cc:2889] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:15.482787  5414 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:16:15.520646  5550 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:15.616225  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 91744.5us
I20260709 13:16:15.430889  5333 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.624687  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.526114  5563 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.635231  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.636778  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.637879  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.530421  5412 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.112s
I20260709 13:16:15.642271  5246 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:15.650019  5287 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:15.650496  5287 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:15.616037  5317 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:15.658447  5094 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:15.662220  5315 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:15.683977  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 168571us
I20260709 13:16:15.685863  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.686540  5246 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.526907  5310 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.624720  5258 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
W20260709 13:16:15.732219  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 211438us
I20260709 13:16:15.688099  5641 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:15.741756  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103931us
I20260709 13:16:15.751298  3965 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:15.746941  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.686772  5643 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:16:15.755913  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.763590  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.764024  4942 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:15.764544  4942 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.766384  4942 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:15.767537  4041 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:16:15.769675  4041 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:15.773417  4041 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:15.728418  5246 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:15.802338  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:15.744220  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.808833  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.815374  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:15.815886  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 188919us
W20260709 13:16:15.801393  5526 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.000s
I20260709 13:16:15.753988  5399 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.819300  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.743216  5641 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:15.673537  5287 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.811369  5640 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:15.751464  5633 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.107s
I20260709 13:16:15.866811  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:15.874369  3971 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:15.817986  5643 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:15.862295  5443 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.005s
I20260709 13:16:15.853406  5638 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.882390  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:15.862679  5526 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:15.863757  5317 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:16:15.919952  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 193464us
I20260709 13:16:15.816385  5532 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:16:15.864158  5641 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:15.925700  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:15.878806  5315 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.883410  5640 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:15.925504  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116698us
I20260709 13:16:15.927094  4684 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:15.883003  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:15.934911  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:15.935992  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53169.1us
I20260709 13:16:15.936710  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:15.917733  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 174942us
W20260709 13:16:15.937273  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:15.941509  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:15.924669  5287 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.932282  5559 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:15.978852  5619 consensus_meta.cc:287] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.003s
W20260709 13:16:15.983626  5341 consensus_meta.cc:287] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.002s
I20260709 13:16:15.922118  5412 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:16:15.947928  5258 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:15.961292  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:16.007998  5441 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.009066  5441 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.010663  5557 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.011282  5557 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:16.012403  5639 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:16:16.013044  5640 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.998683  5443 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.001368  5633 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:16.020510  5175 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:15.993361  5317 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:16.074963  5635 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.150s
I20260709 13:16:16.076386  5557 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:16.078361  5658 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
W20260709 13:16:16.083637  5660 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:16:16.088290  3965 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:16.002383  5341 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:16.092144  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 166475us
I20260709 13:16:15.997972  5619 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:15.973822  5246 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.058719  5633 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.062024  5258 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.121658  4046 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:16.112934  5642 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:16:16.130290  5341 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.130538  5619 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.005749  5643 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.133570  5601 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:16.116550  5633 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:16.157160  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56455.1us
I20260709 13:16:16.158031  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:16.156339  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 214748us
I20260709 13:16:16.124115  5258 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.202878  5667 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.205499  5662 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.218357  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:16.204164  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:16.222811  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 350834us
W20260709 13:16:16.229322  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.240444  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:16.220912  5656 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:16:16.243196  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:16.245466  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.219735  5662 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.245829  4117 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:16.246479  4118 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:16.247709  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:16.248299  3972 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:16.251470  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.251925  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:16.252206  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.253995  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:16.258424  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.259461  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 796) took 1017 ms. Trace:
I20260709 13:16:16.259830  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:16.244858  5427 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.259846  4116 rpcz_store.cc:276] 0709 13:16:15.242040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.242378 (+   338us) service_pool.cc:224] Handling call
0709 13:16:15.253803 (+ 11425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.253999 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:16.100258 (+846259us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.258936 (+158678us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.259015 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:16.259082 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.259165 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.259415 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":839843,"prepare.queue_time_us":870868,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":147694,"threads_started":1}
W20260709 13:16:16.267138  5669 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:16:16.275389  4047 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:16.275878  3972 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:16.219477  5667 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.250072  5662 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.282146  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.285750  3972 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.286296  4085 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.287412  4085 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:16.287694  3972 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.288115  3968 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:16.291754  3968 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.258294  5647 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:16:16.274933  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:16.302387  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.303666  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.283866  5310 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.289768  5559 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:16.301388  5673 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:16:16.337589  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.297776  5647 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.290046  5557 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:16:16.342649  5661 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.300616  5643 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:16:16.336666  5310 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.354444  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.301285  5674 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 13:16:16.346882  5647 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:16.361325  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.365438  4085 leader_election.cc:400] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4.
I20260709 13:16:16.377427  5695 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.380911  5694 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.383312  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.384473  4044 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:16.361037  5317 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.385876  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.369993  5297 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.021s
W20260709 13:16:16.390897  5294 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.063s	user 0.008s	sys 0.004s
I20260709 13:16:16.391295  5294 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.391680  5297 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:16.392056  5297 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.392356  5297 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:16.393388  5294 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.396005  5667 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.398679  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 802) took 1110 ms. Trace:
I20260709 13:16:16.399013  5694 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.399501  5694 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.399860  5694 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.401156  3963 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.399048  4121 rpcz_store.cc:276] 0709 13:16:15.288074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.288698 (+   624us) service_pool.cc:224] Handling call
0709 13:16:15.308755 (+ 20057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.523521 (+214766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.398445 (+874924us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b540026acd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:16.398618 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488077184}
I20260709 13:16:16.372611  5559 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:16:16.421041  3970 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
W20260709 13:16:16.420189  5563 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.774s	user 0.005s	sys 0.005s
I20260709 13:16:16.429050  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 51) took 1106 ms. Trace:
I20260709 13:16:16.402833  5317 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:16.439157  5655 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:16:16.439670  5684 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:16:16.426699  5426 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:16.434089  5271 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.011s	user 0.013s	sys 0.002s
I20260709 13:16:16.466138  5695 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.439905  5685 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:16:16.440678  5690 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:16:16.441226  5692 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:16:16.468055  5641 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.000s
I20260709 13:16:16.468624  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 993) took 1019 ms. Trace:
I20260709 13:16:16.426827  5679 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.537801  5683 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:16.447700  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.472667  5175 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:16.439314  5687 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:16:16.487519  4042 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
W20260709 13:16:16.473397  5094 consensus_meta.cc:287] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.000s
W20260709 13:16:16.439332  5691 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:16:16.527374  3966 rpcz_store.cc:276] 0709 13:16:15.449034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.472948 (+ 23914us) service_pool.cc:224] Handling call
0709 13:16:15.501268 (+ 28320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.501503 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.501528 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:15.512390 (+ 10862us) log.cc:844] Serialized 26 byte log entry
0709 13:16:15.825097 (+312707us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:15.873176 (+ 48079us) log.cc:844] Serialized 14 byte log entry
0709 13:16:15.873412 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:15.873500 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.468424 (+594924us) raft_consensus.cc:1685] finished
0709 13:16:16.468445 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.468570 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":95401,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":75,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":5012,"thread_start_us":291723,"threads_started":1,"wal-append.queue_time_us":683992}
I20260709 13:16:16.525949  5661 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:16.551465  5414 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.544265  5441 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.552241  5587 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.552618  5587 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:16.553452  5587 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.554464  5587 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.547158  5569 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.557279  5569 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.558158  3971 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:16.559324  5569 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.560956  5333 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.538435  5683 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:16.542858  4011 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:16.430856  4120 rpcz_store.cc:276] 0709 13:16:15.322925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.436043 (+113118us) service_pool.cc:224] Handling call
0709 13:16:15.436364 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:15.436570 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:16.244273 (+807703us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.358086 (+113813us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.422899 (+ 64813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:16.422950 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:16.422993 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.428861 (+  5868us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.428992 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":695582,"prepare.queue_time_us":696172,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":86,"raft.queue_time_us":24642,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":8301,"thread_start_us":284254,"threads_started":4,"wal-append.queue_time_us":104274}
W20260709 13:16:16.551379  5697 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:16.552273  5441 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:16.531370  5317 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.565831  4942 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.551909  5414 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:16.573101  5258 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.573935  5526 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:16.577275  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:16.641710  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.577781  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:16.639297  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55018.8us
I20260709 13:16:16.579074  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.580053  5638 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.580679  4047 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 13:16:16.645399  4047 pending_rounds.cc:85] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 1
I20260709 13:16:16.645689  4047 pending_rounds.cc:107] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:16.645941  4047 raft_consensus.cc:2889] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:16.580049  4045 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.581248  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.482324  5426 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.647820  5638 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.648030  5414 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.649331  5426 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.499754  5271 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.649923  5638 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.650394  4113 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:16.649631  5414 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.651973  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.578403  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.653317  4121 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:16.581393  5613 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:16.658157  5637 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:16.658707  5637 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.659927  5563 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:16.660467  5563 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.597232  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:16.660737  5637 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.661635  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.662278  5613 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:16.663895  5529 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.664588  5685 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.664191  5613 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.665884  4038 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:16.611838  5310 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.663396  4045 raft_consensus.cc:2955] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:16.668222  4121 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.668390  4118 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.670755  4942 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:16.671241  4942 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.671746  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:16.672528  5569 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.593760  5662 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.545152  5641 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.651304  5271 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:16.677891  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.673183  4942 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.683107  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:16.683414  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.681030  4118 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.690424  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.691571  4942 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:16.691665  4040 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:16.692047  4942 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.693918  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:16.664100  5683 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.591409  5445 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 13:16:16.672905  5569 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:16.679284  5641 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.678705  5563 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.690613  5315 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.673383  5441 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:16.695048  5399 consensus_meta.cc:287] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.004s
I20260709 13:16:16.675401  5662 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.673600  5633 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.682695  5587 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:16:16.696172  5333 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.681836  5427 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.715499  4942 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.591627  5647 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.725132  5529 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:16.725600  5647 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.672751  5297 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.725733  5529 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:16.727538  5297 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.722595  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.729089  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.729601  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.700732  5569 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:16.730190  4121 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:16.731591  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.729807  3972 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:16.737593  5529 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:16.737792  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.739094  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.739868  3972 raft_consensus.cc:2410] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:16:16.740972  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.677302  5526 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:16.677472  5694 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.717047  5399 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.720927  5333 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.757457  5333 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.758591  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 786) took 1011 ms. Trace:
I20260709 13:16:16.758980  3971 rpcz_store.cc:276] 0709 13:16:15.746809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.882090 (+135281us) service_pool.cc:224] Handling call
0709 13:16:16.758442 (+876352us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54001563d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:16.758539 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1536320768}
I20260709 13:16:16.717144  5315 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.760831  4038 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:16.771626  5399 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.773746  5399 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:16.775031  5646 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.044s	user 0.010s	sys 0.003s
I20260709 13:16:16.775779  5399 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:16.778644  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.782176  3972 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.785094  3972 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:16:16.794418  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:16.794653  5633 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.796015  5633 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.796746  5643 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.797281  5643 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.799252  5643 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.779840  5641 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:16.780134  5569 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.805634  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:16.805874  5694 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.806519  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.804996  5633 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:16.809286  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 989) took 1482 ms. Trace:
I20260709 13:16:16.805956  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.811430  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.806100  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.813604  4118 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:16.809747  3967 rpcz_store.cc:276] 0709 13:16:15.326851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.327003 (+   152us) service_pool.cc:224] Handling call
0709 13:16:15.346143 (+ 19140us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:15.420162 (+ 74019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.420193 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:15.421646 (+  1453us) log.cc:844] Serialized 52 byte log entry
0709 13:16:16.582078 (+1160432us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b180021b2c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:16:16.761630 (+179552us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.769325 (+  7695us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.770018 (+   693us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.770234 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.770301 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.809086 (+ 38785us) raft_consensus.cc:1685] finished
0709 13:16:16.809105 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.809231 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10246,"prepare.queue_time_us":14223,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":53,"raft.queue_time_us":59438,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":45151,"spinlock_wait_cycles":13889280,"thread_start_us":213826,"threads_started":2,"wal-append.queue_time_us":1360665}
I20260709 13:16:16.816370  4040 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:16.820566  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.821223  4118 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:16.822196  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.803794  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 991) took 1367 ms. Trace:
I20260709 13:16:16.800525  5315 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:16.827813  5591 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.805881  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:16.855227  3963 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:16.856931  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:16.857582  3972 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:16.864535  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.830211  4112 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:16.825853  3964 rpcz_store.cc:276] 0709 13:16:15.422096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.424431 (+  2335us) service_pool.cc:224] Handling call
0709 13:16:15.481844 (+ 57413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:15.520026 (+ 38182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:15.522632 (+  2606us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.472520 (+949888us) spinlock_profiling.cc:243] Waited 7.52 ms on lock 0x7b2c000014c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:16:16.472982 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.689104 (+216122us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.702014 (+ 12910us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.716273 (+ 14259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.720426 (+  4153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.778337 (+ 57911us) raft_consensus.cc:1685] finished
0709 13:16:16.784838 (+  6501us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.789351 (+  4513us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7681,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":12973,"spinlock_wait_cycles":22114048,"thread_start_us":168138,"threads_started":1,"wal-append.queue_time_us":234809}
I20260709 13:16:16.832911  5526 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:16.833225  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.833773  5601 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:16.834641  5643 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:16.841176  5441 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:16:16.842549  5698 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
I20260709 13:16:16.884040  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.843988  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 779) took 1101 ms. Trace:
W20260709 13:16:16.845317  5680 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.552s	user 0.001s	sys 0.010s
I20260709 13:16:16.849217  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.851734  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:16.876590  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:16.886758  3972 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:16.887570  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:16.882017  5643 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.902173  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:16.884828  3965 rpcz_store.cc:276] 0709 13:16:15.742633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.798961 (+ 56328us) service_pool.cc:224] Handling call
0709 13:16:16.843842 (+1044881us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400278154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:16.843936 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247401344}
I20260709 13:16:16.891312  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.898870  5675 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.900538  5317 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.932288  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.936154  5246 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.937637  5246 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:16.937882  5662 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.938369  5662 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.940410  5662 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.940675  4114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:16.941336  4114 raft_consensus.cc:606] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:16.941674  4114 raft_consensus.cc:614] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:16.902177  5647 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:16.942700  5647 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.935527  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:16.944918  4942 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:16.945245  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:16.945410  4942 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:16.943650  5641 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.951053  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 789) took 1202 ms. Trace:
I20260709 13:16:16.882889  5441 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:16.902009  5526 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:16.933707  5557 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:16.933454  5683 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:16.971478  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63557us
W20260709 13:16:16.968053  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 99587.8us
I20260709 13:16:16.967321  4942 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.948734  5094 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:16.948734  5640 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:16.929855  5315 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 13:16:16.951419  3968 rpcz_store.cc:276] 0709 13:16:15.748431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.298617 (+550186us) service_pool.cc:224] Handling call
0709 13:16:16.298931 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.300832 (+  1901us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:16.338281 (+ 37449us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.388151 (+ 49870us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:16.417113 (+ 28962us) log.cc:844] Serialized 26 byte log entry
0709 13:16:16.417289 (+   176us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:16.424500 (+  7211us) log.cc:844] Serialized 14 byte log entry
0709 13:16:16.425122 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:16.425220 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:16.841954 (+416734us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:16.950835 (+108881us) raft_consensus.cc:1685] finished
0709 13:16:16.950862 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:16.950998 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25423,"prepare.queue_time_us":48221,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2764,"raft.queue_time_us":1803,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":30808,"spinlock_wait_cycles":22148992,"thread_start_us":28532,"threads_started":1,"wal-append.queue_time_us":100001}
I20260709 13:16:16.986101  4039 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:16.949728  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116581us
I20260709 13:16:16.990950  5647 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:16.992091  5426 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:16.993095  5333 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:16.993453  5333 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:16.993696  5426 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:16.980361  5557 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:16.952987  5637 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:16:16.889881  5601 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:16.980567  5683 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.007443  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.007803  5526 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.007537  5094 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.009950  5556 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:17.010746  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:16.981652  5640 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.021245  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.030252  4045 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:16.950337  5675 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.011283  5535 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.012030  5637 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:17.014720  5683 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.016824  5635 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.019721  5246 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.029212  5640 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.022917  5557 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.039345  5341 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:17.018877  5526 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.065469  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 1029) took 1331 ms. Trace:
I20260709 13:16:17.071695  4046 rpcz_store.cc:276] 0709 13:16:15.733773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.734251 (+   478us) service_pool.cc:224] Handling call
0709 13:16:15.734599 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:16.122137 (+387538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.065204 (+943067us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b540035cfd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:17.065406 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882876672}
I20260709 13:16:17.011615  5441 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.047679  5333 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.081552  5333 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:17.065698  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49596.4us
I20260709 13:16:17.035794  5094 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.048481  5662 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.036180  5443 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:16:17.069919  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59260.5us
I20260709 13:16:17.065303  5633 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:17.070255  5557 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.087798  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.093598  3972 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [3.2-4.3]
I20260709 13:16:17.095424  4119 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:16:17.089781  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.089979  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.091526  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:17.097350  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.097990  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:17.098654  4119 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.092702  3968 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:17.099493  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:17.077092  5638 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.079651  5569 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.065058  5246 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.102313  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.102723  3967 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [4.2-4.2]
I20260709 13:16:17.107656  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.109772  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.111586  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.112744  3965 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:17.103654  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.081965  5341 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:17.117997  5310 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:17.113126  5724 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:17.119529  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.119808  5724 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:17.120306  5315 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:17.120697  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.121513  5443 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.121770  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.122047  5414 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.122370  3965 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:17.122390  5414 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:17.124053  5414 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.105940  5638 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.125232  5414 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.123155  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.130125  5246 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.130542  3965 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:17.132543  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.133708  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.134011  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.134366  4039 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:17.142828  5643 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.143479  5643 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:17.088840  5662 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.146668  5662 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.108258  3964 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:17.148824  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.119446  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:17.106451  4038 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:17.117959  4119 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:17.158260  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.158825  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.155058  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.159287  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.166326  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.158511  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.169691  3968 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.170876  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.173645  5662 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.174065  5662 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.174400  5662 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.183797  3964 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:17.173069  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.130650  5246 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.190024  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.105753  5427 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:16:17.101411  5557 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.187464  5723 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.188936  5569 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:17.194806  5694 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.157598  5443 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.192745  5414 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.120736  5724 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.194947  5647 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:17.214936  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:17.217209  5310 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.201855  5246 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.233350  5427 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:17.238953  5271 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.225410  5341 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:17.266037  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 93029.8us
I20260709 13:16:17.240466  5569 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:17.247323  5601 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.248126  5675 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.252892  5310 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.225939  5723 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:17.305523  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.262964  5271 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:17.301752  5722 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.277021  5427 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:17.292589  5310 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.240756  5662 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.312455  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:17.295413  5647 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:17.324019  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 134059us
I20260709 13:16:17.309432  5094 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.325743  5315 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.366606  4942 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.323463  5647 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:17.326086  5613 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.367089  4942 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.362928  5725 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.375344  4942 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:17.369657  5715 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:16:17.382792  5644 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.306s	user 0.005s	sys 0.000s
I20260709 13:16:17.322383  5722 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.370713  5668 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.369051  5315 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.463745  5647 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:17.464325  5729 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:16:17.464427  5613 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:17.465034  5726 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:16:17.359063  5569 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.469566  5722 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.469971  5427 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.464521  5735 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:17.503944  5735 consensus_queue.cc:1243] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:17.504403  5735 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:17.504701  5735 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:17.386970  5725 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.397941  5557 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.367091  5271 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.478869  5563 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:16:17.479610  5733 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:16:17.480564  5732 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:16:17.469794  5715 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:16:17.482064  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:17.507323  5591 consensus_meta.cc:287] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.000s
I20260709 13:16:17.485764  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:17.486616  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 156834us
W20260709 13:16:17.385097  5731 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:16:17.361825  5640 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.469797  5723 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:17.490458  5716 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 13:16:17.476511  5683 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:17.528851  5426 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.529055  5094 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.530285  5683 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.530000  5735 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:17.508471  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:17.531293  5700 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.971s	user 0.000s	sys 0.002s
W20260709 13:16:17.484850  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.502115  5747 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.533046  5747 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.533784  5647 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.535115  5747 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.535470  5725 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.537508  5556 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.506407  5613 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.525888  5315 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.539932  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.498564  5668 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:17.516985  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:17.540522  4047 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.515312  5563 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:17.541463  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.537912  5341 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.533639  5271 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.543473  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.543949  4046 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:17.541839  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.544724  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.551401  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.552881  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:17.553267  5720 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.418s	user 0.001s	sys 0.000s
I20260709 13:16:17.553841  5613 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.545054  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.555119  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.531243  5735 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.520386  5246 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.546545  4044 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:17.578527  4044 pending_rounds.cc:85] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 2
I20260709 13:16:17.578825  4044 pending_rounds.cc:107] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:17.579047  4044 raft_consensus.cc:2889] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.538033  5556 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.581897  5556 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.536494  5426 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.548102  5563 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.583312  5563 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.554550  5341 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.586393  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.586647  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.586848  5341 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.587145  4040 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:17.548585  5668 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.556035  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:17.599951  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43989.8us
I20260709 13:16:17.600706  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.601830  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.601966  5310 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.603051  5730 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.603358  5725 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.603964  5310 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.550068  4683 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:17.603134  5728 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.605245  5744 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:17.608246  5663 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.608364  4047 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:17.611464  5640 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.617910  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:17.558043  5675 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:16:17.618774  5613 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.619153  5613 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.619488  5613 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:17.623201  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 68230.9us
I20260709 13:16:17.624207  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.625290  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.626034  5663 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:17.626377  5663 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.626706  5663 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.618904  5675 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:17.635236  5675 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:17.635437  5640 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.634217  5734 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.636945  5675 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.638068  5675 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:17.640990  5745 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:16:17.634163  5662 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.637082  5640 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.633109  5747 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:16:17.657286  4120 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 2. Current term is 3. Ops: []
I20260709 13:16:17.643438  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36870 (request call id 64) took 2319 ms. Trace:
I20260709 13:16:17.646560  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:17.648118  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.661415  4117 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:17.662746  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.663234  4119 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:17.663949  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.664677  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.658936  4115 rpcz_store.cc:276] 0709 13:16:15.326271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.460707 (+134436us) service_pool.cc:224] Handling call
0709 13:16:17.643187 (+2182480us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400080f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76452735 00007fed7644a9fa 00007fed7b4124c9 00007fed7498ec54 00007fed7498ebe2 00007fed7498eb11 00007fed7498ea8c 00007fed7498dd42 00007fed7478748c 00007fed747868c6
0709 13:16:17.643365 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198456064}
I20260709 13:16:17.666066  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.665880  5529 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.669212  5685 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.671259  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:17.675103  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.675932  4116 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:17.677536  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.682052  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:17.683166  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.683844  4119 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:17.684551  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.687759  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.688294  4116 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:17.690160  4117 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:17.691172  4112 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:17.691365  4117 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 13:16:17.693562  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.666081  5657 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.670560  5315 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.697943  4119 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:17.672355  5728 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.699914  4119 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:17.669720  5685 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.701917  5685 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.704198  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.678988  5529 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.692186  5640 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.707896  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.708876  5529 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.703785  5315 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.703455  5657 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.714089  5315 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.716305  5535 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.716791  5535 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.718705  5535 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.724066  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.724720  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:17.725832  4120 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:17.727903  5663 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.711403  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:17.711967  4117 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
W20260709 13:16:17.733695  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.735162  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.737028  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.738591  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.739224  4039 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:17.740787  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.739308  5526 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.743388  5657 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:17.780071  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44994.3us
I20260709 13:16:17.785461  4119 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:17.761468  5532 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.787632  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.789067  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.774158  5663 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.779945  5638 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.789698  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.790452  4042 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:17.791455  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.791834  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:17.792750  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.793016  5636 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.795089  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.794329  5445 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.788476  5550 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.797580  5550 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:17.798395  5750 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:16:17.799535  5550 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.802873  5638 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.803386  5638 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.805091  5647 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.796932  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.805418  5638 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.806627  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.807165  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.807883  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.808481  5399 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.808691  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.809012  5399 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.807337  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.810125  4115 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:17.811039  5399 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.810343  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.812644  5647 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.812428  4112 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:17.814795  5647 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:17.793790  5556 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:17.793298  5341 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:17.793277  5637 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:17.820741  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.815667  3970 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:17.807165  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.810515  4115 pending_rounds.cc:85] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:17.818840  4042 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.819339  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.816368  4119 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:17.820019  5637 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.904110  4120 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:17.821741  4044 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:17.905633  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.824052  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.907018  4038 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:17.906073  5637 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:17.848538  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.908123  4112 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:17.909061  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:17.909668  4112 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.843690  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.921064  4112 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:17.921336  4038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "293c0ff21e6f4e9f93555aaba177566b"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:17.922869  4115 pending_rounds.cc:107] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 4.3
W20260709 13:16:17.922931  5664 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.023s	sys 0.023s
I20260709 13:16:17.923345  4115 raft_consensus.cc:2889] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:17.869326  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.821928  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.924947  4041 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:17.795037  5636 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.925354  5638 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.903806  4117 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:17.925836  5638 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.925750  5636 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.926457  5638 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.921715  4043 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
W20260709 13:16:17.923030  5754 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:16:17.933333  5685 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.933571  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 901) took 1691 ms. Trace:
W20260709 13:16:17.925261  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103463us
I20260709 13:16:17.933842  5685 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.936545  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.937004  4113 rpcz_store.cc:276] 0709 13:16:16.242414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.242536 (+   122us) service_pool.cc:224] Handling call
0709 13:16:16.242858 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.650851 (+407993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.933322 (+1282471us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54002ea754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:17.933515 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":936609536}
I20260709 13:16:17.939706  4042 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:17.940582  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.936268  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:17.826905  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.941601  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.821931  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.942070  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.942418  3938 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.942783  4119 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 3: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:17.943996  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:17.945089  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:17.944566  5535 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:17.923653  5664 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.024s	sys 0.023s
I20260709 13:16:17.946380  5685 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.940537  5526 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:17.947073  5315 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.947181  5526 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.947593  5315 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.949200  5526 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.949505  5315 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.949083  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.953859  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.954205  5662 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:16:17.957266  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.959157  5640 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:17.959568  5640 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:17.959941  5640 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:17.960089  5714 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.848s	user 0.002s	sys 0.000s
I20260709 13:16:17.961529  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.962702  5637 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.964058  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.965946  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.966382  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.966995  4045 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:17.952329  5694 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:17.968025  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:17.955121  5685 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:17.980105  5685 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:17.980585  5685 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:17.993928  5637 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:17.923848  5613 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:18.002635  5613 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:18.003123  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:17.970747  5728 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:18.004254  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.004570  5728 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.004956  5728 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:18.005280  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.005744  5728 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.006975  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 803) took 1319 ms. Trace:
I20260709 13:16:18.008498  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.009578  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:17.969595  5526 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:18.010306  5526 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:18.011179  5526 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.971329  5529 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.013559  5529 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.013206  3867 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 3, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:18.014823  3867 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:18.016528  3867 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 3 to 5, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 5 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:18.019162  3870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 137) took 11623 ms (client timeout 15000 ms). Trace:
I20260709 13:16:18.022734  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.023988  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:18.024482  3968 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.950785  5638 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:18.019593  3870 rpcz_store.cc:269] 0709 13:16:06.396138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:06.400859 (+  4721us) service_pool.cc:224] Handling call
0709 13:16:18.019074 (+11618215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:15.660282 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:15.661056 (+   774us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:15.661097 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:16:15.661120 (+    23us) tablet.cc:662] Decoding operations
0709 13:16:15.662211 (+  1091us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:15.662269 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:15.662292 (+    23us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:16:15.726105 (+ 63813us) tablet.cc:701] Row locks acquired
0709 13:16:15.728655 (+  2550us) write_op.cc:260] PREPARE: finished
0709 13:16:15.752052 (+ 23397us) write_op.cc:270] Start()
0709 13:16:15.801408 (+ 49356us) write_op.cc:276] Timestamp: P: 1783602975743067 usec, L: 0
0709 13:16:15.806098 (+  4690us) op_driver.cc:348] REPLICATION: starting
0709 13:16:15.924193 (+118095us) log.cc:844] Serialized 4028 byte log entry
0709 13:16:16.412460 (+488267us) op_driver.cc:464] REPLICATION: finished
0709 13:16:16.746129 (+333669us) write_op.cc:301] APPLY: starting
0709 13:16:16.746845 (+   716us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:16.747100 (+   255us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:16.760406 (+ 13306us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:16.793426 (+ 33020us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:16.793625 (+   199us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:16:16.793670 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:16.793921 (+   251us) log.cc:844] Serialized 76 byte log entry
0709 13:16:16.806137 (+ 12216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:16.806328 (+   191us) write_op.cc:454] Released schema lock
0709 13:16:16.806387 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:16.808232 (+  1845us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:16.808267 (+    35us) write_op.cc:454] Released schema lock
0709 13:16:16.939898 (+131631us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644932a 00007fed763cef14 00007fed763ceec3 00007fed763cee38 00007fed763cedf3 00007fed763ce0dc 00007fed763f7e16 00007fed763dfcbb 00007fed763ca39d 00007fed763cdd75
Metrics: {"mutex_wait_us":617091,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":302480,"apply.run_cpu_time_us":4443,"apply.run_wall_time_us":62123,"num_ops":10,"prepare.queue_time_us":195520,"prepare.run_cpu_time_us":31995,"prepare.run_wall_time_us":455694,"raft.queue_time_us":230019,"raft.run_cpu_time_us":122582,"raft.run_wall_time_us":575624,"replication_time_us":577348,"spinlock_wait_cycles":8856832,"thread_start_us":631148,"threads_started":4,"wal-append.queue_time_us":206918,"wal-append.run_cpu_time_us":21839,"wal-append.run_wall_time_us":1664967}]]}
I20260709 13:16:18.026371  5638 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.027493  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:18.028514  5721 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.902s	user 0.002s	sys 0.000s
I20260709 13:16:18.028595  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.029381  3963 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:17.946421  5535 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:17.975682  4684 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:18.030151  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:17.977031  5641 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:17.977231  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.043659  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:18.044147  4116 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:17.979095  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:17.979192  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.967027  5657 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:17.997843  5757 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:16:18.007329  3971 rpcz_store.cc:276] 0709 13:16:16.688063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.778960 (+ 90897us) service_pool.cc:224] Handling call
0709 13:16:16.779273 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:16.782771 (+  3498us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:16.785418 (+  2647us) log.cc:844] Serialized 14 byte log entry
0709 13:16:17.008481 (+223063us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.008961 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.009088 (+   127us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:17.009119 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.009187 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:17.959561 (+950374us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:18.006701 (+ 47140us) raft_consensus.cc:1685] finished
0709 13:16:18.006805 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.006919 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9707,"prepare.queue_time_us":7210,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":66498,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":3788,"spinlock_wait_cycles":83566464,"thread_start_us":184122,"threads_started":1,"wal-append.queue_time_us":276101}
I20260709 13:16:18.054478  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.009528  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:17.971055  5663 raft_consensus.cc:993] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:17.973907  4680 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:18.005765  4045 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.013919  5529 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.037511  4038 raft_consensus.cc:606] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Received request to transfer leadership to TS 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:18.069200  4038 raft_consensus.cc:614] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:17.967962  4120 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:18.042515  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.055843  4119 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:18.006975  5728 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.064203  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:17.955765  5636 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.071341  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:18.078768  4116 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:18.079964  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:18.083283  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.053671  5657 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.042623  5641 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.016498  5640 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.069491  5615 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.115643  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.094599  3963 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:18.077205  5443 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.110422  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.118254  4044 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:18.091989  4045 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:18.116833  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:18.118495  4043 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:18.073964  5663 raft_consensus.cc:1081] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:18.119931  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.085583  5569 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.084936  5638 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:18.112416  5657 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.124847  3966 raft_consensus.cc:2368] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:18.122473  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.124293  3963 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:18.123047  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:18.084664  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 105685us
I20260709 13:16:18.111935  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 914) took 1133 ms. Trace:
I20260709 13:16:18.126245  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.128322  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.130856  4045 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:18.120313  5297 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:18.136518  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.136996  3963 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:18.122941  5662 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:18.122816  5647 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.137156  3968 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:18.109270  5643 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:16:18.125871  5569 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.126567  5694 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.135673  5741 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:18.128710  5638 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:18.150941  4046 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:18.153251  4045 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:18.156126  5636 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.141945  5662 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.145354  5569 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.173372  5641 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.164609  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:18.175630  4680 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.176522  5640 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.156373  3968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:18.186533  3968 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:18.186903  3968 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.177369  5638 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.145653  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:18.165680  5662 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.201810  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.202190  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.203538  4117 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:18.218660  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.219604  4121 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:18.175552  5685 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.232620  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:18.212548  5535 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:18.213177  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 73701.1us
I20260709 13:16:18.243839  4085 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:18.244203  5760 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:16:18.236456  5647 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:18.272562  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.133327  4114 rpcz_store.cc:276] 0709 13:16:16.977773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:16.980215 (+  2442us) service_pool.cc:224] Handling call
0709 13:16:16.988624 (+  8409us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:16.991067 (+  2443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:16.991101 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:16.991769 (+   668us) log.cc:844] Serialized 52 byte log entry
0709 13:16:17.070355 (+ 78586us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:16:17.073746 (+  3391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:17.079289 (+  5543us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.027990 (+948701us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:18.030273 (+  2283us) raft_consensus.cc:1685] finished
0709 13:16:18.041218 (+ 10945us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.111460 (+ 70242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":547,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"spinlock_wait_cycles":61215616,"thread_start_us":55625,"threads_started":1,"wal-append.queue_time_us":134121}
I20260709 13:16:18.315613  5647 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.345762  5647 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:18.420392  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 176627us
I20260709 13:16:18.428042  3968 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.314786  5694 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.459082  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 817) took 1298 ms. Trace:
I20260709 13:16:18.454298  5685 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.455039  5258 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.466677  5315 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.468119  5727 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.472316  5526 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.513957  5526 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.516336  5526 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.501745  5258 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.520840  5727 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.522826  5258 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.523135  5727 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.488911  5747 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:18.524842  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 915) took 1432 ms. Trace:
I20260709 13:16:18.501242  3968 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.525943  5426 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.525205  4118 rpcz_store.cc:276] 0709 13:16:17.092648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.092781 (+   133us) service_pool.cc:224] Handling call
0709 13:16:17.100594 (+  7813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.216687 (+116093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.216726 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.245220 (+ 28494us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.384894 (+139674us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:17.384937 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.524439 (+1139502us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001446d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:18.524485 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.524531 (+    46us) raft_consensus.cc:1685] finished
0709 13:16:18.524543 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.524783 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3021,"raft.queue_time_us":30508,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":11576,"spinlock_wait_cycles":259133312,"thread_start_us":111410,"threads_started":1,"wal-append.queue_time_us":203680,"wal-append.run_cpu_time_us":1389,"wal-append.run_wall_time_us":1001545}
I20260709 13:16:18.509783  5441 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.526588  5663 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:18.526981  5663 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:18.527776  5663 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:18.536362  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 719362us
I20260709 13:16:18.538918  5640 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.539453  5640 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:18.542588  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 747489us
I20260709 13:16:18.544021  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 819) took 1370 ms. Trace:
I20260709 13:16:18.487007  5717 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.546660  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:18.547322  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.544489  3965 rpcz_store.cc:276] 0709 13:16:17.173157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.610652 (+437495us) service_pool.cc:224] Handling call
0709 13:16:17.610982 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.611165 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:18.138307 (+527142us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.541291 (+402984us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.543639 (+  2348us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.543703 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:18.543748 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.543853 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.543964 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":451135,"prepare.queue_time_us":565831,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":66,"raft.queue_time_us":331,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":16178,"thread_start_us":444219,"threads_started":2}
I20260709 13:16:18.552826  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.555442  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.559100  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.560075  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.560307  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.561000  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.561280  4044 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:18.561830  4046 raft_consensus.cc:2410] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:18.553994  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:18.563030  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.563584  4046 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.567243  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.568317  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.459637  3972 rpcz_store.cc:276] 0709 13:16:17.161517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.526716 (+365199us) service_pool.cc:224] Handling call
0709 13:16:17.526983 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.527148 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:18.134290 (+607142us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.458695 (+324405us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.458746 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.458788 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.458910 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.459026 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":501089,"prepare.queue_time_us":646782,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":2522,"thread_start_us":429560,"threads_started":2}
I20260709 13:16:18.569880  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.570421  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.571000  4039 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.571658  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:18.572636  4116 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.573164  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.573778  3966 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:18.512384  5657 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.577126  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 992) took 3143 ms. Trace:
I20260709 13:16:18.576356  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.578428  4043 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.586140  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.586898  3968 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:18.545990  5341 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:18.577522  3969 rpcz_store.cc:276] 0709 13:16:15.434133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:15.434299 (+   166us) service_pool.cc:224] Handling call
0709 13:16:17.081210 (+1646911us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:17.081391 (+   181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:17.657359 (+575968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:17.657391 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:17.657859 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:16:17.692680 (+ 34821us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:16:18.496427 (+803747us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.496669 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.576840 (+ 80171us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540030be54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:18.576896 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:18.576941 (+    45us) raft_consensus.cc:1685] finished
0709 13:16:18.576952 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.577071 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380624,"prepare.queue_time_us":481910,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":3148,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":8444,"spinlock_wait_cycles":1353070720,"thread_start_us":453490,"threads_started":2,"wal-append.queue_time_us":48859}
I20260709 13:16:18.557490  5414 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.566936  5426 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.604355  4041 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:18.602613  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:18.636309  4120 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.004s
I20260709 13:16:18.637971  3971 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 5. Ops: []
I20260709 13:16:18.638551  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:18.638849  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 94082.1us
I20260709 13:16:18.639786  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.640897  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:18.613675  4116 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
W20260709 13:16:18.616024  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.558578  5569 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.646500  5724 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:18.647747  5569 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.648928  3970 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:18.568382  4680 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:18.575304  5612 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:18.657841  5749 raft_consensus.cc:2764] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:16:18.659832  5657 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.607028  5341 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:18.661448  5341 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.662204  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.664927  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.665588  5640 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.666275  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.630728  5414 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.668516  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.674889  3968 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:18.669327  4046 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:18.667032  3969 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:18.677857  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:18.677922  4043 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
W20260709 13:16:18.674152  5529 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.592s	user 0.013s	sys 0.019s
I20260709 13:16:18.642373  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:18.565093  5717 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.633770  5315 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:18.683660  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:18.683713  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:18.692082  3971 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.692646  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:18.694562  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:18.625095  5650 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:18.684847  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.698668  3967 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:18.687201  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:18.662365  5341 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:18.683106  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72988.2us
I20260709 13:16:18.696230  4118 raft_consensus.cc:2410] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:18.706144  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:18.688930  5297 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:18.707324  4942 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:18.716238  5445 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:18.715835  5426 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:18.695278  4114 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.694119  5526 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:18.732622  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 310562us
I20260709 13:16:18.689796  5556 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:18.686282  5529 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.702944  5532 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:18.743947  3971 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:18.748917  4942 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:16:18.746014  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51814us
I20260709 13:16:18.709842  5783 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:18.731884  5776 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:16:18.752094  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:18.755303  4115 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.755625  4115 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:18.756059  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.752846  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.756887  4119 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:18.753676  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.758005  4112 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:18.757345  4117 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:18.760355  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:18.760946  4112 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.764365  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:18.764977  4113 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.705207  5637 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:18.705360  5591 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:18.708372  5588 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:18.728549  5297 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:18.756346  4115 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.784608  4115 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.785596  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:18.776227  4121 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:18.732787  5426 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:18.730135  5445 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:18.697217  5315 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:18.778805  5532 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:18.778710  5526 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:18.845758  5526 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.847330  5613 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.847736  5613 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:18.849231  5717 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.783326  5786 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:18.849989  5786 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.851935  5786 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.852567  5663 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:16:18.854091  5662 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.637s	user 0.021s	sys 0.009s
I20260709 13:16:18.854465  5662 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.856382  5662 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:18.786031  5637 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:18.848466  5613 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.858189  5317 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:18.858760  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.859058  4047 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:18.710152  5650 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:18.780279  5728 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.698s	user 0.016s	sys 0.017s
I20260709 13:16:18.745579  5246 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:18.884035  4113 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:18.858256  5613 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.793037  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:18.798311  4112 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:18.755030  5783 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.739283  5647 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.783234  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.786420  5782 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:18.799630  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 135265us
I20260709 13:16:18.813490  5532 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.822285  5414 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:18.828467  5297 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.890909  5783 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:18.900185  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 887) took 1163 ms. Trace:
I20260709 13:16:18.832535  5529 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:18.900573  4047 rpcz_store.cc:276] 0709 13:16:17.736593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.740478 (+  3885us) service_pool.cc:224] Handling call
0709 13:16:18.900005 (+1159527us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540011a3d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:18.900102 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570035968}
I20260709 13:16:18.836934  5443 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:18.901355  5443 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:18.902200  5443 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.836982  5724 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:16:18.903273  5724 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:18.903379  5443 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.904093  5724 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.906422  5637 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:18.906972  5637 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:18.907819  5637 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:18.909500  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 932) took 1093 ms. Trace:
I20260709 13:16:18.859289  5662 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:18.790563  4121 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:18.799768  5426 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:18.801633  5445 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.807232  4115 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
W20260709 13:16:18.891160  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 98210.7us
W20260709 13:16:18.837819  5781 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:16:18.869166  4039 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:18.858691  5317 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.912531  4120 rpcz_store.cc:276] 0709 13:16:17.816571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:17.953233 (+136662us) service_pool.cc:224] Handling call
0709 13:16:17.953467 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:17.953603 (+   136us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:16:17.967636 (+ 14033us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.636990 (+669354us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.675489 (+ 38499us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.909156 (+233667us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:18.909211 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:18.909251 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.909312 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:18.909448 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3658,"prepare.queue_time_us":13946,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":402140,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":41795,"thread_start_us":233237,"threads_started":1}
I20260709 13:16:18.913863  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.914093  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.914366  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.915381  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:18.928373  4038 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:18.915613  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.918754  5662 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:18.929343  4044 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:18.916795  5529 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:18.911957  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 128796us
I20260709 13:16:18.913792  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:18.918720  5724 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:18.898052  5650 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:18.942596  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 204640us
I20260709 13:16:18.945024  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:18.926962  5739 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:18.953979  4085 leader_election.cc:400] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:18.957261  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:18.936655  5315 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:18.957273  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:16:18.959496  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 318337us
I20260709 13:16:19.016779  5315 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:18.986210  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:18.986876  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.029309  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 1040) took 1062 ms. Trace:
I20260709 13:16:18.985443  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.001575  5633 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:19.022718  5317 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:18.980074  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:18.941831  5643 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:16:19.000073  5782 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:19.016952  5685 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.033483  4038 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:18.952747  5786 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:19.012297  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:19.039613  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 332637us
I20260709 13:16:19.000415  5445 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:19.040504  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 245800us
W20260709 13:16:19.039959  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 322758us
I20260709 13:16:19.044422  5728 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:19.049467  3971 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:19.048938  3970 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:19.047856  3963 rpcz_store.cc:276] 0709 13:16:17.967230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.139991 (+172761us) service_pool.cc:224] Handling call
0709 13:16:18.140270 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:18.140683 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:16:18.251525 (+110842us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.578003 (+326478us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:18.578413 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:16:18.578532 (+   119us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:18.598298 (+ 19766us) log.cc:844] Serialized 14 byte log entry
0709 13:16:18.598511 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:18.598576 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:19.019894 (+421318us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b18000cdb40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:16:19.029056 (+  9162us) raft_consensus.cc:1685] finished
0709 13:16:19.029082 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:19.029242 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":54236,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":7006,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":49980,"spinlock_wait_cycles":6971776,"thread_start_us":361273,"threads_started":2,"wal-append.queue_time_us":373689}
W20260709 13:16:19.058365  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101613us
I20260709 13:16:18.980448  4114 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:19.071782  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:19.076455  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:19.060288  5727 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:19.078310  4011 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.051406  5633 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:19.088882  5727 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:19.089335  5727 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.090029  5723 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.089720  5633 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.082434  5635 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.090407  5723 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.090783  5723 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.059777  5315 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.091902  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:19.078650  5728 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.093685  5647 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.094954  5728 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.079836  5612 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:19.095729  5612 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:19.069067  5685 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.097075  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.097779  5333 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:19.098057  5685 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.098289  5333 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:19.077245  5784 raft_consensus.cc:2764] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:16:19.098703  5612 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:19.086726  5441 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:19.073693  5662 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.093040  4942 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:19.112378  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:19.117964  3970 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:19.124053  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.125427  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.128304  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:19.129140  4120 raft_consensus.cc:2368] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5.
I20260709 13:16:19.128381  4116 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:19.130981  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:19.131522  4116 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.138535  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.139178  4120 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:19.140641  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:19.141585  4120 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.144451  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.145315  4115 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:19.147050  4115 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:16:19.147390  4115 pending_rounds.cc:85] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:19.147589  4115 pending_rounds.cc:107] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:16:19.147799  4115 raft_consensus.cc:2889] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:19.149669  4115 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:19.151546  3971 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:19.093073  5315 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.112820  5635 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 13:16:19.155683  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 76794.9us
I20260709 13:16:19.162150  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.115237  5612 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:19.113628  5317 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:19.082724  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e20b6631af674e838a0accf36c31749f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:19.172068  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:19.151710  5794 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.099175  5333 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.176800  4121 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:19.180186  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:19.173089  5317 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.183226  5317 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.183703  5636 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:19.184062  5636 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:19.185043  5728 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:19.185282  5315 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.172923  5612 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:19.166705  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 84011.2us
I20260709 13:16:19.191692  4116 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:19.194339  4120 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:19.165607  5633 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.199426  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:19.200567  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.220743  4011 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:19.223516  3971 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:19.225639  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.227047  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.240937  4012 leader_election.cc:400] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5.
I20260709 13:16:19.241421  4012 leader_election.cc:403] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:16:19.241811  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.242029  5532 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5.
I20260709 13:16:19.243258  4116 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:19.244275  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:19.196619  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.186064  5636 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.185544  5728 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.205384  5643 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.205139  5685 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:16:19.255185  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 191902us
I20260709 13:16:19.284647  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:19.286702  3966 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:19.288168  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59305.8us
I20260709 13:16:19.288918  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.192855  5794 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.246925  5591 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.302930  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:19.312333  4117 raft_consensus.cc:606] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:19.312656  4117 raft_consensus.cc:614] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:19.305173  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.305912  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:19.306509  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.309049  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.309275  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:19.310460  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:19.249653  5587 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.246613  5317 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.250134  5526 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:19.315583  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.247913  5246 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:16:19.289460  5685 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.344594  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.356204  3971 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:19.344660  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:19.301321  5445 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.289043  5643 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.247722  5588 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:16:19.301767  5636 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.248835  5635 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:16:19.285081  5441 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:16:19.252777  5426 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:19.359350  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43845.3us
I20260709 13:16:19.374974  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.362952  3964 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:19.363678  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53288.4us
I20260709 13:16:19.364557  4044 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:19.376408  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:19.345500  5796 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:19.347904  5786 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:19.376652  5805 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:16:19.317916  5647 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:16:19.358647  5685 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.362179  5725 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.366256  5798 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.389869  4043 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:19.368643  5643 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.381104  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.381299  5796 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:19.393556  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 102825us
I20260709 13:16:19.394974  4942 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:19.416118  4040 raft_consensus.cc:2368] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6.
I20260709 13:16:19.392549  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:19.381476  5635 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:19.371793  5650 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:19.378829  5804 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:16:19.424329  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.383076  5258 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.428288  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:19.419678  5803 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:16:19.392714  5694 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.428983  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.383611  5315 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 13:16:19.288909  5532 consensus_queue.cc:1175] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3fa9d459de485e824f023c55580bc6" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:16:19.433401  5811 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:16:19.437721  5802 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:16:19.475713  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:19.447490  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.423194  5443 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:16:19.485555  5662 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:19.435448  5591 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:16:19.511725  5727 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.429813  5414 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.427702  5725 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.430205  5786 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.439396  5694 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.422619  5798 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:19.495656  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48241.3us
I20260709 13:16:19.496145  5717 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.526837  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.509892  5796 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.510068  5556 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.431700  5794 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.512281  5591 consensus_queue.cc:1243] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:19.472982  5258 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.492543  5741 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:19.523211  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.523588  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.524775  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.543248  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.543996  4120 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:19.537333  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.546087  4045 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:19.546906  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.547464  4045 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:19.437925  5800 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:19.483186  5612 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:19.579054  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.533455  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:19.533932  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.580331  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.581584  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.536480  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.582839  4044 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.586449  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.527067  5315 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:19.536653  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 144180us
W20260709 13:16:19.495308  5810 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:16:19.539537  4118 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:19.542321  4112 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:19.518530  5694 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.575886  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:19.594420  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 118366us
I20260709 13:16:19.577914  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.531147  3969 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:19.592691  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:19.591137  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 168460us
I20260709 13:16:19.596221  3972 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:19.597146  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:19.594821  4117 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:19.603026  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.538627  5588 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.540645  5258 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.532279  5662 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:16:19.602751  5724 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.003s
I20260709 13:16:19.603896  4045 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:19.517867  5414 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.541148  5728 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.605155  5441 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.575845  5747 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.576020  5800 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:19.574805  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:19.620798  5258 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.539088  5556 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.644492  4116 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:16:19.592087  5741 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:19.618438  4041 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:19.605685  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.616662  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:19.616509  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 114637us
I20260709 13:16:19.604233  5315 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.659269  5315 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:19.644779  5807 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:16:19.633935  5800 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:19.663211  5786 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:19.664146  5786 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:19.648716  5783 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.004s
I20260709 13:16:19.653270  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.621165  5588 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.632246  5426 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:19.665598  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68545.9us
I20260709 13:16:19.618945  4044 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:19.646943  4114 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:19.675197  4684 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:19.647222  5821 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.678622  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:19.656693  5820 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.636111  5747 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:19.685283  5815 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:16:19.681006  5529 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.693573  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:19.681739  5315 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.675663  5819 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:19.702340  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:19.698091  4112 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:19.684489  5822 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.702986  4120 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:19.695907  5813 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:19.674247  5783 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.687960  5820 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.711829  5820 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.712093  5643 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.709867  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.682200  5635 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:16:19.717026  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:19.732242  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:19.694098  5799 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.792086  4120 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:19.694512  5830 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:19.797971  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:19.700202  5727 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.834661  3968 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:19.703800  5725 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:19.705104  5633 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:19.701730  5796 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:19.699628  5317 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:16:19.686221  5821 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.790100  5798 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.855098  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.858080  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.714021  5783 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.836814  5717 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:19.836391  5830 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:19.704704  5315 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.858758  3963 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:19.705152  5529 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.865072  4039 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:19.868638  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:19.833678  5829 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:19.696672  5662 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.869218  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.850720  5832 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.869939  4039 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:19.853475  5727 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:19.873642  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:19.875582  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:19.875972  3964 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:19.875835  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:19.882941  3972 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:19.741389  5813 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.867050  5830 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:19.831566  5799 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.910567  5808 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.911464  5694 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.740899  5822 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.855422  5796 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.858459  5633 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.874114  5414 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.719115  5819 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.927215  5799 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.928525  5741 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:19.878329  5832 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.930248  5315 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.931159  4041 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:19.866652  5827 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:16:19.886024  5829 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:19.937736  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.944756  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:19.934792  5613 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.043s	user 0.014s	sys 0.000s
W20260709 13:16:19.935405  5723 consensus_meta.cc:287] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.005s
I20260709 13:16:19.917500  5727 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:19.919745  5820 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:19.949258  4116 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:19.954183  4046 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:19.937043  5747 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.961793  5727 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.963626  5822 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.944360  5414 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:19.964491  5414 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.966687  5414 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:19.968484  5685 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.556s	user 0.006s	sys 0.000s
I20260709 13:16:19.954659  5725 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.969424  5643 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.945214  5588 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.937563  5808 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.985041  5808 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.972011  5819 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.973590  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:19.974489  5800 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.976002  5821 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:19.955062  5636 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.001s
I20260709 13:16:19.991492  5830 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:19.985635  5820 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:19.982561  5685 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.000495  5796 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.000913  5563 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:20.001546  5633 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:20.010648  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 327319us
I20260709 13:16:20.013847  4112 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:16:19.957631  5723 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.021240  5820 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:20.023608  5246 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.661s	user 0.007s	sys 0.003s
I20260709 13:16:20.025187  5800 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:19.971241  5717 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.026496  5694 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:20.015170  5563 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:20.030798  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:20.036271  5832 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:20.039059  5835 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:16:20.047726  5529 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:19.954329  5829 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.043889  5258 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.062798  4038 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:20.064214  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:20.072906  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.074601  4114 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:20.035396  5830 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.077363  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.078014  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.055096  5246 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:16:20.081209  4114 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:20.082286  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.056039  5526 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.085227  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.062623  5844 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.083766  3965 raft_consensus.cc:2368] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:20.085845  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.090466  5563 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.091804  5563 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.092970  5723 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.087544  5808 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.096560  5808 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.098716  5808 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:20.085891  4113 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:20.087975  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:20.100670  4121 raft_consensus.cc:606] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.103976  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.117993  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.118667  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.079931  5725 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.064275  5315 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:16:20.121568  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.086225  5830 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.124408  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.125168  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.126528  3968 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:20.123320  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.127983  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.129125  3963 raft_consensus.cc:2410] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:16:20.130672  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44991.2us
I20260709 13:16:20.129487  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.131601  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.132644  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.133188  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.131560  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.133201  3971 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.135417  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.137532  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.138072  3964 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.121729  5725 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:20.137984  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.134429  5297 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.119076  5847 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:20.153928  3970 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:20.132833  5834 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:16:20.117429  5844 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.159138  5793 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:16:20.128257  5854 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.162767  5829 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.163831  5685 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.152858  5529 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:20.165025  4114 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:20.165361  5258 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.166081  5258 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:20.166525  5258 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.157718  5297 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.168732  5297 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.170841  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.171877  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.176045  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.176810  4040 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:20.131860  5526 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:20.181921  5846 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:20.165459  5529 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:20.153904  5725 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.186368  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.188673  5844 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:20.189821  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.203773  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.191632  3971 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:20.194126  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.196457  4040 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:20.195843  5846 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:20.200956  5663 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:20.207285  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.208076  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.206183  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.207346  5663 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:20.170490  5258 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.210819  5663 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.211967  5663 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.214440  3965 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.215871  5846 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.215767  5529 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.224272  5813 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.232510  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.233179  5830 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:20.239378  3968 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:20.223492  5725 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.271543  5725 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.276964  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.277777  4116 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:20.281540  3964 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:20.282270  3966 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:20.298316  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 912) took 1385 ms (client timeout 1608 ms). Trace:
W20260709 13:16:20.298759  4046 rpcz_store.cc:269] 0709 13:16:18.913271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.913576 (+   305us) service_pool.cc:224] Handling call
0709 13:16:20.298156 (+1384580us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540028cb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:20.298259 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350968064}
I20260709 13:16:20.299399  5297 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.306221  5297 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:20.319478  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.320698  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.321462  5725 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.321861  5725 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:20.322016  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.322584  5725 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.323230  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:16:20.325615  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 959) took 1541 ms (client timeout 1820 ms). Trace:
W20260709 13:16:20.325999  4119 rpcz_store.cc:269] 0709 13:16:18.784260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.785350 (+  1090us) service_pool.cc:224] Handling call
0709 13:16:20.325456 (+1540106us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:20.325559 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2140597504}
I20260709 13:16:20.328604  5526 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.322326  5830 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.329908  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 1056) took 1024 ms. Trace:
I20260709 13:16:20.330262  3969 rpcz_store.cc:276] 0709 13:16:19.305768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:19.316291 (+ 10523us) service_pool.cc:224] Handling call
0709 13:16:19.316566 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:19.595844 (+279278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:20.329674 (+733830us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b5400277754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:20.329850 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492899712}
I20260709 13:16:20.333109  5725 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.335455  5556 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.336068  5725 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.339330  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.339432  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.340129  3971 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:20.341297  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.340070  3969 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.341751  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.343582  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.349131  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.350356  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.350903  3965 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:20.351691  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.352290  3965 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:20.353391  3964 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:20.355872  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.360026  3964 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:16:20.362766  3972 raft_consensus.cc:1217] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Deduplicated request from leader. Original: 3.2->[5.3-5.3]   Dedup: 5.3->[]
I20260709 13:16:20.363276  3972 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:20.364238  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.366070  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.366618  4114 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.360872  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.372620  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:20.368633  5445 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:20.377198  5445 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:20.393419  5532 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.360116  5717 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.395212  5563 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.394145  5532 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:20.396695  5563 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.397105  5532 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.398921  5532 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.398970  5563 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.395407  5633 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.400949  5717 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.401356  5717 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.403182  5633 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.405313  5633 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:20.406067  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e20b6631af674e838a0accf36c31749f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:20.406635  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.407258  3968 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 3.
I20260709 13:16:20.407595  5445 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:20.408361  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.408912  5612 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.409267  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:20.409364  5612 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.411317  5612 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.411686  5637 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:20.412042  5796 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.412436  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.412698  5796 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:20.413134  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.413838  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:20.414832  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.415403  5819 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.415743  5333 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.416136  5333 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.416514  5333 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.417498  4044 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:20.418147  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.426795  4047 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:20.427721  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.417404  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.429068  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.429590  4042 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.414144  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.419190  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:20.430524  4115 raft_consensus.cc:606] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:20.430776  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.431344  4044 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.420104  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.432065  4039 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.420671  4046 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:20.420953  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.424993  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.430895  4115 raft_consensus.cc:614] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:20.434546  3968 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.420110  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:20.436267  4085 leader_election.cc:400] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5.
I20260709 13:16:20.437156  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.437362  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.437955  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.362160  5529 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.411981  5799 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:20.450634  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.442203  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.455339  5445 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:20.456584  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.456879  5445 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.457490  4118 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:20.442814  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.443933  4046 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:20.444319  4942 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:20.444888  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:20.446329  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.458776  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.459259  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.459977  4116 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:20.460891  5633 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:20.447060  4045 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:20.441795  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.472043  5633 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:20.441421  3937 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.608s (SENT) [suppressed 9 similar messages]
I20260709 13:16:20.411754  5612 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:20.441049  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.442528  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.457007  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.459339  4121 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:20.477246  3968 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:20.466113  4046 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:20.467892  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.469949  4942 consensus_queue.cc:1243] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 5.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:20.476475  5840 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.480901  5840 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.481287  5840 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.470494  5445 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.471056  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:20.472136  5799 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:20.472553  5817 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:20.474779  4112 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:20.441865  5297 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.455498  5728 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.484692  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.485633  4942 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:20.486560  4114 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
W20260709 13:16:20.487848  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46858.4us
I20260709 13:16:20.494807  4039 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:20.499828  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:20.507392  4120 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:20.465523  5741 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:20.504590  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:20.506434  4942 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.516332  4942 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.510262  4047 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:20.511791  4044 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:20.507107  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.520423  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.521834  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.514494  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:20.523346  5854 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:20.524390  5854 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.524751  5854 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.525168  5854 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.529831  5809 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.530264  5809 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:20.531414  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.546818  4042 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:20.513087  5728 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.554873  5728 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.541963  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:20.561498  5800 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:20.561987  5800 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:20.562785  5800 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.564023  5800 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.503336  5650 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:20.505479  5587 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.501878  5817 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:20.568678  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54296.8us
I20260709 13:16:20.594610  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:20.539407  5809 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.545622  5816 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:16:20.489773  5612 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.572711  5563 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.596740  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:16:20.597982  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56436.2us
I20260709 13:16:20.517700  5445 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.609005  5445 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:20.609490  5445 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.609166  5817 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.610451  5817 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.545341  5341 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:20.611603  5341 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.611943  5341 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.598450  5532 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.614248  5563 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.600159  5633 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:16:20.621240  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:20.600373  5650 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:20.630486  5650 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.630865  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.606606  5793 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:20.598712  5741 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:20.591691  5725 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:20.581085  5799 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.616308  5563 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.630678  5854 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.639258  4942 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.599601  3969 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:20.641891  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45234.1us
I20260709 13:16:20.574533  5813 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.654244  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.654834  4113 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:20.656816  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.657536  3969 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
W20260709 13:16:20.658139  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 216727us
I20260709 13:16:20.656905  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.659000  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:20.661904  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.662483  3969 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
I20260709 13:16:20.662745  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.664579  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.633169  5793 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:20.646047  5724 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.672904  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.673574  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.680066  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.666252  5633 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:20.677340  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:20.687703  5836 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:20.691455  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.671711  5816 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.703409  5816 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.704387  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.705015  3966 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:20.693169  5793 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.693977  5741 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:20.694967  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.679032  5612 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.711259  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.713191  4044 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:20.700811  5341 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.678130  5830 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.645959  5725 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:20.702082  5633 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:20.714882  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.725445  4047 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:20.715502  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.726600  4039 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:20.727360  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.727896  4039 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.716538  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.717592  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.729979  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.714236  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.730804  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:20.720180  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:20.733675  4044 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:20.702633  4040 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
W20260709 13:16:20.722136  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49098.5us
I20260709 13:16:20.716106  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.735172  4046 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:20.736146  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:20.743263  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 41) took 9340 ms. Trace:
W20260709 13:16:20.749442  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.751157  4086 leader_election.cc:400] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6.
I20260709 13:16:20.743278  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.753811  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:20.754462  4047 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:20.743919  4045 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:20.743402  5633 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:20.743278  5834 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:20.756222  4086 leader_election.cc:403] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:20.758699  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.759315  3965 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.759979  4041 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:20.762351  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.768911  4942 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.722965  5830 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:20.744323  5612 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.702721  5717 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.773607  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:20.791934  4120 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:20.795882  4039 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:16:20.802977  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59748.2us
I20260709 13:16:20.760639  5694 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:20.816053  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:20.771790  5297 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6.
I20260709 13:16:20.776412  5830 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:20.821687  3967 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:20.751582  3867 rpcz_store.cc:276] 0709 13:16:11.403584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:11.403868 (+   284us) service_pool.cc:224] Handling call
0709 13:16:20.743201 (+9339333us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:18.167052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:18.177351 (+ 10299us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:18.177396 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:16:18.177422 (+    26us) tablet.cc:662] Decoding operations
0709 13:16:18.234961 (+ 57539us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:18.236881 (+  1920us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:18.237475 (+   594us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:18.346903 (+109428us) tablet.cc:701] Row locks acquired
0709 13:16:18.346924 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:16:18.347064 (+   140us) write_op.cc:270] Start()
0709 13:16:18.347177 (+   113us) write_op.cc:276] Timestamp: P: 1783602978347016 usec, L: 0
0709 13:16:18.347200 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:18.470159 (+122959us) log.cc:844] Serialized 1297 byte log entry
0709 13:16:19.363075 (+892916us) op_driver.cc:464] REPLICATION: finished
0709 13:16:19.488371 (+125296us) write_op.cc:301] APPLY: starting
0709 13:16:19.488470 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:19.488617 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:19.488746 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:19.489283 (+   537us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:19.489495 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:16:19.489547 (+    52us) write_op.cc:312] APPLY: finished
0709 13:16:19.489778 (+   231us) log.cc:844] Serialized 34 byte log entry
0709 13:16:19.526789 (+ 37011us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:19.531163 (+  4374us) write_op.cc:454] Released schema lock
0709 13:16:19.532738 (+  1575us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:19.620359 (+ 87621us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:19.622647 (+  2288us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1952480,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":117554,"apply.run_cpu_time_us":2300,"apply.run_wall_time_us":105042,"num_ops":3,"prepare.queue_time_us":137557,"prepare.run_cpu_time_us":31868,"prepare.run_wall_time_us":724323,"raft.queue_time_us":314845,"raft.run_cpu_time_us":19840,"raft.run_wall_time_us":184098,"replication_time_us":1000602,"spinlock_wait_cycles":85760,"thread_start_us":712679,"threads_started":4,"wal-append.queue_time_us":451036,"wal-append.run_cpu_time_us":31629,"wal-append.run_wall_time_us":1572021}]]}
I20260709 13:16:20.824594  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.835275  4120 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:20.817198  5827 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.839257  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:20.842839  3965 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
W20260709 13:16:20.843389  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:20.821597  5663 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.793985  5612 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.849908  5847 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:20.862099  5847 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:20.863178  5612 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.821003  5526 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:16:20.877916  5841 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:20.878428  5841 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:20.879491  5841 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.876153  3870 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 6, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.847483  5825 raft_consensus.cc:2764] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:16:20.822338  5694 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.889118  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:20.880620  5841 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:20.897375  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 228085us
I20260709 13:16:20.906260  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:20.906260  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:20.907987  3964 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:20.887943  3870 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:20.911090  3870 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.912900  3870 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.914330  3870 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:20.861346  5333 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:20.915555  3870 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.930500  3870 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 2, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.882555  5827 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:16:20.938934  3870 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:20.889676  5854 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:20.920632  5877 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:16:20.943465  3870 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:20.918113  5587 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:20.954851  4038 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:20.939730  3964 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:20.954500  3870 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:20.960031  5341 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:20.975979  3870 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:16:20.975936  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 213640us
I20260709 13:16:20.963095  5587 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:20.987702  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:20.993669  5876 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:16:20.994465  5872 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:16:20.997021  5333 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:20.980564  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 141370us
I20260709 13:16:21.002792  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:21.003892  5840 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.002s
I20260709 13:16:21.005496  5694 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.001560  5717 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.013893  5728 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.015432  5783 raft_consensus.cc:993] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:21.017326  5587 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.021139  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.036429  5647 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.037006  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.040096  3971 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:20.990228  5844 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.048514  3963 raft_consensus.cc:2368] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6.
I20260709 13:16:21.037786  3870 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.001420  5725 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:21.037035  5808 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.000742  5809 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.039618  5840 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.061671  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:21.059865  3870 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 4, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.069442  3870 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.071113  3870 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.072597  3870 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.067500  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.056906  5717 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.076711  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:21.051239  5785 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:16:21.076290  3870 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.048193  5647 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.086215  3870 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 4, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.075057  5341 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.087633  5647 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.072841  5800 raft_consensus.cc:1081] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:21.093683  3870 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.096721  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.063125  5889 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:21.062443  5827 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:21.063556  5839 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:16:21.082778  5887 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:21.100905  3870 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.069324  5445 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.087752  5840 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.061715  5808 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.093245  5717 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.103936  5800 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:21.129985  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53357.5us
I20260709 13:16:21.130856  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.131197  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.095759  5341 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.134819  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:21.104277  5893 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:16:21.137437  5879 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:16:21.138034  5886 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:16:21.135555  5887 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:21.139210  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:21.139724  5889 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:21.102070  5633 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.142048  3870 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.152585  3870 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:16:21.153898  5892 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:16:21.156445  5341 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.157332  5809 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.159272  5633 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.145581  5893 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.160526  5893 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.162020  5445 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:21.162231  5813 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.000s
I20260709 13:16:21.153048  5728 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.162619  5813 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.154021  3870 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.168534  4118 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:21.170230  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.170727  4114 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:21.171341  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.169903  4120 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:21.171872  4040 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.172688  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.173254  4044 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:21.174729  4039 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:21.174961  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.175475  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.175987  4119 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.181159  5897 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:21.182041  5840 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:21.145175  5717 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:21.184127  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.185475  3870 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.192214  3870 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 4, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.190119  4118 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:21.190387  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.197222  3870 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.201002  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.205125  3870 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 3, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 3 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.208130  4119 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:21.195489  5830 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.210765  5830 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.196085  5840 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:21.214341  4114 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:21.206485  3870 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.217779  3870 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.222131  3870 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.223506  3870 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:21.225607  3870 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.227140  3870 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 4, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.228581  3870 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 3, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:21.230088  3870 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:21.208278  5297 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.225709  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.238142  4040 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:21.239167  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.240198  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.241505  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.242583  4040 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:21.243486  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.218398  5897 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:21.216466  5895 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.207888  5832 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:21.254007  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.254603  4040 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.243227  5792 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.258888  5717 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.289736  5840 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:21.256228  5887 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.293334  4041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:21.293856  5808 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.259152  5827 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:21.295015  5827 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:21.306520  5827 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:21.311595  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:21.280560  4043 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.263142  4040 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:21.294010  4041 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:21.317890  4041 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.319604  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.320252  4040 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:21.333853  4041 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.321285  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.321661  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.282713  5885 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.338666  4046 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.281991  5895 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.279789  5816 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.263540  5897 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.350945  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.355309  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.321048  5633 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.352926  5840 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.358246  5840 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.358630  5840 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.359167  5798 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.352957  5839 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:16:21.364864  5633 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.366933  5633 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.358475  5832 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.340595  5893 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.340202  5885 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.370340  5893 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.371809  5885 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.354307  5895 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.367648  4043 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:21.379998  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.380657  4038 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.381481  5798 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.381842  5798 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.382650  5798 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.383993  5798 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.385095  5832 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.386029  5832 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.388310  4038 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:21.389309  5297 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.398537  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.400225  4041 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.400681  5297 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.324918  5889 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:21.404331  5885 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.406585  5893 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.404254  5809 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.420562  5809 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.417752  5893 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.476239  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.427981  5889 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:21.459996  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 108870us
I20260709 13:16:21.499809  5643 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:21.478572  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.472319  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.480825  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.519016  3970 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.425505  5840 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.521312  5643 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.523098  5840 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.522867  5903 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:21.525183  5897 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:21.526443  5893 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.526891  5728 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:21.501336  5820 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:21.529090  5820 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.495572  3964 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:21.430606  5895 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.535153  5895 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.472137  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:21.472890  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:21.499279  5258 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:21.475404  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:21.474327  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:21.537346  3967 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:21.539402  3972 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.506781  5809 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.543121  4044 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:21.544500  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.545418  4039 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.546012  5834 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:21.546204  3965 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:21.546568  5834 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.545420  5258 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:21.549786  5258 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.554015  5820 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.544874  3968 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:21.562045  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.566771  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.567725  4040 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:21.567471  5820 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.573391  4012 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.578732  5637 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:21.581655  3969 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.584252  5556 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.588053  5556 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:21.582369  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.598299  5556 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.600517  5556 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.602859  3964 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:21.604395  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.604493  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:21.609434  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47818us
I20260709 13:16:21.610430  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.582270  5888 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:16:21.632571  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.633495  5893 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.633934  5893 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.634313  5893 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.626435  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:21.653328  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:21.657541  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47244.1us
I20260709 13:16:21.660984  3970 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:21.650415  5643 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.630551  5820 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:21.672680  3971 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.678472  4039 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:21.678584  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.686383  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.689734  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:21.648738  5834 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.695411  5844 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:21.692299  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:21.698015  5798 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.698472  5798 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.698799  5798 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.692345  5840 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.705399  5840 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.707679  5840 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.708297  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:21.709697  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 901) took 1262 ms. Trace:
I20260709 13:16:21.710064  4116 rpcz_store.cc:276] 0709 13:16:20.447633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.460524 (+ 12891us) service_pool.cc:224] Handling call
0709 13:16:20.464534 (+  4010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:20.464737 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:16:20.824121 (+359384us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.039169 (+215048us) log.cc:844] Serialized 14 byte log entry
0709 13:16:21.683661 (+644492us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b18000501a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287
0709 13:16:21.709071 (+ 25410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:21.709169 (+    98us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:21.709247 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:21.709348 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:21.709526 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18013,"prepare.queue_time_us":483024,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":4166,"raft.queue_time_us":37775,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":16238,"spinlock_wait_cycles":10815744,"thread_start_us":586929,"threads_started":3}
I20260709 13:16:21.714504  5783 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:21.715026  5783 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.716065  5783 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.696209  5844 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.730003  5901 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:21.730458  5785 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.731024  3969 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:21.731303  5834 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.668565  5809 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:16:21.731478  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:21.733891  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53386.6us
I20260709 13:16:21.731041  5785 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.737426  4043 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:21.737978  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:21.739118  5785 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.735394  5901 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:21.742983  5901 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.745946  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.746728  4942 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:21.749949  5809 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.750389  5809 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:21.750711  5809 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.748610  4942 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.754724  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:21.755596  4046 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:21.754040  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.760044  3969 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:21.761886  5902 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.539s	user 0.006s	sys 0.000s
I20260709 13:16:21.761766  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.761724  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.763756  4040 raft_consensus.cc:2368] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:16:21.764461  4942 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.763203  4041 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:21.765041  5820 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:21.766559  5840 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:21.767962  5820 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.768577  5820 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.769666  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.770396  4114 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:21.770774  5820 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:21.763757  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.763242  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.774808  4119 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: [4.2-6.3]
I20260709 13:16:21.774821  4121 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:21.778105  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.778782  4047 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:21.781203  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.783459  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.784047  4119 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:21.784385  5834 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:21.784830  5834 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.785689  5834 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.787060  5834 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.792954  5895 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:21.793522  5895 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:21.794611  5895 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.796236  5895 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.797508  4942 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.798266  4942 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:21.805171  4046 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:21.806216  4942 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:21.807708  5297 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.791182  5785 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.809980  5785 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.810400  5785 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.815084  5844 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.815518  4046 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:21.818226  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.819162  4116 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 4: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:21.820308  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:21.828715  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46785.5us
I20260709 13:16:21.832749  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.834568  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.835381  4038 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:16:21.836841  5717 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:21.837464  5717 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.831838  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:21.832645  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.845016  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.847661  5647 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.848099  5647 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:21.848500  5647 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.853289  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.854260  4116 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:21.841729  5297 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.871464  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.890239  5685 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.893988  5893 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.900969  4116 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:21.904122  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71581.8us
W20260709 13:16:21.904942  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 73273.1us
I20260709 13:16:21.911190  5798 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.913290  5798 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.915125  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.916355  4046 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.922194  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.928963  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.929932  4116 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:21.929776  4121 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.932032  5893 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:21.939080  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:21.940807  3969 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:21.940999  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.944497  5647 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:21.946626  5717 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:21.947113  4121 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:21.947989  5785 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.944350  5809 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:21.948997  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.947271  3937 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:21.950387  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.950696  4119 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:21.953727  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.954409  5809 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.955682  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:21.956357  4942 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:21.956887  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:21.957541  4942 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.958465  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.952200  5556 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.958586  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:21.960412  4040 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:21.965001  5717 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.966943  5556 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:21.967394  5556 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:21.965530  5717 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:21.967823  5556 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.968186  4117 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:21.968200  5717 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:21.969956  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.970608  4117 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:21.968307  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.971539  5685 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:21.971959  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:21.975390  5785 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:21.978893  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:21.966434  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:21.985944  5717 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:21.988654  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:21.988940  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:21.989110  5717 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:21.989746  4942 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:21.990402  5893 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:21.990351  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:21.995558  4046 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:21.996246  4942 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:21.997749  4942 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:21.999526  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e20b6631af674e838a0accf36c31749f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:22.000087  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.000427  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.001221  3971 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:22.003857  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.004386  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.004861  5809 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.005424  5809 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:22.006790  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.001385  4040 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:22.006417  5809 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.007603  3971 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:22.008455  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.010838  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.013021  4116 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:22.022743  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64223.5us
I20260709 13:16:22.018774  5647 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:22.025729  4121 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:22.027168  5893 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.019587  5637 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.031881  5637 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:22.031981  3937 leader_election.cc:400] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:16:22.032424  5637 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.032614  3937 leader_election.cc:403] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.048189  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.049492  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.050025  3967 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.051297  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.053004  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.053695  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.054239  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.055399  5887 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:16:22.055861  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:22.056126  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58844.6us
I20260709 13:16:22.052533  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.042757  5893 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:22.069099  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.059191  5785 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.077373  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.080430  5785 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.082870  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.083937  5741 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.085273  5785 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.086493  5526 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:22.087356  5893 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.088722  4116 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.089210  5717 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.101888  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.089995  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.089874  5889 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:22.103350  4046 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:22.104014  4115 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:16:22.104709  3965 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:22.105602  4039 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.090487  4119 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.107030  5526 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.091095  3937 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:16:22.107590  5717 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.108011  5717 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.108292  4120 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:22.108913  5717 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.110158  5717 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.104910  3968 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.111016  3937 leader_election.cc:403] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.093930  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.096498  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.107442  5526 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.118465  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.122550  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.063309  5556 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.125044  4119 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.126559  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.127243  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.080644  5563 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:16:22.125020  5888 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.121439  5887 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:16:22.132686  5834 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.142278  4046 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 3. (term mismatch)
I20260709 13:16:22.150604  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.130985  5895 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.158313  5785 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.159744  4040 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.149066  4046 pending_rounds.cc:85] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 2
I20260709 13:16:22.143533  5888 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.161222  5888 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.165143  5830 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.165472  5633 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:22.165786  5685 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.166260  5685 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.169063  5663 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.169559  5643 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.170200  5643 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.173264  4046 pending_rounds.cc:107] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:16:22.173643  4046 raft_consensus.cc:2889] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.148887  5834 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.174906  5834 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.175187  5526 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.176215  5526 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.159381  5901 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:22.177416  5901 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.184969  4942 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.207561  4116 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
W20260709 13:16:22.204118  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 137904us
I20260709 13:16:22.203779  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:22.165163  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.221902  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:22.186309  3967 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:16:22.239408  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74289.3us
I20260709 13:16:22.240357  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.247726  4942 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.253535  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.258298  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:22.182592  5798 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:16:22.270005  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.270071  4117 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.246098  5844 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.281894  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.287948  4121 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.292239  4040 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.206346  5830 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.298310  4039 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:22.298537  5834 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.299429  5844 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.300019  5844 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.301276  5643 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.301465  4046 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:22.303735  5685 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.309528  4038 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.277868  5741 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.317289  5563 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.317798  5563 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:22.319017  5563 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.321652  5633 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.322392  5633 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:22.274715  5840 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.323670  5633 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.300669  5834 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.281194  5785 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:16:22.336542  5887 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.336902  4112 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:22.337265  4112 pending_rounds.cc:85] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:22.321923  4118 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.337337  5887 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.339433  5887 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.341698  5901 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.354645  5844 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.357399  4117 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:22.363951  5888 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.386787  5888 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.368507  5830 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.372511  5563 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.374145  4112 pending_rounds.cc:107] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:22.390829  4112 raft_consensus.cc:2889] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.401928  4046 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:22.406064  4039 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.408334  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:22.381341  5637 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.384322  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.420961  5526 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.421200  4039 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.421675  5526 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.365434  5556 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.423758  5526 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.428114  5637 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:22.458719  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 325058us
I20260709 13:16:22.508037  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:22.511626  3967 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.515409  5824 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:22.516520  5824 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.516901  5824 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:22.517349  5887 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.517994  5824 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:22.519531  5824 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.493916  5901 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.522595  5901 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.534252  5830 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.535077  5830 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:22.561158  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 306048us
I20260709 13:16:22.517951  5887 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:22.569491  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 299547us
I20260709 13:16:22.573691  4039 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:22.536690  5929 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:22.570000  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.586537  4116 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:22.588996  4039 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:22.590981  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:22.592973  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:22.593448  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.594501  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.599967  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.602845  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.582425  5888 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:22.606994  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.608246  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.610117  4117 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:16:22.612939  4117 pending_rounds.cc:85] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:22.613221  4117 pending_rounds.cc:107] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:16:22.613466  4117 raft_consensus.cc:2889] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.613713  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.595851  5783 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.609586  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.607988  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.614866  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:22.623680  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.624370  3963 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:22.626773  4118 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:22.630349  5938 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.630651  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.631042  4011 leader_election.cc:400] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6.
I20260709 13:16:22.631409  4011 leader_election.cc:403] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:22.627526  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.605489  5929 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:22.614766  5741 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.631471  3971 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:22.637131  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.638283  4113 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:22.638649  5935 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.638401  5937 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:22.635516  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.622035  5901 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.651602  5929 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.652751  3967 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:22.634080  5936 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.654057  5936 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.655267  4043 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:22.655622  5844 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.656313  5936 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:22.638986  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:22.656183  5844 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.657158  5887 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.649044  4942 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:16:22.649864  5741 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.626020  5783 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.625819  5830 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.659559  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.658582  4041 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:22.667765  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:22.658208  4942 consensus_queue.cc:1243] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:22.674685  3937 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.668826  5637 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6.
W20260709 13:16:22.678351  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 84777.9us
I20260709 13:16:22.680861  5936 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.681346  5937 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.682085  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:22.682467  5942 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:22.683483  5935 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.640635  5820 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:16:22.675860  5889 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:16:22.687879  5741 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.636117  5663 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:16:22.634120  5940 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 13:16:22.642727  5946 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.713219  5893 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.695235  5783 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.701714  3965 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:22.727062  4039 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:22.701318  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.644721  5633 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:16:22.705041  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.673146  5830 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:16:22.713248  5820 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.729615  5820 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.731819  5820 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.692835  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.732492  5940 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.733657  5940 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:22.710594  5663 consensus_queue.cc:1243] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 4.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:22.725282  5889 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.701233  5941 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
W20260709 13:16:22.726347  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 95720.9us
I20260709 13:16:22.710423  5844 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:22.699968  5887 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:16:22.738511  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:22.734032  5940 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.741353  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.726105  5893 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:22.740239  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.744258  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.749131  3967 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:22.750406  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 342931us
I20260709 13:16:22.736632  5889 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.764897  3965 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:22.769009  3964 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:22.765107  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:22.772531  5936 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:22.771735  5258 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.778270  5935 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.777240  5936 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:22.761865  5633 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:22.780455  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:22.783427  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48991.3us
I20260709 13:16:22.773105  5830 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.771983  5957 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.782783  5954 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.791162  5889 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.793227  5633 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:22.780476  5936 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.795094  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.796334  4039 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:22.791201  5637 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.801806  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.794266  5633 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.803078  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:22.805903  5950 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:22.807201  5941 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:22.808446  5887 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.794039  5889 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.809505  5941 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.809873  5941 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.810339  4043 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:22.810614  5941 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.811954  5941 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:22.812976  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47990.4us
I20260709 13:16:22.814095  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:22.814425  5950 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.815330  5931 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.815824  5940 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.816934  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:22.817479  5937 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.817823  5931 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:22.818361  5931 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:22.819231  5931 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.790452  5830 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.821067  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:22.825614  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:22.828930  5643 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:16:22.816212  5717 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:22.836660  5717 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.837531  5717 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.838531  5717 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.817893  5937 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:22.835656  5663 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.792788  5893 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.829078  5685 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:16:22.847924  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:22.852943  4042 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:22.856309  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.857019  4116 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:22.856220  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:22.858402  3971 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:22.858858  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:22.860620  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.856334  4117 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:22.863397  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.864337  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.863971  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.861125  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:22.861342  5663 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.823577  5954 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.867841  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.841566  5937 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.869890  3966 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.870311  5937 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:22.870990  5954 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.871197  3969 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:22.872956  5783 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.831401  5940 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.821734  5258 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:16:22.893922  3965 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:22.905437  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.906785  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:22.907773  4116 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:22.910158  4942 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:22.861807  5685 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:16:22.917392  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:22.921195  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:22.920328  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67863.6us
I20260709 13:16:22.926024  3969 pending_rounds.cc:85] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 1
I20260709 13:16:22.926414  3969 pending_rounds.cc:107] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:16:22.926651  3969 raft_consensus.cc:2889] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:22.835687  5529 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:16:22.927681  4942 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.929678  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.902223  5643 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:22.801615  5957 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.930377  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:22.943614  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 110730us
I20260709 13:16:22.944458  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.913909  5893 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.942806  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:22.947422  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:22.964989  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:22.945529  5297 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:22.967201  4942 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:22.945371  5966 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:22.951361  5938 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:22.968654  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:22.972980  4942 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:22.942150  5785 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:16:22.959924  5647 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:22.960242  5526 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:22.973616  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:22.913511  5830 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:22.950358  5895 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:22.953778  5887 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:22.949021  5798 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:22.952752  5258 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:16:22.950865  5834 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:16:22.970376  5633 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:16:23.003427  5935 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:23.037730  5935 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.038141  5935 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.038522  5887 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.039008  5887 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.044000  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.044416  4039 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:23.004364  3867 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 3 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:23.009253  5944 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
I20260709 13:16:22.997363  4942 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:23.046882  4942 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:22.966164  5643 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.001417  5297 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:16:23.033860  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 61203.5us
I20260709 13:16:23.086796  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:22.977566  5929 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:22.978214  5938 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.087878  5938 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.089090  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.089916  5895 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:23.090989  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.069976  4046 pending_rounds.cc:85] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 1
I20260709 13:16:23.092705  5834 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:23.093021  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.093233  5834 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:23.093742  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.094187  5834 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.095310  5844 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:23.095680  5844 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.095995  5844 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:22.988368  5647 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:23.096942  5647 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.097376  4046 pending_rounds.cc:107] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 4.2
I20260709 13:16:23.097868  4046 raft_consensus.cc:2889] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.093096  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.093416  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.126044  3970 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:23.126508  4040 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:23.126544  3970 pending_rounds.cc:85] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 2
I20260709 13:16:23.127579  3970 pending_rounds.cc:107] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:23.127830  3970 raft_consensus.cc:2889] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.127420  4045 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:16:23.157799  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71107.1us
W20260709 13:16:23.161109  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 63487.8us
I20260709 13:16:23.158197  4942 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.151219  5633 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:23.173908  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 218865us
I20260709 13:16:23.153083  5941 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:23.151738  5887 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.133075  5946 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:16:23.170449  5809 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:23.200213  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65041.5us
I20260709 13:16:23.173702  5931 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.175071  5901 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:23.201985  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.205104  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.206506  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.206516  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:23.207862  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.207943  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:23.173518  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e20b6631af674e838a0accf36c31749f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:23.233521  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.193233  5637 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:16:23.204039  5901 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:23.182514  5633 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:23.259150  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:23.209306  5809 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:23.262460  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59745.5us
I20260709 13:16:23.221269  5663 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.198031  5941 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.271315  4117 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:23.273645  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.221632  5936 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:23.240998  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 64352.4us
W20260709 13:16:23.329833  5965 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.374s	user 0.002s	sys 0.000s
I20260709 13:16:23.338455  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.348315  5643 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.208412  5297 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:23.342339  5717 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 13:16:23.369694  5969 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:23.370245  5969 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.370924  5936 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.371708  5982 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:23.372241  5982 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.373417  4114 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 1
I20260709 13:16:23.373766  4114 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:16:23.373994  4114 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:23.379076  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 216486us
I20260709 13:16:23.379940  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.384656  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:23.392943  5980 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.185s	user 0.004s	sys 0.000s
I20260709 13:16:23.393680  5941 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.394752  4120 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:23.395550  5633 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.280184  5957 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.402467  5957 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:23.403790  5938 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.368616  5929 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:23.403100  5957 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:23.418864  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.425621  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.362239  5901 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.438076  4044 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:23.439695  4047 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:23.455467  4942 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.444229  4115 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:23.463263  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.463907  4040 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:23.466113  5982 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.466977  5793 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.469554  5935 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.470443  5969 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.470958  5901 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.471441  5647 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.471939  5935 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.472572  4113 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:23.474510  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 241030us
I20260709 13:16:23.475775  5978 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.477420  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.478124  5889 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.478544  5889 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.479764  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.480983  5643 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.481787  5978 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.489967  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.490150  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:23.490739  4045 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:16:23.492659  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 106574us
I20260709 13:16:23.460315  5844 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.501040  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.485512  5957 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:23.500654  4119 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:23.480611  5889 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.501433  6001 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:23.439989  5929 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:23.514680  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.523746  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:23.526221  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.527536  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.532827  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.533484  3967 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:23.530498  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:23.496711  5938 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.541895  3972 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:23.542470  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.544059  3970 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.545147  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:23.546762  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:23.547180  3969 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:16:23.547576  3969 pending_rounds.cc:85] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 3
I20260709 13:16:23.547819  3969 pending_rounds.cc:107] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:16:23.548071  3969 raft_consensus.cc:2889] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:23.542033  3867 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 3 to 4, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:23.501976  5844 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.523926  5887 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:23.564836  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:23.501389  5741 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 13:16:23.567265  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49127.9us
I20260709 13:16:23.542677  5258 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.568377  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:23.574777  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.575662  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.537993  6001 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.590934  6001 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.592892  5999 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:23.597962  5945 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:23.598532  5945 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:23.599013  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.599685  4942 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:23.600490  5637 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:23.602391  3971 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:23.590651  5970 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:16:23.604169  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.607584  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.608461  4112 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:23.578598  5685 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:23.609547  5685 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:23.609882  5685 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.600870  5637 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:23.618800  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48335.5us
I20260709 13:16:23.619298  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.568173  5529 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:23.627722  3970 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:23.577467  5966 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.643280  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.643860  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.577351  5887 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.653628  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.657349  5637 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.658593  5637 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:23.611961  5844 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:23.661206  5844 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:23.663262  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:23.663885  4684 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:23.639747  5529 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:23.665267  5529 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:23.550140  5978 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:16:23.670223  5929 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:23.677567  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.678278  3970 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:23.679141  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 97624.4us
W20260709 13:16:23.680775  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 61041us
I20260709 13:16:23.684150  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.687497  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:23.689906  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.701941  4115 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:23.703824  5685 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.706218  5647 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.714252  5887 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:23.717891  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 142262us
I20260709 13:16:23.715361  3867 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 5 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.721735  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.660502  5945 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:23.663280  5844 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:23.672696  5809 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.722106  3867 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 5 to 6, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:23.726212  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.679759  5840 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.736521  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.737300  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:23.724599  5741 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.746989  4116 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:23.727394  5887 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.726948  5941 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:23.753768  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.749516  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:23.758167  4116 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:23.743873  5969 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:23.766693  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.734866  5970 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:23.773475  5830 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.749137  5844 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:23.752668  5793 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:23.787050  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:23.760069  5940 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.791038  4115 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:23.789561  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.779954  5685 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.798560  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.814347  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:23.820822  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:23.817656  5888 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:23.817945  5820 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:23.821158  5783 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.791544  5793 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.801735  5940 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.847785  5946 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.851213  5946 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.851500  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.852753  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.853399  5946 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.863059  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.863969  4116 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:23.845674  5888 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.866906  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:23.857784  6008 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:16:23.844036  5985 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.868345  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.861804  5529 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.876581  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.877316  4043 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:23.858639  5793 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.879021  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:23.881683  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.886036  5741 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.889132  5981 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:23.846711  5820 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.877365  5966 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.894558  4942 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:23.896394  4012 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:23.900552  6020 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:16:23.902065  6019 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:16:23.906677  5940 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.863826  5783 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.887917  5633 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.913064  5938 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.889762  5989 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:16:23.919303  5966 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.936105  5966 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.880616  5985 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.938920  5985 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.940814  5783 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.942546  5901 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.943087  5901 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.945618  5830 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.946130  5830 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.946465  5901 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.949980  5830 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.917559  5935 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:23.917613  5944 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.957729  5844 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.958247  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.927096  5529 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:23.928399  5888 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.891549  5637 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:23.954675  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.960870  5297 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.926331  5820 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:23.957973  5944 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.920341  4045 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:23.964857  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.966089  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.959538  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.969970  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:23.971524  6002 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.975587  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:23.969712  3867 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 1 to 4, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:23.975939  5989 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.976279  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:23.978293  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:23.980655  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 59408.4us
I20260709 13:16:23.978952  5945 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:23.959510  5637 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:23.986876  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.988107  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:23.990948  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.993656  5563 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:23.994035  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.994612  5563 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:16:23.995133  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:23.996282  5563 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:23.997253  3966 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:23.997519  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:23.998122  3971 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:23.998896  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.001284  5637 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:23.997550  5944 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.000669  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.002787  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.003153  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.003329  3966 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:24.003724  3967 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:23.999408  3971 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:24.005463  4011 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:24.002337  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.002746  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.008787  4042 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:23.996098  5936 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.013270  3970 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.013922  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:24.008435  3964 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:24.013612  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:24.016227  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.016893  3964 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:24.017970  5957 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.018617  5936 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.017755  5935 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:23.989454  5783 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:24.025007  5945 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:24.026968  5783 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:24.029537  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:23.979995  5888 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:23.985234  5820 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.040910  4085 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:23.990087  5982 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.050587  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.051338  4043 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:23.990228  5633 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:16:24.052415  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.053440  4121 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:24.054957  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.058400  4121 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:16:24.062799  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.063546  4121 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:24.064993  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.063771  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.067497  4118 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.065689  4121 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:24.075796  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:24.077639  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.078250  4112 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:24.050800  5997 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.074400  3937 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.083248  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.086889  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.082779  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:24.088567  4114 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:24.050800  5982 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.090888  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:24.091481  4041 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.093755  5793 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.094161  5793 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.094478  5793 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.089809  5820 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.090145  5966 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.027948  5783 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.101646  4044 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:24.103219  4044 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:24.103458  5982 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.110152  4118 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.110785  5978 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:24.111166  5978 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:24.111693  5957 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.112072  5978 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.091295  5997 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.047874  5888 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:24.116809  5997 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.121382  4040 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:16:24.125051  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:24.156201  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:24.090572  5258 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:24.163879  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:24.159873  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 144375us
I20260709 13:16:24.168421  5970 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:24.175678  5970 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.178210  5970 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.169229  5633 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.150183  5901 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.169736  5966 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.170573  5950 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:24.153259  5999 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.184438  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.174777  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:24.179517  6027 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:16:24.179164  5633 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.179194  5901 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.178683  4041 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:24.179813  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.080852  5529 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.116019  5793 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.232717  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:24.181951  5966 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.186419  5999 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.237304  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.239285  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.242062  4040 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
W20260709 13:16:24.236263  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 146926us
I20260709 13:16:24.276093  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.240571  5966 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.246299  5999 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.292460  5940 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:24.308248  5633 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.280222  5937 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.314638  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.315361  3965 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:24.316705  4085 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.320297  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:24.318470  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.322103  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:24.325700  5945 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.326117  5945 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.326471  5945 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.327734  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:24.328363  4683 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:24.330128  5990 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:24.322804  5297 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.331090  5297 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.333983  5297 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.297274  5529 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:16:24.335795  5895 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.336253  5895 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.336658  5895 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.336781  5901 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.338660  5793 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.279516  5981 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:16:24.339563  5981 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:24.339886  5981 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:24.340734  5981 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.341922  5981 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.297930  5840 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.342612  5840 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.343042  5840 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.343948  5895 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.345368  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.345803  5982 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.346544  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.346724  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.347519  4116 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:24.330524  5809 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:24.350829  5982 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.331141  6001 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:24.352558  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:24.348469  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.361888  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.350849  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:24.361894  4116 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:24.362792  4113 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:24.364722  4085 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:24.377573  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.399940  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.401068  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.400635  3968 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:24.403527  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.402724  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:24.394218  5895 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.361203  5793 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.359652  6001 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:24.428681  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.432615  4042 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
W20260709 13:16:24.435300  6040 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:24.424752  5929 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.437970  5929 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.439960  5929 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.440426  4041 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:24.403019  5820 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.449303  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:24.450137  4113 raft_consensus.cc:606] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:24.454655  6001 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.456080  6001 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:24.457706  6041 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.107s	user 0.002s	sys 0.001s
I20260709 13:16:24.463397  4044 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:24.465453  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.361502  5830 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:24.407711  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:24.479787  3971 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.387398  5893 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.427937  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:24.392978  5947 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:24.485881  3965 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:24.480264  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56930.6us
I20260709 13:16:24.487008  4085 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:24.487249  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.489502  4113 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:24.490028  5947 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.490417  5947 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.490917  5941 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:24.491314  5941 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:24.499455  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:24.380070  5297 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.109s
W20260709 13:16:24.500685  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 213291us
I20260709 13:16:24.488408  3967 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:24.504966  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:24.505522  4045 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.507572  3968 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:24.444347  5820 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.485211  5893 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.513803  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:24.518790  4047 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:24.518890  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:24.517266  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:24.490741  5840 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.527908  4045 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:24.504673  5637 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:24.516937  5798 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.522141  5893 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:24.526712  5556 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:24.530388  5990 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:24.614545  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 75975.4us
W20260709 13:16:24.632546  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:24.671257  5637 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:24.594112  5798 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.673811  5820 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.675021  5798 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.678021  5989 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.678902  5989 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.682336  4118 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:24.689019  6029 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:16:24.672494  5637 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.543215  5895 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.733693  5895 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:24.734103  5895 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:24.593355  5556 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.736574  5556 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:24.626036  3867 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 2 to 4, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:24.775635  4114 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:24.702157  5946 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.535396  6017 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.208s
I20260709 13:16:24.739524  5990 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.813407  5999 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.813867  5989 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.814903  5990 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:24.815632  3964 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:16:24.818899  5966 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:16:24.819270  5966 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.820287  3970 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:24.822216  5947 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.823289  6034 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:24.823784  6034 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.860651  3971 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:24.863600  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:24.864297  3966 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:24.866031  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:24.868175  6061 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:24.868804  6061 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:24.869232  6061 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:24.882236  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 357028us
I20260709 13:16:24.815510  5999 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:24.982077  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 460778us
W20260709 13:16:24.984804  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74453.2us
I20260709 13:16:24.987825  5556 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:24.990003  5556 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:24.782729  5945 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:24.996986  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 113911us
I20260709 13:16:24.998351  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:24.999599  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:24.978361  5981 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.004s
W20260709 13:16:25.011642  3937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.016s	sys 0.062s
W20260709 13:16:25.012087  3937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.017s	sys 0.062s
W20260709 13:16:25.012423  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 730861us
W20260709 13:16:24.971017  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 441368us
I20260709 13:16:24.983611  5954 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.019243  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.004534  5556 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:25.006649  5985 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.011435  5990 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.031792  5945 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.032037  6055 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.022498  5954 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.034824  5954 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.049724  5895 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:25.052454  5895 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:25.020782  5966 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:25.067694  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48532.2us
I20260709 13:16:25.026966  5556 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.057897  5840 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.077467  3867 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 2 to 4, term changed from 3 to 5, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:25.082196  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.056842  5893 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:25.083071  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.084713  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.085753  4038 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:25.082808  4039 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
W20260709 13:16:25.089955  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 66471.4us
I20260709 13:16:25.090621  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.100860  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.101805  4039 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.086643  6034 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.116725  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.120664  4045 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:25.115869  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.121917  4038 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.123389  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.101526  5947 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.101732  5820 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:16:25.173624  6059 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:16:25.200753  6055 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:25.209961  6055 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.222548  4038 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.203325  5820 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:25.200716  5937 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:25.220626  6001 consensus_meta.cc:287] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.764s	user 0.009s	sys 0.000s
I20260709 13:16:25.223816  5556 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.241428  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:25.242161  4113 raft_consensus.cc:606] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:25.242513  4113 raft_consensus.cc:614] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:25.234019  5937 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:25.246681  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 129601us
I20260709 13:16:25.250299  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.251494  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.255945  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.254890  5840 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.258752  5840 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.259150  5840 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.259869  5888 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:25.266877  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 941) took 1096 ms. Trace:
I20260709 13:16:25.267342  3964 rpcz_store.cc:276] 0709 13:16:24.170527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.172218 (+  1691us) service_pool.cc:224] Handling call
0709 13:16:24.172515 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.825010 (+652495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.266571 (+441561us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400277254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:25.266788 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478469376}
I20260709 13:16:25.268842  5893 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.269259  5947 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.269750  5947 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.270093  5947 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.255374  6001 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.273188  6001 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.273587  6001 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.277947  6061 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.279462  5820 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.307032  4038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:25.308887  4038 raft_consensus.cc:606] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:25.313851  4038 raft_consensus.cc:614] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:25.314939  6069 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:16:25.317304  5941 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.318727  5941 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.325364  5526 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:25.325990  5685 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:25.326244  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.326534  5685 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.327806  5643 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.328552  5685 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.328370  5643 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.329100  5685 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:25.326073  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 636118us
I20260709 13:16:25.334630  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:25.335059  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.335230  4119 raft_consensus.cc:606] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:25.339761  4119 raft_consensus.cc:614] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:25.340262  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.343674  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.344663  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.346191  3971 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:25.347122  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.347290  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.347518  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.348161  3965 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:25.348726  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 335592us
I20260709 13:16:25.350854  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:25.353175  3965 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.336169  5685 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.331542  5526 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:25.333284  5970 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.340744  6032 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:25.361793  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.325635  5937 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.367205  3968 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:25.368435  6076 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:16:25.369244  5685 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.352947  6055 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.373426  6055 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.374328  6034 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.374943  6034 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.375313  6034 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.375907  6055 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.377542  3967 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:25.378027  6072 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.363696  5643 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.379626  5526 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.380676  5526 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.381683  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 943) took 1210 ms. Trace:
I20260709 13:16:25.382072  3969 rpcz_store.cc:276] 0709 13:16:24.171115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.172404 (+  1289us) service_pool.cc:224] Handling call
0709 13:16:24.172705 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.244224 (+ 71519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.244253 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.281809 (+ 37556us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.516161 (+234352us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.516204 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.381236 (+865032us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b54002c8b54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:25.381287 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.381343 (+    56us) raft_consensus.cc:1685] finished
0709 13:16:25.381356 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.381608 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9567,"raft.queue_time_us":97,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":29134,"spinlock_wait_cycles":163544960,"thread_start_us":164095,"threads_started":1,"wal-append.queue_time_us":431081}
I20260709 13:16:25.384091  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.385509  5889 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.386106  5889 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:25.387072  5889 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.366060  5556 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:16:25.385545  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.389533  3967 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.390033  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.390342  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.391991  3967 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:25.393118  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.394464  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.395200  3968 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:25.395571  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.395995  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.392232  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.397915  5981 raft_consensus.cc:2764] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:16:25.398953  5840 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.399547  6002 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:25.399921  6002 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.400247  6002 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:25.348793  5957 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:16:25.401518  5957 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:25.401854  5957 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:25.402678  5957 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.403864  5957 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.398097  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:25.407491  4683 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.410173  5840 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.366828  5970 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.396487  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:25.422571  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 165595us
I20260709 13:16:25.422909  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.426167  3967 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.428601  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.428622  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.429484  4043 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:25.430724  3965 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:25.431517  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.431676  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.432055  3968 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:25.432065  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.432811  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.433876  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.432158  3965 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.436877  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.378547  6072 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.478232  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e20b6631af674e838a0accf36c31749f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:25.479182  4119 raft_consensus.cc:606] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:25.432408  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.479828  4119 raft_consensus.cc:614] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:25.436450  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.444321  6061 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.444705  5556 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.478153  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.480903  5556 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:25.481624  4043 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.467653  6034 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.436391  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.482187  5556 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:25.483155  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46830.1us
I20260709 13:16:25.438530  5663 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.483916  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:25.447902  4683 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.451813  3965 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.452569  6001 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.453421  6074 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:25.487397  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.486452  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.455680  4045 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:25.462106  5947 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.484546  6061 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.496312  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.497267  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:25.469515  5937 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.385842  6032 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:25.446929  5970 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.451622  3964 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.484694  5685 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.489034  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.490339  5997 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:25.465963  6002 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.467533  5844 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.469274  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.483343  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:25.518606  4118 raft_consensus.cc:2368] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:16:25.504454  4113 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6.
I20260709 13:16:25.504678  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.486912  5999 raft_consensus.cc:2764] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 13:16:25.506911  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet e20b6631af674e838a0accf36c31749f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:25.487048  5663 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.503229  3969 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.525043  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.525537  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.493016  3968 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.496819  6053 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.512082  4119 raft_consensus.cc:2368] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:16:25.516340  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.520248  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:25.521279  3967 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:25.521826  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.511022  4043 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:25.530197  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:25.541761  6043 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.208s	user 0.014s	sys 0.012s
I20260709 13:16:25.542582  5947 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.543035  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 947) took 1370 ms. Trace:
I20260709 13:16:25.517055  5997 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.544188  5888 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.543380  3963 rpcz_store.cc:276] 0709 13:16:24.172208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.175390 (+  3182us) service_pool.cc:224] Handling call
0709 13:16:24.175712 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.176208 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.176243 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:24.176809 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:16:24.255454 (+ 78645us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.255500 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.255579 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:25.506344 (+1250765us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:25.542748 (+ 36404us) raft_consensus.cc:1685] finished
0709 13:16:25.542769 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.542976 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1478,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":44078976,"thread_start_us":78258,"threads_started":1,"wal-append.queue_time_us":145080}
I20260709 13:16:25.544723  5888 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:25.545722  5888 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.523025  5941 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.547520  5941 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.548277  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.548959  6072 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.549531  5941 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.551164  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.554517  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.555789  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.558696  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.559440  5978 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:25.559731  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:25.562064  6001 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.563992  6074 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.564340  5938 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.564523  6074 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.565078  5997 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.566030  5793 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.503010  6061 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.551164  5663 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.568325  6061 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.540537  6053 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:25.563077  6034 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.571561  6034 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.571372  5938 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.560663  3966 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:25.574647  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.576557  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.577183  3963 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.582916  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:25.556303  4114 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 3.
I20260709 13:16:25.585342  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:25.587684  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.588810  4043 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.589148  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.588522  4118 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:25.609794  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.610800  4116 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:25.614864  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.570914  6002 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.584915  5643 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:25.621832  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:25.624264  4118 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:25.625226  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:25.585110  6061 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.587599  5844 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.571003  6053 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:25.591197  5889 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.587733  5947 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:16:25.627892  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 132248us
I20260709 13:16:25.610378  5793 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:25.644747  4043 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:25.588040  6034 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.627110  6072 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:25.671922  6072 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.672955  6034 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.674152  6072 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:25.679279  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101073us
I20260709 13:16:25.680017  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.640822  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:25.590747  6066 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:16:25.663579  5844 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:25.633208  6061 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.685998  5556 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:25.691939  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.663883  5889 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:25.694234  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 108376us
I20260709 13:16:25.667598  5947 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.698879  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.710175  6061 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.706110  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.712103  3968 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:25.716548  3963 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:25.719547  5556 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:25.720626  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:25.721568  6074 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.723462  5556 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.725414  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 942) took 1554 ms. Trace:
I20260709 13:16:25.725793  3970 rpcz_store.cc:276] 0709 13:16:24.170841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:24.171141 (+   300us) service_pool.cc:224] Handling call
0709 13:16:24.171460 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:24.820656 (+649196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:25.725135 (+904479us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400408dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:25.725353 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491581184}
I20260709 13:16:25.724781  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.728595  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.705391  5793 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.729638  5889 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.729908  6066 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:25.741055  5993 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:25.730378  5938 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:25.746131  4012 leader_election.cc:400] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:16:25.740975  6066 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.741782  5993 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.750448  5947 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:25.751086  5993 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:25.754177  6044 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.424s	user 0.009s	sys 0.018s
I20260709 13:16:25.754673  5844 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:25.738200  6002 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:25.758490  3963 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:25.757753  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.760596  3970 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:25.764506  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 1057) took 1781 ms. Trace:
I20260709 13:16:25.764909  4120 rpcz_store.cc:276] 0709 13:16:23.982626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:23.982737 (+   111us) service_pool.cc:224] Handling call
0709 13:16:24.005798 (+ 23061us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:16:24.055915 (+ 50117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:24.055948 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:16:24.081708 (+ 25760us) log.cc:844] Serialized 52 byte log entry
0709 13:16:24.235729 (+154021us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:24.294123 (+ 58394us) log.cc:844] Serialized 14 byte log entry
0709 13:16:24.311778 (+ 17655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:24.311847 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:24.442975 (+131128us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b48002001d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:16:25.753484 (+1310509us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:16:25.764255 (+ 10771us) raft_consensus.cc:1685] finished
0709 13:16:25.764278 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:25.764435 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92677,"prepare.queue_time_us":58201,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":31417,"raft.run_cpu_time_us":1962,"raft.run_wall_time_us":138326,"spinlock_wait_cycles":78036736,"thread_start_us":112272,"threads_started":1,"wal-append.queue_time_us":175714}
I20260709 13:16:25.769904  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.776401  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.777591  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.777714  5937 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.778326  5526 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.778723  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.779994  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.783679  5938 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:25.783887  5937 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:25.784832  5946 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.785305  5946 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.756389  6066 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:25.771309  6002 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:25.797415  6002 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.801707  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:25.803499  5633 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:25.804004  5633 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.763985  6034 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:16:25.806298  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.806327  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.809012  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.808936  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.810364  4040 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:25.810653  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:25.814225  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.784739  5938 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:25.822299  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.819604  6013 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.837743  5643 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:25.818346  5938 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:25.838325  5643 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.839174  5938 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:25.841562  5895 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:25.812736  5937 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:16:25.813027  5889 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.853952  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.854658  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.855319  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.856999  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.840600  5938 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:25.861537  3963 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:25.880012  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:25.821043  5978 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:25.842190  6046 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:25.884671  3963 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:25.853171  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:25.857231  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:25.883924  5895 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:16:25.916174  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.915795  3971 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:25.924010  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66870.3us
I20260709 13:16:25.925885  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.927001  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.929008  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:25.931211  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:25.931993  4046 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:25.841425  6032 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:25.841465  6087 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.041141  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:25.939635  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:25.940375  3971 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:25.937855  4039 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:26.046332  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.048475  4046 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:25.854017  5937 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:25.889933  6002 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:25.940747  5830 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:26.058880  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.082995  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.087275  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:25.923189  6046 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:26.089808  5741 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:26.090476  5741 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:26.049587  6001 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:26.091547  6001 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.093397  6001 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.093856  6001 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.094278  6001 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.094581  5834 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.095141  5834 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.096087  5955 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:26.096560  5955 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:26.098491  5955 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.099191  5685 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:26.099766  5685 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.103430  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:25.882194  5889 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.100011  6066 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.119298  5889 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.119661  6066 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.120220  6066 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:26.120924  6068 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:26.099879  5830 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.121467  6068 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.100981  5258 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:26.127360  5258 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.127600  5643 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.129733  5643 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.131896  3964 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:26.093688  5633 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.062808  5937 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.121580  5685 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:26.088703  6098 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:16:26.091082  6046 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.146513  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:26.141948  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59049.8us
I20260709 13:16:26.156661  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.127118  5830 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.161393  4046 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:26.158545  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.143710  5783 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.172283  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.146461  5643 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:26.145409  5844 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.183735  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.160018  5637 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.086377  6002 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.192317  6088 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:26.192883  5834 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.192875  5643 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.183653  5741 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:26.197759  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.145783  5798 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:26.198472  6110 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:26.201526  6099 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:16:26.145210  6017 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:16:26.203500  6068 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.120723  6066 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.221581  5783 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.183866  5647 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:26.223834  5647 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:26.208886  5637 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.224294  5647 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.224649  6066 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.225939  5637 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:26.226953  6104 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:16:26.207579  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 435971us
I20260709 13:16:26.204980  6056 raft_consensus.cc:993] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:26.186735  5526 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:26.241968  6001 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.187644  5895 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.223410  5258 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.246879  6056 raft_consensus.cc:1081] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
W20260709 13:16:26.252526  6097 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 13:16:26.253880  5946 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.229606  6017 consensus_queue.cc:1243] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:16:26.273470  5783 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:26.276615  5741 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:26.276984  5741 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:26.277470  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.277799  5741 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.279556  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.240553  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.281088  3969 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:26.231549  6088 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.281307  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.282864  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.233628  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:26.260083  5643 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.232197  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:26.286610  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54472.7us
I20260709 13:16:26.266357  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.292151  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.267472  5888 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.269085  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:26.269852  5556 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:26.278765  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.279096  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:26.284217  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50731.6us
I20260709 13:16:26.284940  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.280668  5741 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.276912  5820 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.293247  4012 leader_election.cc:400] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6.
I20260709 13:16:26.261587  6002 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.272257  5946 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.255692  5830 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.311142  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:26.311617  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.291232  6032 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.290261  5993 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.299140  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.316488  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.317121  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.318020  4119 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:26.318357  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.320616  4115 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.297459  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.319466  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.322773  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.327253  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.329643  3965 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.311581  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.294669  6001 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:26.336162  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.338217  3969 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.339964  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.340744  4119 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 13:16:26.341311  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43970us
I20260709 13:16:26.342021  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.349052  3965 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:26.350780  6013 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.354673  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.361282  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.340386  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.354821  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.362995  5931 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.326025  5993 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.322168  5954 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:26.313911  5820 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.364352  5954 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:26.364434  3969 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:26.312186  5888 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.358450  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.361910  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:26.364742  5954 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.366343  6001 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:26.363888  5993 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.364012  4012 leader_election.cc:400] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:16:26.368916  4113 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:26.362001  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.370464  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.371201  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.373339  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.377522  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.380568  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.383704  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:26.385677  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.387122  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.387629  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.388221  4044 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.390563  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.388427  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.392268  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.395481  3963 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:26.334470  6088 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.396142  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.397337  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.399655  3965 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:16:26.399875  4117 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:26.366194  5888 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.366113  5820 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.404796  3969 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:26.405030  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.407697  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.410481  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.411158  4119 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.363845  5830 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.394841  5970 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.433811  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.435459  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.436730  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.439723  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.443053  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.440387  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.446089  4042 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:16:26.441119  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.401711  5955 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.400908  6095 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:26.439996  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.455807  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.454258  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.402302  3963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:26.451593  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.459945  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.461230  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.413882  5889 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.388873  5937 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.451802  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.467823  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:26.471319  4042 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:26.434365  6056 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.399262  5647 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.397604  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:26.474031  5647 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.475049  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.475716  5937 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.476436  3970 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 4: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:26.478163  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.481129  5895 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.481935  5895 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.465848  5978 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.484613  4116 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:16:26.385080  6001 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.471401  4085 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.488191  4116 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:26.489209  4116 pending_rounds.cc:85] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 3
I20260709 13:16:26.489576  4116 pending_rounds.cc:107] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:26.489908  4116 raft_consensus.cc:2889] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.493608  6095 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:26.494122  6095 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:26.494508  6095 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.497370  3937 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.498457  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.499089  4042 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:26.499621  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.499869  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.500370  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.501012  3966 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:26.455148  5982 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:26.503500  3969 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:26.459306  5830 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.506384  4040 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:26.450248  6112 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.514420  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.458168  5820 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:16:26.501318  6013 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.501772  5957 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:16:26.527302  5957 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:26.527624  5957 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:26.528347  5957 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.529451  5957 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.504642  5978 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.463346  6114 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.524580  3963 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:26.551366  3963 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.524343  4043 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:26.519565  5955 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:26.508689  5889 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.557994  4039 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:26.545599  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.550788  4044 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:26.538614  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.567049  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.485991  6056 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.582084  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 1077) took 1064 ms. Trace:
I20260709 13:16:26.582577  4112 rpcz_store.cc:276] 0709 13:16:25.517636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:25.518018 (+   382us) service_pool.cc:224] Handling call
0709 13:16:25.518269 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:25.565662 (+ 47393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:25.565692 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:25.565730 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:25.565757 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:26.581798 (+1016041us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b54003a7ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:26.581856 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:26.582012 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108536192}
I20260709 13:16:26.584564  6093 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.585196  3963 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.590698  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:26.593396  6013 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.595428  4119 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:26.525081  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 155728us
I20260709 13:16:26.613571  5944 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.616842  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:26.621294  6082 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:16:26.640614  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.594233  5834 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:26.556828  5955 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:26.569446  5741 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.661509  4117 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 13:16:26.661935  4117 pending_rounds.cc:85] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 2
I20260709 13:16:26.662147  4117 pending_rounds.cc:107] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:16:26.662390  4117 raft_consensus.cc:2889] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:26.644608  5946 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.658310  4683 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:26.665306  3968 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:16:26.598803  5929 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.676806  5929 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:26.663298  5955 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.677878  5929 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.667122  5633 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.645272  5834 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:26.682721  6056 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.682544  6001 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:26.684233  3972 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:26.687749  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:26.691783  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.702169  5938 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:26.704030  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:26.697387  5936 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:26.705302  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.665956  6103 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:16:26.707139  4942 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.702798  5929 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.716461  4086 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.712899  5297 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:16:26.724227  3967 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:26.724426  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.710189  6056 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:26.725049  6121 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:26.725152  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 226340us
I20260709 13:16:26.719946  5936 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:26.717677  5820 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:16:26.731218  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.719724  6103 consensus_queue.cc:1243] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:26.736644  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.737578  4038 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:16:26.740892  6065 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.741257  6067 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:26.729276  6056 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:16:26.746833  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:26.748454  5889 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:26.735625  6034 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:26.749053  5889 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.729984  6121 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.751282  5889 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.736726  6001 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:26.756789  5993 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.760317  4042 raft_consensus.cc:2368] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6.
I20260709 13:16:26.760998  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.761628  4046 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:26.762480  5954 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.763695  4040 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:16:26.758879  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:26.732683  5938 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:26.747493  6056 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.769683  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.770730  3963 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.771520  5978 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:26.772126  5981 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.767467  5938 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.773036  6112 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:26.773543  6112 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:26.774222  3966 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:26.775184  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.751377  6121 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:26.777431  6130 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
I20260709 13:16:26.778196  5938 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.778519  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.779451  5936 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.828676  6095 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.780378  5563 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:26.829711  5563 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:26.830734  6095 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.830543  5563 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.831858  5563 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.774358  6112 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.832578  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:26.754171  6067 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:26.835186  3969 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:26.835813  6067 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.793332  5834 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.794006  5954 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.799983  6001 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:26.801014  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:26.838559  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:26.843889  5834 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:26.845005  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44225.9us
I20260709 13:16:26.845350  5741 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:26.845722  5741 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:26.846055  5741 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.848801  4086 leader_election.cc:400] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6.
I20260709 13:16:26.849184  4086 leader_election.cc:403] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:16:26.850015  5946 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.844102  6032 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:26.851503  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:26.853677  5983 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:26.857386  3969 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:26.859449  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.861352  3969 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:26.863770  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.867334  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:26.867993  4119 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:26.811051  6056 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.870417  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.871623  6056 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.826107  6013 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:26.882557  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.883404  4046 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.793378  5993 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:26.885977  5946 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6.
I20260709 13:16:26.894994  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.818374  5955 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:26.897926  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.904311  4043 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.911347  4043 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:26.903498  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.914710  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:26.915424  3964 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:26.916388  4119 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:26.917821  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.918326  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.918479  3964 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.919198  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 42) took 5111 ms. Trace:
I20260709 13:16:26.920456  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.923844  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:26.923684  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.924520  4121 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:26.924921  4121 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:26.871330  5741 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.926904  4119 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:26.931171  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:26.929544  4121 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:26.949074  3966 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:26.955024  4121 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:26.964171  4119 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:26.964999  4118 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:26.950014  5938 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:26.970155  3972 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.975914  3969 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:26.978047  4121 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:26.955286  4680 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:26.980728  5741 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:26.982026  6079 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:16:26.982470  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:26.984316  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70351.1us
I20260709 13:16:26.981202  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:26.989488  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:26.990244  3964 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:26.993304  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:26.993901  3969 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:26.989817  4046 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:26.969568  5938 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:27.004356  3969 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:27.002166  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:27.008244  6112 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.008924  6112 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:26.997381  5993 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:27.006139  5938 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.025475  5741 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:27.026806  5888 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:27.027159  5888 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:27.027580  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:27.028326  5983 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:27.027987  5888 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:27.028859  5983 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:26.996533  5563 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:16:26.919550  3867 rpcz_store.cc:276] 0709 13:16:21.791192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.791450 (+   258us) service_pool.cc:224] Handling call
0709 13:16:21.805390 (+ 13940us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b540033ff90. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed733280b2 00007fed7c2a1a89 00007fed7c239da6 00007fed7c20b088 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc
0709 13:16:21.829303 (+ 23913us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:16:26.902604 (+5073301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:25.293250 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:25.294071 (+   821us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:25.294187 (+   116us) write_op.cc:435] Acquired schema lock
0709 13:16:25.294219 (+    32us) tablet.cc:662] Decoding operations
0709 13:16:25.295297 (+  1078us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:25.295372 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:25.295403 (+    31us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:25.296264 (+   861us) tablet.cc:701] Row locks acquired
0709 13:16:25.296289 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:16:25.312099 (+ 15810us) write_op.cc:270] Start()
0709 13:16:25.312248 (+   149us) write_op.cc:276] Timestamp: P: 1783602985308429 usec, L: 0
0709 13:16:25.312276 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:16:25.364726 (+ 52450us) log.cc:844] Serialized 3019 byte log entry
0709 13:16:25.923610 (+558884us) op_driver.cc:464] REPLICATION: finished
0709 13:16:26.333680 (+410070us) write_op.cc:301] APPLY: starting
0709 13:16:26.336901 (+  3221us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:26.401229 (+ 64328us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:26.433680 (+ 32451us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:26.559258 (+125578us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:26.559453 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:16:26.559494 (+    41us) write_op.cc:312] APPLY: finished
0709 13:16:26.559729 (+   235us) log.cc:844] Serialized 58 byte log entry
0709 13:16:26.559902 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:26.560024 (+   122us) write_op.cc:454] Released schema lock
0709 13:16:26.560088 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:26.661844 (+101756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:26.663526 (+  1682us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2066591,"reported_tablets":8,"spinlock_wait_cycles":58567296,"child_traces":[["op",{"apply.queue_time_us":380996,"apply.run_cpu_time_us":3753,"apply.run_wall_time_us":316542,"num_ops":7,"prepare.queue_time_us":108417,"prepare.run_cpu_time_us":51663,"prepare.run_wall_time_us":345912,"raft.queue_time_us":76723,"raft.run_cpu_time_us":21970,"raft.run_wall_time_us":368105,"replication_time_us":547818,"thread_start_us":360087,"threads_started":4,"wal-append.queue_time_us":325168}]]}
I20260709 13:16:27.009892  6112 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.007467  5945 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:16:27.029861  5983 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.055608  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:27.033463  5993 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:27.057782  4042 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:27.059419  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:27.071187  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63896.1us
I20260709 13:16:27.072367  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:27.051753  5888 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:27.054739  5889 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:16:27.038383  5297 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:16:27.089603  5954 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:27.091699  5955 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:27.062608  6116 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:27.042222  6056 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:16:27.090472  5993 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.134971  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:16:27.132797  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45843us
I20260709 13:16:27.062909  6001 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 13:16:27.137936  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58719us
I20260709 13:16:27.071725  5981 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:16:27.156949  5741 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.158478  5741 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:16:27.135756  6141 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.094s	user 0.000s	sys 0.004s
I20260709 13:16:27.165458  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:27.166293  5981 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:27.174768  5981 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:27.168808  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 134) took 8522 ms. Trace:
I20260709 13:16:27.170185  3868 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 3 to 4, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.173933  5938 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:27.181226  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46330.3us
I20260709 13:16:27.168529  5741 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.191730  3868 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:27.196372  3969 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:27.136409  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58570.3us
I20260709 13:16:27.192823  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:27.210623  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:27.210860  4113 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:16:27.191146  5935 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:27.215530  3868 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:27.218595  5947 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:27.220079  4038 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:16:27.220427  4038 pending_rounds.cc:85] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 3
I20260709 13:16:27.220628  4038 pending_rounds.cc:107] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:16:27.220889  4038 raft_consensus.cc:2889] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.177888  3870 rpcz_store.cc:276] 0709 13:16:18.646537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:18.647036 (+   499us) service_pool.cc:224] Handling call
0709 13:16:19.011966 (+364930us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:16:19.053262 (+ 41296us) spinlock_profiling.cc:243] Waited 30.4 ms on lock 0x7b540033ff90. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73328640 00007fed7c1ffb76 00007fed7c309c3e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:16:27.168590 (+8115328us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:21.794067 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:21.794932 (+   865us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:21.794981 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:16:21.795016 (+    35us) tablet.cc:662] Decoding operations
0709 13:16:21.891295 (+ 96279us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:21.891408 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:21.891434 (+    26us) tablet.cc:685] Acquiring locks for 36 operations
0709 13:16:21.938372 (+ 46938us) tablet.cc:701] Row locks acquired
0709 13:16:21.938421 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:16:21.938632 (+   211us) write_op.cc:270] Start()
0709 13:16:21.938803 (+   171us) write_op.cc:276] Timestamp: P: 1783602981938555 usec, L: 0
0709 13:16:21.938841 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:16:21.939608 (+   767us) log.cc:844] Serialized 14117 byte log entry
0709 13:16:22.031164 (+ 91556us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b54000abca0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c1dbe 00007fed763cc930 00007fed763cc8d8 00007fed763cc858 00007fed763cc813 00007fed763cba9c 00007fed7c2b7626 00007fed7c2b1dd8 00007fed764087cb 00007fed7640b2c0
0709 13:16:22.509654 (+478490us) op_driver.cc:464] REPLICATION: finished
0709 13:16:22.657850 (+148196us) write_op.cc:301] APPLY: starting
0709 13:16:22.657974 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:22.665117 (+  7143us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:22.665158 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:22.746503 (+ 81345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:22.746964 (+   461us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
0709 13:16:22.747031 (+    67us) write_op.cc:312] APPLY: finished
0709 13:16:22.747614 (+   583us) log.cc:844] Serialized 235 byte log entry
0709 13:16:22.772120 (+ 24506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.790721 (+ 18601us) write_op.cc:454] Released schema lock
0709 13:16:22.822231 (+ 31510us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:22.878401 (+ 56170us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:22.882239 (+  3838us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":59580,"reported_tablets":53,"spinlock_wait_cycles":579908864,"child_traces":[["op",{"apply.queue_time_us":117422,"apply.run_cpu_time_us":11549,"apply.run_wall_time_us":184102,"num_ops":36,"prepare.queue_time_us":110869,"prepare.run_cpu_time_us":14839,"prepare.run_wall_time_us":238480,"raft.queue_time_us":406184,"raft.run_cpu_time_us":20638,"raft.run_wall_time_us":157598,"replication_time_us":551771,"spinlock_wait_cycles":11391232,"thread_start_us":456972,"threads_started":4,"wal-append.queue_time_us":64111,"wal-append.run_cpu_time_us":33176,"wal-append.run_wall_time_us":1744632}]]}
I20260709 13:16:27.204370  5741 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.225665  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:27.204968  6116 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.225474  5935 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:27.192533  5981 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.277477  5981 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:27.233500  6116 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:27.289142  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 96421.9us
I20260709 13:16:27.273562  5935 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.290391  5563 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:27.290956  5563 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:27.291821  5563 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.284415  5938 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:27.262893  3868 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.298228  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:27.298857  3967 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.252352  6013 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:27.309649  6116 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:27.312879  3868 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 2 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:27.318150  4116 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:27.319449  3967 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
W20260709 13:16:27.321205  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:27.323076  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47755.6us
I20260709 13:16:27.325074  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:27.329412  4118 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:27.346141  4046 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:27.347291  5887 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:16:27.363672  5887 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:27.364032  5887 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:27.364840  5887 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.365718  5887 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:27.372090  4118 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:27.370364  3868 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 2 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 5 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.373354  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:27.329464  6071 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:16:27.390465  5969 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:27.421923  3868 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:27.423301  5969 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:27.477085  5969 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:27.507956  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.682179  3868 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 2 to 4, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 4 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:16:27.686491  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.698832  3868 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 3 to 4, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 4 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:27.720662  3868 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:27.724310  3868 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:16:27.759706  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 170444us
I20260709 13:16:27.760664  5966 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:27.788055  6145 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.526s	user 0.006s	sys 0.019s
W20260709 13:16:27.793044  6157 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:16:27.804014  5966 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.806381  5966 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:27.814524  6144 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.587s	user 0.016s	sys 0.008s
W20260709 13:16:27.839396  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.850953  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:27.845590  5935 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:27.878799  3964 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:27.867689  6161 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
W20260709 13:16:27.892028  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46078.6us
I20260709 13:16:27.888568  5935 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:27.904505  5935 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:27.894433  6150 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:16:27.911404  4047 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:16:27.919575  6162 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:16:27.922240  5783 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:27.933239  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:27.936441  3969 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:27.937853  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:27.938477  3971 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:27.942324  4118 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:16:27.942696  4118 pending_rounds.cc:85] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 4
I20260709 13:16:27.942904  4118 pending_rounds.cc:107] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:16:27.942984  4121 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:27.943236  4118 raft_consensus.cc:2889] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:27.945498  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:27.946467  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:27.947687  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:27.949205  4039 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:27.952981  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:27.953644  4113 raft_consensus.cc:606] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:27.953984  4113 raft_consensus.cc:614] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:27.962723  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:27.963375  4112 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:27.939484  5820 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:27.994534  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:27.968952  6171 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:28.018205  4117 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:28.052469  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.021311  4041 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:28.076452  4112 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:28.076690  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:28.027454  6095 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:28.027002  5966 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:27.971521  6070 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:16:28.078838  4117 raft_consensus.cc:606] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:28.060974  6169 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.060880  5887 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:16:28.051687  5820 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.084548  6095 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.136996  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:28.143359  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 87254.7us
I20260709 13:16:28.144209  4042 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:28.145907  6001 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:28.146485  6095 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.089336  5978 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.166383  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:28.135813  6031 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.183689  4114 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:28.092693  5966 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.132833  6169 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.179292  5981 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:28.189397  5981 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.189747  5981 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.185971  6031 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.192903  6031 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.196159  5966 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.177711  5978 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.198642  5978 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.178597  6095 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:28.202497  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 141296us
I20260709 13:16:28.219201  5820 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.221462  6169 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.226168  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.233246  4045 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:28.227252  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.208115  6095 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.234292  4043 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
W20260709 13:16:28.233757  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50781.7us
I20260709 13:16:28.244621  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:28.240213  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:28.248677  6095 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.250924  6095 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.253139  6095 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.256879  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:28.259835  5889 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.263600  6169 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:28.292480  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.293104  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.293910  4043 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:28.248955  5981 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.299626  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.268927  6171 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:16:28.315088  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45434.6us
I20260709 13:16:28.266388  5966 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:28.269236  6001 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:28.340667  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.342845  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:28.293871  6169 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.359426  6169 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:28.359704  6159 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.646s	user 0.007s	sys 0.007s
I20260709 13:16:28.270900  5889 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
W20260709 13:16:28.366367  6172 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:16:28.369259  5981 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.370425  5966 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.342218  6001 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:28.372750  5966 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.375025  6001 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.384640  5938 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.385320  5938 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.387449  5938 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.372748  3971 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.391433  6178 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:28.377942  6177 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:16:28.392798  6178 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:28.379163  5982 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:28.394484  5982 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:28.423936  5982 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:28.426066  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83312.1us
I20260709 13:16:28.434295  6109 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:28.434978  5999 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.435441  5999 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.435987  6109 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.437348  5999 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.436517  6109 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.438928  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:28.440019  6109 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.441665  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:28.442772  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.445392  4119 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.446437  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:28.446368  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.447067  4120 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.452066  4038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:28.452749  4038 raft_consensus.cc:606] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:28.453104  4038 raft_consensus.cc:614] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:16:28.466032  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55130.1us
I20260709 13:16:28.468400  4118 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:28.470691  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:28.472054  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.434659  6116 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.478466  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:28.477483  3969 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:28.479581  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.480648  3964 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:28.482612  4042 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:28.482894  3969 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.486223  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.447203  6160 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:16:28.489791  4121 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:28.454704  5966 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.492976  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:28.480886  5999 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.496884  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:28.498273  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.499819  3969 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:28.476687  6109 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.500937  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:28.507189  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:28.507804  3971 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:28.485256  6177 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.499426  5981 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.499521  6174 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.499593  5889 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:28.538452  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 196656us
I20260709 13:16:28.487757  6116 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.494024  5936 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:16:28.548408  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:28.505946  5999 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.557189  3971 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:28.567390  4038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:28.568046  4038 raft_consensus.cc:606] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:28.568388  4038 raft_consensus.cc:614] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:28.516322  5969 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:16:28.518395  6169 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.502336  5966 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.514372  6109 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:28.582259  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67308.5us
I20260709 13:16:28.518152  6177 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:28.627089  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 106830us
W20260709 13:16:28.628897  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 124206us
I20260709 13:16:28.630877  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:28.631541  6177 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.634543  5887 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:28.632227  6177 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:28.548949  5889 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:28.623042  6145 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:16:28.647671  4112 raft_consensus.cc:2368] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:16:28.546751  6174 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.518265  6171 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:28.677062  3964 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:28.649181  6013 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:16:28.677214  6149 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:28.648216  6070 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:28.695847  4045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:28.699366  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.700037  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.701722  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.702337  4118 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:28.679286  5935 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:28.702255  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:28.714545  6187 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:16:28.716583  6195 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:28.716423  5969 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:16:28.726045  5936 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:28.703621  5981 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.730563  5981 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.690310  6013 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.735869  6013 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.741034  5966 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.742584  5889 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.744537  6169 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.700749  5947 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.746388  5947 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.748730  5947 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.749600  6109 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:28.756029  4120 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:28.758136  6174 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.798419  6156 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:28.802778  6156 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.754550  6001 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.807251  6001 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.781468  5981 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.809691  6156 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.829762  5947 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.830695  5947 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.832906  5947 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:28.843641  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.844806  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.846274  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.863890  4115 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:28.846524  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.849157  6156 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.850944  5981 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.865710  5981 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.868098  5981 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.860579  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.869472  6156 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.868234  5887 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:28.872555  5887 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:28.873693  6156 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.874605  5887 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.871014  5981 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.875406  5981 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:28.882679  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 233547us
I20260709 13:16:28.871949  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:28.883435  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.883723  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.887260  6155 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:28.887645  6155 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:28.887949  6155 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:28.855435  5999 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:28.893131  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 176911us
I20260709 13:16:28.893514  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:28.893723  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:28.895853  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.897089  3937 leader_election.cc:400] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:16:28.897253  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.897895  4121 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:28.903119  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.904104  4117 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:28.902618  3937 leader_election.cc:403] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:28.894193  5993 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:28.903419  6070 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:28.910750  6065 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:28.902275  6209 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:28.908630  6116 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.921730  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:28.914911  6109 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:28.913028  5936 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:16:28.924468  6191 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:16:28.926877  5981 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:28.927474  6209 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:28.930474  6177 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:28.933149  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:28.931902  4118 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:28.948475  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:29.085070  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:29.105352  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.090445  6156 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.099467  5889 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:29.103211  6087 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.119159  5981 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:29.087656  6177 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.113889  6194 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.116180  6156 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:29.121503  5889 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:29.133108  6156 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.141734  5889 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.162245  5981 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:29.162853  5981 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.166464  6065 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:29.169232  6065 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:29.127022  6087 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.132961  6194 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.172489  5887 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.179883  6155 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.182346  5982 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:29.132202  6209 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.205574  6065 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.225623  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.218500  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:29.233625  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 146889us
I20260709 13:16:29.191337  5887 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.235164  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:29.236967  3971 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:29.233366  6087 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.244136  6065 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.249068  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:29.249923  4040 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:29.249017  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.255206  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.240932  6217 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:29.257634  6217 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.265172  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.265797  6194 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.266422  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:29.266984  6155 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.267495  6177 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.268978  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.273571  3965 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:29.274042  5887 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.277700  5981 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.281201  3971 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:29.282884  5981 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.287171  6065 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:29.287406  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:29.313258  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:29.313910  6181 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.314754  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.288136  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:29.316196  4120 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.317165  6178 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.317293  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:29.318060  3971 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:29.289171  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.320150  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:29.320823  4113 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:29.291923  6095 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.325021  6095 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.327003  6095 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.294178  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:29.313234  6065 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.330506  6065 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.296985  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.330751  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.331384  4038 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:16:29.336692  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.337152  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.337877  4112 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:29.338006  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.338641  3967 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.339327  4042 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:29.339816  4045 raft_consensus.cc:606] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:29.340129  4045 raft_consensus.cc:614] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:29.342162  4120 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:29.298431  6217 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.298899  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.293078  4040 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:16:29.303925  6109 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:16:29.305307  5889 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.312079  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.344489  3870 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 4 to 6, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:29.367226  3967 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:29.352361  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.368304  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.369701  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.368695  4044 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:29.377079  3938 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:29.380089  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.380169  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:29.383821  3972 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:16:29.385627  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:29.387286  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.388301  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:29.393796  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.395545  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:29.433079  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 56078.1us
W20260709 13:16:29.433910  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54590.5us
I20260709 13:16:29.394368  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:29.444691  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49465.5us
W20260709 13:16:29.441663  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66953.1us
W20260709 13:16:29.448504  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54204.7us
I20260709 13:16:29.447438  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:29.397771  6155 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:29.467754  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:29.470655  6017 raft_consensus.cc:993] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:29.471163  6017 raft_consensus.cc:1081] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:29.378027  6178 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:16:29.478835  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.442775  5966 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.459072  5937 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:29.468641  6206 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:16:29.501688  6155 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:29.502777  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54187.3us
I20260709 13:16:29.460956  6116 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:29.493431  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46094us
I20260709 13:16:29.509541  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:29.494968  6065 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:29.507201  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.467350  6109 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:29.433588  6156 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.547524  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:29.545679  6109 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.556944  6109 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:29.548290  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44855.9us
I20260709 13:16:29.562754  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.511821  6065 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:29.566769  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.567137  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.590863  3971 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:29.593273  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45847.3us
I20260709 13:16:29.594106  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:29.518627  5947 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:29.563903  6191 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.602746  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.513821  6116 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.589578  6165 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:29.611166  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.595748  6065 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:29.600571  6121 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.617798  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.600931  6079 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:16:29.637511  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.602355  5947 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.615119  5633 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.610338  6165 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:29.648268  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:29.647228  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.641247  6171 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.611508  6155 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.655054  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.655747  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:29.659847  6214 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:16:29.647477  5889 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.673346  5935 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:29.678014  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.678435  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:29.681460  4118 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:29.681864  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89716.9us
I20260709 13:16:29.680685  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.692742  4118 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:29.679684  6156 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:29.704413  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.681196  5935 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:29.719635  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:29.720204  4043 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:29.721486  6222 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:16:29.732173  5947 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:29.735421  6116 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:29.737203  6226 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:16:29.740064  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:29.751442  6079 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:29.751847  6079 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:29.752616  6079 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.753724  6079 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:29.754436  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.755106  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:29.755355  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72371.4us
I20260709 13:16:29.755959  4039 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:16:29.756908  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:29.757812  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:29.762140  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 208206us
I20260709 13:16:29.766589  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.769246  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:29.770216  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.771517  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.777175  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:29.778122  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:29.792308  4114 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:29.764935  5966 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.779412  5981 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.779172  6194 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:29.845110  4043 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:29.849025  5937 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:29.927853  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 285849us
W20260709 13:16:29.941183  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 178326us
W20260709 13:16:29.943465  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 171997us
I20260709 13:16:29.946353  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:29.944244  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 147361us
I20260709 13:16:29.956655  5937 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.958406  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.960747  5937 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:29.962304  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.964516  5937 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:29.833568  5935 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:29.930639  6191 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:29.967849  3971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:29.937626  6165 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:29.971793  3971 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:29.982228  3971 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:29.969259  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.984582  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:29.986006  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:29.991041  4045 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
W20260709 13:16:29.990296  5982 consensus_queue.cc:1175] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3fa9d459de485e824f023c55580bc6" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 13:16:30.006251  3970 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.010357  3966 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:30.014281  5935 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.032738  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.031564  3971 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:30.047281  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 81559.1us
I20260709 13:16:30.052590  6065 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.055910  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.056527  3971 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.057837  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.059419  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.043689  6013 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.061442  6194 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.059142  6156 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.048545  6177 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:30.063598  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.048868  6109 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.076179  6156 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.076733  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.077750  6109 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:30.078594  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.079633  6156 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.070449  6065 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.063472  6206 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.064596  5945 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:16:30.082871  6206 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.085059  6206 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.064996  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:30.060271  6217 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:16:30.068535  6177 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.089196  6177 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.085134  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:30.092041  4045 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:30.095849  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:30.096904  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79152.4us
I20260709 13:16:30.097604  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.099687  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.103400  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.110169  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:30.113564  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.113485  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:30.126302  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.127774  4045 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:30.106534  5966 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.109066  5981 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:30.121018  6116 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:30.117113  5889 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.135138  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.142457  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:30.145337  4115 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:30.145664  4115 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:30.146335  4115 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.147337  4115 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:30.108980  6034 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:16:30.150416  6116 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:30.155282  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.159046  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.132121  6160 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.178555  4115 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:30.158143  5937 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:30.186811  6116 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.173679  6236 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.172458  6217 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:16:30.231550  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 105271us
W20260709 13:16:30.255743  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56360.6us
I20260709 13:16:30.257561  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.237919  6034 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.268419  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:30.270541  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:30.279376  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.279981  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:30.277628  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 142559us
I20260709 13:16:30.283641  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.280252  4115 raft_consensus.cc:2410] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:16:30.261440  6191 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:16:30.321332  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44158.5us
I20260709 13:16:30.275729  6034 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.322595  6245 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:30.325815  6196 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.326651  5946 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:30.320708  6263 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:30.338838  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:30.394739  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55985.2us
I20260709 13:16:30.396697  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:30.397236  4044 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.403328  6034 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:30.384639  6182 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.054s	user 0.000s	sys 0.002s
I20260709 13:16:30.399752  6245 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:30.412844  6245 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:30.386070  6259 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.126s	user 0.002s	sys 0.000s
I20260709 13:16:30.400328  6235 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:30.424633  6235 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:30.425545  6235 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.426695  4680 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:30.400908  6196 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.430672  6196 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.436288  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.437861  5946 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:30.438764  5946 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.441268  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.453461  6209 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:30.453874  6209 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:30.454674  6209 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.455864  6209 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:30.473258  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:30.491065  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 43) took 2596 ms. Trace:
I20260709 13:16:30.491595  3870 rpcz_store.cc:276] 0709 13:16:27.896540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:27.897904 (+  1364us) service_pool.cc:224] Handling call
0709 13:16:30.490952 (+2593048us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:29.713124 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:29.867302 (+154178us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:29.867341 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:16:29.867367 (+    26us) tablet.cc:662] Decoding operations
0709 13:16:29.867747 (+   380us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:29.867807 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:29.867836 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:29.868048 (+   212us) tablet.cc:701] Row locks acquired
0709 13:16:29.868062 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:16:29.868215 (+   153us) write_op.cc:270] Start()
0709 13:16:29.868326 (+   111us) write_op.cc:276] Timestamp: P: 1783602989868169 usec, L: 0
0709 13:16:29.868348 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:29.869040 (+   692us) log.cc:844] Serialized 598 byte log entry
0709 13:16:30.085727 (+216687us) op_driver.cc:464] REPLICATION: finished
0709 13:16:30.253597 (+167870us) write_op.cc:301] APPLY: starting
0709 13:16:30.253688 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:30.253802 (+   114us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:30.253941 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:30.254211 (+   270us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:30.254380 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:30.254428 (+    48us) write_op.cc:312] APPLY: finished
0709 13:16:30.275608 (+ 21180us) log.cc:844] Serialized 22 byte log entry
0709 13:16:30.324121 (+ 48513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:30.328812 (+  4691us) write_op.cc:454] Released schema lock
0709 13:16:30.330343 (+  1531us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:30.398378 (+ 68035us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:30.400623 (+  2245us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":220613,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":148873,"apply.run_cpu_time_us":5016,"apply.run_wall_time_us":131645,"num_ops":1,"prepare.queue_time_us":209126,"prepare.run_cpu_time_us":3028,"prepare.run_wall_time_us":166605,"replication_time_us":217179,"thread_start_us":213252,"threads_started":2}]]}
I20260709 13:16:30.518283  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:30.523041  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:30.532320  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 193619us
I20260709 13:16:30.539700  3968 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:30.548138  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.572371  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.578532  4044 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:30.583559  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.567803  5938 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.598315  5889 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:16:30.589227  6249 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.590236  6217 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:30.614084  4116 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:16:30.619729  4040 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:30.630712  6264 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.244s	user 0.002s	sys 0.000s
I20260709 13:16:30.634181  6178 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:30.658880  4115 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:30.660307  6177 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:30.677268  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:30.689675  4045 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:30.659044  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 128) took 10242 ms. Trace:
I20260709 13:16:30.699196  4114 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:30.705329  3969 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:30.709002  6260 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:30.711012  6238 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:30.729959  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:30.744505  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67333.9us
I20260709 13:16:30.764039  6246 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:30.765251  5935 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.763785  3869 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 3 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:30.692559  3868 rpcz_store.cc:276] 0709 13:16:20.416919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:20.417062 (+   143us) service_pool.cc:224] Handling call
0709 13:16:30.658968 (+10241906us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:28.013355 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:28.013895 (+   540us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:28.013928 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:16:28.013947 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:28.014967 (+  1020us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:28.015050 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:28.015077 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:16:28.016138 (+  1061us) tablet.cc:701] Row locks acquired
0709 13:16:28.016158 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:16:28.016308 (+   150us) write_op.cc:270] Start()
0709 13:16:28.016420 (+   112us) write_op.cc:276] Timestamp: P: 1783602988016262 usec, L: 0
0709 13:16:28.016443 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:16:28.149296 (+132853us) log.cc:844] Serialized 4421 byte log entry
0709 13:16:28.570787 (+421491us) op_driver.cc:464] REPLICATION: finished
0709 13:16:28.876672 (+305885us) write_op.cc:301] APPLY: starting
0709 13:16:28.876785 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:28.877024 (+   239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:28.877139 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:28.878207 (+  1068us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:28.878429 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:16:28.878474 (+    45us) write_op.cc:312] APPLY: finished
0709 13:16:28.878759 (+   285us) log.cc:844] Serialized 82 byte log entry
0709 13:16:28.901730 (+ 22971us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:28.907034 (+  5304us) write_op.cc:454] Released schema lock
0709 13:16:28.909225 (+  2191us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:28.914452 (+  5227us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:28.914489 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":245027,"reported_tablets":56,"child_traces":[["op",{"apply.queue_time_us":305641,"apply.run_cpu_time_us":3089,"apply.run_wall_time_us":36876,"num_ops":11,"prepare.queue_time_us":115607,"prepare.run_cpu_time_us":21647,"prepare.run_wall_time_us":276397,"raft.queue_time_us":413389,"raft.run_cpu_time_us":50174,"raft.run_wall_time_us":417628,"replication_time_us":554195,"spinlock_wait_cycles":749312,"thread_start_us":894261,"threads_started":5,"wal-append.queue_time_us":200489}]]}
I20260709 13:16:30.757442  6013 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:16:30.773216  5947 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:30.773590  5947 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:30.774324  5947 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.775421  5947 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:30.770177  3869 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.791846  4045 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:16:30.802299  4117 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:16:30.765766  5935 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.766929  6191 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.795413  3869 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 1 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:30.761447  6017 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:16:30.852005  6031 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.852651  6031 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.854861  6031 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:30.856096  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50823.4us
I20260709 13:16:30.859462  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:30.860296  3964 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:30.860865  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.861469  4116 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:30.863797  5935 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.858646  6196 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.865638  6196 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.866982  6017 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:30.867367  6017 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:30.867668  6196 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.815555  6191 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.870445  6191 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:30.877053  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:30.879869  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:30.879990  6238 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:30.882720  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:30.868083  6017 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.884393  6017 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:30.888310  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 94590us
I20260709 13:16:30.889097  6262 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:30.899317  4012 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.900029  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.901567  5982 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:30.902024  5982 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.902393  5982 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:30.902895  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.906026  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:30.906201  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:30.876600  6206 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:30.907213  6206 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:30.911695  3969 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:16:30.912997  6013 consensus_queue.cc:1175] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e032f02b0aa450384dda978641ba666" responder_term: 7 status { last_received { term: 7 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 7 index: 4 } }
I20260709 13:16:30.916534  5935 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:30.923349  6251 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:30.944962  6065 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:30.945647  6065 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:30.998870  4046 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:31.003391  6251 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:31.044592  4038 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:31.047096  6071 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:31.047590  6065 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:31.047801  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:31.056977  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:31.060304  4121 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:31.061302  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:31.061590  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 155476us
I20260709 13:16:30.810562  3869 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 4 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.065788  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.067770  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.081660  3972 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:31.086829  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:31.067682  3869 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:31.088706  3869 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 3 to 6, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.090612  3869 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.094043  3869 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 4, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 4 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.073712  6268 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.099347  6206 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.073585  5563 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:31.104411  5947 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.101997  3869 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 2 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:31.093391  5966 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:16:31.076249  6070 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:31.114166  4038 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:16:31.079252  6278 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:16:31.118147  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:31.126569  5889 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:31.150168  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:31.221004  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:31.279609  6283 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.122s	user 0.003s	sys 0.000s
W20260709 13:16:31.293200  6281 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:16:31.292721  5955 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:31.295320  6284 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
W20260709 13:16:31.277701  6282 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:16:31.301746  3968 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:31.318444  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89415.6us
I20260709 13:16:31.308295  3857 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e20b6631af674e838a0accf36c31749f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:16:31.319618  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.322250  5931 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:31.309226  5982 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.350644  5982 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.361763  4116 raft_consensus.cc:2955] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:31.370191  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:31.371106  3967 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:31.424489  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:31.430897  4116 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:31.431983  4012 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.432258  6196 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.435223  6196 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.437309  6196 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.444940  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:31.445672  3966 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:31.450351  6289 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:31.450872  6289 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:31.451622  6289 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.457427  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:31.457996  4117 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:31.465273  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:31.494977  6217 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:31.525620  6295 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.106s	user 0.003s	sys 0.000s
I20260709 13:16:31.514611  6291 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.534055  6291 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.536139  6291 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.524310  6217 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.537500  6217 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.546806  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:31.569413  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:31.570104  4115 raft_consensus.cc:606] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.570441  4115 raft_consensus.cc:614] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.573426  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:31.573961  4040 raft_consensus.cc:606] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.574286  4040 raft_consensus.cc:614] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.576694  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:31.577245  4115 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.578527  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:31.579113  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:31.581234  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:31.581779  4116 raft_consensus.cc:606] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.591786  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.593290  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:31.593873  4116 raft_consensus.cc:606] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.594193  4116 raft_consensus.cc:614] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:31.599103  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:31.599714  4116 raft_consensus.cc:606] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.594235  6291 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.605116  6291 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.605472  6291 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.606995  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:31.608925  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:31.626677  5946 raft_consensus.cc:993] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:31.627210  6236 raft_consensus.cc:1081] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:31.629463  3967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:31.630013  3967 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:31.630338  3967 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.588183  6217 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.636997  3967 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.637728  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:31.638289  3969 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.639189  3967 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.640050  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:31.640565  4040 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.634023  6017 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:31.645830  6017 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.646960  4040 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:31.648231  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:31.649016  5889 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:31.649488  5889 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:31.649652  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:31.650542  3967 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:31.650338  5889 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.654066  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:31.654630  4116 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:31.654937  4116 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:31.657073  3969 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:31.658253  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:31.659129  5931 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.659162  4116 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.660650  4116 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:31.661033  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:31.659786  5931 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:31.661666  4041 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:31.666461  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.676136  4116 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:31.683687  5946 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:31.684285  5946 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:31.687911  3867 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 5 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.684721  5946 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.665745  5931 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.649821  6017 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:31.710359  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 44) took 1139 ms. Trace:
I20260709 13:16:31.714455  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:31.715057  4118 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:16:31.716006  6291 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.723073  4118 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:31.728659  5946 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.730706  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:31.733969  6291 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.736591  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:31.737639  4118 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:31.708369  6217 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.761823  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:31.763613  4118 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:16:31.760663  5946 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:31.710757  3867 rpcz_store.cc:276] 0709 13:16:30.575861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.589901 (+ 14040us) service_pool.cc:224] Handling call
0709 13:16:31.705645 (+1115744us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:31.690854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:31.691356 (+   502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:31.691390 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:16:31.691407 (+    17us) tablet.cc:662] Decoding operations
0709 13:16:31.691751 (+   344us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:31.691804 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:31.691830 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:31.691998 (+   168us) tablet.cc:701] Row locks acquired
0709 13:16:31.692015 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:16:31.692170 (+   155us) write_op.cc:270] Start()
0709 13:16:31.692291 (+   121us) write_op.cc:276] Timestamp: P: 1783602991692115 usec, L: 0
0709 13:16:31.692315 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:16:31.692922 (+   607us) log.cc:844] Serialized 535 byte log entry
0709 13:16:31.695037 (+  2115us) op_driver.cc:464] REPLICATION: finished
0709 13:16:31.695805 (+   768us) write_op.cc:301] APPLY: starting
0709 13:16:31.695874 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:31.696279 (+   405us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:31.696383 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:31.696639 (+   256us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:31.696855 (+   216us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:31.696902 (+    47us) write_op.cc:312] APPLY: finished
0709 13:16:31.697129 (+   227us) log.cc:844] Serialized 22 byte log entry
0709 13:16:31.700066 (+  2937us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.700153 (+    87us) write_op.cc:454] Released schema lock
0709 13:16:31.700196 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:31.700520 (+   324us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.700544 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":66917,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":474,"apply.run_cpu_time_us":1526,"apply.run_wall_time_us":4676,"num_ops":1,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2244,"prepare.run_wall_time_us":2299,"replication_time_us":2595}]]}
I20260709 13:16:31.819710  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.819536  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:31.821298  3967 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:31.828650  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 138) took 9875 ms. Trace:
I20260709 13:16:31.857635  5563 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:31.858439  5563 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:31.829332  3869 rpcz_store.cc:276] 0709 13:16:21.953376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:21.953718 (+   342us) service_pool.cc:224] Handling call
0709 13:16:22.108998 (+155280us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:16:31.828342 (+9719344us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:31.215361 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:31.247266 (+ 31905us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:31.247299 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:16:31.247312 (+    13us) tablet.cc:662] Decoding operations
0709 13:16:31.248208 (+   896us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:31.248262 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:31.248291 (+    29us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:16:31.248976 (+   685us) tablet.cc:701] Row locks acquired
0709 13:16:31.248991 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:16:31.249122 (+   131us) write_op.cc:270] Start()
0709 13:16:31.249219 (+    97us) write_op.cc:276] Timestamp: P: 1783602991249079 usec, L: 0
0709 13:16:31.249240 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:31.249921 (+   681us) log.cc:844] Serialized 3645 byte log entry
0709 13:16:31.410398 (+160477us) op_driver.cc:464] REPLICATION: finished
0709 13:16:31.602757 (+192359us) write_op.cc:301] APPLY: starting
0709 13:16:31.602841 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:31.603025 (+   184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:31.603133 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:31.623724 (+ 20591us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:31.624208 (+   484us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:16:31.624252 (+    44us) write_op.cc:312] APPLY: finished
0709 13:16:31.624518 (+   266us) log.cc:844] Serialized 70 byte log entry
0709 13:16:31.650665 (+ 26147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.650794 (+   129us) write_op.cc:454] Released schema lock
0709 13:16:31.650839 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:31.651768 (+   929us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:31.651797 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57275,"reported_tablets":53,"spinlock_wait_cycles":113067264,"child_traces":[["op",{"apply.queue_time_us":192116,"apply.run_cpu_time_us":2706,"apply.run_wall_time_us":48397,"num_ops":9,"prepare.queue_time_us":98932,"prepare.run_cpu_time_us":3833,"prepare.run_wall_time_us":77975,"replication_time_us":160999,"thread_start_us":150152,"threads_started":2}]]}
I20260709 13:16:31.881740  4040 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:31.888085  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:31.853685  3870 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:31.900424  5887 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:31.901144  5887 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.904031  5887 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:31.896335  3870 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 8 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.917166  6236 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:31.917798  6236 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:31.919054  6236 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.930754  3870 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.936296  5647 raft_consensus.cc:993] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:31.912743  5563 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:31.941334  6079 raft_consensus.cc:1081] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:31.952099  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:31.952920  4044 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:31.958886  3870 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:31.961452  3870 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.963290  3870 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:31.965372  3870 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:31.968401  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:31.969686  6155 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:31.970095  6155 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:31.970425  6155 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.017164  3969 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:32.018074  3969 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.018483  3969 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.026824  4117 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:32.035920  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:32.065320  6206 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:32.069901  3969 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.072404  3967 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:32.060691  3870 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.079192  3870 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.080914  3969 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.086239  6155 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.089097  6155 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.094242  6291 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:32.082423  3870 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.123587  6247 raft_consensus.cc:993] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:32.124264  6247 raft_consensus.cc:1081] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:32.121490  3870 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.126061  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:32.126617  4040 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.126638  3870 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.137629  3870 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.139070  3870 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.139621  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:32.146855  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:32.147959  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:32.150127  3967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:32.153100  4041 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.153126  4118 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:32.154093  4118 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:32.154930  4118 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.156221  4118 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:32.161036  4041 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:16:32.167819  4118 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:32.162518  3870 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.169471  3870 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.172842  3870 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.174281  3870 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:32.176574  3970 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:32.179658  3967 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:32.180130  3967 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.175840  3870 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 3 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 5 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.170262  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:32.197681  4040 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:32.198657  6155 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:32.200749  6155 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:32.193205  3870 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.211405  6155 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.196509  6217 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:16:32.218875  3967 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.222353  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:32.224478  6177 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:32.225263  6177 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:32.228394  3967 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.230494  4044 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:32.232270  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:32.233423  3870 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 7, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.237984  6177 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.253037  4041 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.255574  6262 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:32.260696  6262 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.262948  6262 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.262445  3870 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.264295  3870 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.283916  4041 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:32.285612  4117 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:32.292843  3870 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.294600  3870 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.272161  6217 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:32.302640  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:32.299785  6217 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.305656  3870 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.307566  3870 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 1 to 7, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:32.308890  6095 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:16:32.322731  6217 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.325086  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:32.325752  3967 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:32.325883  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:32.304052  6177 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:32.326556  4116 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:32.326918  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:32.327535  6155 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.328044  6155 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:32.329007  6155 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.325199  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:32.332715  4114 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:32.333581  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:32.333027  4114 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:32.333184  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:32.334883  4116 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:32.336277  5935 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:32.336688  5935 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:32.337046  5935 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.315434  3870 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 6, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:32.338717  4114 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.346558  4114 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.348721  6177 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:32.351143  6177 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.354928  6177 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.378361  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:32.386559  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:32.380748  5889 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:32.400805  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:32.404439  3967 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.414873  3969 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:32.417109  4118 raft_consensus.cc:2368] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:16:32.402395  5889 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:32.417810  5889 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:32.421320  6310 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:16:32.430110  6236 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:32.430903  6236 consensus_queue.cc:1243] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:16:32.431945  6236 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:32.432312  6236 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:32.439628  4044 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:32.440814  6236 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.443320  6017 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:32.445204  6236 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:32.421255  4115 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:32.455200  4114 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:32.482859  3937 leader_election.cc:400] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:16:32.483433  3937 leader_election.cc:403] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:16:32.551602  5935 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.553097  4041 raft_consensus.cc:2368] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:16:32.555348  5935 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.574057  3967 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:32.626106  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:32.618101  5887 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:16:32.638301  5633 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:32.624595  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 157379us
W20260709 13:16:32.623128  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 135735us
W20260709 13:16:32.654017  6314 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:16:32.657130  6328 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:32.674120  6312 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:16:32.654280  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:32.686339  4117 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:32.695266  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:32.706718  4115 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:32.709625  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 69973.1us
I20260709 13:16:32.721360  5889 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:32.723497  5889 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:32.725571  3967 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:32.729290  3937 leader_election.cc:400] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:16:32.736716  3967 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:32.741060  4115 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:32.750692  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:32.752213  4118 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:32.759088  6325 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:32.762465  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:32.763417  6333 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:32.763945  6333 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:32.764923  6333 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:32.778354  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47795us
I20260709 13:16:32.824462  4115 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:16:32.824930  4115 pending_rounds.cc:85] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 5
I20260709 13:16:32.825169  4115 pending_rounds.cc:107] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:16:32.825415  4115 raft_consensus.cc:2889] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:32.826285  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:32.813650  6319 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
W20260709 13:16:32.949518  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 92756.3us
W20260709 13:16:32.950997  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 116417us
I20260709 13:16:32.968945  4040 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:16:32.972406  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 131640us
W20260709 13:16:33.047824  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 228291us
W20260709 13:16:33.148558  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99703.1us
I20260709 13:16:33.151124  6319 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:33.155017  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 106950us
I20260709 13:16:33.166340  3867 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 3 to 6, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 4 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:16:33.150561  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116261us
I20260709 13:16:33.226614  4041 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:33.258791  6322 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:33.259478  6322 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:33.265996  6340 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:16:33.273957  6322 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:16:33.285619  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82325.8us
W20260709 13:16:33.284373  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88823.6us
W20260709 13:16:33.291532  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72991.1us
I20260709 13:16:33.346491  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:33.358155  6194 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:16:33.383747  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 102384us
I20260709 13:16:33.406133  6341 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:33.406906  6328 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:33.413142  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:33.424378  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:33.442303  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 135) took 2891 ms. Trace:
I20260709 13:16:33.451100  4044 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:33.442752  3870 rpcz_store.cc:276] 0709 13:16:30.551197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:30.567307 (+ 16110us) service_pool.cc:224] Handling call
0709 13:16:30.745208 (+177901us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b540033ff90. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed733280b2 00007fed7c2a1a89 00007fed7c239da6 00007fed7c20b088 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc
0709 13:16:30.752754 (+  7546us) spinlock_profiling.cc:243] Waited 7.1 ms on lock 0x7b540033ff90. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed733280f6 00007fed7c2a1a89 00007fed7c239da6 00007fed7c20b088 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc
0709 13:16:33.442170 (+2689416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:32.653150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:32.653803 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:32.653871 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:16:32.653890 (+    19us) tablet.cc:662] Decoding operations
0709 13:16:32.656283 (+  2393us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:32.656401 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:32.656437 (+    36us) tablet.cc:685] Acquiring locks for 28 operations
0709 13:16:32.676940 (+ 20503us) tablet.cc:701] Row locks acquired
0709 13:16:32.676985 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:16:32.677174 (+   189us) write_op.cc:270] Start()
0709 13:16:32.677329 (+   155us) write_op.cc:276] Timestamp: P: 1783602992677105 usec, L: 0
0709 13:16:32.677345 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:16:32.678201 (+   856us) log.cc:844] Serialized 11017 byte log entry
0709 13:16:32.786885 (+108684us) op_driver.cc:464] REPLICATION: finished
0709 13:16:32.985695 (+198810us) write_op.cc:301] APPLY: starting
0709 13:16:32.985955 (+   260us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:32.986964 (+  1009us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:32.987172 (+   208us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:33.036038 (+ 48866us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:33.036464 (+   426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:16:33.036507 (+    43us) write_op.cc:312] APPLY: finished
0709 13:16:33.073089 (+ 36582us) log.cc:844] Serialized 187 byte log entry
0709 13:16:33.143065 (+ 69976us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.144362 (+  1297us) write_op.cc:454] Released schema lock
0709 13:16:33.144744 (+   382us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:33.220168 (+ 75424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.225966 (+  5798us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2198,"reported_tablets":48,"spinlock_wait_cycles":23910400,"child_traces":[["op",{"apply.queue_time_us":198380,"apply.run_cpu_time_us":20682,"apply.run_wall_time_us":209071,"num_ops":28,"prepare.queue_time_us":120803,"prepare.run_cpu_time_us":7814,"prepare.run_wall_time_us":56606,"replication_time_us":105515,"thread_start_us":279277,"threads_started":2}]]}
I20260709 13:16:33.483620  4117 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:33.479996  4011 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:33.492038  3965 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:33.493366  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:33.499354  6356 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:33.478547  6349 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:16:33.501214  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 45) took 1630 ms. Trace:
I20260709 13:16:33.500160  4121 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:33.507192  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet e20b6631af674e838a0accf36c31749f with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:49084
I20260709 13:16:33.501703  3867 rpcz_store.cc:276] 0709 13:16:31.877414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.895474 (+ 18060us) service_pool.cc:224] Handling call
0709 13:16:33.501132 (+1605658us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:33.229635 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:33.316369 (+ 86734us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:33.316404 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:16:33.316420 (+    16us) tablet.cc:662] Decoding operations
0709 13:16:33.316779 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:33.316829 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:33.316854 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:33.317038 (+   184us) tablet.cc:701] Row locks acquired
0709 13:16:33.317056 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:16:33.317209 (+   153us) write_op.cc:270] Start()
0709 13:16:33.317317 (+   108us) write_op.cc:276] Timestamp: P: 1783602993317164 usec, L: 0
0709 13:16:33.317339 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:33.317920 (+   581us) log.cc:844] Serialized 535 byte log entry
0709 13:16:33.411743 (+ 93823us) op_driver.cc:464] REPLICATION: finished
0709 13:16:33.412220 (+   477us) write_op.cc:301] APPLY: starting
0709 13:16:33.412303 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:33.412412 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:33.412507 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:33.412729 (+   222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:33.412899 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:33.412938 (+    39us) write_op.cc:312] APPLY: finished
0709 13:16:33.413133 (+   195us) log.cc:844] Serialized 22 byte log entry
0709 13:16:33.413295 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.413375 (+    80us) write_op.cc:454] Released schema lock
0709 13:16:33.413415 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:33.413760 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.413786 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":1481,"apply.run_wall_time_us":1482,"num_ops":1,"prepare.queue_time_us":1910,"prepare.run_cpu_time_us":2871,"prepare.run_wall_time_us":112169,"replication_time_us":82695}]]}
I20260709 13:16:33.541236  6323 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:33.579200  3868 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.601907  6177 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:33.583417  3868 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.622839  5935 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:33.625311  3868 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 9, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 9 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.674815  3868 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.706880  3868 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 2 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 5 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.717188  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:33.716792  3868 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.736258  3868 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 3 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.762883  3867 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.764837  3867 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:33.766872  3867 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 9, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.768325  3867 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 6, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.769917  3867 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.782773  6362 tablet_replica.cc:333] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:16:33.786341  6362 raft_consensus.cc:2243] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:33.787461  6362 raft_consensus.cc:2272] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:16:33.841686  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44968.9us
I20260709 13:16:33.852274  3867 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.860839  3867 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:33.877225  6362 ts_tablet_manager.cc:1916] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:33.894564  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:33.895265  4119 raft_consensus.cc:606] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:33.902680  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:33.903301  4040 raft_consensus.cc:606] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:33.911597  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:33.912187  4119 raft_consensus.cc:606] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:33.918854  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:33.919486  4119 raft_consensus.cc:606] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:33.924827  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:33.925427  4119 raft_consensus.cc:606] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:33.941061  6346 raft_consensus.cc:993] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:33.941679  6330 raft_consensus.cc:1081] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:33.943557  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:33.944088  3964 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:33.944422  3964 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:33.982007  3867 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 7 to 9, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 9 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:16:33.930912  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:34.005192  4119 raft_consensus.cc:606] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:34.005609  4119 raft_consensus.cc:614] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:34.005735  6160 raft_consensus.cc:993] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:34.006477  6160 raft_consensus.cc:1081] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:34.009024  3972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:34.009589  3972 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.009928  3972 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.010466  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 129) took 2516 ms. Trace:
I20260709 13:16:34.017149  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:16:34.018973  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:34.019490  3972 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.021405  3972 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:34.022192  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:34.021723  3964 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.023869  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:34.033166  4040 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.033492  4114 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:34.033802  4114 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:34.030973  6346 raft_consensus.cc:993] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:34.034509  4114 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.035753  4114 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.039180  6346 raft_consensus.cc:1081] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:34.041355  4040 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:34.041911  3972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:34.042999  3972 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.043391  3972 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.044278  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:34.045367  6319 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:34.045861  6319 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:34.046655  6319 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.010838  3868 rpcz_store.cc:276] 0709 13:16:31.493739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:31.497953 (+  4214us) service_pool.cc:224] Handling call
0709 13:16:34.010387 (+2512434us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:33.740678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:33.741195 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:33.741226 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:16:33.741239 (+    13us) tablet.cc:662] Decoding operations
0709 13:16:33.741991 (+   752us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:33.742045 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:33.742070 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:16:33.742604 (+   534us) tablet.cc:701] Row locks acquired
0709 13:16:33.742617 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:16:33.742759 (+   142us) write_op.cc:270] Start()
0709 13:16:33.742866 (+   107us) write_op.cc:276] Timestamp: P: 1783602993742715 usec, L: 0
0709 13:16:33.742884 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:16:33.743533 (+   649us) log.cc:844] Serialized 2865 byte log entry
0709 13:16:33.746427 (+  2894us) op_driver.cc:464] REPLICATION: finished
0709 13:16:33.746849 (+   422us) write_op.cc:301] APPLY: starting
0709 13:16:33.746931 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:33.747121 (+   190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:33.747211 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:33.747897 (+   686us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:33.748084 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:16:33.748130 (+    46us) write_op.cc:312] APPLY: finished
0709 13:16:33.748364 (+   234us) log.cc:844] Serialized 58 byte log entry
0709 13:16:33.748522 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.748641 (+   119us) write_op.cc:454] Released schema lock
0709 13:16:33.748689 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:33.750274 (+  1585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:33.750301 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":24131,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":2191,"apply.run_wall_time_us":3108,"num_ops":7,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":3175,"prepare.run_wall_time_us":5487,"replication_time_us":3410,"spinlock_wait_cycles":69888}]]}
I20260709 13:16:34.051579  3972 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.053731  3972 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:34.058697  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:34.059206  4040 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.066920  3964 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:34.074260  4040 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:34.075358  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:34.076962  4114 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:34.074462  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:34.080015  4119 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:34.081379  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:34.082741  4113 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:34.083019  4113 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:34.083977  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:34.084527  4045 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.084409  4113 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.085700  4113 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:34.083367  6349 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:34.091707  6349 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:34.092645  6349 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.102885  6362 ts_tablet_manager.cc:1929] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 13:16:34.103482  6362 log.cc:1199] T e20b6631af674e838a0accf36c31749f P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/e20b6631af674e838a0accf36c31749f
I20260709 13:16:34.080264  4119 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:34.110934  4113 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:34.119818  4045 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:34.118276  4119 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.122357  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:34.122735  4119 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.129150  6341 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:34.129678  6341 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:34.130577  6341 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.140287  4042 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:34.176277  4119 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
W20260709 13:16:34.219525  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87638.9us
W20260709 13:16:34.230458  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 108192us
I20260709 13:16:34.311178  6079 raft_consensus.cc:993] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:34.311671  6079 raft_consensus.cc:1081] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:34.318315  6355 raft_consensus.cc:993] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:34.318835  6355 raft_consensus.cc:1081] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:34.321163  4119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
I20260709 13:16:34.321708  4119 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.322036  4119 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.127825  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet e20b6631af674e838a0accf36c31749f (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
W20260709 13:16:34.329321  3856 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 202317us
I20260709 13:16:34.334587  4119 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.406002  4119 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:34.408144  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 139) took 1470 ms. Trace:
I20260709 13:16:34.408667  3869 rpcz_store.cc:276] 0709 13:16:32.938124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:32.938295 (+   171us) service_pool.cc:224] Handling call
0709 13:16:32.980203 (+ 41908us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:16:34.408054 (+1427851us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29967,"reported_tablets":43,"spinlock_wait_cycles":64115584}
I20260709 13:16:34.414300  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:34.418067  4042 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:34.418391  4042 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:34.432432  4042 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.477101  4042 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.485745  3972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:34.486522  3972 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:34.486889  3972 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.503175  3972 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.507534  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:34.508278  3966 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:34.518769  4042 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:34.524281  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:34.531599  4040 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.537220  6374 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:34.542269  6374 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:34.544560  3972 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:34.545331  6328 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:34.548575  4119 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.549757  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:34.550315  4040 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.556093  6374 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.568312  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:34.568933  4113 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:34.569216  4113 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:34.569947  4113 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.570936  4113 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:34.588279  4113 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:34.580621  3966 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:34.524080  3869 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 5 to 6, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.603168  6349 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:34.595924  4040 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:34.603518  3869 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.623916  3869 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:34.622890  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:34.643041  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 99734.5us
I20260709 13:16:34.641994  6377 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:34.664503  6377 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:34.672806  6377 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:34.699062  4119 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:34.723357  4040 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:34.734872  3868 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:34.724444  6262 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:16:34.759588  6341 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:16:34.779824  4113 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:34.800868  6377 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:34.803947  4045 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:34.820356  6319 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:16:34.987933  3966 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:34.991189  6371 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:35.027446  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:35.032881  4042 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:35.034430  6368 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:35.108156  3869 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 5 to 6, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.149819  4113 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:35.152921  6319 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:35.214149  4045 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:35.216039  6376 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:35.267778  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:35.377645  3966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:35.378242  3966 raft_consensus.cc:606] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:35.383154  3966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:35.383809  3966 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:35.386173  6341 raft_consensus.cc:993] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.386708  6376 raft_consensus.cc:1081] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.391232  3972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:35.391809  3972 raft_consensus.cc:606] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:35.393138  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:35.393677  4113 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.394016  4113 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.403048  4045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:35.403928  4045 raft_consensus.cc:606] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:35.418785  4045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:35.419355  4045 raft_consensus.cc:606] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:35.420867  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:35.422586  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:35.450169  4113 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.452332  4113 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:35.455227  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:35.455791  4045 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.461977  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:35.462841  3966 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:35.463181  3966 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:35.464008  3966 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.483703  3966 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:35.487885  6355 raft_consensus.cc:993] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:35.488463  6332 raft_consensus.cc:1081] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:35.492048  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:35.492578  3964 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.492944  3964 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.501245  3964 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.503718  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:35.504266  4042 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:35.504558  4042 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:35.504990  3966 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:35.505290  4042 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.506477  4042 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.507874  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:35.506412  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:35.520130  4042 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:35.528491  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:35.529341  6319 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:35.529891  6319 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:35.530758  6319 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.535754  6368 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:35.536242  6368 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:35.537091  6368 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.551594  3964 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:35.569528  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:35.570195  4113 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.612874  3868 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 6 to 7, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:35.631880  4113 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:35.655108  3868 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.723253  6403 raft_consensus.cc:993] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.723762  6403 raft_consensus.cc:1081] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.725461  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
I20260709 13:16:35.725986  4113 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.726343  4113 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.756081  4113 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.760941  6319 raft_consensus.cc:993] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.761452  6319 raft_consensus.cc:1081] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.763044  4121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:35.763547  4121 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.763880  4121 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.769860  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:35.770438  3972 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.777236  4121 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.777793  3972 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:35.779067  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:35.779904  6368 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:35.780387  6368 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:35.781208  6368 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.783046  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:35.783631  3964 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:35.783931  3964 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:35.784248  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:35.784751  4040 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.784619  3964 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.785715  3964 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:35.791288  4121 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:35.793869  4040 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:35.795012  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:35.795780  6160 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:35.796234  6160 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:35.797065  6160 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.816138  4113 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:35.817399  3964 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:35.818290  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:35.819054  4045 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:35.819417  4045 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:35.820223  4045 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.821882  4045 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.842077  4045 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:35.852356  6376 raft_consensus.cc:993] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.852862  6376 raft_consensus.cc:1081] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:35.857616  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:35.858131  4113 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:35.858460  4113 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.861358  3868 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.883088  4113 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.885664  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:35.886193  3964 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:35.886468  3964 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:35.887120  3964 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.888172  3964 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.903533  3964 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:35.906108  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:35.905613  3868 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.906646  4040 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:35.907575  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:35.908600  6160 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:35.909113  6160 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:35.909981  6160 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:35.920439  4040 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:35.923209  4113 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:35.951586  3868 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:35.978842  4113 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:35.985899  6401 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.028205  4040 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:36.029696  6319 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.083165  4040 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:36.090952  6368 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:36.148798  3972 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:36.150444  6160 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:36.206899  4040 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:36.208858  6160 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.243423  3972 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:36.244990  6405 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.289467  4040 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:36.313138  6380 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.315639  3966 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:36.317400  6405 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.341477  4045 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:36.397935  3966 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:36.400714  6380 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:36.412297  6160 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:36.423604  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.674944  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:36.814692  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:36.815485  4113 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:36.825230  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:36.825834  4040 raft_consensus.cc:606] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:36.838649  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:36.839227  4040 raft_consensus.cc:606] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:36.842531  3965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:36.843086  3965 raft_consensus.cc:606] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:36.848078  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:16:36.849052  5563 raft_consensus.cc:993] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:36.849522  5563 raft_consensus.cc:1081] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:36.849898  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:36.854090  3965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:36.854656  3965 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.854982  3965 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.862179  3965 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:36.868460  3965 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:36.870654  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:36.871263  4040 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:36.871549  4040 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:36.876406  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:36.877511  4113 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.872236  4040 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:36.892082  4040 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:36.913105  5563 raft_consensus.cc:993] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:36.913609  5563 raft_consensus.cc:1081] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:36.922621  4118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
I20260709 13:16:36.923204  4118 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:36.923527  4118 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.947477  4040 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:36.949046  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:36.949923  4118 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:36.951896  4118 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:36.952564  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:36.952807  4113 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:36.953217  3965 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:36.953100  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:36.960521  3965 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:36.961854  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:36.962734  6371 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:36.963239  6371 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:36.964138  6371 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:36.965803  6376 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:36.966344  6376 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:36.967218  6376 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:36.969707  4045 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:36.970106  4045 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:36.970937  4045 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:36.972335  4045 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.008708  3869 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.060500  4045 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:37.078518  3867 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 6 to 7, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.197441  6423 raft_consensus.cc:993] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:37.197979  6376 raft_consensus.cc:1081] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:37.199738  4119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:37.200258  4119 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.200606  4119 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.207711  4119 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:37.210322  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:37.210882  3965 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:37.211164  3965 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:37.211833  3965 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:37.216244  3965 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.222244  6371 raft_consensus.cc:993] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:37.222772  6371 raft_consensus.cc:1081] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:37.225363  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:16:37.225911  3964 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:37.226266  3964 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.235327  3964 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:37.237210  3964 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:37.241012  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:37.241621  4113 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:37.241921  4113 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:37.242803  4113 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:37.243883  4113 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.244462  3965 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:37.245698  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:37.246469  6380 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:37.246909  6380 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:37.247730  6380 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:37.249217  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:37.249802  4045 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:37.273279  4119 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:37.275395  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:37.275985  4040 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:37.279487  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:16:37.289319  4040 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:37.296615  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:37.294824  4113 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:16:37.303512  6341 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:37.308674  6341 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:37.309583  6341 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:37.345086  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51285.9us
I20260709 13:16:37.348418  3867 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:37.372937  3869 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 8 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 9 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:37.378860  3972 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:37.381335  6405 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.387979  4045 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:37.389673  6380 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.479336  4119 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:37.480875  6422 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.601293  4040 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:16:37.603557  6401 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.786131  4040 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:37.789108  6423 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:37.849609  4113 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:37.851447  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:37.853040  4045 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:37.854362  6160 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.871222  3972 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:37.873307  6405 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:37.879988  6423 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:16:38.081696  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:38.179714  4044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:38.180313  4044 raft_consensus.cc:606] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:38.184166  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:38.184867  4113 raft_consensus.cc:606] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:38.192420  3972 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:38.193014  3972 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:38.194803  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:38.197526  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:38.225868  6441 raft_consensus.cc:993] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:38.226398  6441 raft_consensus.cc:1081] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:38.229729  3972 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:38.230260  3972 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.230569  3972 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.244985  3972 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:38.253996  3972 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:38.255468  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:38.256047  4044 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:38.256311  4044 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:38.256685  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:38.257280  4119 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.257014  4044 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:38.258284  4044 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:38.265074  4044 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:38.266361  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:38.267223  6401 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:38.267706  6401 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:38.268522  6401 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:38.286967  4119 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:38.317552  3869 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 3 to 4, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 4 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.453523  6380 raft_consensus.cc:993] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:38.453992  6380 raft_consensus.cc:1081] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:38.504936  4044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:38.505489  4044 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.505797  4044 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.533034  4044 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:38.541604  4044 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:38.542572  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:38.543217  4119 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:38.543507  4119 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:38.545586  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:38.546319  3964 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.545492  4119 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:38.548727  4119 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:38.566120  4119 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:38.576534  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:38.579269  6332 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:38.579865  6332 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:38.580653  6332 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:38.589526  3964 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:38.656289  3869 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 5, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:38.668469  4044 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:38.674785  6401 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.774899  4117 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:38.833415  6341 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:38.858404  6422 raft_consensus.cc:993] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:38.858915  6422 raft_consensus.cc:1081] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
W20260709 13:16:38.915512  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75210.5us
I20260709 13:16:38.935140  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:38.935721  4113 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:38.936088  4113 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:38.961748  4113 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:39.012337  4113 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:39.013342  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:39.028626  4044 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.015880  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:39.029424  3965 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:39.029724  3965 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:39.030395  3965 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:39.031435  3965 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:39.016959  4115 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:39.038622  3965 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:39.038699  4044 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:39.046733  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:39.047785  6371 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:39.048329  6371 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:39.049235  6371 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:39.070344  6441 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:39.108009  3869 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:39.114825  3965 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:16:39.122093  6332 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:39.201165  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.541206  4045 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:39.544958  6457 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:39.553531  3964 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:39.556154  6457 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:39.602077  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:39.832297  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:39.832963  4121 raft_consensus.cc:606] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:39.835688  3964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:39.836258  3964 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:39.841620  4044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:39.842180  4044 raft_consensus.cc:606] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:39.843464  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:39.845211  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:40.023487  5563 raft_consensus.cc:993] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:40.023998  5563 raft_consensus.cc:1081] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:40.037854  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:40.038425  3964 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.038777  3964 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.077538  3964 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.080075  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:40.080605  4044 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:40.080899  4044 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:40.081566  4044 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.082497  4044 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.097671  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:40.098292  4113 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:40.098964  4044 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:40.099390  3964 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:40.104820  4113 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:16:40.111353  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:40.112228  6455 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:40.112696  6455 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:40.115068  6455 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.175304  3869 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 4 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.202008  6457 raft_consensus.cc:993] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:40.202476  6457 raft_consensus.cc:1081] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:40.207921  4045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:40.208472  4045 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.209199  4045 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.223630  4045 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.226341  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:40.226578  4045 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:40.226899  3964 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.227806  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:40.228341  4113 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:40.228631  4113 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:40.230899  4113 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.232004  4113 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:40.235658  3964 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:40.239732  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:40.240478  6441 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:40.241153  6441 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:40.241982  6441 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.258553  4113 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:40.269554  6341 raft_consensus.cc:993] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:40.270037  6341 raft_consensus.cc:1081] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:40.274045  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:40.274600  4113 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:40.276343  4113 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.284570  4113 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.295408  3869 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 7 to 8, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 8 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:40.300782  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:40.301646  3964 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:40.301934  3964 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:40.302559  3964 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.303417  3964 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.305508  4113 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:40.306444  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:40.307018  4045 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:40.322062  3964 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:16:40.323240  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:40.324313  6457 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:40.324851  6457 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:40.325688  6457 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:40.342564  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:16:40.377148  3869 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 9 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:40.598690  4045 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:40.602347  6401 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.669991  4113 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:40.671391  6455 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:40.752113  4113 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:40.785198  3965 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:16:40.792356  6332 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:40.795374  6481 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:40.846124  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:40.870695  3965 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:40.874027  6457 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:40.925251  4040 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:16:40.941080  6457 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:16:40.976926  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 172749us
W20260709 13:16:41.033058  6486 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.058s	user 0.005s	sys 0.017s
W20260709 13:16:41.045199  6485 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
W20260709 13:16:41.142560  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 100117us
W20260709 13:16:41.338032  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60727.4us
W20260709 13:16:41.354606  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 81471.2us
I20260709 13:16:41.887151  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:41.938659  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 73540.7us
W20260709 13:16:41.945716  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 130829us
W20260709 13:16:42.027025  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48468.5us
I20260709 13:16:42.275313  4114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:42.276305  4114 raft_consensus.cc:606] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:42.280464  4045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:42.281077  4045 raft_consensus.cc:606] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:42.284629  3964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:42.285287  3964 raft_consensus.cc:606] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:42.289448  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:42.291636  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:42.304375  6500 raft_consensus.cc:993] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:42.304991  6500 raft_consensus.cc:1081] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:42.310019  4114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:42.310658  4114 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.311111  4114 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.329847  4114 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:42.333406  4114 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:42.334429  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:42.335353  4045 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.335390  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:42.336033  3964 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:42.340683  3964 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:42.343834  4045 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:42.344025  3964 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:42.345403  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:42.346448  6501 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:42.347297  6501 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:42.348310  6501 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:42.351936  3964 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:42.363937  3964 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:42.409116  3868 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:42.515653  6481 raft_consensus.cc:993] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:42.516189  6481 raft_consensus.cc:1081] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:42.518266  3965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:42.518808  3965 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:42.519140  3965 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.588373  3965 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:42.608170  3965 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:42.611778  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:42.612398  4114 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.615187  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:42.615770  4044 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:42.616029  4044 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:42.616870  4044 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:42.618399  4044 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:42.622740  4114 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:42.640508  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:42.644563  6401 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:42.645154  6401 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:42.646188  6401 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:42.657998  4114 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:42.676530  4041 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:42.678900  6497 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:42.689709  4683 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:42.723353  6497 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:42.730348  6474 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:42.751312  4045 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:42.921923  3868 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:42.935721  4040 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:42.943084  4044 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:42.945147  6501 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:42.981657  3964 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:42.993935  6512 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:43.010700  6494 raft_consensus.cc:993] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:43.011175  6494 raft_consensus.cc:1081] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:43.012969  4040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:43.013487  4040 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:43.014045  4040 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.045984  3868 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 3 to 7, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:43.060984  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 63142.3us
W20260709 13:16:43.070935  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74062.6us
W20260709 13:16:43.141276  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78332.2us
W20260709 13:16:43.170159  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 97849.5us
I20260709 13:16:43.035450  4040 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:43.215297  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e61a3a06f437423cad355c7951a460bc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:16:43.221197  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:43.237896  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet e61a3a06f437423cad355c7951a460bc with delete_type TABLET_DATA_TOMBSTONED (TS 1e032f02b0aa450384dda978641ba666 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:45584
I20260709 13:16:43.245136  3965 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.246237  4040 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:43.293016  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:43.392958  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 153033us
I20260709 13:16:43.402349  3965 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:43.403709  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:43.404194  4114 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:43.404428  4114 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:43.405879  4114 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:43.406953  4114 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:43.429524  6519 tablet_replica.cc:333] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:16:43.452275  4683 raft_consensus.cc:2955] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:43.439253  6519 raft_consensus.cc:2243] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:43.459125  4114 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
W20260709 13:16:43.461489  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67683.2us
I20260709 13:16:43.476970  6519 raft_consensus.cc:2272] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:43.480607  6519 ts_tablet_manager.cc:1916] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:43.481014  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:43.481782  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44797.9us
I20260709 13:16:43.492913  6516 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:43.493451  6516 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:43.477084  4121 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:43.509837  6516 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:43.531951  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78041.1us
W20260709 13:16:43.536914  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 97724us
I20260709 13:16:43.548969  6519 ts_tablet_manager.cc:1929] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:16:43.549590  6519 log.cc:1199] T e61a3a06f437423cad355c7951a460bc P 1e032f02b0aa450384dda978641ba666: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/wals/e61a3a06f437423cad355c7951a460bc
I20260709 13:16:43.555965  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet e61a3a06f437423cad355c7951a460bc (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
W20260709 13:16:43.568207  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 92957.9us
I20260709 13:16:43.577390  6401 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:43.586156  4045 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:43.637640  6526 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:43.649183  3867 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:43.976517  3965 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:43.978329  6516 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:44.028280  4121 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:44.031020  6529 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:44.309844  4041 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:16:44.344483  4013 consensus_peers.cc:597] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e32744704d014399851a0661c8929ded. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.346726  3965 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:44.347221  4114 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:44.348495  6529 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:44.351883  6529 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:44.407167  6529 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.415740  4114 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.450457  3867 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
W20260709 13:16:44.461592  6547 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:16:44.495414  3965 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:44.499502  3972 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.614310  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:44.640584  3938 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf4967e9db3b4158acf225267ad19344. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.649524  4119 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:44.650803  4041 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:44.667294  6527 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:44.670408  6525 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:44.697464  6401 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.699173  4119 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.725800  3868 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:44.729799  4040 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:44.818282  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:44.818957  4042 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:44.827811  6548 raft_consensus.cc:993] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:44.828430  6549 raft_consensus.cc:1081] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:44.837755  3965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:44.838394  3965 raft_consensus.cc:606] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:44.843395  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:44.844142  4042 raft_consensus.cc:606] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:44.844133  3963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:44.845453  3963 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.845785  3963 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:44.857131  3972 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:44.858618  6548 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:16:44.861177  3965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:44.861812  3965 raft_consensus.cc:606] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:44.861811  3963 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:44.863905  3963 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:44.877302  4013 consensus_peers.cc:597] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd0cb418885343fdbc63ca85b6214aec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:44.883677  6548 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.886240  3972 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.905823  4113 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:44.909812  6516 raft_consensus.cc:993] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:44.910382  6516 raft_consensus.cc:1081] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:44.912102  3963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:44.912617  3963 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:44.912986  3963 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.920079  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:44.920696  4113 raft_consensus.cc:606] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:44.926403  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:44.926780  3963 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:44.928378  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:44.928737  3963 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:44.929308  3868 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index -1 to 3, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.930477  6559 ts_tablet_manager.cc:933] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:44.939730  6559 tablet_copy_client.cc:323] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:16:44.943902  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet e32744704d014399851a0661c8929ded from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
W20260709 13:16:44.965824  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 59938.8us
I20260709 13:16:44.968156  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:44.972811  4044 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:44.970858  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:44.973588  4045 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:44.973949  4041 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:44.978236  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet e32744704d014399851a0661c8929ded from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-e32744704d014399851a0661c8929ded
I20260709 13:16:44.975683  6548 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:16:44.973901  4045 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:44.982872  3972 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:44.983379  4045 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:44.984402  4045 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:44.992158  4057 tablet_copy_source_session.cc:215] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:45.002321  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:45.002920  4119 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.010157  6559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e32744704d014399851a0661c8929ded. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.014638  4119 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:44.973167  4044 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:45.002151  4046 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:45.022346  4044 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.022699  6401 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:45.023769  4044 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:45.027244  4114 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:16:45.028039  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:45.028614  4121 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:45.031186  3938 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 397fa935c4d84e7fbb1e5dc631ce3711. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:45.036288  4121 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:45.051465  4045 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:45.052778  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:45.053637  6401 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:45.054939  6401 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:45.055735  6401 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.064821  6553 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:45.066138  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:45.067061  4044 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:45.074605  6527 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:45.077350  4044 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:45.077337  3868 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 5 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.095568  6559 tablet_copy_client.cc:806] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:45.102618  6559 tablet_copy_client.cc:670] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:45.105567  6527 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:45.107329  6527 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.116209  6559 tablet_copy_client.cc:538] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:16:45.121106  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45771.4us
I20260709 13:16:45.106170  4121 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Committing config change with OpId 4.3: config changed from index -1 to 3, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:45.123582  6566 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.125849  3868 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:45.129036  6559 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:45.167166  4119 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index -1 to 5, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:45.194356  6521 raft_consensus.cc:993] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:45.195070  6561 raft_consensus.cc:1081] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:45.200156  4046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:45.201562  4046 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.201917  4046 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.215063  4046 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:45.220607  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46776.6us
I20260709 13:16:45.222445  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:45.223006  3963 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.234911  4046 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:45.235687  3963 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:45.242242  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:45.243845  6548 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:45.244362  6548 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:45.245280  6548 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.250238  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:45.250854  4121 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:45.251048  4121 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:45.251585  4121 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.253517  4121 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.264607  6566 raft_consensus.cc:993] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:45.265161  6566 raft_consensus.cc:1081] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:45.271634  4121 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:45.278053  3868 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.285416  4119 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:45.286206  4119 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.286597  4119 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.301783  4119 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.313520  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:45.314188  3965 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:45.314522  3965 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:45.315035  6525 raft_consensus.cc:993] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:45.315621  6525 raft_consensus.cc:1081] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:45.315290  3965 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.316919  3965 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.318786  4044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49100
I20260709 13:16:45.319324  4044 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:45.319661  4044 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.326215  6573 ts_tablet_manager.cc:933] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:16:45.328929  4119 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:45.330039  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:45.330842  4046 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:45.333010  3870 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.336314  4044 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:45.338352  3965 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:16:45.339089  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:45.361518  3963 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:45.362948  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:45.370981  6561 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:45.368821  3963 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:45.371543  6561 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:45.372742  3963 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:45.342590  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:45.375499  3963 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.373021  6561 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:45.375645  4683 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:45.341595  4044 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:45.390245  4683 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:45.392545  4046 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:16:45.402423  3963 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:45.373710  6573 tablet_copy_client.cc:323] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.193:44737
I20260709 13:16:45.431945  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:45.435485  3982 tablet_copy_service.cc:140] P 1e032f02b0aa450384dda978641ba666: Received BeginTabletCopySession request for tablet cf4967e9db3b4158acf225267ad19344 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:34862)
I20260709 13:16:45.436079  3982 tablet_copy_service.cc:161] P 1e032f02b0aa450384dda978641ba666: Beginning new tablet copy session on tablet cf4967e9db3b4158acf225267ad19344 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:34862: session id = 293c0ff21e6f4e9f93555aaba177566b-cf4967e9db3b4158acf225267ad19344
I20260709 13:16:45.424032  6577 ts_tablet_manager.cc:933] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:45.443181  6529 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:45.443759  6529 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:45.444965  6529 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:45.454725  6577 tablet_copy_client.cc:323] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:16:45.454321  3870 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 9, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 9 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:45.455446  6559 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:45.460482  6559 tablet_bootstrap.cc:492] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:45.463135  6579 ts_tablet_manager.cc:933] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:16:45.464545  6559 ts_tablet_manager.cc:1403] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.336s	user 0.034s	sys 0.000s
I20260709 13:16:45.469595  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet bd0cb418885343fdbc63ca85b6214aec from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:16:45.469391  6559 raft_consensus.cc:359] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:45.470496  6559 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:45.472674  6559 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:45.470359  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet bd0cb418885343fdbc63ca85b6214aec from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-bd0cb418885343fdbc63ca85b6214aec
I20260709 13:16:45.474097  3982 tablet_copy_source_session.cc:215] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:45.486119  6573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf4967e9db3b4158acf225267ad19344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.490279  4119 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:45.493781  6525 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:45.504225  4057 tablet_copy_source_session.cc:215] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:45.510252  6559 ts_tablet_manager.cc:1434] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:16:45.530035  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-e32744704d014399851a0661c8929ded received from {username='slave'} at 127.0.0.1:41202
I20260709 13:16:45.530537  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-e32744704d014399851a0661c8929ded on tablet e32744704d014399851a0661c8929ded with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:45.531571  6577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cb418885343fdbc63ca85b6214aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.535866  3870 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:45.542616  6579 tablet_copy_client.cc:323] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.193:44737
I20260709 13:16:45.560429  6573 tablet_copy_client.cc:806] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:45.561156  6573 tablet_copy_client.cc:670] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:45.565290  4046 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:16:45.572384  3982 tablet_copy_service.cc:140] P 1e032f02b0aa450384dda978641ba666: Received BeginTabletCopySession request for tablet 397fa935c4d84e7fbb1e5dc631ce3711 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:34862)
I20260709 13:16:45.576411  3982 tablet_copy_service.cc:161] P 1e032f02b0aa450384dda978641ba666: Beginning new tablet copy session on tablet 397fa935c4d84e7fbb1e5dc631ce3711 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:34862: session id = 293c0ff21e6f4e9f93555aaba177566b-397fa935c4d84e7fbb1e5dc631ce3711
I20260709 13:16:45.576794  6570 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:16:45.589695  6573 tablet_copy_client.cc:538] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:45.599707  6573 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:45.616493  4119 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:45.617449  3982 tablet_copy_source_session.cc:215] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:45.651117  6570 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:45.683754  6579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 397fa935c4d84e7fbb1e5dc631ce3711. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:45.686460  6577 tablet_copy_client.cc:806] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:45.700838  4046 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:45.710502  6577 tablet_copy_client.cc:670] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:45.727770  6577 tablet_copy_client.cc:538] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:45.737651  6570 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:45.752902  4117 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:45.754618  6531 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.802081  4683 raft_consensus.cc:1217] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
W20260709 13:16:45.813491  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 75255.5us
I20260709 13:16:45.826356  6577 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:45.840075  6573 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:45.850870  3965 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:45.857781  4044 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:45.870373  3964 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:16:45.909308  6573 tablet_bootstrap.cc:492] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:45.910401  6533 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.911561  6531 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:45.914386  6573 ts_tablet_manager.cc:1403] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.315s	user 0.031s	sys 0.005s
I20260709 13:16:45.918001  6583 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:45.929646  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:45.921180  6573 raft_consensus.cc:359] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:45.925853  4683 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:45.937309  6573 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:45.938051  6573 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:45.939931  6585 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:16:45.987457  6573 ts_tablet_manager.cc:1434] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.069s	user 0.003s	sys 0.005s
W20260709 13:16:46.025617  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49976.2us
I20260709 13:16:46.048167  6579 tablet_copy_client.cc:806] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:46.052301  6579 tablet_copy_client.cc:670] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:46.090476  3963 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:46.098856  6577 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:46.120147  6577 tablet_bootstrap.cc:492] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:46.122200  6577 ts_tablet_manager.cc:1403] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.296s	user 0.043s	sys 0.064s
I20260709 13:16:46.131287  3982 tablet_copy_service.cc:342] P 1e032f02b0aa450384dda978641ba666: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-cf4967e9db3b4158acf225267ad19344 received from {username='slave'} at 127.0.0.1:34862
I20260709 13:16:46.131800  3982 tablet_copy_service.cc:434] P 1e032f02b0aa450384dda978641ba666: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-cf4967e9db3b4158acf225267ad19344 on tablet cf4967e9db3b4158acf225267ad19344 with peer 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:46.141669  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 113142us
I20260709 13:16:46.157577  6577 raft_consensus.cc:359] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:46.158707  6577 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:46.162220  6579 tablet_copy_client.cc:538] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:46.162938  6549 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:16:46.199409  6579 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:46.203890  6577 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:16:46.227900  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75328.6us
I20260709 13:16:46.230171  4680 raft_consensus.cc:1217] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:16:46.264076  6577 ts_tablet_manager.cc:1434] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.000s
W20260709 13:16:46.269106  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116721us
I20260709 13:16:46.321898  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-bd0cb418885343fdbc63ca85b6214aec received from {username='slave'} at 127.0.0.1:41202
I20260709 13:16:46.322358  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-bd0cb418885343fdbc63ca85b6214aec on tablet bd0cb418885343fdbc63ca85b6214aec with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:46.409195  6612 raft_consensus.cc:1064] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:46.411963  6612 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 2, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:46.433509  4683 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:46.435595  6549 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:46.437343  4119 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:46.464972  6585 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:46.511282  3963 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:46.576269  4683 raft_consensus.cc:1217] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Deduplicated request from leader. Original: 4.2->[4.3-4.3]   Dedup: 4.3->[]
I20260709 13:16:46.581180  6531 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:46.653965  6611 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.667994  4113 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.705332  6614 raft_consensus.cc:1064] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:46.711921  6614 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:46.759167  3867 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 4 to 5, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.768179  4683 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.784008  4680 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:46.784554  3963 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index 4 to 5, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.785694  6614 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:46.794737  4044 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:46.796663  4119 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:46.807830  6571 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:46.823354  6571 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:16:46.879395  6579 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:46.880343  6579 tablet_bootstrap.cc:492] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:46.907955  6579 ts_tablet_manager.cc:1403] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.709s	user 0.045s	sys 0.014s
I20260709 13:16:46.923746  6579 raft_consensus.cc:359] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:46.924739  6579 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:46.925515  6579 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:46.933073  4046 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.932341  6527 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:46.949127  6579 ts_tablet_manager.cc:1434] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.041s	user 0.000s	sys 0.008s
I20260709 13:16:46.962827  3982 tablet_copy_service.cc:342] P 1e032f02b0aa450384dda978641ba666: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-397fa935c4d84e7fbb1e5dc631ce3711 received from {username='slave'} at 127.0.0.1:34862
I20260709 13:16:46.963328  3982 tablet_copy_service.cc:434] P 1e032f02b0aa450384dda978641ba666: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-397fa935c4d84e7fbb1e5dc631ce3711 on tablet 397fa935c4d84e7fbb1e5dc631ce3711 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:46.997529  6549 raft_consensus.cc:1064] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:47.002673  4680 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:16:47.025687  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65459.3us
I20260709 13:16:47.031921  6549 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 1, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:47.042155  6625 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.202s	user 0.003s	sys 0.000s
I20260709 13:16:47.046912  4119 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.139034  4680 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:47.140820  6600 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:47.141726  4119 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:47.143496  6600 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:47.150661  3963 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:47.156601  6549 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:16:47.193238  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:47.233369  3866 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.244616  6531 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.247098  4046 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:47.260479  3963 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.265630  4113 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:47.265326  4680 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.269397  6549 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:47.265254  4683 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:16:47.287007  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 3 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.298703  3965 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:47.280236  6549 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:47.316990  6548 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.322170  4680 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:47.325979  4117 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index 3 to 4, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.364523  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:47.365693  6605 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.367652  4046 raft_consensus.cc:606] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:47.372159  4040 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:16:47.373786  4119 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.377136  4680 raft_consensus.cc:2955] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.385473  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:47.386117  4113 raft_consensus.cc:606] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:47.392725  3968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:47.393443  3968 raft_consensus.cc:606] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:47.396214  6566 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.401684  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:16:47.404572  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:47.408823  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e32744704d014399851a0661c8929ded with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.415673  4683 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.442729  3870 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 5 to 6, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New cstate: current_term: 5 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:47.456422  3855 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf4967e9db3b4158acf225267ad19344 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.463305  6527 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:47.469524  4684 raft_consensus.cc:1217] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEARNER]: Deduplicated request from leader. Original: 6.4->[6.5-6.5]   Dedup: 6.5->[]
I20260709 13:16:47.547971  6548 raft_consensus.cc:993] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:47.548488  6600 raft_consensus.cc:1081] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:47.560949  4044 raft_consensus.cc:2955] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.619825  3869 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 6 to 7, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New cstate: current_term: 5 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.621304  3968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:47.622944  3968 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.623521  3968 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.644415  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet cf4967e9db3b4158acf225267ad19344 with delete_type TABLET_DATA_TOMBSTONED (TS 0f3fa9d459de485e824f023c55580bc6 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36870
I20260709 13:16:47.646515  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet e32744704d014399851a0661c8929ded with delete_type TABLET_DATA_TOMBSTONED (TS 1e032f02b0aa450384dda978641ba666 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45584
I20260709 13:16:47.675746  4040 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:47.682328  4113 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:47.683776  6529 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:47.687266  4680 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:47.632303  3968 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.696985  6548 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.702135  6529 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:47.711045  6636 tablet_replica.cc:333] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:16:47.712819  6636 raft_consensus.cc:2243] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.719278  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd0cb418885343fdbc63ca85b6214aec with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:47.731393  4117 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.733055  6636 raft_consensus.cc:2272] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.749763  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:47.750393  4040 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:47.750466  6553 raft_consensus.cc:993] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:47.751173  6553 raft_consensus.cc:1081] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:47.723631  4680 raft_consensus.cc:2955] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:47.754017  6636 ts_tablet_manager.cc:1916] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:47.757201  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:47.757753  4113 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.758073  4113 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.762828  4040 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:47.763612  3968 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:47.764680  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:47.765329  4117 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.766042  4113 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.772910  4117 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:47.728080  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 4 to 5, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.776818  4040 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.785991  4040 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.796489  4040 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:47.797262  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:47.798144  3968 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:47.798444  3968 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:47.795699  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:47.799093  3968 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.801004  3968 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.802210  4113 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:47.805008  6628 raft_consensus.cc:993] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:47.808274  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:47.827396  4046 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:47.809069  6614 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.829082  6614 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:47.829754  6628 raft_consensus.cc:1081] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:47.829970  6614 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.843837  4046 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:47.848173  3968 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:47.853921  6637 tablet_replica.cc:333] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:16:47.856142  4046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:47.857312  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:47.857630  4046 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:47.858057  4046 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.872668  6608 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:47.873275  6608 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:47.874164  6608 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.874071  6636 ts_tablet_manager.cc:1929] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 13:16:47.875383  6636 log.cc:1199] T cf4967e9db3b4158acf225267ad19344 P 0f3fa9d459de485e824f023c55580bc6: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/wals/cf4967e9db3b4158acf225267ad19344
I20260709 13:16:47.875641  4046 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.878155  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet cf4967e9db3b4158acf225267ad19344 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:16:47.888039  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:47.888401  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:47.888674  6637 raft_consensus.cc:2243] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:47.888837  3963 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.890347  4113 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:47.892745  4113 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:47.893532  4113 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.894701  4113 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:47.894977  6637 raft_consensus.cc:2272] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:47.896585  4046 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:47.900542  6637 ts_tablet_manager.cc:1916] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:47.900990  3963 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:16:47.902277  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:47.902707  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet bd0cb418885343fdbc63ca85b6214aec with delete_type TABLET_DATA_TOMBSTONED (TS 1e032f02b0aa450384dda978641ba666 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45584
I20260709 13:16:47.903612  6602 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:47.904126  6602 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:47.905033  6602 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:47.936360  4113 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:16:47.958333  6639 raft_consensus.cc:1064] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:47.967825  6639 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 3, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:47.977237  3869 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 6 to 7, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.991462  3870 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 8 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:47.999615  4680 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:48.001410  4113 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:48.003378  6614 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:48.003741  4040 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:48.007273  3869 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.013168  6614 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:48.023299  6614 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:48.052055  6614 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.062827  6637 ts_tablet_manager.cc:1929] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:16:48.063336  6637 log.cc:1199] T e32744704d014399851a0661c8929ded P 1e032f02b0aa450384dda978641ba666: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/wals/e32744704d014399851a0661c8929ded
I20260709 13:16:48.065236  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet e32744704d014399851a0661c8929ded (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:16:48.066380  6637 tablet_replica.cc:333] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:16:48.069502  4119 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.076674  6637 raft_consensus.cc:2243] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.077682  6637 raft_consensus.cc:2272] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.088371  4680 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.121658  6637 ts_tablet_manager.cc:1916] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:48.134266  3869 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:48.150903  4040 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 5 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.155611  3968 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:48.180428  4683 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:48.183578  6639 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.202641  6605 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.204355  4683 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.211546  4119 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:48.215613  3855 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 397fa935c4d84e7fbb1e5dc631ce3711 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:48.221119  6637 ts_tablet_manager.cc:1929] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.4
I20260709 13:16:48.221616  6637 log.cc:1199] T bd0cb418885343fdbc63ca85b6214aec P 1e032f02b0aa450384dda978641ba666: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/wals/bd0cb418885343fdbc63ca85b6214aec
I20260709 13:16:48.223022  3868 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 6 to 7, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.226079  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet bd0cb418885343fdbc63ca85b6214aec (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:16:48.240688  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet 397fa935c4d84e7fbb1e5dc631ce3711 with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:49084
I20260709 13:16:48.247027  6614 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.254765  4119 raft_consensus.cc:2955] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 6 to 7, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:48.262794  6646 tablet_replica.cc:333] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:16:48.263967  6646 raft_consensus.cc:2243] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:48.274319  6646 raft_consensus.cc:2272] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:48.284518  6646 ts_tablet_manager.cc:1916] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:48.324348  6646 ts_tablet_manager.cc:1929] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:16:48.332422  6646 log.cc:1199] T 397fa935c4d84e7fbb1e5dc631ce3711 P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/397fa935c4d84e7fbb1e5dc631ce3711
I20260709 13:16:48.334209  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet 397fa935c4d84e7fbb1e5dc631ce3711 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:16:48.358613  3968 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:48.360747  6608 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:48.405654  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:48.405823  4117 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:48.408595  6614 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:48.413034  4119 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:48.415778  6548 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:48.428905  4046 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:16:48.435822  6605 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:16:48.447799  4046 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:48.456954  6535 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:16:48.468884  3965 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:16:48.470527  6602 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:16:49.067809  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 61589.6us
I20260709 13:16:49.347033  4040 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.365932  4119 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:49.367641  6659 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:49.369164  3968 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:16:49.371944  4013 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fdf62b06bdd54048a2cc215663a17a2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:49.379174  6659 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:49.423090  6657 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.432322  4113 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.460011  3869 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 7, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.496984  3965 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index -1 to 7, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.550549  4113 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.571983  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:49.706584  4087 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8e3b561578040338afbbb292ee9e4b7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:49.706763  3965 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:49.710266  6669 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:49.716118  6665 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:16:49.726716  4046 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:49.742956  6667 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:49.744681  6670 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.753361  3968 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.785997  6676 ts_tablet_manager.cc:933] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:49.799688  4113 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.815622  3868 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:49.828022  4040 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:49.829216  6676 tablet_copy_client.cc:323] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:16:49.833012  3968 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:49.836040  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet fdf62b06bdd54048a2cc215663a17a2e from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:16:49.835901  6628 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:49.836627  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet fdf62b06bdd54048a2cc215663a17a2e from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-fdf62b06bdd54048a2cc215663a17a2e
I20260709 13:16:49.837191  6667 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:16:49.837147  4087 consensus_peers.cc:597] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e7bedca9d544f8992960c04a55f9233. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:49.851348  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:49.851948  4040 raft_consensus.cc:606] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:49.854578  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:49.854893  4057 tablet_copy_source_session.cc:215] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:49.855131  4113 raft_consensus.cc:606] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:49.858012  3964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:49.858554  3964 raft_consensus.cc:606] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:49.859126  6676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fdf62b06bdd54048a2cc215663a17a2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:49.867663  3964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:49.868292  3964 raft_consensus.cc:606] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:49.871156  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:49.871932  4046 raft_consensus.cc:606] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:16:49.874007  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:16:49.874778  4040 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.876288  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:16:49.887436  6676 tablet_copy_client.cc:806] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:49.888087  6676 tablet_copy_client.cc:670] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:49.890251  6667 raft_consensus.cc:993] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:49.890739  6667 raft_consensus.cc:1081] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:49.892596  4046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:16:49.892185  6670 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.892696  4041 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.898339  6676 tablet_copy_client.cc:538] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:49.912413  4046 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.912919  4046 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.920958  4046 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.931898  4046 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:49.932960  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:49.933563  3968 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.932994  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:49.934679  6659 raft_consensus.cc:993] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:49.936391  6659 raft_consensus.cc:1081] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:49.932061  3868 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 6, term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to <none>, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:49.937911  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:49.938426  3964 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:49.938776  3964 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.944062  4113 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:49.944453  4113 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:49.945298  4113 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.946877  4041 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.947021  4113 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:49.949307  3964 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:49.952334  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:49.953094  3964 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:49.953248  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:49.953816  4117 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.963132  4038 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:49.963502  4038 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:49.964264  4038 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:49.966924  4038 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:49.970409  6676 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:49.959578  4113 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:49.981565  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:49.971053  4117 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:49.982443  6529 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:49.983027  6529 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:49.983976  6529 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:49.986130  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:49.986955  6614 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:49.987426  6614 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:49.988174  6614 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:49.993909  4038 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:50.003145  6605 raft_consensus.cc:993] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:50.003641  6605 raft_consensus.cc:1081] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:16:50.005316  4042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49100
I20260709 13:16:50.005877  4042 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.006238  4042 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.010130  3868 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.016397  4042 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.026595  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:50.027213  3965 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:50.027494  3965 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:50.028247  3965 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.029862  3965 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.036942  3968 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:50.041378  3963 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:50.047564  3965 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:50.061852  4042 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:50.063310  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:50.063781  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:50.063921  4113 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.069767  6529 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:50.070349  6529 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:50.071274  6529 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.080430  4113 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:50.083367  3870 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 5 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:16:50.108034  4013 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 237eb348003645f7abcc1c18bd324690. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.110831  6639 raft_consensus.cc:993] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:50.116319  6682 raft_consensus.cc:1081] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:50.117898  3965 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:50.119814  3870 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.120797  6657 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:16:50.123466  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:50.124014  4113 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.124331  4113 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.126636  4117 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:16:50.134085  4113 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.128381  6681 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:16:50.140669  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:50.141223  4041 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.151724  4041 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:50.153395  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:50.154589  6628 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:50.154678  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:50.155102  6628 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:50.155272  3965 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:50.155591  3965 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:50.156178  4113 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:50.156023  6628 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.157303  3965 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.158391  3965 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:50.154945  6529 raft_consensus.cc:993] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:50.180142  6529 raft_consensus.cc:1081] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:16:50.183786  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:16:50.184417  3964 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:50.184743  3964 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.194808  3964 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.195117  3965 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:50.197630  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:50.198237  4041 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:50.198501  4041 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:50.199237  4041 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:50.246261  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45544.9us
I20260709 13:16:50.246816  3964 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:50.238509  6681 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:50.271533  6676 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:50.267783  4041 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.272449  6676 tablet_bootstrap.cc:492] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:50.277891  3870 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:16:50.279939  4117 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:50.285853  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:50.297386  4119 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:50.286430  6676 ts_tablet_manager.cc:1403] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.316s	user 0.020s	sys 0.023s
I20260709 13:16:50.302702  6676 raft_consensus.cc:359] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:50.303544  6676 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:50.304174  6676 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:50.313442  4119 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:50.279973  4041 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:50.326135  3963 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:50.352787  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:50.354107  6685 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:16:50.354589  6685 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:50.355400  6685 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:50.328904  6693 ts_tablet_manager.cc:933] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:50.345904  3870 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 4, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 4 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:50.348033  6676 ts_tablet_manager.cc:1434] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:16:50.368336  6693 tablet_copy_client.cc:323] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:16:50.371025  4130 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet f8e3b561578040338afbbb292ee9e4b7 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:16:50.371577  4130 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet f8e3b561578040338afbbb292ee9e4b7 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-f8e3b561578040338afbbb292ee9e4b7
I20260709 13:16:50.379375  4130 tablet_copy_source_session.cc:215] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:50.388567  6693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8e3b561578040338afbbb292ee9e4b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.393338  3870 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 3 to 4, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 4 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:50.408840  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-fdf62b06bdd54048a2cc215663a17a2e received from {username='slave'} at 127.0.0.1:41202
I20260709 13:16:50.409343  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-fdf62b06bdd54048a2cc215663a17a2e on tablet fdf62b06bdd54048a2cc215663a17a2e with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:50.421531  4046 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:50.423297  6685 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:50.427520  6693 tablet_copy_client.cc:806] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:50.428418  6693 tablet_copy_client.cc:670] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:50.434072  6693 tablet_copy_client.cc:538] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:50.448187  3964 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:50.454448  6688 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:16:50.450577  4013 consensus_peers.cc:597] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e7bedca9d544f8992960c04a55f9233. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:16:50.469076  6693 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:50.468480  3964 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Committing config change with OpId 6.6: config changed from index -1 to 6, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:16:50.479915  3965 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:50.486553  6688 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.491843  4117 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:16:50.493726  6682 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:50.527347  4119 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:16:50.529201  6681 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:50.570621  6676 ts_tablet_manager.cc:933] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:50.589764  4119 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:50.593060  6681 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.682767  6676 tablet_copy_client.cc:323] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:16:50.684963  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet 237eb348003645f7abcc1c18bd324690 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:16:50.685509  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet 237eb348003645f7abcc1c18bd324690 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-237eb348003645f7abcc1c18bd324690
I20260709 13:16:50.693859  4057 tablet_copy_source_session.cc:215] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:50.705168  3964 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:50.706980  6533 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.707945  6676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237eb348003645f7abcc1c18bd324690. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:50.755738  4041 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:16:50.757597  6533 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:50.767935  4683 raft_consensus.cc:1217] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Deduplicated request from leader. Original: 7.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:16:50.793165  6676 tablet_copy_client.cc:806] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:50.793886  6676 tablet_copy_client.cc:670] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:50.865363  4119 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:50.877311  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:16:50.880069  6605 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:50.885423  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 138953us
I20260709 13:16:50.942308  6676 tablet_copy_client.cc:538] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:50.952685  6676 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:50.983429  4041 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:16:50.985100  6685 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:16:51.013650  6693 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:51.028339  6693 tablet_bootstrap.cc:492] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:51.031158  6693 ts_tablet_manager.cc:1403] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.562s	user 0.029s	sys 0.016s
I20260709 13:16:51.036391  6713 ts_tablet_manager.cc:933] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:51.039322  6693 raft_consensus.cc:359] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:51.060269  6693 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:51.083191  6693 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:51.092676  6693 ts_tablet_manager.cc:1434] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 13:16:51.098037  6713 tablet_copy_client.cc:323] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:16:51.106982  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet 2e7bedca9d544f8992960c04a55f9233 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:16:51.107508  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet 2e7bedca9d544f8992960c04a55f9233 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-2e7bedca9d544f8992960c04a55f9233
I20260709 13:16:51.109939  4130 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-f8e3b561578040338afbbb292ee9e4b7 received from {username='slave'} at 127.0.0.1:51850
I20260709 13:16:51.110401  4130 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-f8e3b561578040338afbbb292ee9e4b7 on tablet f8e3b561578040338afbbb292ee9e4b7 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:51.115705  4057 tablet_copy_source_session.cc:215] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:16:51.119539  6713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e7bedca9d544f8992960c04a55f9233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:16:51.187503  6676 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:51.189189  6676 tablet_bootstrap.cc:492] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:51.198369  6676 ts_tablet_manager.cc:1403] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.246s	user 0.020s	sys 0.008s
I20260709 13:16:51.203045  6713 tablet_copy_client.cc:806] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:16:51.217171  6713 tablet_copy_client.cc:670] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:16:51.216305  6676 raft_consensus.cc:359] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:51.223081  6676 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:51.225251  6676 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:51.227025  6713 tablet_copy_client.cc:538] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:16:51.242287  6676 ts_tablet_manager.cc:1434] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:16:51.244269  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-237eb348003645f7abcc1c18bd324690 received from {username='slave'} at 127.0.0.1:41202
I20260709 13:16:51.244702  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-237eb348003645f7abcc1c18bd324690 on tablet 237eb348003645f7abcc1c18bd324690 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:51.247020  6713 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:16:51.288570  4683 raft_consensus.cc:1217] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:16:51.297406  6681 raft_consensus.cc:1064] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:51.300240  6681 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:51.406163  4683 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:51.408021  4119 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:51.409574  6713 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:16:51.410511  6713 tablet_bootstrap.cc:492] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:16:51.410524  3965 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:51.411901  6687 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:51.412896  6529 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:51.413720  6688 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:51.419740  6713 ts_tablet_manager.cc:1403] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.173s	user 0.033s	sys 0.004s
I20260709 13:16:51.427657  6713 raft_consensus.cc:359] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:51.428557  6713 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:16:51.429273  6713 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:51.442210  6713 ts_tablet_manager.cc:1434] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:16:51.446056  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-2e7bedca9d544f8992960c04a55f9233 received from {username='slave'} at 127.0.0.1:41202
I20260709 13:16:51.446480  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-2e7bedca9d544f8992960c04a55f9233 on tablet 2e7bedca9d544f8992960c04a55f9233 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:51.498999  6529 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.500607  3964 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.509455  4683 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.526386  4119 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.539076  3868 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 7 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:51.592444  4683 raft_consensus.cc:1217] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Deduplicated request from leader. Original: 6.6->[7.7-7.7]   Dedup: 7.7->[]
I20260709 13:16:51.640501  4683 raft_consensus.cc:1217] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 13:16:51.730854  4041 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:51.742161  6670 raft_consensus.cc:1064] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:51.750455  4683 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:51.750775  3964 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:16:51.752525  6529 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:51.763960  6724 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.765095  6723 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:16:51.771657  3965 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.793407  6670 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:51.805992  4683 raft_consensus.cc:2955] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Committing config change with OpId 7.9: config changed from index 8 to 9, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.836254  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fdf62b06bdd54048a2cc215663a17a2e with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:16:51.862212  3869 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index 8 to 9, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.887188  4046 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:51.887274  4680 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:51.889964  6717 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:51.896286  6533 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:51.906912  3965 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:16:51.921636  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet fdf62b06bdd54048a2cc215663a17a2e with delete_type TABLET_DATA_TOMBSTONED (TS 0f3fa9d459de485e824f023c55580bc6 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:36870
I20260709 13:16:51.929802  6669 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:51.974318  6732 tablet_replica.cc:333] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:16:51.977588  6732 raft_consensus.cc:2243] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:16:51.978477  6732 raft_consensus.cc:2272] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:16:51.983929  6533 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:51.985240  6732 ts_tablet_manager.cc:1916] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:16:51.997793  4680 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:52.005733  6732 ts_tablet_manager.cc:1929] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.8
I20260709 13:16:52.006310  6732 log.cc:1199] T fdf62b06bdd54048a2cc215663a17a2e P 0f3fa9d459de485e824f023c55580bc6: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/wals/fdf62b06bdd54048a2cc215663a17a2e
I20260709 13:16:52.045811  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet fdf62b06bdd54048a2cc215663a17a2e (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:16:52.170917  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:16:52.696343  4087 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.008s	sys 0.063s
W20260709 13:16:52.696832  4087 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.008s	sys 0.063s
W20260709 13:16:52.925642  4649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.008s	sys 0.004s
W20260709 13:16:52.926044  4649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.008s	sys 0.004s
I20260709 13:16:52.927690  6736 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:52.946291  6736 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:52.948482  6736 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:52.930205  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 232538us
I20260709 13:16:52.944049  6742 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:52.956169  6742 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:52.959859  6742 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:52.969661  6723 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.060286  6723 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.062500  6723 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:52.978513  6716 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.063351  6716 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.065970  6716 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.008607  6743 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.066933  6743 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.069341  6743 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.026096  6741 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.070218  6741 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.071408  6743 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.071943  6743 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.072796  6741 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.026908  6736 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.073568  6736 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.075789  6736 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.082983  6736 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.083640  6736 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.086249  6736 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.042308  6745 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.042683  6669 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.087791  6669 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.090211  6669 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.091347  6669 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.091848  6669 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.093856  6669 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.096273  6745 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.098287  6745 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.106581  6747 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.107179  6747 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.107491  6716 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.108048  6716 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.110126  6716 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.073812  6743 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.133066  6716 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.133821  6716 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.136466  6716 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.137120  6742 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.137780  6742 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.139194  6747 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.139837  6742 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.140751  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:53.141369  4680 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:53.142814  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:53.147485  6747 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:53.147946  6747 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.148381  6747 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:16:52.989778  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 228110us
I20260709 13:16:53.264654  6751 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:53.267683  3965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.323s	user 0.021s	sys 0.014s
W20260709 13:16:53.268450  3965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.022s	sys 0.015s
I20260709 13:16:53.270351  6752 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.296293  6748 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.270699  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2146) took 1335 ms. Trace:
I20260709 13:16:53.300654  6737 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.301789  6737 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.305219  6710 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.305441  6740 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.306152  6756 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.306330  6710 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.307395  6756 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:53.306524  6740 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.309136  6716 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.310034  6723 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.310410  6737 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.297499  6748 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.317101  6740 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.330428  6710 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.332592  6748 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.335057  6743 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.267756  6751 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.335928  6743 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.339542  6736 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.341094  6752 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.341277  6736 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.344907  6743 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.327860  6716 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.344416  3870 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 6 to 7, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:53.348004  6716 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.300230  3965 rpcz_store.cc:276] 0709 13:16:51.935456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:51.942509 (+  7053us) service_pool.cc:224] Handling call
0709 13:16:51.943013 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:16:51.943367 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:51.943392 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:16:51.944235 (+   843us) log.cc:844] Serialized 564 byte log entry
0709 13:16:53.269860 (+1325625us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:53.269987 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.270164 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:16:53.270260 (+    96us) raft_consensus.cc:1685] finished
0709 13:16:53.270276 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.270566 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1324921,"threads_started":1,"wal-append.queue_time_us":30637,"wal-append.run_cpu_time_us":1727,"wal-append.run_wall_time_us":1001748}
I20260709 13:16:53.349262  6752 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.337973  6751 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.351127  6745 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.351984  6745 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.354293  6746 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.355315  6746 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.357327  6723 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.357184  6669 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.366056  6669 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.357959  6748 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.376574  6685 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.377470  6685 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.380280  6685 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.380961  6744 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.381865  6744 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.382768  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2147) took 1400 ms. Trace:
I20260709 13:16:53.384375  6744 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.384817  6754 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.385375  6749 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.386453  6743 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.386164  6747 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.387862  3963 rpcz_store.cc:276] 0709 13:16:51.981925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.381246 (+1399321us) service_pool.cc:224] Handling call
0709 13:16:53.381913 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.382287 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.382313 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.382378 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:16:53.382411 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.382469 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.382588 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.394501  6749 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.396905  6755 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.397807  6755 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.374660  6752 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:53.400381  6755 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.393149  6744 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.415944  6747 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.417446  6750 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.418184  6750 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.420403  6750 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.426908  6755 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.410071  6752 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.446156  6745 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.446902  6749 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.502748  6740 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.503542  6740 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.412055  6748 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.497699  6670 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.465910  6739 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.496168  6710 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.498319  6716 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.445447  6759 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.499677  6755 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.439992  6760 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.518997  6760 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.500913  6745 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.499716  6723 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.485625  6747 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.444942  6754 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.446462  6746 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.509886  6758 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.510155  6740 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.442420  6669 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.444964  6743 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.532537  6760 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.532678  6743 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.518322  6755 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.439280  6744 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.533211  6759 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.534013  6754 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.535202  6744 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.535990  6746 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.525146  6749 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.540781  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.540520  6758 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.535590  6759 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.536451  6748 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.544683  6764 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.545015  6739 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.541356  6710 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.546413  6749 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.542548  6669 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:53.547559  6746 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.549728  6716 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.552320  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.554296  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.554234  6752 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.569156  6669 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.573735  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.574602  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:53.554870  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.540572  6747 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.576177  6710 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.555688  6670 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.579224  6716 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.579311  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:53.580042  4121 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:53.583024  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:53.583724  4121 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:16:53.584964  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:53.585979  6755 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.586738  6755 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.589121  6755 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.589718  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2150) took 1579 ms. Trace:
I20260709 13:16:53.590166  3972 rpcz_store.cc:276] 0709 13:16:52.010611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.588696 (+1578085us) service_pool.cc:224] Handling call
0709 13:16:53.589100 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.589269 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.589293 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.589349 (+    56us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:16:53.589408 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.589458 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.589557 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.590582  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:53.591885  4121 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:53.557557  6723 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.554206  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.598109  6723 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.562587  3968 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:53.567435  6749 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.569056  3963 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:53.594033  6669 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.591894  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2148) took 1609 ms. Trace:
I20260709 13:16:53.597630  6764 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.597821  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.597554  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:53.601900  3964 rpcz_store.cc:276] 0709 13:16:51.982231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.590935 (+1608704us) service_pool.cc:224] Handling call
0709 13:16:53.591290 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:53.591478 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:53.591503 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:53.591556 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:53.591585 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:53.591630 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:53.591725 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:53.722306  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.724201  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.645426  6735 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.725201  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.724443  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.589737  6755 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.696094  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.600315  6746 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.754173  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.988842  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:53.601600  6760 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.645993  6764 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.682219  6769 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:53.665270  6736 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:53.606948  6748 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.003566  4046 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
I20260709 13:16:53.750289  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.751423  4040 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:53.743957  6774 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:53.664937  6759 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.019611  6755 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.607267  6745 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:54.022043  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.017741  6754 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.003309  6744 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.030499  6756 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.124213  6744 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.126479  6744 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.127120  6754 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.006153  6770 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:54.129493  6754 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.129210  6770 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.130429  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.131063  4046 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:54.131418  6745 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:54.131511  6770 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.032416  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.132907  6779 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.133493  6779 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.135427  6763 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.136047  6763 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.033593  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.137147  3970 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:54.138170  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.139439  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.139986  3970 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:53.750610  6735 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.033947  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.142624  6735 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:54.034591  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.143604  3971 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:54.034979  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.039642  6780 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.041570  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.043840  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.150682  6756 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:54.150455  6780 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.075083  6760 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:53.642560  6773 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.652509  6758 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.652245  6750 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:53.751659  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:53.750836  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.096577  6776 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:54.106200  6768 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.157018  3964 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:16:54.106973  6759 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.157469  6768 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.157878  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:16:54.158663  6776 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.159225  6759 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:54.107785  6774 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.159603  6768 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.109452  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.160339  4042 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:16:54.110035  4044 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:54.110438  6755 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.135576  6779 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.157191  6750 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.161301  6780 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.110829  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.111726  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.155776  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.123181  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.009361  6752 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.132001  6748 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.164150  6752 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:54.165272  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77136.7us
I20260709 13:16:54.157080  6773 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.161301  6774 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:53.645978  6723 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.169224  3968 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:54.171466  6748 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.151222  6756 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.162933  3972 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:16:54.172636  3966 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:54.163189  4047 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:54.173645  6756 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.174727  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.175138  4117 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:54.121469  6764 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.149781  6769 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.170176  6773 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.164161  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.171290  6752 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.179724  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.183429  6750 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.649477  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:54.181875  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.184738  3972 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:54.184087  6723 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.185715  6723 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.187018  6763 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.173877  6735 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.187929  6735 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.188789  4680 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:54.185916  6769 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.192466  6670 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.191946  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.193684  3970 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:54.199481  6776 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:53.635004  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:54.202934  6765 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.203286  6755 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.203575  6765 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.203933  6755 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.205758  6765 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.206236  6750 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.193727  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:54.209996  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.206900  6750 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.210427  4042 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:54.212831  6750 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.205821  6755 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.202510  6774 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.213711  6774 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.215749  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.188323  6723 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.199955  6764 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.192735  6735 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.210002  6783 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.219311  6774 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.234344  6783 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.234771  6783 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.220409  6764 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.223878  4680 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:54.228475  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:54.229108  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.229990  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.230724  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.231405  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.231612  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.232791  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.238209  4041 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:54.239446  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.239732  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.233186  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.236054  4043 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:54.240137  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.240173  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.242449  4683 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:54.242797  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.243384  6778 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:54.243985  6778 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.238140  4676 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:54.243935  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.318360  6710 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.319903  6782 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.320560  6782 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.321975  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.322930  6782 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.323817  6710 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.327486  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.328924  6735 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:54.329406  6735 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.329782  6735 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:54.332882  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:54.333855  6670 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.334239  6670 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.334612  6670 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.335908  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.337154  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.247110  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.348119  6784 raft_consensus.cc:1064] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:54.351790  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:54.352423  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:54.354434  6755 raft_consensus.cc:1064] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:16:54.356837  6746 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:54.354583  6745 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:54.357523  6746 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.358103  6745 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:54.358230  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.358729  6745 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:54.359616  6746 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:54.359452  6755 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.361035  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.361384  3938 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:54.362252  6605 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:54.363027  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.364315  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.364640  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.364998  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.365578  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.365900  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.366206  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.366959  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.367028  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.370594  6745 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:54.375682  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.376423  3967 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:16:54.385936  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:54.386423  6760 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:54.391733  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.392809  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.393723  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.410032  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:54.418256  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.351636  6710 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.426406  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.431257  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:54.432439  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.387174  6784 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:54.450659  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.501389  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:54.501986  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70912.2us
W20260709 13:16:54.467048  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 114299us
I20260709 13:16:54.503234  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.505157  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:54.507046  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:54.509804  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 99974.5us
I20260709 13:16:54.506996  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:54.511299  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.514684  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.508491  4676 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:54.526814  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.527602  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.527930  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.529018  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.530066  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.531136  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.531919  6717 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:54.521350  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:54.522089  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:54.523577  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.525875  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:54.504554  6736 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:54.561003  6746 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:55.423830  6670 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.089s	user 0.009s	sys 0.002s
W20260709 13:16:55.423830  6783 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 1.189s	user 0.001s	sys 0.010s
I20260709 13:16:54.504261  6752 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:54.532835  6769 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:54.524389  6745 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:55.425253  6735 consensus_meta.cc:287] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.095s	user 0.007s	sys 0.004s
I20260709 13:16:55.445767  6735 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:55.446587  6739 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:55.449545  6739 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:55.444082  6783 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:55.443142  6752 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:55.450248  6739 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:55.450887  6752 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:55.451444  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2177) took 1415 ms (client timeout 1546 ms). Trace:
W20260709 13:16:55.451851  3966 rpcz_store.cc:269] 0709 13:16:54.035778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.110566 (+ 74788us) service_pool.cc:224] Handling call
0709 13:16:55.451226 (+1340660us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b54003976d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:55.451349 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22405504}
I20260709 13:16:55.452643  6739 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:55.454996  6745 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:55.455576  6745 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:55.457629  6745 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:55.458252  6783 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:54.532312  6717 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:55.448470  6735 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:54.609557  6682 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:16:55.431478  6785 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.014s	sys 0.031s
I20260709 13:16:55.464949  6682 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:55.466336  6682 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:55.436452  6736 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:55.448966  6746 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:53.645402  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:55.469555  6736 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.472638  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:55.462734  6717 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:55.442905  6670 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:55.476538  3966 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 3.
W20260709 13:16:55.477571  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 1946) took 1901 ms (client timeout 1903 ms). Trace:
I20260709 13:16:55.477746  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:55.468427  6785 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.015s	sys 0.032s
I20260709 13:16:54.532171  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:55.478034  4114 rpcz_store.cc:269] 0709 13:16:53.576502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.600511 (+ 24009us) service_pool.cc:224] Handling call
0709 13:16:55.477485 (+1876974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.489465  3966 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:55.468168  6769 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:55.493108  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:55.478416  6747 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:55.499419  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 149) took 1099 ms. Trace:
I20260709 13:16:55.503010  4047 rpcz_store.cc:276] 0709 13:16:54.393874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.531953 (+138079us) service_pool.cc:224] Handling call
0709 13:16:55.493669 (+961716us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.509284  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:55.510016  4047 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:55.515688  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:55.492980  6784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.005s	sys 0.029s
W20260709 13:16:55.519716  6784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.005s	sys 0.030s
I20260709 13:16:55.528738  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:55.536798  6769 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:55.540939  6746 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:55.895135  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:55.899802  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2251) took 1321 ms. Trace:
I20260709 13:16:55.900311  4047 rpcz_store.cc:276] 0709 13:16:54.577922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.533841 (+955919us) service_pool.cc:224] Handling call
0709 13:16:55.899720 (+365879us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.953485  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:55.954165  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
W20260709 13:16:55.954653  4047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2248) took 1518 ms (client timeout 2002 ms). Trace:
W20260709 13:16:55.955024  4047 rpcz_store.cc:269] 0709 13:16:54.436355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.906054 (+1469699us) service_pool.cc:224] Handling call
0709 13:16:55.954594 (+ 48540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.956207  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:55.957492  4047 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:55.958385  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2240) took 1524 ms. Trace:
I20260709 13:16:55.958771  4047 rpcz_store.cc:276] 0709 13:16:54.433830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.955935 (+1522105us) service_pool.cc:224] Handling call
0709 13:16:55.958326 (+  2391us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:55.952617  6670 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:55.993476  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:55.994390  4047 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:55.994861  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2256) took 1386 ms. Trace:
I20260709 13:16:55.995133  4047 rpcz_store.cc:276] 0709 13:16:54.639194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.981423 (+1342229us) service_pool.cc:224] Handling call
0709 13:16:55.994791 (+ 13368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.036911  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:56.037712  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2255) took 1429 ms. Trace:
I20260709 13:16:56.038097  4047 rpcz_store.cc:276] 0709 13:16:54.608304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:55.995617 (+1387313us) service_pool.cc:224] Handling call
0709 13:16:56.037646 (+ 42029us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.033196  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:16:56.021553  6752 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.004s
I20260709 13:16:56.040723  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:56.042629  4047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2246) took 1607 ms (client timeout 2101 ms). Trace:
W20260709 13:16:56.043030  4047 rpcz_store.cc:269] 0709 13:16:54.435282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.039598 (+1604316us) service_pool.cc:224] Handling call
0709 13:16:56.042569 (+  2971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.043952  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:56.041541  6682 consensus_meta.cc:287] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:16:56.044389  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:56.045457  4047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2245) took 1610 ms (client timeout 2141 ms). Trace:
I20260709 13:16:56.045383  3966 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
W20260709 13:16:56.046307  4047 rpcz_store.cc:269] 0709 13:16:54.435029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.043703 (+1608674us) service_pool.cc:224] Handling call
0709 13:16:56.045408 (+  1705us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:56.045876  4682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 216) took 1816 ms (client timeout 1880 ms). Trace:
W20260709 13:16:56.044896  6717 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.000s
W20260709 13:16:56.047454  4682 rpcz_store.cc:269] 0709 13:16:54.224043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.567630 (+343587us) service_pool.cc:224] Handling call
0709 13:16:56.039931 (+1472301us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.061190  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:56.040328  6752 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:56.063402  4047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 147) took 1670 ms (client timeout 2190 ms). Trace:
I20260709 13:16:56.044714  6682 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:56.064548  4047 rpcz_store.cc:269] 0709 13:16:54.393336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.046972 (+1653636us) service_pool.cc:224] Handling call
0709 13:16:56.063339 (+ 16367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.065568  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:56.064311  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:56.058485  6717 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:56.066192  6682 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:56.069218  6682 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:56.069747  6682 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:56.071527  6736 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.573s	user 0.008s	sys 0.000s
I20260709 13:16:56.071764  6682 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:56.072459  6736 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:56.071861  4043 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:56.066269  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2239) took 1632 ms. Trace:
I20260709 13:16:56.073122  6717 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:56.073457  4047 rpcz_store.cc:276] 0709 13:16:54.433604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.065328 (+1631724us) service_pool.cc:224] Handling call
0709 13:16:56.066219 (+   891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.066138  6752 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:56.074707  6736 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:56.074939  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2253) took 1496 ms. Trace:
W20260709 13:16:56.075464  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2250) took 1566 ms (client timeout 1572 ms). Trace:
I20260709 13:16:56.075276  4047 rpcz_store.cc:276] 0709 13:16:54.578592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:56.074146 (+1495554us) service_pool.cc:224] Handling call
0709 13:16:56.074445 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:56.074642 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:56.074669 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:56.074713 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:56.074748 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:56.074796 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:56.074889 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:56.076049  4043 rpcz_store.cc:269] 0709 13:16:54.509210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.525475 (+ 16265us) service_pool.cc:224] Handling call
0709 13:16:56.075393 (+1549918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:56.853844  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:56.855046  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1884) took 2280 ms (client timeout 1994 ms). Trace:
W20260709 13:16:56.855515  3969 rpcz_store.cc:269] 0709 13:16:54.574612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.577199 (+  2587us) service_pool.cc:224] Handling call
0709 13:16:56.854942 (+2277743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:54.567653  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:56.991513  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2247) took 2555 ms (client timeout 1614 ms). Trace:
W20260709 13:16:56.991999  4042 rpcz_store.cc:269] 0709 13:16:54.435870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.513585 (+ 77715us) service_pool.cc:224] Handling call
0709 13:16:56.991374 (+2477789us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.015710  4684 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.018460  6798 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.019034  6798 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.021777  6798 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.022277  6798 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.022758  6798 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.024662  6798 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.045986  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.046684  3967 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
W20260709 13:16:57.047171  3967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1885) took 2472 ms (client timeout 1908 ms). Trace:
W20260709 13:16:57.047506  3967 rpcz_store.cc:269] 0709 13:16:54.574902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.641201 (+ 66299us) service_pool.cc:224] Handling call
0709 13:16:57.047102 (+2405901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.057137  6778 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:54.563005  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 201988us
I20260709 13:16:57.068657  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:57.077383  4648 connection.cc:256] RPC call timeout handler was delayed by -1.7678446760000952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
I20260709 13:16:57.080509  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:57.081326  6799 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.081724  6799 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.082103  6799 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:16:57.089774  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.450s	user 0.009s	sys 0.036s
W20260709 13:16:57.090315  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.451s	user 0.009s	sys 0.036s
I20260709 13:16:57.090874  6759 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:57.091420  6759 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.093205  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.094067  6759 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.094609  6759 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.095073  6759 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.095345  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.095922  4115 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 4.
I20260709 13:16:57.097031  6759 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.097506  6759 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:57.097946  6759 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.098296  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:57.099038  4045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 1966) took 2861 ms (client timeout 1951 ms). Trace:
W20260709 13:16:57.099393  4045 rpcz_store.cc:269] 0709 13:16:54.237951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.238693 (+   742us) service_pool.cc:224] Handling call
0709 13:16:57.098153 (+2859460us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:16:57.098961 (+   808us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383232}
I20260709 13:16:57.100086  6759 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.100847  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.101460  4114 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
W20260709 13:16:57.101823  4086 connection.cc:256] RPC call timeout handler was delayed by -1.9925045950001277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:16:57.102192  4086 connection.cc:256] RPC call timeout handler was delayed by -1.9547045950000665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
I20260709 13:16:57.102380  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.104593  6799 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.106993  6799 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:16:57.102458  4086 connection.cc:256] RPC call timeout handler was delayed by -1.9214045950000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:16:57.107707  4086 connection.cc:256] RPC call timeout handler was delayed by -1.9169045950000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
W20260709 13:16:57.107856  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 2.5856e+06us
I20260709 13:16:57.107640  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:16:57.108083  4086 connection.cc:256] RPC call timeout handler was delayed by -1.9016045949999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:16:57.109424  3967 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.110016  6759 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.112876  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.115533  4115 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:57.116142  4649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.569s (SENT)
I20260709 13:16:53.674449  6716 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.119867  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.121132  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.121335  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.121738  4046 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
W20260709 13:16:57.122460  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 145) took 2729 ms (client timeout 1686 ms). Trace:
I20260709 13:16:57.122800  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.122537  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.123382  4047 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:57.123759  4042 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:57.124261  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.126583  4683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 214) took 2903 ms. Trace:
I20260709 13:16:57.127069  4683 rpcz_store.cc:276] 0709 13:16:54.223279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.225345 (+  2066us) service_pool.cc:224] Handling call
0709 13:16:54.241663 (+ 16318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.242842 (+  1179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.126285 (+2883443us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b54000604d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:57.126485 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23346944}
I20260709 13:16:57.128152  4121 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.129736  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.130340  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 90) took 3944 ms. Trace:
I20260709 13:16:57.130520  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.130882  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.122463  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.132354  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:54.576609  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.133363  3968 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:57.133814  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1889) took 2557 ms (client timeout 1681 ms). Trace:
I20260709 13:16:57.134629  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.134652  6716 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:57.134711  4046 rpcz_store.cc:269] 0709 13:16:54.392797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.523340 (+130543us) service_pool.cc:224] Handling call
0709 13:16:57.122392 (+2599052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.134311  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 226) took 3603 ms. Trace:
I20260709 13:16:57.130724  3870 rpcz_store.cc:276] 0709 13:16:53.186051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.187506 (+  1455us) service_pool.cc:224] Handling call
0709 13:16:57.130256 (+3942750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:53.503099 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:53.503795 (+   696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:53.503850 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:16:53.503884 (+    34us) tablet.cc:662] Decoding operations
0709 13:16:53.504322 (+   438us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:53.504434 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:53.504467 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:53.504847 (+   380us) tablet.cc:701] Row locks acquired
0709 13:16:53.504897 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:16:53.505101 (+   204us) write_op.cc:270] Start()
0709 13:16:53.505281 (+   180us) write_op.cc:276] Timestamp: P: 1783603013505025 usec, L: 0
0709 13:16:53.505327 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:16:53.506284 (+   957us) log.cc:844] Serialized 599 byte log entry
0709 13:16:54.378057 (+871773us) op_driver.cc:464] REPLICATION: finished
0709 13:16:55.469718 (+1091661us) write_op.cc:301] APPLY: starting
0709 13:16:55.469828 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:55.469964 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:55.470112 (+   148us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:55.470428 (+   316us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:55.470748 (+   320us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:55.470816 (+    68us) write_op.cc:312] APPLY: finished
0709 13:16:55.471133 (+   317us) log.cc:844] Serialized 23 byte log entry
0709 13:16:55.533027 (+ 61894us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:55.534649 (+  1622us) write_op.cc:454] Released schema lock
0709 13:16:55.534711 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:55.947821 (+413110us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:55.952337 (+  4516us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":59136,"child_traces":[["op",{"apply.queue_time_us":1091234,"apply.run_cpu_time_us":21294,"apply.run_wall_time_us":430126,"num_ops":1,"prepare.queue_time_us":136334,"prepare.run_cpu_time_us":30038,"prepare.run_wall_time_us":254051,"raft.queue_time_us":189754,"raft.run_cpu_time_us":47594,"raft.run_wall_time_us":1134677,"replication_time_us":872500,"thread_start_us":1526106,"threads_started":5,"wal-append.queue_time_us":716142,"wal-append.run_cpu_time_us":8026,"wal-append.run_wall_time_us":2107707}]]}
I20260709 13:16:57.137781  3869 rpcz_store.cc:276] 0709 13:16:53.531235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.531526 (+   291us) service_pool.cc:224] Handling call
0709 13:16:54.385483 (+853957us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:16:57.134150 (+2748667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7501,"reported_tablets":1,"spinlock_wait_cycles":517664000}
I20260709 13:16:57.126622  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.135432  4121 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:57.141505  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.141582  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.142786  4121 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:57.144687  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.109457  4086 connection.cc:256] RPC call timeout handler was delayed by -1.896204594999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:16:57.145354  4116 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
W20260709 13:16:57.145571  4086 connection.cc:256] RPC call timeout handler was delayed by -1.8566045950001353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:16:57.145949  4086 connection.cc:256] RPC call timeout handler was delayed by -1.8548045950001324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 13:16:57.146201  4086 connection.cc:256] RPC call timeout handler was delayed by -1.7711045949999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
W20260709 13:16:57.146447  4086 connection.cc:256] RPC call timeout handler was delayed by -1.7693045949999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:16:57.146708  4086 connection.cc:256] RPC call timeout handler was delayed by -1.7594045949999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 13:16:57.147019  4086 connection.cc:256] RPC call timeout handler was delayed by -1.753104594999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:16:57.147279  4086 connection.cc:256] RPC call timeout handler was delayed by -1.7036045950001153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 13:16:57.147708  4086 connection.cc:256] RPC call timeout handler was delayed by -1.6910045950000949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 13:16:57.147989  4086 connection.cc:256] RPC call timeout handler was delayed by -1.6667045950000556s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:16:57.148231  4086 connection.cc:256] RPC call timeout handler was delayed by -1.6406045950000134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
I20260709 13:16:57.145283  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.148872  4116 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.149540  4038 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:57.151145  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 221) took 2920 ms. Trace:
I20260709 13:16:57.151567  6716 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.151530  4677 rpcz_store.cc:276] 0709 13:16:54.230765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.150284 (+2919519us) service_pool.cc:224] Handling call
0709 13:16:57.150582 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.150793 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.150830 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.150892 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:57.150932 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.150988 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.151087 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.152328  4116 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
W20260709 13:16:57.148485  4086 connection.cc:256] RPC call timeout handler was delayed by -1.5848045950001506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:16:57.153052  4086 connection.cc:256] RPC call timeout handler was delayed by -1.5677045950001229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:16:57.153337  4086 connection.cc:256] RPC call timeout handler was delayed by -1.5380045950000749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:16:57.153631  4086 connection.cc:256] RPC call timeout handler was delayed by -1.5092045950000283s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 13:16:57.153774  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55609.1us
I20260709 13:16:57.154171  4116 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:57.154960  3967 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:16:57.155728  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.156051  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:16:57.147222  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1880) took 2643 ms (client timeout 1680 ms). Trace:
W20260709 13:16:57.157229  4086 connection.cc:256] RPC call timeout handler was delayed by -1.4786045949999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 13:16:57.157449  3965 rpcz_store.cc:269] 0709 13:16:54.503795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.506024 (+  2229us) service_pool.cc:224] Handling call
0709 13:16:57.147146 (+2641122us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.157763  4086 connection.cc:256] RPC call timeout handler was delayed by -1.442604595000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:16:57.134240  3968 rpcz_store.cc:269] 0709 13:16:54.575909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.576354 (+   445us) service_pool.cc:224] Handling call
0709 13:16:57.133749 (+2557395us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.158077  4086 connection.cc:256] RPC call timeout handler was delayed by -1.4102045950000957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
I20260709 13:16:57.156932  6799 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:57.158419  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.159427  4116 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
W20260709 13:16:57.146708  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:54.640303  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.162094  3970 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
W20260709 13:16:57.162518  3970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1883) took 2588 ms (client timeout 2188 ms). Trace:
W20260709 13:16:57.162818  3970 rpcz_store.cc:269] 0709 13:16:54.574241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.580564 (+  6323us) service_pool.cc:224] Handling call
0709 13:16:57.162457 (+2581893us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.166213  4068 debug-util.cc:398] Leaking SignalData structure 0x7b0800303e60 after lost signal to thread 2854
I20260709 13:16:57.167259  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.168012  4120 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:57.169687  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.168658  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.170320  4120 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:16:57.169705  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 1856) took 2831 ms. Trace:
I20260709 13:16:57.171339  3972 rpcz_store.cc:276] 0709 13:16:54.337920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.340581 (+  2661us) service_pool.cc:224] Handling call
0709 13:16:54.576096 (+235515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.576323 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.576348 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.576390 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:54.576423 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:54.576471 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.169525 (+2593054us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54001c9b50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:57.169625 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540835072}
I20260709 13:16:57.172040  6716 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.172972  6716 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.127260  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.173624  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.166253  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.184278  4121 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:57.185019  4114 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:57.128398  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:57.167326  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080030b160 after lost signal to thread 3904
W20260709 13:16:57.158411  4086 connection.cc:256] RPC call timeout handler was delayed by -1.3706045950000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 13:16:57.185786  4086 connection.cc:256] RPC call timeout handler was delayed by -1.3490045949999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
I20260709 13:16:57.186461  4045 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
W20260709 13:16:57.188947  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4e40 after lost signal to thread 3996
I20260709 13:16:57.189255  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.189628  6716 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.189862  4117 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:16:57.190155  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080005ff40 after lost signal to thread 4071
I20260709 13:16:57.190889  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.191231  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08002cede0 after lost signal to thread 4145
W20260709 13:16:57.191586  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8420 after lost signal to thread 4146
I20260709 13:16:57.192030  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.192559  4115 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
W20260709 13:16:57.192632  4068 debug-util.cc:398] Leaking SignalData structure 0x7b0800059ca0 after lost signal to thread 4709
I20260709 13:16:57.193339  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.187709  6799 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:57.195174  6799 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.197256  6752 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.197796  6752 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.199736  6752 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.199805  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.200908  6798 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.201099  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.201563  6798 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.199528  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.202767  4121 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.203683  6798 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.203850  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.204483  4115 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:57.200578  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.197751  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.212462  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:57.213200  4678 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:57.213519  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.214277  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:57.214663  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:57.215659  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:57.215910  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:57.217684  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.205142  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.221179  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51494.9us
W20260709 13:16:57.224435  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 2.1839e+06us
I20260709 13:16:57.227586  4676 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.229624  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.213466  4683 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:16:57.230275  4121 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:57.214236  4682 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:57.216562  4681 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:57.231099  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.232125  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.232914  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 2.72937e+06us
I20260709 13:16:57.233093  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.233279  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.233872  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:57.234190  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.234571  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.234781  4112 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:57.235708  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.235935  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.237524  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.238708  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.238884  6798 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.239569  6798 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.239964  6798 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.240175  4087 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:57.241295  6752 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.241447  6802 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.241776  6752 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:16:57.241995  4013 connection.cc:256] RPC call timeout handler was delayed by -1.3027181219999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 13:16:57.242218  6752 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.242516  6802 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.243371  4675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 200) took 3010 ms. Trace:
I20260709 13:16:57.243745  4675 rpcz_store.cc:276] 0709 13:16:54.232883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.314769 (+ 81886us) service_pool.cc:224] Handling call
0709 13:16:54.319255 (+  4486us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:54.341035 (+ 21780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:54.341074 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:54.341131 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:16:54.341204 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.243119 (+2901915us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b54006801d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:57.243172 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.243311 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49471232}
I20260709 13:16:57.244901  6802 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:57.242827  4649 connection.cc:256] RPC call timeout handler was delayed by -2.5161411320002571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
W20260709 13:16:57.245795  4649 connection.cc:256] RPC call timeout handler was delayed by -2.5161411320002571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18120000000000003s for a response
I20260709 13:16:57.245860  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.246697  3964 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:57.247044  4649 connection.cc:256] RPC call timeout handler was delayed by -2.4801255239999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:16:57.247400  4649 connection.cc:256] RPC call timeout handler was delayed by -2.4801255239999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:16:57.247658  4649 connection.cc:256] RPC call timeout handler was delayed by -2.3979695760001505s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
I20260709 13:16:57.247794  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 1881) took 2737 ms. Trace:
I20260709 13:16:57.248135  3964 rpcz_store.cc:276] 0709 13:16:54.510748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.522878 (+ 12130us) service_pool.cc:224] Handling call
0709 13:16:54.523168 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.247066 (+2723898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.247581 (+   515us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54002c9054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:57.247740 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6262992128}
W20260709 13:16:57.250115  4649 connection.cc:256] RPC call timeout handler was delayed by -2.3467392780000864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:16:57.250965  4649 connection.cc:256] RPC call timeout handler was delayed by -2.3427325520001432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:16:57.251344  4649 connection.cc:256] RPC call timeout handler was delayed by -1.9137365210001462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.219s for a response
W20260709 13:16:57.251631  4649 connection.cc:256] RPC call timeout handler was delayed by -1.7212674320001042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 13:16:57.251952  4649 connection.cc:256] RPC call timeout handler was delayed by -1.059335646000136s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 13:16:57.252168  4649 connection.cc:256] RPC call timeout handler was delayed by -1.0538526210000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 13:16:57.255816  6752 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.258111  6752 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:57.266891  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44574.5us
I20260709 13:16:57.251570  6802 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.274070  6804 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.274621  6804 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.274997  6804 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.278813  6802 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.281280  6802 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:57.283399  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.696s	user 0.006s	sys 0.078s
W20260709 13:16:57.289510  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48658.1us
W20260709 13:16:57.290328  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.704s	user 0.007s	sys 0.079s
W20260709 13:16:57.290761  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 2.72155e+06us
W20260709 13:16:57.294214  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 54107.3us
I20260709 13:16:57.288944  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.288203  6710 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.298502  6710 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.300848  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:57.302088  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:16:57.302875  6799 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.303388  6799 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.303877  6799 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.296598  6802 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:16:57.308446  4038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 1949) took 3306 ms (client timeout 1901 ms). Trace:
I20260709 13:16:57.309844  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:57.309885  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:16:57.308971  4038 rpcz_store.cc:269] 0709 13:16:54.002509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.032013 (+ 29504us) service_pool.cc:224] Handling call
0709 13:16:57.308174 (+3276161us) spinlock_profiling.cc:243] Waited 3.02 s on lock 0x7b540028c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:57.308344 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6937544064}
I20260709 13:16:57.269215  6807 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:57.310002  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 51355.6us
W20260709 13:16:57.314989  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53431.3us
I20260709 13:16:57.315506  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2231) took 2964 ms. Trace:
I20260709 13:16:57.316020  4044 rpcz_store.cc:276] 0709 13:16:54.349214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.349329 (+   115us) service_pool.cc:224] Handling call
0709 13:16:57.308345 (+2959016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.308611 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.308644 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.308715 (+    71us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:16:57.308755 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.308845 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.313685 (+  4840us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b540028c650. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:16:57.313822 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6790332672}
I20260709 13:16:57.308971  6710 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.318569  6809 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.319180  6809 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.319933  6717 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.319808  6798 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.320374  6717 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.320658  6806 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.321205  6806 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.325189  6798 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.325871  6798 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.326352  6798 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:57.327651  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 87160us
I20260709 13:16:57.328513  6806 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.328657  6810 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.327426  6717 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.333158  6670 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.333557  6670 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.333890  6670 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.329404  6810 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.336944  6809 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:54.561026  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.337687  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
W20260709 13:16:57.338181  3971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1882) took 2777 ms (client timeout 1979 ms). Trace:
I20260709 13:16:57.329262  6806 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:16:57.338565  3971 rpcz_store.cc:269] 0709 13:16:54.560565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.560714 (+   149us) service_pool.cc:224] Handling call
0709 13:16:57.338106 (+2777392us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:16:57.343880  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55022.1us
I20260709 13:16:57.344846  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.338189  6810 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.327482  6811 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.338358  6807 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.343237  6806 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.355391  6806 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:57.362534  6807 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.353348  6811 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.365171  6811 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.349787  6798 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.365321  6807 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.369717  6717 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.371758  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 1942) took 3664 ms. Trace:
I20260709 13:16:57.372159  6717 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.364365  6670 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.374449  6670 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.376449  6804 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.379627  6799 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.384549  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:57.385427  6804 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.386605  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:57.386849  6799 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.372195  4039 rpcz_store.cc:276] 0709 13:16:53.707137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:53.707261 (+   124us) service_pool.cc:224] Handling call
0709 13:16:57.370880 (+3663619us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:57.371112 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.371314 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.371346 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.371382 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:16:57.371417 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.371472 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.371583 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397952}
W20260709 13:16:57.392323  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 80189.5us
I20260709 13:16:57.387321  4677 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:16:57.401423  6797 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.448s	user 0.011s	sys 0.008s
W20260709 13:16:57.402549  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002101a0 after lost signal to thread 2854
W20260709 13:16:57.405277  4012 connection.cc:256] RPC call timeout handler was delayed by -1.4572688640000706s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260709 13:16:57.406240  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 96483.8us
W20260709 13:16:57.406704  4012 connection.cc:256] RPC call timeout handler was delayed by -1.450068864000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:16:57.407071  4012 connection.cc:256] RPC call timeout handler was delayed by -1.3537688639999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:16:57.392741  6807 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.406754  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.410805  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 94608.7us
I20260709 13:16:57.409011  4119 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:57.414018  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08003085c0 after lost signal to thread 3904
W20260709 13:16:57.407393  4012 connection.cc:256] RPC call timeout handler was delayed by -1.3150688640000681s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:16:57.414610  4012 connection.cc:256] RPC call timeout handler was delayed by -1.3141688640000666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260709 13:16:57.416500  4012 connection.cc:256] RPC call timeout handler was delayed by -1.3132688640000652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260709 13:16:57.409121  6807 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:16:57.421478  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66914.7us
W20260709 13:16:57.416813  4012 connection.cc:256] RPC call timeout handler was delayed by -1.28536886400002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:16:57.424108  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.427048  6807 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.427683  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.429294  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:57.433663  6819 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:16:57.445755  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.446902  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.447824  6717 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.448112  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.428535  6811 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:57.432291  4684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 219) took 3202 ms. Trace:
W20260709 13:16:57.456470  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3880 after lost signal to thread 3996
I20260709 13:16:57.448534  6717 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.457284  6717 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.457482  6759 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:57.457957  6759 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:57.458317  6759 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:57.458962  6670 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:16:57.457701  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea1a0 after lost signal to thread 4071
W20260709 13:16:57.461150  4705 debug-util.cc:398] Leaking SignalData structure 0x7b0800367ae0 after lost signal to thread 4145
W20260709 13:16:57.461454  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002dc2c0 after lost signal to thread 4146
W20260709 13:16:57.462666  4705 debug-util.cc:398] Leaking SignalData structure 0x7b080032d560 after lost signal to thread 4709
W20260709 13:16:57.462929  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002fd3e0 after lost signal to thread 4710
I20260709 13:16:57.464821  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.465521  3964 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.433743  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.421144  6802 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:16:54.580016  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.456130  4684 rpcz_store.cc:276] 0709 13:16:54.229755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.237442 (+  7687us) service_pool.cc:224] Handling call
0709 13:16:54.241770 (+  4328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.016202 (+2774432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.431943 (+415741us) spinlock_profiling.cc:243] Waited 2.77 s on lock 0x7b5400562554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:16:57.432178 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6378598272}
W20260709 13:16:57.441500  4012 connection.cc:256] RPC call timeout handler was delayed by -1.2295688639999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
I20260709 13:16:57.433939  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.474232  4012 connection.cc:256] RPC call timeout handler was delayed by -1.183668864000083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:16:57.474597  4012 connection.cc:256] RPC call timeout handler was delayed by -1.1809688640000786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 13:16:57.474886  4012 connection.cc:256] RPC call timeout handler was delayed by -1.1629688640000495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1849s for a response
W20260709 13:16:57.475145  4012 connection.cc:256] RPC call timeout handler was delayed by -1.1485688640000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 13:16:57.475399  4012 connection.cc:256] RPC call timeout handler was delayed by -1.1449688640000204s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
W20260709 13:16:57.475656  4012 connection.cc:256] RPC call timeout handler was delayed by -1.1350688640000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 13:16:57.475924  4012 connection.cc:256] RPC call timeout handler was delayed by -1.1062688639999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 13:16:57.476183  4012 connection.cc:256] RPC call timeout handler was delayed by -1.0459688640000877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 13:16:57.476439  4012 connection.cc:256] RPC call timeout handler was delayed by -1.0333688640000673s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 13:16:57.476697  4012 connection.cc:256] RPC call timeout handler was delayed by -1.0324688640000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
I20260709 13:16:57.434283  6813 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:16:57.444264  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 327) took 3406 ms. Trace:
I20260709 13:16:57.450083  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.473178  4041 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:57.459666  6670 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.472913  6806 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.473109  6717 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.480084  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.482621  3963 rpcz_store.cc:276] 0709 13:16:54.038081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.150961 (+112880us) service_pool.cc:224] Handling call
0709 13:16:57.437934 (+3286973us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:16:57.438123 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:16:57.443915 (+  5792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:16:57.443943 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:16:57.443986 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:16:57.444016 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:16:57.444076 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:16:57.444204 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10878208}
I20260709 13:16:57.487908  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:57.484035  4041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2241) took 3050 ms (client timeout 1681 ms). Trace:
W20260709 13:16:57.490365  4041 rpcz_store.cc:269] 0709 13:16:54.434079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:54.533481 (+ 99402us) service_pool.cc:224] Handling call
0709 13:16:57.483956 (+2950475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:16:57.492019  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:57.495780  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 143076us
I20260709 13:16:57.500285  6819 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:57.501456  6819 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:57.501771  6819 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:57.487489  6802 consensus_queue.cc:1243] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:16:57.508952  6809 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.512612  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.521064  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.524971  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.525588  4046 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:57.527282  4677 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:16:57.528064  6811 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.528743  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.529436  3963 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:16:57.530272  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.530946  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.531555  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:57.486177  3971 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:16:57.533689  6806 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.510555  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.540225  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.531283  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.546365  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.547262  6821 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.549966  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.550926  3967 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:57.551721  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.552282  3967 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:16:57.553088  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.555552  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.485998  6822 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.509629  6809 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.569756  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.570241  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.570878  4044 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
W20260709 13:16:57.568650  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72215.2us
I20260709 13:16:57.571746  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.578529  6798 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.579097  6798 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.579276  6759 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.537314  6771 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.580559  6809 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.581490  6759 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.584270  6771 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.584780  6771 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.585388  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.585839  4684 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:57.586719  6771 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.588166  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.543208  6752 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.589290  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.589533  6752 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.550411  6806 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.589912  4047 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:16:57.589994  6752 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.590390  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.591173  4046 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 4: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:57.568838  6822 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.592038  6752 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.592311  6822 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.596784  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:37676
I20260709 13:16:57.597579  4046 raft_consensus.cc:606] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:57.598572  6806 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.598986  6806 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.599545  3964 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:57.600878  6816 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.603209  6815 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:16:57.603562  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.604272  6815 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:57.604686  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.571446  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.610738  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.600610  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.616488  3963 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:57.616876  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 128091us
I20260709 13:16:57.618908  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.619565  4046 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:16:57.623620  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.604629  6815 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:57.628472  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 148647us
I20260709 13:16:57.629684  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:57.628002  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55769.1us
I20260709 13:16:57.629143  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:57.573321  6807 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.626636  6817 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.639910  6817 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.640316  6817 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.628118  6818 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.647130  6818 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.647568  6818 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.652570  6806 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.654385  6809 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.654878  6806 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.655614  3967 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:57.661110  6815 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.662648  6815 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.663998  6807 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.634949  6717 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.656471  6809 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.624450  6802 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.668365  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.681694  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:57.683565  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57298.6us
W20260709 13:16:57.632714  3937 connection.cc:256] RPC call timeout handler was delayed by -2.5954132599999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:16:57.686637  3937 connection.cc:256] RPC call timeout handler was delayed by -2.5083405259999836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1605s for a response
I20260709 13:16:57.688496  6822 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:57.689353  6827 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.691504  6817 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.714687  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:16:57.701061  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 61400.4us
I20260709 13:16:57.702868  6716 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:57.705418  4087 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:57.681125  6823 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.681504  6802 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:57.723129  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.701407  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.724833  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.719013  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50746us
I20260709 13:16:57.725826  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.727411  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:57.726788  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.729094  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:57.725533  4117 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:57.730400  4121 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:57.733723  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.725970  6828 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:57.737396  6828 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.737612  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.724886  6759 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.738461  6670 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.738903  6828 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:57.739226  3966 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.739599  6798 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.740272  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.741530  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.742465  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.743021  3966 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:57.744210  3972 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.745179  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.729707  6802 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.745678  3972 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:16:57.746461  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.746970  6759 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:57.747354  6759 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.747476  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.747756  6759 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.749358  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.726260  6804 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:57.750787  6804 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:57.750376  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:57.717762  6716 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:57.751667  6804 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.715478  6827 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:57.753240  6827 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.752858  6716 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:57.754254  6716 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.756173  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:57.736745  6834 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.710913  6778 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:16:57.756942  6834 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.757522  6834 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.720050  6823 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.756168  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:57.731264  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.736745  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.716987  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:57.773586  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56655.8us
I20260709 13:16:57.743798  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:57.715170  3937 connection.cc:256] RPC call timeout handler was delayed by -2.4552405260001251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
I20260709 13:16:57.767691  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:16:57.775362  3937 connection.cc:256] RPC call timeout handler was delayed by -2.4184276840001075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19030000000000002s for a response
I20260709 13:16:57.769176  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.770466  6822 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.771171  6717 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.769249  4120 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.757547  6778 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:57.772249  6817 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.768630  4115 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:57.774537  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:16:57.776021  3937 connection.cc:256] RPC call timeout handler was delayed by -2.4145776269999715s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
I20260709 13:16:57.776713  4114 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:57.781908  3937 connection.cc:256] RPC call timeout handler was delayed by -2.3299776270000621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 13:16:57.779569  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.782044  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:16:57.782263  3937 connection.cc:256] RPC call timeout handler was delayed by -2.2966629570000805s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:16:57.783435  3937 connection.cc:256] RPC call timeout handler was delayed by -2.2660776269999587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:16:57.783720  3937 connection.cc:256] RPC call timeout handler was delayed by -2.1843405260001418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
I20260709 13:16:57.776281  6670 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.823995  6759 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.872185  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.779544  6820 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:57.776326  6823 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.862138  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.827581  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:57.833707  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52013.9us
I20260709 13:16:57.718263  6818 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.823848  6821 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.816860  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.878566  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.830500  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.781517  6778 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:57.783995  3937 connection.cc:256] RPC call timeout handler was delayed by -2.1694682009999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
I20260709 13:16:57.880633  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:16:57.885099  3937 connection.cc:256] RPC call timeout handler was delayed by -1.857941467000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:16:57.885433  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8354414670000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:16:57.873486  6670 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.886116  6670 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.872253  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:57.875653  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101186us
I20260709 13:16:57.877207  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.877471  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.851802  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:57.878648  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.881919  6759 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.881058  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.820506  6828 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.889533  6778 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.890720  6778 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:57.890858  6828 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.891681  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.892114  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.892822  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.893043  6821 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.894176  4118 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.894826  4677 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:57.888689  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.884506  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:57.885716  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8156414669999776s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:16:57.897336  3937 connection.cc:256] RPC call timeout handler was delayed by -1.5303414669999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:16:57.883400  6834 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:57.897810  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4970414670001446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 13:16:57.885603  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.898710  4042 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:57.896346  6759 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.878688  6816 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.899910  6816 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:57.900379  6816 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.902704  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.878901  6811 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:57.872479  6806 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.905819  6806 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.908010  6806 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:57.898231  3937 connection.cc:256] RPC call timeout handler was delayed by -1.470041467000101s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:16:57.908466  6802 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:16:57.909058  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4349414670000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
I20260709 13:16:57.909454  6817 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:57.909598  6834 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.910698  6833 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:57.912308  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.913744  3964 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:57.912319  6833 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:57.916003  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:57.915867  6833 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.917065  4039 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:57.917299  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.918569  6799 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.918934  6802 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:57.919163  6821 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:57.909569  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3926414669999758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 13:16:57.919804  3971 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:57.920002  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:57.920517  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.921170  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:57.921307  6836 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:57.922523  6822 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:57.922889  6822 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:16:57.923252  6822 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:57.924818  6834 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:57.926266  6834 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:57.926590  6834 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:57.917053  6833 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.928946  4649 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:57.921828  6831 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:57.930037  6836 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:57.930852  6806 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:57.917563  6818 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:57.932005  6836 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:57.933107  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:57.931547  6806 consensus_queue.cc:1243] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:16:57.934192  4045 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:16:57.935063  6802 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:57.927582  6827 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.938535  4038 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:16:57.938995  6829 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:16:57.938207  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52664.1us
I20260709 13:16:57.961570  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:57.961925  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.939078  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:57.939551  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.961539  3964 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:57.938432  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:57.929977  6831 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:57.962522  3963 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:57.963038  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:57.962976  3965 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:57.955255  6818 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:16:57.965480  6670 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:57.967602  6670 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:57.941866  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:57.970672  3965 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:16:57.971618  3972 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:57.931447  6822 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.002249  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:57.960950  6812 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:57.972211  6810 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.006486  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:57.936483  6821 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:58.007120  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.007457  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.927328  6834 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.008155  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:58.008432  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 66646.1us
I20260709 13:16:58.008701  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.008994  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.032063  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.009644  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.005149  6670 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:16:58.013041  6803 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.045408  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.046432  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:57.973608  6831 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:57.937770  6823 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.034122  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:58.001420  6806 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:16:58.030787  6812 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.058768  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.033099  6804 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.062510  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.030195  6810 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.062534  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.034264  6759 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.068482  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:16:58.069165  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 111021us
I20260709 13:16:58.074450  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.075495  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.067889  6812 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.077581  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.070099  6834 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.077749  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.060905  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:58.068121  6804 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:58.082103  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.083341  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.084101  3866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 229) took 1007 ms. Trace:
I20260709 13:16:58.081452  6804 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.087282  6842 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.087738  6842 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.088064  6842 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.088989  6778 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.089043  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.089517  6778 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.090348  6778 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.091848  6778 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.093819  6823 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.096794  6816 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.096917  6804 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.099040  6816 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.101858  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:58.102713  4682 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:58.071796  6759 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:58.104014  6759 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.084476  3866 rpcz_store.cc:276] 0709 13:16:57.021840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.022225 (+   385us) service_pool.cc:224] Handling call
0709 13:16:58.029153 (+1006928us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":3}
I20260709 13:16:58.118058  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:58.129822  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 98119.8us
I20260709 13:16:58.131266  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.131404  6847 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.132937  6847 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.133351  6847 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.078255  6752 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:16:58.145208  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.146704  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.146832  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.147310  3965 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.147425  6848 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:58.079504  6771 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.148075  6771 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.148473  6771 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.147848  6848 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:58.149109  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.149660  6848 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.150120  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.150682  4114 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:16:58.150906  6848 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.151590  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.153133  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.153512  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.154633  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.156469  3972 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.154227  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.156569  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.152596  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.161454  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.130509  6820 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.163493  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.165959  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.167133  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.167331  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.171005  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.172297  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.170703  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.192299  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.185051  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.188165  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.197240  4684 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:58.192308  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.184983  6807 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.195349  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.155651  6752 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.195051  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.181561  6802 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.203739  6802 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.204159  6802 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.206350  6771 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.208381  6771 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.071077  6819 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.211161  6802 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.218371  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.154166  6804 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.155381  6798 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:58.220451  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 47508.3us
I20260709 13:16:58.166983  6809 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.228193  3965 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:16:58.181025  6810 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.230492  3870 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 8 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:16:58.171749  6813 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:16:58.256168  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 138192us
I20260709 13:16:58.143944  6803 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:16:58.245573  6802 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.253850  6827 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.268988  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.225139  6798 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.268879  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:16:58.258807  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 211487us
I20260709 13:16:58.273204  3970 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:58.272750  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:58.213440  6752 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.229264  6778 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.254129  6813 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.259519  6822 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:58.283133  6798 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.294382  6812 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.317205  4684 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:58.323460  6812 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.282433  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.324960  6751 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:58.326035  6751 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:58.326396  6751 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.327255  6751 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.328424  6751 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.329129  6830 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.330312  6798 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.332419  6798 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.335170  6811 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:16:58.325992  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43612.1us
I20260709 13:16:58.338101  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.339491  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.340003  6844 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.340444  6844 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.340965  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.168479  6847 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.257503  6759 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.291419  6820 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:58.267225  6846 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:16:58.344064  3968 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.345115  6846 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.345498  6846 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.346217  6846 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:58.347559  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 341059us
I20260709 13:16:58.344275  6759 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.294866  6831 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.349767  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.284895  6809 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.350953  6759 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.351147  6809 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.351697  6809 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.344275  6847 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.353291  6798 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.347329  6846 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.353691  6798 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.354188  6798 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.354557  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.355453  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.297365  6842 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.358655  3963 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:58.359570  6842 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.296042  6806 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.360250  6806 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.300880  6802 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.361264  6802 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.361665  6802 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.288800  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:58.364287  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75575.5us
I20260709 13:16:58.341536  6830 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.356208  6847 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.365561  6847 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.365217  6806 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.365963  6847 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.351787  6831 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.366155  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:16:58.367115  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 179721us
I20260709 13:16:58.367818  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.369031  6830 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.369483  6830 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.369841  6830 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.371556  6802 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.369199  6806 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.374832  6810 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.267321  6848 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:16:58.377704  6848 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.347270  6752 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.378314  6848 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.378553  3971 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:58.297474  6799 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:58.301229  6813 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.379534  6799 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:58.379911  6799 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:58.380709  6799 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.381958  6799 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.382386  6752 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.364936  6852 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:58.383441  6852 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.383574  6847 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.384440  6852 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.385931  6813 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.386452  6819 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.388067  4117 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:58.389437  6813 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.394160  6844 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.395530  6844 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.401561  6847 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.397639  6802 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:16:58.409626  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.408540  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.411109  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.414999  6834 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.415738  6834 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:16:58.405066  6855 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.110s	user 0.004s	sys 0.000s
I20260709 13:16:58.415988  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.406420  6821 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:58.417586  6821 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.409436  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:58.418756  6820 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.418432  6834 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.418896  6821 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:58.425796  6821 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.427269  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:16:58.429666  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77205.7us
I20260709 13:16:58.430421  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.431048  6820 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:58.404484  6798 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.417490  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.433274  6810 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.433683  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.434533  6810 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:16:58.434902  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.435678  6759 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.436038  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.436324  6820 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.436316  6810 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.439311  6798 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.407877  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.437466  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.437258  6820 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.437933  6834 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.444336  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.447158  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.447208  6811 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:58.449370  6811 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.449759  6811 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.444689  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.451310  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:58.449263  6853 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.452382  6856 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.455441  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.456557  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.458034  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.458804  4117 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:58.458956  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:58.459628  4038 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.459560  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.443498  6798 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:58.453104  6856 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.464151  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.482472  4112 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.465440  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:58.483089  4042 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:58.465914  6849 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.466060  6821 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.450546  6811 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.466790  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.466313  6828 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:16:58.487968  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.467351  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:58.455122  6847 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:16:58.468308  6739 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.468852  3971 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.446614  6810 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.469305  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.492745  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.485265  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.471800  4120 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.474910  3967 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.481676  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.482033  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.494176  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.494635  4047 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.494828  4038 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:58.469942  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.460839  6829 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:16:58.483695  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.488726  4039 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:58.486392  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.442730  6830 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.497690  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.499285  4045 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.495002  6834 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.494869  6802 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.505447  6829 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:58.505795  6829 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.505888  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.505808  3972 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:16:58.506686  6829 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.508409  6829 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.487716  6822 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.510998  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.511607  4041 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.513401  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.514086  6811 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.514688  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.504426  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.515401  4038 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.484618  6856 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.517542  6825 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:16:58.517930  6825 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.504289  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.519191  4042 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.487263  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.487389  4118 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.488250  4117 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:58.488309  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.504297  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.487403  4114 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: []
W20260709 13:16:58.489199  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 220434us
I20260709 13:16:58.522264  3970 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.522497  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:58.523554  6751 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.490105  6847 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.479038  6798 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.461926  6809 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.525117  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.525661  6798 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.526845  6809 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.527004  6799 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.527733  6799 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:16:58.529721  6847 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.489820  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.533245  4113 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:16:58.533648  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.489740  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.454634  6853 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:58.491482  3964 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.495980  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:58.489885  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.518710  6825 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.489279  4040 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.539269  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.541031  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.542555  4046 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:58.543644  4041 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:16:58.547247  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.539299  6825 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.546520  6821 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:16:58.545054  6751 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.551329  6834 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:58.551775  6834 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:58.552117  6834 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.553108  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.553490  6751 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.554051  3968 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.554438  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.554875  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.555524  3968 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.556242  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.556699  6751 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.558001  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.559096  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.522571  6830 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.560652  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:58.561802  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.563858  3963 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
W20260709 13:16:58.570555  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85365.3us
I20260709 13:16:58.560097  6810 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.573037  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.561236  6751 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.574090  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.573765  4040 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.575140  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.575606  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.577414  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.577939  4045 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:16:58.558394  6827 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:16:58.578708  6827 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:58.579071  6827 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.564057  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.574767  3964 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.579864  4047 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:58.574810  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.572690  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.583477  4047 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.585139  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.586763  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.587589  4040 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:16:58.590754  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.591777  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.592321  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.593411  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.601938  4040 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:58.602947  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.604012  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.605135  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.606549  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.607204  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:58.606463  3965 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.610419  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
W20260709 13:16:58.611225  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49489.8us
I20260709 13:16:58.612566  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.613652  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.614662  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.617404  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.617890  4044 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.618161  3968 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.618372  6831 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.618688  4039 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.619752  4039 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:16:58.620224  6806 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.621331  6819 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.605865  6815 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:58.605868  6752 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.623642  6823 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:58.606228  6810 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.617321  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.546633  6849 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:16:58.625921  6856 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.628003  6856 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.629985  3966 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.632144  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.626230  6849 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.637633  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.635313  4039 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.634199  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.636201  4121 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:16:58.584110  6853 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.648424  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.648936  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.588032  6821 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.654279  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:58.658526  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43896.4us
I20260709 13:16:58.661854  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:58.621582  6739 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.665165  4046 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:16:58.670285  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.645838  6813 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.645112  6849 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.618018  6847 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.681670  6771 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.682145  6821 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:58.684893  6808 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:16:58.686368  6717 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.686496  6852 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:58.690212  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.668849  6809 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.677263  6806 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.677410  6844 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.678989  6814 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.710606  6840 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.706884  6717 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.716131  3969 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:58.720961  6847 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.701249  6802 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:16:58.722126  6802 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:58.722491  6802 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.723363  6802 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.707067  6849 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.736047  6820 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:58.737136  6820 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:58.724579  6802 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:58.737605  6820 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.738044  3966 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:58.746631  6872 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:16:58.747645  6872 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.747500  6798 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.748049  6872 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.748921  6872 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.749706  6798 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.750106  6872 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.750447  6717 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.751569  6717 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.743057  6829 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.752943  6829 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.755527  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.755698  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.756320  4121 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:58.757300  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:58.757539  6829 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.758371  4121 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:58.758731  6829 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.760063  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.761044  6812 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:58.762025  6856 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.762742  6856 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:58.763921  6856 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.765045  6856 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.766744  4120 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:58.762027  6809 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:16:58.789652  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.778016  6840 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:58.790422  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:58.779371  6812 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:16:58.790925  6847 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.775334  6815 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:16:58.781314  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.791368  6847 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:58.782119  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:58.791044  6873 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:16:58.791934  6834 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.792269  3966 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:58.792250  6847 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.783022  6827 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.796172  6847 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.789824  6809 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.797437  6809 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:58.798204  6834 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.798565  6809 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.799846  6809 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:16:58.800048  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.780556  6820 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.791532  6812 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.803341  6812 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:58.787433  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:16:58.772151  6853 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.805761  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.808810  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.813280  4039 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.812608  4046 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.814033  4040 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:16:58.814504  4040 pending_rounds.cc:85] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 4
I20260709 13:16:58.814689  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.815256  4047 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.788435  4115 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:16:58.844535  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.847322  4121 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:58.850301  4119 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:58.853061  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.856575  4045 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 3. Current term is 4. Ops: []
I20260709 13:16:58.857642  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.858422  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:58.858347  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.814725  4040 pending_rounds.cc:107] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:58.859223  4040 raft_consensus.cc:2917] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:58.859601  4040 raft_consensus.cc:2889] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:16:58.859647  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.844631  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.867550  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.868476  4039 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:58.869253  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.870317  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.830201  6875 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:16:58.844292  6799 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:58.844135  6873 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.874015  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.876350  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:58.878902  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:16:58.881281  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.804646  6812 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.879040  3966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:58.871454  6759 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.886325  6810 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:58.872809  6836 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.883464  3966 raft_consensus.cc:606] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:58.846175  6811 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:16:58.882838  6827 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.879756  6875 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:58.877231  6856 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.892280  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:16:58.904045  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:58.914142  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.917183  6830 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:58.891083  6820 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.889012  6810 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:58.889199  6873 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:16:58.911427  6842 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:58.925514  6812 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.896281  6852 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:58.938211  6849 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:58.957931  4044 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:16:58.959815  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 92329.7us
I20260709 13:16:58.963080  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:58.945638  6842 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:58.964588  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:16:58.971515  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 111938us
I20260709 13:16:58.972374  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.974390  6880 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.975107  6880 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.975785  6882 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.978056  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.971908  6810 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.979883  6810 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:58.984833  6873 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:58.985294  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:58.986420  6871 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:58.986797  6871 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.986891  6872 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:58.964073  6831 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:16:58.987584  6871 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.987963  6831 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.990109  6831 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:58.964938  6842 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:58.997206  6739 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:58.997651  6739 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:58.998421  6739 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:58.999651  6739 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.000451  6871 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.008044  6799 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:58.969321  6875 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.011255  6836 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:16:58.972729  6853 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:58.986907  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:59.018834  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 104773us
I20260709 13:16:59.020274  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:59.021878  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.024611  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.027173  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:59.026649  6829 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.027725  6809 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:59.030864  6809 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:59.031245  6809 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.027864  6881 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:16:59.018582  6852 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:16:59.025686  6873 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.038255  3965 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:16:59.040279  6856 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.041657  6809 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.044252  6759 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.044643  6759 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.045485  6759 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.046727  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:16:59.047026  6759 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.047555  4684 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:16:59.050961  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 91) took 1522 ms. Trace:
I20260709 13:16:59.051335  3870 rpcz_store.cc:276] 0709 13:16:57.528957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.529148 (+   191us) service_pool.cc:224] Handling call
0709 13:16:59.050876 (+1521728us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:58.358724 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:58.367079 (+  8355us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:58.367115 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:58.367137 (+    22us) tablet.cc:662] Decoding operations
0709 13:16:58.398140 (+ 31003us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:58.398224 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:58.398251 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:16:58.398447 (+   196us) tablet.cc:701] Row locks acquired
0709 13:16:58.398464 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:16:58.398628 (+   164us) write_op.cc:270] Start()
0709 13:16:58.398740 (+   112us) write_op.cc:276] Timestamp: P: 1783603018398580 usec, L: 0
0709 13:16:58.398761 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:16:58.399405 (+   644us) log.cc:844] Serialized 536 byte log entry
0709 13:16:58.557083 (+157678us) op_driver.cc:464] REPLICATION: finished
0709 13:16:58.699963 (+142880us) write_op.cc:301] APPLY: starting
0709 13:16:58.704865 (+  4902us) tablet.cc:1367] starting BulkCheckPresence
0709 13:16:58.716710 (+ 11845us) tablet.cc:1370] finished BulkCheckPresence
0709 13:16:58.725128 (+  8418us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:16:58.729191 (+  4063us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:16:58.744696 (+ 15505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:16:58.772890 (+ 28194us) write_op.cc:312] APPLY: finished
0709 13:16:58.773178 (+   288us) log.cc:844] Serialized 23 byte log entry
0709 13:16:58.773385 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:58.773489 (+   104us) write_op.cc:454] Released schema lock
0709 13:16:58.773530 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:16:58.774076 (+   546us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:16:58.774106 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":494346,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":107490,"apply.run_cpu_time_us":2533,"apply.run_wall_time_us":82860,"num_ops":1,"prepare.queue_time_us":71846,"prepare.run_cpu_time_us":3451,"prepare.run_wall_time_us":88421,"raft.queue_time_us":141347,"raft.run_cpu_time_us":13229,"raft.run_wall_time_us":43797,"replication_time_us":158141,"thread_start_us":280290,"threads_started":4,"wal-append.queue_time_us":5536}]]}
I20260709 13:16:59.061126  6882 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:16:59.061587  6877 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:59.062090  6853 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:16:59.062109  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:16:59.062922  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.061882  6828 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:16:59.063102  6852 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.063162  6670 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:16:59.063629  6852 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.063689  6670 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.064646  6670 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.065449  6834 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.061820  6881 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:16:59.066927  6881 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.067250  6881 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.068044  6881 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.068928  6820 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:59.066027  6834 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.064599  6852 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:59.072146  6808 consensus_queue.cc:1175] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8c8b10100a146e6a81f308505fe9f46" responder_term: 6 status { last_received { term: 6 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 6 index: 3 } }
I20260709 13:16:59.072680  6834 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:59.075099  6804 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.075502  6804 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.065833  6882 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.077505  6882 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.080178  4120 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.080444  4115 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.060283  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 235) took 1312 ms. Trace:
I20260709 13:16:59.071846  6852 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:16:59.081450  4119 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.081809  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:59.082273  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.083166  4120 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.082437  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.067126  6828 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:16:59.080973  4121 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:59.086436  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:16:59.086841  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.069888  6881 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.087724  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.084982  6828 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.086710  6670 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:16:59.090183  3970 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:16:59.087124  4121 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:59.091255  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.101641  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.102526  6879 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:16:59.103886  6879 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:59.104193  6879 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:59.104529  6879 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.080917  3869 rpcz_store.cc:276] 0709 13:16:57.747823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:57.753061 (+  5238us) service_pool.cc:224] Handling call
0709 13:16:59.060219 (+1307158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":463161,"reported_tablets":5}
W20260709 13:16:59.107302  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.109529  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:59.111056  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:59.111903  6806 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.090178  6828 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.114732  6828 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.114166  3868 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.115751  3868 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.117446  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:59.117394  3868 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 5 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:16:59.076332  6804 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.120175  6804 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.084851  6842 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.124562  6842 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:59.127240  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:59.127887  4046 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.128741  4115 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:59.134662  4046 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:16:59.139508  6879 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.149554  4040 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.164415  4684 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:16:59.166198  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 140060us
I20260709 13:16:59.170249  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.171085  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.176148  6877 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:16:59.177772  6853 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:59.178283  6853 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.178959  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:59.180626  4042 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:16:59.185956  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 221409us
I20260709 13:16:59.191730  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.166790  6809 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:59.200754  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.201236  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.202414  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.204536  3970 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:59.204517  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.207933  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.208551  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.224248  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.225912  3965 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:16:59.227053  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.202514  6834 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.174924  6810 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:16:59.231276  4121 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:59.246574  4115 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
W20260709 13:16:59.237671  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66633.1us
I20260709 13:16:59.209921  6739 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.201831  6802 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:16:59.232546  6844 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.228801  6806 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.278864  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:16:59.280931  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78934.9us
I20260709 13:16:59.283689  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.265182  6875 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.289819  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.292433  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:59.274485  6881 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.216131  6872 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:16:59.300997  6752 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.296425  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:59.290691  6814 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.295449  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:16:59.268903  6808 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:16:59.271309  6825 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:16:59.294472  6831 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.292801  6853 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.299399  6856 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.319327  6834 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.321743  6670 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.365130  6847 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.359917  4113 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:16:59.368320  3970 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:16:59.377063  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 80716.2us
I20260709 13:16:59.303107  6881 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.363122  6879 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:59.384048  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.363896  6752 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.369292  6880 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:16:59.379694  6822 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:16:59.392879  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:59.379500  6759 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:16:59.437350  6759 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.437821  6806 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.438225  6759 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.392937  6831 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.439602  6759 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.394749  6752 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.390578  6847 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:16:59.395735  6881 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:59.386590  6670 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:16:59.398473  6887 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:16:59.401130  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.402928  3966 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.407117  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.409595  3965 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:16:59.413166  6821 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:16:59.421419  6893 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.058s	user 0.004s	sys 0.000s
I20260709 13:16:59.430540  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:59.431202  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.432090  4043 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:16:59.436515  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43728.6us
I20260709 13:16:59.488131  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.467617  4119 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
W20260709 13:16:59.395886  6884 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:16:59.386363  6834 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.452275  6812 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:16:59.506784  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.488922  6883 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:16:59.507484  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:59.462186  6822 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.514909  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:59.507942  4684 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:16:59.508261  6809 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:16:59.516175  6809 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:59.515794  6822 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.510790  4044 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.516539  6809 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.498956  6847 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:59.483443  6821 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:59.509843  6812 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.518779  4684 pending_rounds.cc:85] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 4
I20260709 13:16:59.519032  4043 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:16:59.438284  6806 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.522822  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:16:59.490717  6799 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.525894  4684 pending_rounds.cc:107] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:16:59.528293  4684 raft_consensus.cc:2917] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:16:59.528744  4684 raft_consensus.cc:2889] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:16:59.531030  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 248958us
I20260709 13:16:59.485039  6828 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:16:59.435230  6880 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.565089  4041 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:59.490674  6825 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:16:59.566421  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.583534  4115 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:59.565456  4042 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:16:59.509902  6895 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.527890  6799 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.522740  6809 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.581053  4040 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:16:59.585765  4114 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.597245  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.609771  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b759a28e523c491c941636a30d249939"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:16:59.610504  4119 raft_consensus.cc:606] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.610849  4119 raft_consensus.cc:614] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:16:59.612226  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.613778  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.617748  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.628887  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.631422  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.634655  4115 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: []
I20260709 13:16:59.625882  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.596822  6844 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:16:59.641819  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 234762us
I20260709 13:16:59.625391  6771 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:16:59.568977  6849 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:16:59.647450  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:16:59.655313  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.655562  4113 raft_consensus.cc:2376] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5. Re-sending same reply.
I20260709 13:16:59.628654  6847 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.626926  6883 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:16:59.633904  6809 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.633442  6875 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.658355  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:16:59.615365  6840 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:16:59.633498  6856 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.631947  6897 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.660349  6827 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:16:59.664361  6882 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:16:59.664858  4044 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:59.667325  6906 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.668437  6806 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:59.669067  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.686132  3966 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
W20260709 13:16:59.685374  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54024us
I20260709 13:16:59.687837  6799 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:59.687883  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:59.689049  6897 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:16:59.689971  6897 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.690212  6844 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.693264  6670 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:59.694212  6900 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:16:59.694631  6900 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.694931  6900 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:16:59.699306  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.670240  6880 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:59.672894  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.700552  3969 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:16:59.674154  6881 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:16:59.674109  4121 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:16:59.676328  4112 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.676910  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:59.662014  6885 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:16:59.678617  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.659282  6814 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:16:59.702716  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.679606  6847 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.609473  6895 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.731299  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.733632  3966 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:16:59.737442  4684 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:16:59.738962  4112 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:16:59.746460  6880 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:16:59.746871  6880 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:59.747635  6880 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.648317  6812 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.720160  6875 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.753922  6875 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.723727  6849 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:16:59.697732  6906 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.721773  6759 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:16:59.758992  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 104426us
I20260709 13:16:59.720378  6881 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.763406  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:59.767575  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.768136  4046 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:16:59.765501  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.771171  4043 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:16:59.767087  4118 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:16:59.766963  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.744576  6814 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.780326  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.770596  6856 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.803094  6812 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:16:59.795084  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:16:59.815941  4013 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:59.793610  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:59.807614  3969 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:16:59.818572  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:16:59.819455  4118 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:16:59.785722  6759 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:16:59.774302  6820 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:16:59.795440  6834 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:16:59.829239  6812 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:16:59.829751  6812 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.829490  6911 raft_consensus.cc:993] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:59.830549  6911 raft_consensus.cc:1081] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:16:59.830627  6812 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.774363  6907 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:16:59.840466  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65844.5us
I20260709 13:16:59.843206  4043 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.812302  6912 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:16:59.811385  6873 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:16:59.810892  6844 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.881583  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.882887  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:16:59.822140  6799 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:16:59.821676  6908 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.810777  6840 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:16:59.884837  4118 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:59.897311  3969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:16:59.850137  4112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:16:59.806849  6913 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 13:16:59.907481  4121 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:16:59.924075  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:16:59.925733  4112 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:16:59.925644  3969 raft_consensus.cc:606] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.927474  6905 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:16:59.928258  6910 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:16:59.928542  6896 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:16:59.932085  6898 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:16:59.885977  6799 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.932618  6898 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.934232  4043 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:16:59.876681  6847 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.932653  6799 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.926584  4112 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:16:59.937881  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:16:59.938493  4043 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:16:59.939589  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:59.945041  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:16:59.946751  6913 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:16:59.947110  6883 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.947289  6913 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:16:59.947672  6913 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.947921  6906 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:16:59.948427  6913 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.948983  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:16:59.949621  3968 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
W20260709 13:16:59.949689  6752 consensus_queue.cc:1175] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8c8b10100a146e6a81f308505fe9f46" responder_term: 5 status { last_received { term: 4 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:16:59.950750  6842 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:16:59.936228  6856 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.897320  6911 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.952561  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:16:59.955273  6906 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:16:59.955672  6906 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:16:59.956009  6906 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:16:59.958642  6912 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:16:59.959759  6912 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.936496  6822 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:16:59.939306  6812 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:16:59.883596  6844 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:16:59.964807  6883 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:16:59.965431  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:16:59.934950  6898 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:16:59.949638  6913 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:16:59.878726  6881 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.967819  6908 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.972926  6834 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.986743  6898 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:16:59.900885  6814 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.997304  6881 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.009761  6822 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:16:59.969295  6759 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:16:59.998651  6907 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:16:59.999480  6802 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:00.003706  6898 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.020644  4044 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:16:59.997494  6900 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.021931  6898 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.020167  6905 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:00.003649  6834 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.001693  6908 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.022840  6802 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.020577  6883 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.026142  6852 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:17:00.172251  6908 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.170019  6897 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.175122  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 223280us
W20260709 13:17:00.183346  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.253907  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.256110  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
W20260709 13:17:00.048126  6919 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:17:00.023626  6907 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.258592  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.047952  6914 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:00.261183  6943 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:00.266189  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:00.046046  6915 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
W20260709 13:17:00.063580  6922 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:00.059207  6831 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:00.065061  6810 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:00.269603  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.269022  4043 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:00.268291  3966 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.042949  4112 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.258764  6873 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.065831  6900 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.295053  6945 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.295233  6872 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:00.295624  6945 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.268918  6844 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:00.258124  6897 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.299275  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.273496  6914 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:00.301545  4648 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:00.311208  4112 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.039968  6905 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.309279  3969 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:17:00.287602  6831 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:00.293592  6810 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:00.039302  6822 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.323065  6844 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:00.323676  6844 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.267918  6923 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.316s
I20260709 13:17:00.325381  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:00.329821  4038 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.288496  6943 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.336740  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:00.337142  6914 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.338160  6914 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:00.302690  6873 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.341643  6834 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.345753  6943 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.325945  6895 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:00.360606  6831 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.362191  6907 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.363950  6911 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:00.366377  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.357770  6928 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:00.357333  6926 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:17:00.392958  6828 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.393488  6828 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.329916  6906 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.396170  6906 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.398506  6872 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.399029  6872 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.399935  6799 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.401094  6872 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.401117  6897 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.402093  6799 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.402627  6898 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.393388  6844 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.375092  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "293c0ff21e6f4e9f93555aaba177566b"
 from {username='slave'} at 127.0.0.1:40680
W20260709 13:17:00.385924  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.410035  4112 raft_consensus.cc:606] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Received request to transfer leadership to TS 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:00.411249  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.435300  4041 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:00.436092  6821 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.438709  6880 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.407460  6895 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.440336  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:00.441039  4112 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:00.440936  6895 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.441406  4112 raft_consensus.cc:614] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:00.442755  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:00.442996  6895 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.407860  6906 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.406090  6831 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.406810  6844 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:00.447142  6844 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.448593  6752 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.449117  6752 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.443993  6906 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.440114  6840 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.421836  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:00.468781  4042 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.456940  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.459125  4041 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:00.423175  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:00.411572  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.472561  4038 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:00.472738  4039 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.472932  4040 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:00.476368  3966 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.456115  6897 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:00.411634  6918 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.642s	user 0.000s	sys 0.004s
I20260709 13:17:00.406286  6941 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:00.449368  6844 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.413010  6928 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:00.491403  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.458252  6825 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:00.513361  6825 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:00.514318  6802 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.514221  6825 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.515442  6825 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.407184  6873 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.413036  6942 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.516680  6942 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.517982  6945 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.519471  6942 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:00.411665  6828 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:00.455816  6834 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.503958  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.521250  6834 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.404739  6898 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.523466  6834 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.502920  6823 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.459694  6906 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.524324  6823 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.524783  6823 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:00.525722  6873 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.526139  6873 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.526484  6873 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.500500  6871 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.505028  6808 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.505183  6879 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.505815  6931 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:00.506345  6939 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 13:17:00.464813  6840 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.504904  6946 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.562151  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:00.546180  6828 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.555296  6822 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.515689  6875 raft_consensus.cc:993] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:00.593086  6875 raft_consensus.cc:1081] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:00.503677  6941 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.595163  6941 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.556951  6906 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:00.596491  6906 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.598088  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 227) took 2113 ms. Trace:
I20260709 13:17:00.581848  6946 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.559139  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.602237  3866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 237) took 1187 ms. Trace:
I20260709 13:17:00.557864  6871 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.602948  3866 rpcz_store.cc:276] 0709 13:16:59.414850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.415015 (+   165us) service_pool.cc:224] Handling call
0709 13:17:00.602166 (+1187151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15743,"reported_tablets":1}
I20260709 13:17:00.572484  6931 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.605437  6759 raft_consensus.cc:1064] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:17:00.605908  6931 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:00.606328  6840 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:00.606527  6952 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.055s	user 0.001s	sys 0.002s
I20260709 13:17:00.607033  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:00.610350  6828 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.610968  4044 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:00.557289  6847 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.616187  4039 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
W20260709 13:17:00.527865  6812 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 13:17:00.451125  6752 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.477860  6929 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:17:00.549229  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.571971  6853 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.556990  6852 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.557499  6842 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.548704  4042 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:00.490830  6897 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.580070  4683 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:00.598585  6906 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.556939  4681 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.588644  6810 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:00.561378  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95621.5us
I20260709 13:17:00.615120  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.633126  6739 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.621889  6885 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:00.617559  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:00.681807  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 64343.6us
I20260709 13:17:00.681910  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.682499  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:00.571280  6834 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.598496  3868 rpcz_store.cc:276] 0709 13:16:58.484215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:58.497204 (+ 12989us) service_pool.cc:224] Handling call
0709 13:17:00.598028 (+2100824us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:16:59.357311 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:16:59.432655 (+ 75344us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:16:59.432691 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:16:59.432711 (+    20us) tablet.cc:662] Decoding operations
0709 13:16:59.433311 (+   600us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:16:59.433366 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:16:59.433395 (+    29us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:16:59.433711 (+   316us) tablet.cc:701] Row locks acquired
0709 13:16:59.433736 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:16:59.433893 (+   157us) write_op.cc:270] Start()
0709 13:16:59.434008 (+   115us) write_op.cc:276] Timestamp: P: 1783603019433836 usec, L: 0
0709 13:16:59.434030 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:16:59.434680 (+   650us) log.cc:844] Serialized 1361 byte log entry
0709 13:16:59.756937 (+322257us) op_driver.cc:464] REPLICATION: finished
0709 13:16:59.990699 (+233762us) write_op.cc:301] APPLY: starting
0709 13:16:59.995595 (+  4896us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:00.003367 (+  7772us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:00.023477 (+ 20110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:00.061286 (+ 37809us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:00.061496 (+   210us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:17:00.061542 (+    46us) write_op.cc:312] APPLY: finished
0709 13:17:00.061773 (+   231us) log.cc:844] Serialized 35 byte log entry
0709 13:17:00.061925 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:00.062008 (+    83us) write_op.cc:454] Released schema lock
0709 13:17:00.062043 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:00.062440 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:00.062464 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68307,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":210139,"apply.run_cpu_time_us":2530,"apply.run_wall_time_us":89723,"num_ops":3,"prepare.queue_time_us":165173,"prepare.run_cpu_time_us":3316,"prepare.run_wall_time_us":109581,"replication_time_us":302823,"thread_start_us":283228,"threads_started":2}]]}
I20260709 13:17:00.566567  6881 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.571328  6872 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.635632  3966 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.602541  6946 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.663784  6961 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.579788  6808 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:00.666922  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.563704  6879 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.616611  6820 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.612409  6828 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.669231  4040 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
W20260709 13:17:00.697827  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 139817us
I20260709 13:17:00.699687  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.671825  4043 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:00.673077  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.624193  6822 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.676975  6897 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.677263  3970 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:00.677946  4045 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.667487  6842 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.667155  6853 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.687693  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.722383  4041 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:00.688867  4044 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.658370  6941 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:00.728729  6808 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.730051  6853 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.731081  6953 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.691210  3965 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:17:00.731565  6953 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.732795  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.733352  3965 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:00.691654  4046 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49100
I20260709 13:17:00.734452  4046 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:00.734778  4046 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:00.692276  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.690577  6834 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.693604  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.693898  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.737496  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.738030  3963 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:00.738117  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.738674  6834 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.696853  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.633173  6847 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.740257  3968 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:00.700240  4040 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:00.696738  6810 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.700603  4039 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:00.666389  6852 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.746744  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.721290  3964 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:00.680471  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.728878  6941 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.658594  6945 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:00.733952  6879 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.698405  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.734114  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.743110  3966 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
W20260709 13:17:00.740716  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 74932.3us
I20260709 13:17:00.743494  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.752185  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.698328  6928 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:00.744660  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.747287  3970 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.747503  3969 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:00.701122  6927 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:00.678431  6739 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.760586  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.753000  3965 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:00.761886  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.755111  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.755585  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.692950  6872 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.763695  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.717020  6856 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:00.757148  4041 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:00.757009  3969 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:00.758633  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.821854  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.753943  4046 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.758903  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:00.759598  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.822783  4683 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:00.822868  3966 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
W20260709 13:17:00.823657  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:00.753830  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53784.3us
I20260709 13:17:00.763046  4042 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:00.692308  6881 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:00.827318  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237eb348003645f7abcc1c18bd324690"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:17:00.764230  3968 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:00.701236  6820 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.740635  6823 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:00.788874  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.824468  4045 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:00.825449  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.763525  6935 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.829303  3970 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:00.759641  6847 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.744048  6883 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:17:00.835467  4121 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:00.837944  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.837628  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.840902  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.841300  4117 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:00.697476  6961 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.768630  6960 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.761431  6928 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:00.843410  4120 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:00.844897  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.845666  4118 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:00.850090  3970 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
W20260709 13:17:00.848356  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.846517  4115 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:00.831349  6914 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:00.835011  6947 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.255s	user 0.000s	sys 0.005s
I20260709 13:17:00.852989  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.853281  4119 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:00.832314  6927 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:00.760200  6945 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.831254  6834 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.864053  6739 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.854416  6828 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.864291  6834 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.864745  6828 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.866683  6834 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.856600  6953 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.767897  6956 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:17:00.869103  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.869715  3966 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:00.871016  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.871474  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.872045  4117 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:00.872190  4113 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:00.860888  6959 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.839931  6935 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.862345  6881 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:00.862962  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.873214  6959 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.873932  6935 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:00.873708  4118 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:00.873135  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.875023  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.867026  6828 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.875226  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:00.874091  4121 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:00.881255  4113 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:00.876106  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.876570  4114 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:00.875551  4118 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.882418  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.883064  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:00.883313  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.848532  6879 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.877730  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.885476  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.881825  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.882351  4117 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.886765  3966 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:00.888806  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.889917  4113 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.890691  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.891430  4121 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:00.891553  4113 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:00.885571  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.885653  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.860411  3970 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.892849  4118 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:00.884958  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.854851  6842 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.895437  4113 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:00.896600  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.897498  4045 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:00.895184  4114 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:00.896917  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.898070  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.898391  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.899024  3963 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:00.899228  4041 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:00.898591  3968 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:00.901418  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.903733  4113 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:00.905689  4114 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:00.906567  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:00.907286  4117 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:00.886264  6953 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:00.893886  6828 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:00.894235  6879 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.911441  6898 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:00.911670  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.995395  3968 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:17:00.912988  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.913129  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:00.914067  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:00.917033  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.918601  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.919399  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:00.996156  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.004151  4114 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.996500  3966 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:00.902395  6739 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:00.911756  6957 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:17:01.006770  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:01.024049  3972 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:00.997265  4045 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:01.025255  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:01.002307  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:00.997517  4042 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:00.996659  3970 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:00.997057  3963 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:01.002125  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:01.002594  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 85621.9us
W20260709 13:17:00.911296  6949 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.123s	user 0.000s	sys 0.005s
I20260709 13:17:01.023033  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.041329  4120 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:01.026067  4117 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:00.852962  6960 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.028780  3963 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:01.038542  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:00.920017  6828 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:00.918342  6822 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:00.995541  6836 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.046985  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.002929  6881 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.007867  6941 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.020372  6739 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.020375  6810 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:01.111297  6739 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.073974  6946 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.122606  6946 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.123039  6946 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.074172  6836 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.127918  6836 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.044471  6856 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.129987  6856 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.132248  6856 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.058607  6828 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.074779  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:01.137895  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64282.4us
I20260709 13:17:01.076308  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.082415  6879 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.083712  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.149283  4039 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:01.052476  3963 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.085765  6881 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.086803  6872 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.087924  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.158043  4042 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:01.158962  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.159560  4118 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:01.104875  4013 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.106048  6961 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.161371  6961 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.161856  6961 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.163849  6961 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:00.995646  6928 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.135143  3971 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:01.165035  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.165758  4117 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:01.045730  6871 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:01.142866  6959 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.146111  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.138125  4114 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:01.167023  4113 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:01.150272  3963 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.052999  6897 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:00.994840  6953 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:00.881747  6967 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:17:01.166903  6821 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:01.149042  6873 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.003s
W20260709 13:17:01.167656  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 62909.9us
I20260709 13:17:01.178644  6852 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.179483  6897 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:01.183027  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.193519  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.194314  4113 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 4.
I20260709 13:17:01.196656  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.197402  4042 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:01.157505  6883 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.158313  6905 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.201848  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.208655  4045 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:01.201628  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.203912  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.211099  4113 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:01.213676  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.214344  4039 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:01.154623  6906 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:17:01.156109  6941 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:17:01.226027  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:01.226799  4684 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:01.039469  6927 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.164497  6739 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.201447  6883 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.233008  6963 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.242440  6963 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.199842  6897 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.202627  6940 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.233991  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:01.234017  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.249228  4113 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:01.251482  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:01.251991  4684 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:01.231361  6905 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.199525  6873 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.255177  3963 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:01.234511  6953 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:01.263929  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.250545  6945 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:01.264799  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 126155us
I20260709 13:17:01.250198  6879 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.249850  6940 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.256714  6905 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.271066  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.272147  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.272841  4114 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:01.272493  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.265695  6963 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.278369  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.272490  6905 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.276813  6960 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.280007  6977 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:01.274003  6945 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.282011  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.270597  6879 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.283077  6881 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:01.282428  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:17:01.295935  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 64752.6us
I20260709 13:17:01.299458  6914 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.299935  6914 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.301402  6739 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.282428  6941 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.280599  6975 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.284373  6940 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.291529  6945 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.291065  6977 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:01.346740  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 322601us
I20260709 13:17:01.286432  6935 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.357959  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:01.344298  6941 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.352510  6945 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.284300  6759 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:01.368992  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87040.9us
I20260709 13:17:01.369124  4046 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:01.362691  6941 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.375937  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:01.376602  4684 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.369807  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.348379  6975 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.373333  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.411448  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.427634  4684 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:01.428489  6969 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.429327  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:01.479404  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50134.4us
I20260709 13:17:01.480595  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.479046  6969 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.407233  6960 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:01.454196  6935 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.454715  6977 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.481700  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.459653  6821 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.460398  6881 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:01.460852  6834 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.461280  6873 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.410344  6883 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.475106  4013 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:01.493614  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 123956us
I20260709 13:17:01.492940  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:01.556555  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 81562.5us
W20260709 13:17:01.556784  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 63889.2us
I20260709 13:17:01.557051  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.481702  6964 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.482004  6969 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:01.594182  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:01.591521  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.481878  6739 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.554946  6821 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.556205  6834 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.598309  6821 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.480346  6946 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.600592  6946 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.601305  6946 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:01.601771  6946 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:01.602654  6946 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.553449  6877 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.553654  6976 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:01.552788  6879 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.587492  6883 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.555131  6881 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:01.487361  6945 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.555369  6982 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.596149  6739 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.585630  6953 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.555019  6963 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:01.586512  6968 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.480268  6828 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.593605  6964 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.555089  6960 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:01.626084  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.614555  6881 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:01.633419  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76439us
I20260709 13:17:01.618428  6739 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.616235  6982 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.638896  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.618999  6953 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.626853  6964 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.625779  6963 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.663419  4112 raft_consensus.cc:606] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:17:01.612514  6877 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.616079  6883 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:01.671564  6965 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.632s	user 0.004s	sys 0.000s
I20260709 13:17:01.660003  6953 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.676265  6960 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.613857  6976 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.662226  6963 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:01.667824  6983 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:01.685613  6828 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.658386  6982 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.628998  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:01.683239  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 92) took 2620 ms. Trace:
W20260709 13:17:01.684505  6980 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:17:01.671741  6877 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.689309  3870 rpcz_store.cc:276] 0709 13:16:59.062497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:16:59.070998 (+  8501us) service_pool.cc:224] Handling call
0709 13:17:01.683173 (+2612175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40694,"reported_tablets":3,"spinlock_wait_cycles":29568}
I20260709 13:17:01.626580  6968 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.689412  6983 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.720983  6897 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.723382  6897 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.724277  6897 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.730476  6968 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:01.738045  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103954us
I20260709 13:17:01.743834  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:01.744730  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.732317  6881 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.732190  6883 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.712466  6985 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.724658  6897 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:01.747246  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.709448  6941 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.751406  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:01.717118  6983 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:01.753829  3967 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:01.752501  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:01.756497  3963 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:01.715231  6914 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.758497  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:01.759929  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:01.761715  6914 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.762964  6988 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:01.763377  6988 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.763677  6988 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.751443  6986 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.767102  6986 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.769193  6986 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.769686  6821 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.772367  6821 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:01.772696  6988 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.773859  6739 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.775986  6739 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.778419  6988 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:01.780083  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:01.780694  4684 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.784024  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:01.784726  3967 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:01.785166  3967 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:01.785364  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:01.786172  3970 raft_consensus.cc:2368] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:01.787320  3963 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:01.772919  6945 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.788421  4684 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:01.753090  6897 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.736207  6905 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.778873  6834 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.786140  3967 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:01.797596  3967 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.797938  6992 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.798508  6992 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.800184  4046 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:01.801110  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:01.801493  6953 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.802240  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:01.802773  3968 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.802958  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:01.803489  6953 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.804075  6953 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.804420  6953 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.804797  6953 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.805969  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:01.807009  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.807468  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:01.809609  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:01.810206  3965 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.762514  6946 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.812161  4046 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:17:01.750232  6969 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.812314  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:01.814888  4042 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:01.792439  6986 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.815987  6986 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.817241  6823 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.817890  6823 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.818226  6823 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.818537  6823 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.820102  6964 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.796064  6821 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:01.795910  6945 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.821589  6976 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.821985  6969 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.822638  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.837225  4044 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:01.838865  3967 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:17:01.846612  3967 pending_rounds.cc:85] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:17:01.822839  3969 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.824637  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:01.847488  3969 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:01.841761  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:01.849097  4046 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:01.825584  6905 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:01.828910  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 1944) took 1135 ms. Trace:
I20260709 13:17:01.849956  3971 rpcz_store.cc:276] 0709 13:17:00.693279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.693397 (+   118us) service_pool.cc:224] Handling call
0709 13:17:01.828705 (+1135308us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400407ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:01.828831 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914493696}
I20260709 13:17:01.813849  6946 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.822956  6739 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:01.813045  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:01.833204  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:01.865020  4684 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.835343  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.836421  4047 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:01.846881  3967 pending_rounds.cc:107] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:17:01.867214  4038 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:01.867748  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.851022  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.754910  6985 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.867251  3967 raft_consensus.cc:2889] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:01.855780  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.868602  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.869228  4042 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
W20260709 13:17:01.841352  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.848214  6945 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.862349  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:01.868355  4047 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:01.811523  6834 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:01.888805  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.904018  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.869490  4040 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:01.911522  4046 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.912310  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:01.875617  4684 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:01.899677  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.913122  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.914376  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.914959  4040 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:01.918797  6983 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.921213  6945 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.919284  6814 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:01.921875  6814 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.922248  6814 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:01.863572  6821 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:01.925953  6821 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.927152  6963 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.928092  6821 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.929740  4114 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:01.928210  4683 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:01.935966  4118 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:01.937054  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.875833  3965 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:01.938989  4038 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:01.941351  3968 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:01.914466  4047 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:01.943944  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.944216  3969 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:17:01.944852  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2260) took 1264 ms (client timeout 1606 ms). Trace:
I20260709 13:17:01.945398  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:01.945021  4121 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
W20260709 13:17:01.945855  3969 rpcz_store.cc:269] 0709 13:17:00.679985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.680161 (+   176us) service_pool.cc:224] Handling call
0709 13:17:01.822538 (+1142377us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b540014b520. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763ca06f 00007fed76442f60 00007fed764447de 00007fed7645027c 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2
0709 13:17:01.944756 (+122218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108454656}
I20260709 13:17:01.946816  4114 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.937775  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.947978  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.949191  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:01.950356  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.950435  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.951112  4042 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:01.951404  4121 raft_consensus.cc:2368] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:01.938292  4118 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:01.952394  4047 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.869472  6739 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:01.953379  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:01.953574  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 163225us
I20260709 13:17:01.954852  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.955372  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.955747  4042 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:17:01.955909  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.961383  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:01.893736  6981 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.974229  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:01.978163  4011 leader_election.cc:400] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:01.978482  4011 leader_election.cc:403] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:01.955312  4121 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:01.894187  6941 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.972822  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.979954  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.928651  6759 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.980544  4047 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:01.946381  6977 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:01.897442  6969 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:01.984503  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.996191  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2034) took 1125 ms. Trace:
I20260709 13:17:01.980159  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:01.995040  6988 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:01.997880  6969 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.999974  6969 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:01.894518  6991 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:17:01.946513  6834 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.005827  6986 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.007517  6834 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.010739  6983 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:01.973527  6739 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:01.982543  6993 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:01.869544  6967 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:01.987381  4046 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:01.943549  6968 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:01.974421  6956 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:17:02.030726  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:01.976125  6905 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.972293  6945 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:01.950124  6940 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:17:02.010303  6982 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:01.863839  6946 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:01.996913  4120 rpcz_store.cc:276] 0709 13:17:00.870690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.870791 (+   101us) service_pool.cc:224] Handling call
0709 13:17:01.996015 (+1125224us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540004cc54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:01.996122 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390168320}
I20260709 13:17:01.953127  6821 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.016157  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.017314  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.044550  4121 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9.
I20260709 13:17:01.980201  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:01.977901  6981 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.048107  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:02.048719  4120 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.049003  6975 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.049834  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2043) took 1214 ms. Trace:
I20260709 13:17:02.019866  6953 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.050207  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.050916  6982 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.019867  4114 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:02.053742  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.054404  4114 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:02.055990  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2050) took 1218 ms. Trace:
I20260709 13:17:02.057806  6964 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.031073  6977 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.061271  6977 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:02.061830  6821 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.062458  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.063575  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:02.063910  6821 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.042265  6905 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.025015  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.019955  6985 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.015501  4117 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:02.070361  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:02.014876  6941 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:01.929072  6936 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:17:01.978621  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.031673  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:02.032019  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:02.034107  6991 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:01.987607  6914 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:17:02.020038  6992 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.031258  6831 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.064836  6905 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.043428  6945 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.013978  6759 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.047472  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.086585  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:02.092964  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.101367  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.102177  3969 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:02.100095  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:36870 (request call id 76) took 1266 ms. Trace:
I20260709 13:17:02.103451  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.104416  3965 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:02.104650  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.105440  3969 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:02.068034  4047 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:02.064039  4038 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.068806  4044 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:01.956939  6871 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:17:02.029034  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44589.3us
I20260709 13:17:02.014503  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.048537  6981 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.056375  4115 rpcz_store.cc:276] 0709 13:17:00.837543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.837747 (+   204us) service_pool.cc:224] Handling call
0709 13:17:02.055845 (+1218098us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:02.055940 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9780992}
I20260709 13:17:02.050166  4119 rpcz_store.cc:276] 0709 13:17:00.835217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.835330 (+   113us) service_pool.cc:224] Handling call
0709 13:17:00.835575 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:00.858615 (+ 23040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.049596 (+1190981us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b54001b1a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:02.049753 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40307456}
I20260709 13:17:02.029752  6967 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.066717  6814 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.072702  6823 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.073189  6963 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.041499  6968 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.074138  6852 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:02.074683  6953 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.075212  4116 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:02.075883  6897 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.065958  6842 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:02.078853  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:02.046083  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.081485  4039 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.103404  4112 rpcz_store.cc:276] 0709 13:17:00.825235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.826631 (+  1396us) service_pool.cc:224] Handling call
0709 13:17:02.091262 (+1264631us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400097c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:02.091368 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921553792}
I20260709 13:17:02.168666  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:02.168715  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154281us
I20260709 13:17:02.123435  3966 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:02.115988  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.197428  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.198436  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.198933  3966 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.200409  4038 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:02.118629  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.201138  3971 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:02.201961  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.201383  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.116303  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.203207  4038 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:02.203315  3963 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:17:02.203573  4039 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:02.204051  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:02.204494  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:02.206406  4039 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.207377  6946 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.177645  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.209033  3972 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:02.209911  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.210990  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.211570  3972 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:02.211737  6885 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:02.212325  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.179719  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.212222  4039 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:17:02.100950  6739 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.213865  3968 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:17:02.081496  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 102917us
I20260709 13:17:02.115082  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.120735  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.217192  3967 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:02.217448  4039 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:02.217795  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.217924  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.218321  3965 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.218598  3967 raft_consensus.cc:2368] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:02.219364  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.101004  6945 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.079679  4042 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.209954  6880 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:17:02.099618  6991 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:02.222090  6880 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:02.222466  6880 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:02.222725  6821 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:02.186936  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.225132  4047 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:02.225534  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.202939  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.226696  3971 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.228420  3972 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:02.196161  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.229212  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237eb348003645f7abcc1c18bd324690"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:17:02.229619  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.229920  4113 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:02.092438  6941 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:02.245539  6941 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.249090  4046 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:02.249706  6906 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:02.252918  4682 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:02.100009  6831 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:02.254602  6831 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.255106  6977 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:02.178094  6883 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:02.180339  6967 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:02.195446  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 149428us
I20260709 13:17:02.275120  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.189992  6852 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.091301  6985 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:02.229769  4112 raft_consensus.cc:606] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:17:02.230671  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.188866  6992 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.231498  3967 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:02.189230  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.302816  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.231586  4011 leader_election.cc:400] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:02.303705  4011 leader_election.cc:403] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.231917  4038 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:02.232196  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.223134  6842 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.238556  3965 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:02.239455  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.306027  3972 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.306227  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.240172  6823 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.232595  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.242465  6897 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.243695  4120 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:02.264715  4042 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
W20260709 13:17:02.268029  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.271677  3966 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:02.277705  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.223912  6821 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:02.298060  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101980us
W20260709 13:17:02.300294  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69697.7us
I20260709 13:17:02.311491  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.208953  6963 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:02.299208  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.304173  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:02.308246  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76814.9us
I20260709 13:17:02.319199  4011 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:02.296926  6810 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.010s	sys 0.018s
I20260709 13:17:02.308296  3963 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:02.314440  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.322142  3966 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:02.322574  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.323196  3963 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.228080  6820 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.320259  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:02.325618  3967 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:02.326267  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.332685  3966 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:02.244661  6881 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:02.324934  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.277566  6883 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.342097  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.345137  6883 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:02.345356  6810 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.012s	sys 0.019s
I20260709 13:17:02.345906  6810 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:02.346863  6810 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.348991  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.350109  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.352584  6883 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.354122  3969 raft_consensus.cc:2368] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7.
I20260709 13:17:02.274834  6840 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:02.279325  6914 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.301441  6852 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.358120  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.301347  6975 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:02.363436  3963 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:02.360179  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:02.314491  6977 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.314093  6877 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.374770  3971 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:02.307405  6956 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:02.375214  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50364us
I20260709 13:17:02.308259  6906 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.070055  6976 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:17:02.374014  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.427484  3963 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:02.316906  6963 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.367007  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.223315  6880 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.411240  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.411324  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.396538  6985 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.343595  6897 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:02.361821  6912 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.362100  6914 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.310730  6992 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.356374  6823 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:02.399749  6982 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:02.401348  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:02.436733  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.435313  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68422.9us
I20260709 13:17:02.433007  3971 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.451722  6929 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:02.374135  6840 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.454890  6840 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:02.455811  6995 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.498s	user 0.003s	sys 0.000s
I20260709 13:17:02.436127  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.222869  6991 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.457446  6968 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.457948  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.458549  3969 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:02.396522  6883 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.437893  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:02.410933  6877 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:02.433105  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:02.460939  6877 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.461292  3963 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:02.462255  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.462831  3963 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.432498  6946 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.452327  6929 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.446022  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.466146  4681 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.466536  4039 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:02.412348  6814 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.412724  6940 raft_consensus.cc:2764] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:02.364289  6828 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:17:02.469626  6962 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:02.425570  6956 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.472431  3967 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:02.431362  6871 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.433260  6963 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:02.400276  6820 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:17:02.433362  6964 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:02.480204  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44150.4us
W20260709 13:17:02.473415  6994 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.517s	user 0.005s	sys 0.000s
W20260709 13:17:02.441716  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 104199us
I20260709 13:17:02.438108  6821 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.523267  3971 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:02.477802  6982 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.523571  6946 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:02.522660  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 76700.4us
W20260709 13:17:02.550812  7007 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:17:02.539271  6810 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:02.521498  6739 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:02.557443  6877 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:02.602937  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.549741  6929 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.540114  3969 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:17:02.508893  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:02.491981  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90697.1us
I20260709 13:17:02.559109  3963 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:02.543970  6992 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.561405  6956 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:02.533305  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.549302  6842 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:02.440864  6941 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:02.440330  6906 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:02.442366  6914 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.604187  3972 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:02.748188  6881 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.769320  6881 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.771368  6881 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.772135  3972 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:02.757910  7018 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:02.753813  6946 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.773168  6936 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:02.773443  6946 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.620858  6945 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.431903  6960 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:17:02.775324  6945 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.775916  4040 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:02.776081  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 1970) took 1022 ms. Trace:
I20260709 13:17:02.732717  7016 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.618459  6853 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.618789  3967 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:02.777297  6853 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.776558  3964 rpcz_store.cc:276] 0709 13:17:01.753838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.754015 (+   177us) service_pool.cc:224] Handling call
0709 13:17:01.754356 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:01.754720 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:01.754748 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:01.758503 (+  3755us) log.cc:844] Serialized 26 byte log entry
0709 13:17:01.951460 (+192957us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:01.951498 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:01.951562 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.258788 (+307226us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:02.775780 (+516992us) raft_consensus.cc:1685] finished
0709 13:17:02.775804 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:02.776018 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2628,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":30169,"spinlock_wait_cycles":49112320,"thread_start_us":162046,"threads_started":1,"wal-append.queue_time_us":196995}
I20260709 13:17:02.779433  6853 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.759519  6871 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.751597  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.772986  7018 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.782876  6871 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.783658  7018 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:02.784368  6936 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:02.786649  6936 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.754165  6990 raft_consensus.cc:993] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 293c0ff21e6f4e9f93555aaba177566b to start an election
I20260709 13:17:02.793166  6990 raft_consensus.cc:1081] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Signalling peer 293c0ff21e6f4e9f93555aaba177566b to start an election
I20260709 13:17:02.795112  6880 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:02.797628  7013 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260709 13:17:02.800755  7015 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:17:02.709650  3856 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 237eb348003645f7abcc1c18bd324690 already in progress [suppressed 37 similar messages]
W20260709 13:17:02.749706  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.757519  3971 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:17:02.766287  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:02.824003  3963 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:02.465319  6759 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:02.617033  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 275632us
I20260709 13:17:02.825408  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.779634  6912 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:02.708580  6823 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.827679  6823 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.624490  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:02.829804  7018 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:02.831050  6960 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:17:02.807571  7009 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.337s	user 0.002s	sys 0.002s
I20260709 13:17:02.833634  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.755016  6831 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:02.834528  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.777179  7016 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:02.862890  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 111361us
I20260709 13:17:02.665278  3869 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 9 to 10, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 10 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.863595  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.864588  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:02.865337  4114 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:02.640702  6814 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:02.749359  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.886344  4112 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.708890  6828 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.727818  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:02.867161  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.868162  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.869208  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.869485  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:02.732290  6976 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:02.697570  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:02.875049  4012 leader_election.cc:400] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:02.750109  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.866565  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.867087  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.886590  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:02.886814  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 137547us
I20260709 13:17:02.887106  4042 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:02.753767  6982 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:02.886171  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:02.864207  3869 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:02.872231  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:02.892155  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 137122us
I20260709 13:17:02.937243  4118 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:02.830967  7018 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:02.904841  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:02.937520  3869 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:02.765705  6906 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:02.937788  4047 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:02.936924  4119 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
W20260709 13:17:02.938441  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 124168us
I20260709 13:17:02.830063  6823 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:02.937485  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:02.993078  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 243043us
I20260709 13:17:02.940172  4038 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:02.989727  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:02.861891  6883 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:02.848973  6941 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:02.990278  3965 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:02.994132  4113 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:17:02.889449  6981 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.704s	user 0.003s	sys 0.008s
W20260709 13:17:03.007211  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 65528.8us
W20260709 13:17:02.995870  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58501.6us
I20260709 13:17:02.851591  6975 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.007872  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:02.994292  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:02.941282  6992 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:02.886739  7017 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:03.007962  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:02.995810  4044 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:02.995456  6906 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.000171  4038 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:02.993820  4675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc"
dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
 from {username='slave'} at 127.0.0.1:51360
W20260709 13:17:02.999125  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 124219us
I20260709 13:17:03.012532  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:02.889972  6897 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:02.941517  6879 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.046113  4012 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9.
I20260709 13:17:03.004842  6991 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:17:02.892908  7005 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.147s
I20260709 13:17:03.047185  4012 leader_election.cc:403] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:02.997414  6883 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:03.051028  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.055797  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.056331  4120 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.051719  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.056699  4113 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:03.056855  4119 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.003710  6825 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.054258  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.054425  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.059656  4118 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:02.936004  6814 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.054996  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.056448  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.062228  4114 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.011186  6823 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.060715  4112 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.063077  4117 raft_consensus.cc:2368] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:02.990265  6976 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.083772  4119 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:03.043627  6808 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:03.070874  6963 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.047655  4677 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:03.043915  6905 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.001s
I20260709 13:17:03.077090  6968 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:03.115077  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:03.045598  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51365.4us
W20260709 13:17:03.088395  6852 consensus_meta.cc:287] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.688s	user 0.005s	sys 0.005s
W20260709 13:17:03.062281  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54391.2us
I20260709 13:17:03.147379  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.000254  6828 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.091924  3969 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:03.093394  4683 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:17:03.000349  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 290714us
W20260709 13:17:03.151278  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:03.044111  6956 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:03.152482  6956 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:17:03.154598  6956 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.062593  6883 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.008960  6981 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.162745  6981 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.047235  6879 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.163552  6879 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.123574  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.087808  6946 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.119019  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.170327  4117 raft_consensus.cc:2368] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.170562  4115 raft_consensus.cc:2368] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.113639  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.171473  4120 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.171561  6946 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.172673  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:03.173282  3965 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.123843  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.120390  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.177058  4684 raft_consensus.cc:2368] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:17:03.177313  4119 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:03.114449  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.085232  7003 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:03.060702  6977 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.001s
W20260709 13:17:03.086302  6967 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
I20260709 13:17:03.043903  6820 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:17:03.149575  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.048751  7017 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:03.078115  6988 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9.
I20260709 13:17:03.180526  4120 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:03.191336  6967 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.192155  6969 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:03.181502  4112 raft_consensus.cc:2368] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9.
I20260709 13:17:03.178156  6852 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.193475  6967 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:03.193267  7017 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.194181  4116 raft_consensus.cc:2368] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:17:03.194624  6852 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.194927  4121 raft_consensus.cc:2368] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:03.182895  6853 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.192426  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.125763  6808 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.196902  4120 raft_consensus.cc:2368] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:03.197300  6808 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.197793  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.192559  6969 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.198526  4120 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:03.199204  7003 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:03.076748  6941 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.200488  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.201516  4120 raft_consensus.cc:2368] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.122783  6825 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:03.196111  7020 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:17:03.191591  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:03.187934  3965 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
W20260709 13:17:03.181955  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49332.5us
I20260709 13:17:03.178004  4675 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:03.209861  4085 leader_election.cc:400] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7.
I20260709 13:17:03.210209  4085 leader_election.cc:403] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.211428  3967 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:03.212543  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:03.201433  6877 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.213841  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.214311  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.220145  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.220942  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.221386  4041 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:03.221827  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.222476  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.223088  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.223727  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.097892  6823 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.214845  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:03.224196  4041 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:03.224805  3963 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.225003  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.198583  6969 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:03.225549  4041 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.225952  6823 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.232527  4041 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:03.215247  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:03.213303  3967 raft_consensus.cc:2368] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.213749  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:03.213935  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.217136  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.203076  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.188390  6977 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.232726  6969 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:03.237988  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.148138  6905 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.190090  6992 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:03.182106  6759 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:17:03.234371  3964 raft_consensus.cc:2368] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:03.202119  6825 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.234797  4113 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.188855  6897 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:03.235050  4044 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.212702  4675 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:03.245386  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.256199  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:03.257097  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.214090  6852 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:03.265190  4043 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:03.235210  4120 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:03.233690  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.267347  4041 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:03.150871  6914 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.090197  7018 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.268800  4011 leader_election.cc:400] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.257041  3968 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:03.247721  4039 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:03.258695  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.262310  6905 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.186496  6975 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.256177  6988 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:17:03.263461  7005 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:03.250905  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.294952  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.306522  4120 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.274024  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.264846  6840 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.269348  4011 leader_election.cc:403] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.298527  4044 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:03.307583  6840 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.308651  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.307363  4041 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:03.216434  6964 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7.
I20260709 13:17:03.309335  4044 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.310004  6840 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.310150  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:03.310940  4041 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:03.311134  6840 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:03.315938  4044 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
W20260709 13:17:03.317843  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 60476us
I20260709 13:17:03.318572  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.318666  4011 leader_election.cc:400] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:03.254902  6823 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:03.320036  4011 leader_election.cc:403] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.254076  6992 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:03.268895  6871 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:03.322477  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.324533  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:03.325197  3966 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:03.337581  4120 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.200465  7003 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.293095  7016 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.269490  6877 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:03.255602  7012 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.597s	user 0.002s	sys 0.002s
I20260709 13:17:03.299901  7002 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:17:03.334146  6883 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.326506  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.373136  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.344185  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:03.304886  7014 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:03.374436  4113 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:03.376259  4120 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
W20260709 13:17:03.379364  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85470.7us
I20260709 13:17:03.269272  6897 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.326170  6969 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:03.382051  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55617.9us
I20260709 13:17:03.397819  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:03.399212  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.328704  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:03.371923  7019 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:17:03.377154  4041 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:03.395648  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:03.395552  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 96118.6us
I20260709 13:17:03.345472  6823 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.411785  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:03.568120  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 223869us
I20260709 13:17:03.559156  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2287) took 1440 ms. Trace:
W20260709 13:17:03.564739  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 168081us
I20260709 13:17:03.570539  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:03.572486  4044 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:03.573233  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.570003  3970 rpcz_store.cc:276] 0709 13:17:02.118614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.169474 (+ 50860us) service_pool.cc:224] Handling call
0709 13:17:02.169824 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:02.284845 (+115021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:02.284881 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:02.285390 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:17:02.436323 (+150933us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:02.521847 (+ 85524us) log.cc:844] Serialized 14 byte log entry
0709 13:17:02.522079 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:02.522151 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:02.806356 (+284205us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18003ef4a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:03.243179 (+436823us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b20001dde78. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed75ffab91 00007fed7601ca19 00007fed75fe78c3 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169 00007fed75ff0131 00007fed75fef42d 000000000038f354
0709 13:17:03.558171 (+314992us) raft_consensus.cc:1685] finished
0709 13:17:03.558256 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:03.558778 (+   522us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111,"prepare.queue_time_us":86278,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":56,"raft.queue_time_us":23125,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":31002,"spinlock_wait_cycles":104508160,"thread_start_us":174442,"threads_started":2,"wal-append.queue_time_us":291047}
I20260709 13:17:03.576445  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.577637  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:03.415138  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:03.582331  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 167147us
W20260709 13:17:03.583320  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 184069us
I20260709 13:17:03.583576  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:03.584865  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:03.585736  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 334770us
I20260709 13:17:03.589001  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:03.590016  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 188421us
I20260709 13:17:03.590760  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:03.591079  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:03.592396  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:03.594194  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:03.597282  6759 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:03.416524  6852 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.449891  6853 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.417193  6881 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.432397  6885 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:03.373492  6871 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.381973  6877 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:03.457230  6960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.011s
W20260709 13:17:03.697494  6960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.000s	sys 0.011s
I20260709 13:17:03.424100  6964 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.444883  6969 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:03.441809  6963 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.447280  6976 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.482517  6988 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:03.701596  6988 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:17:03.702124  7026 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:03.442983  7014 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:03.467113  7025 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:17:03.430209  7027 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:17:03.373855  7028 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
W20260709 13:17:03.475771  7030 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:17:03.726943  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 131544us
I20260709 13:17:03.446305  7035 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:03.477149  7049 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.728839  6820 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:03.698789  7040 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:03.729652  6820 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.731177  6877 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.732264  6820 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.512742  7050 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:03.613204  6991 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:03.634826  7057 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:03.635149  6821 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:03.635619  7005 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.635895  7045 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:03.610704  6897 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:03.762362  7005 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.762684  7057 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.650239  7056 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:03.650846  6967 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:03.653512  4113 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:03.653941  6914 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.655874  6879 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.733799  6871 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.706207  7014 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.657521  7037 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:03.657028  6823 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:03.658569  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78419.6us
W20260709 13:17:03.659544  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 340867us
I20260709 13:17:03.635463  6852 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.662021  7042 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:03.662676  7052 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:03.663358  6975 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:03.664319  7044 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:03.682118  6759 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.698299  6853 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:03.706650  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2300) took 1405 ms. Trace:
I20260709 13:17:03.723702  6883 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:03.724334  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2366) took 1717 ms (client timeout 2074 ms). Trace:
I20260709 13:17:03.704731  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2303) took 1358 ms. Trace:
I20260709 13:17:03.764961  7050 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:03.704751  6988 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.698439  6964 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:03.748935  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237eb348003645f7abcc1c18bd324690"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
W20260709 13:17:03.759660  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 148954us
W20260709 13:17:03.774731  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46874.9us
I20260709 13:17:03.764744  7056 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:03.749033  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2064) took 1810 ms (client timeout 2154 ms). Trace:
I20260709 13:17:03.768653  6879 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.782696  7005 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:03.803332  3966 rpcz_store.cc:276] 0709 13:17:02.345896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.349895 (+  3999us) service_pool.cc:224] Handling call
0709 13:17:03.704349 (+1354454us) spinlock_profiling.cc:243] Waited 974 ms on lock 0x7b5400408dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:03.704552 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2240490880}
W20260709 13:17:03.803025  4043 rpcz_store.cc:269] 0709 13:17:02.006387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.086294 (+ 79907us) service_pool.cc:224] Handling call
0709 13:17:03.723785 (+1637491us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54000ca654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:03.724089 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679269632}
I20260709 13:17:03.775974  6990 raft_consensus.cc:993] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 293c0ff21e6f4e9f93555aaba177566b to start an election
I20260709 13:17:03.814297  4012 leader_election.cc:400] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:03.814246  7073 raft_consensus.cc:1081] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Signalling peer 293c0ff21e6f4e9f93555aaba177566b to start an election
I20260709 13:17:03.802801  3969 rpcz_store.cc:276] 0709 13:17:02.301162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.756530 (+455368us) service_pool.cc:224] Handling call
0709 13:17:03.091684 (+335154us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.150554 (+ 58870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.706248 (+555694us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b5400440050. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:03.706463 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769930112}
I20260709 13:17:03.784683  7057 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:03.807521  4121 rpcz_store.cc:269] 0709 13:17:01.938013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.047218 (+109205us) service_pool.cc:224] Handling call
0709 13:17:03.748434 (+1701216us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540026b6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:03.748658 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518248832}
I20260709 13:17:03.809276  7056 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.803081  7037 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:03.772015  7045 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:03.809046  6964 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:03.771133  6814 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.772745  6831 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.824295  4115 raft_consensus.cc:606] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Received request to transfer leadership
I20260709 13:17:03.807186  7050 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:03.770992  6821 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:03.830404  6821 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.804899  7042 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:03.828436  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:03.828475  7028 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.834095  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:03.842767  7028 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.838032  7042 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:03.826200  7037 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.844236  3870 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 7 to 9, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 9 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.827206  6853 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.839540  6759 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.842859  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 231) took 3781 ms. Trace:
I20260709 13:17:03.847330  3869 rpcz_store.cc:276] 0709 13:17:00.061743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:00.061865 (+   122us) service_pool.cc:224] Handling call
0709 13:17:03.842601 (+3780736us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:03.263497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:03.264060 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:03.264093 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:17:03.264112 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:03.333415 (+ 69303us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:03.333469 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:03.333497 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:17:03.333805 (+   308us) tablet.cc:701] Row locks acquired
0709 13:17:03.333823 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:03.333968 (+   145us) write_op.cc:270] Start()
0709 13:17:03.334073 (+   105us) write_op.cc:276] Timestamp: P: 1783603023333924 usec, L: 0
0709 13:17:03.334092 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:17:03.334711 (+   619us) log.cc:844] Serialized 1317 byte log entry
0709 13:17:03.609867 (+275156us) op_driver.cc:464] REPLICATION: finished
0709 13:17:03.733550 (+123683us) write_op.cc:301] APPLY: starting
0709 13:17:03.733696 (+   146us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:03.733908 (+   212us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:03.738991 (+  5083us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:03.739751 (+   760us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:03.740209 (+   458us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:17:03.740289 (+    80us) write_op.cc:312] APPLY: finished
0709 13:17:03.740721 (+   432us) log.cc:844] Serialized 35 byte log entry
0709 13:17:03.743822 (+  3101us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:03.744013 (+   191us) write_op.cc:454] Released schema lock
0709 13:17:03.744069 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:03.744644 (+   575us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:03.744675 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":186832,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":123267,"apply.run_cpu_time_us":3695,"apply.run_wall_time_us":11094,"num_ops":3,"prepare.queue_time_us":216649,"prepare.run_cpu_time_us":15730,"prepare.run_wall_time_us":196976,"raft.queue_time_us":98612,"raft.run_cpu_time_us":31206,"raft.run_wall_time_us":81365,"replication_time_us":275456,"spinlock_wait_cycles":57216,"thread_start_us":475624,"threads_started":4,"wal-append.queue_time_us":144676}]]}
I20260709 13:17:03.852159  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:03.856707  3966 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:03.822330  7044 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.858500  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:03.859395  3968 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:03.864889  7028 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.859807  7044 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.873334  4684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 229) took 1242 ms. Trace:
I20260709 13:17:03.873903  4684 rpcz_store.cc:276] 0709 13:17:02.624089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.624235 (+   146us) service_pool.cc:224] Handling call
0709 13:17:03.865715 (+1241480us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400600ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:03.866073 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782166272}
I20260709 13:17:03.858876  6821 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:03.823364  7052 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:03.846617  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 4 to 5, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 5 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:03.878998  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63210.7us
I20260709 13:17:03.892589  6828 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:03.895228  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:03.895705  6825 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.011s
I20260709 13:17:03.896981  6853 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:03.898861  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:03.900874  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 76090.7us
I20260709 13:17:03.902316  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:03.866134  6906 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.818s	user 0.015s	sys 0.004s
I20260709 13:17:03.827402  7005 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.765830  6991 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.910997  3870 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 5 to 6, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:03.918639  7005 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.927001  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:03.934012  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:03.941587  3938 leader_election.cc:400] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:17:03.942013  3938 leader_election.cc:403] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:03.896476  6825 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.924590  7005 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.913172  6906 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:03.965569  6992 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.009s
I20260709 13:17:03.966435  6883 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:03.966845  4118 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:03.967706  6825 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:03.967897  6982 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.972s	user 0.014s	sys 0.004s
I20260709 13:17:03.968542  7049 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:03.968381  6982 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.966135  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:03.970144  3968 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:17:03.970331  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:03.966039  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63961.4us
W20260709 13:17:03.970698  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49342.7us
I20260709 13:17:03.876410  7045 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:03.968967  6831 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:17:03.974988  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:03.976867  6840 raft_consensus.cc:2764] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:03.898768  7052 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:03.983129  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:03.959316  3870 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:03.988444  4038 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:03.990762  6906 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:03.999821  6964 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.001793  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.002912  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:04.003545  7034 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.723s	user 0.000s	sys 0.006s
I20260709 13:17:04.004689  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.005250  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.005733  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.018383  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.005766  4677 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:04.009243  6883 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:17:04.010776  6982 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.017207  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.017666  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.037603  4044 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:03.966193  6992 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:04.025110  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43851.2us
I20260709 13:17:04.024487  3965 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.030923  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:04.031769  4675 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.011s
I20260709 13:17:04.042009  7057 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:04.025969  7056 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.057194  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:17:04.057521  7078 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:17:04.058288  4045 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:04.059044  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:04.056522  7081 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:17:04.061111  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.066136  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.072993  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.071664  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.074745  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.076126  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.076329  6982 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.076864  6831 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.077358  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.077490  6831 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.078286  3963 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 5: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:04.078706  7056 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:04.079067  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.079625  6831 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.077168  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2084) took 1074 ms. Trace:
I20260709 13:17:04.047452  4675 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.069316  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.082504  3969 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:04.083285  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.084221  4675 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.080534  4042 rpcz_store.cc:276] 0709 13:17:03.002752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.002933 (+   181us) service_pool.cc:224] Handling call
0709 13:17:03.005218 (+  2285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.040312 (+ 35094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.040359 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.044698 (+  4339us) log.cc:844] Serialized 26 byte log entry
0709 13:17:03.189881 (+145183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:03.189946 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:03.711143 (+521197us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b54000ca154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:03.711257 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:03.941276 (+230019us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:04.073465 (+132189us) raft_consensus.cc:1685] finished
0709 13:17:04.073489 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.076977 (+  3488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1730,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":4420,"spinlock_wait_cycles":106418688,"thread_start_us":99573,"threads_started":1,"wal-append.queue_time_us":194507}
I20260709 13:17:04.085062  4684 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:04.085520  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.085911  4042 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:04.076815  6982 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:04.086769  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.087071  6982 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.087925  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.080313  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.090243  6912 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.090543  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:04.091033  7017 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:04.091406  4043 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.091928  3937 leader_election.cc:400] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:04.092221  3937 leader_election.cc:403] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.092653  7017 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.092947  7056 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.057240  6883 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.093578  7005 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:04.094055  7005 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:04.095130  7005 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.096372  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:04.097098  7005 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.098014  3972 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.098975  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.100234  6840 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.100678  6840 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:04.072228  7049 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:04.101213  7056 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:04.103861  7084 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:04.105129  7049 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.106403  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:04.106402  7049 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.091076  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.104660  4675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:51360 (request call id 215) took 1243 ms. Trace:
I20260709 13:17:04.107733  4675 rpcz_store.cc:276] 0709 13:17:02.861958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.935432 (+ 73474us) service_pool.cc:224] Handling call
0709 13:17:04.082828 (+1147396us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54005618d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76443a3d 00007fed7b413cd0 00007fed74998254 00007fed749981e2 00007fed74998111 00007fed7499808c 00007fed74997342 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:04.084681 (+  1853us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281622272}
I20260709 13:17:04.101045  6840 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.122517  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.125180  4046 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:04.127513  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47295.9us
I20260709 13:17:04.128007  3965 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:04.130304  3963 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:04.133266  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:04.136554  6831 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:04.142112  6852 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.142908  6852 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.143319  6852 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.145473  7057 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:04.146014  7057 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.175472  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:04.175002  4684 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:04.143118  4683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 209) took 1705 ms (client timeout 2013 ms). Trace:
W20260709 13:17:04.190819  4683 rpcz_store.cc:269] 0709 13:17:02.437447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.437652 (+   205us) service_pool.cc:224] Handling call
0709 13:17:04.142794 (+1705142us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54008da254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:04.142951 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416022912}
I20260709 13:17:04.198048  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.202652  4012 leader_election.cc:400] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:04.203037  4012 leader_election.cc:403] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:04.217311  3969 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:04.164322  6877 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:17:04.174882  7037 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.224841  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:04.231504  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:04.232998  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 95482.9us
I20260709 13:17:04.232538  6941 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:04.236480  4114 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:04.237105  4114 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:04.237980  4114 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.239297  4114 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.240718  3963 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:04.241807  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.245885  4044 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:04.251082  7068 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:04.247184  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.260708  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:04.260946  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70936.2us
I20260709 13:17:04.261899  4012 leader_election.cc:400] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:04.265781  3970 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:04.233034  7049 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.251734  7068 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.261314  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.284013  4039 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:04.271920  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:04.270298  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:04.242894  6991 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:04.271127  7050 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.303331  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:04.304648  7050 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:04.309629  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 134365us
I20260709 13:17:04.256302  7056 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.318435  3972 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:04.323562  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:04.325778  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 92030.6us
I20260709 13:17:04.311657  6759 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:04.328799  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 65334.9us
I20260709 13:17:04.329483  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:04.319394  7050 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.339681  6853 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:04.272125  4681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "237eb348003645f7abcc1c18bd324690"
dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
 from {username='slave'} at 127.0.0.1:51360
I20260709 13:17:04.360913  7037 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.347623  6880 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:04.362690  6880 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:04.363516  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45804.5us
I20260709 13:17:04.364283  3937 leader_election.cc:400] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7.
I20260709 13:17:04.352897  7041 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:17:04.353235  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83104us
I20260709 13:17:04.353617  7074 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.354039  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.338040  7050 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:04.365833  7092 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.170s	user 0.003s	sys 0.000s
I20260709 13:17:04.384521  4043 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:04.316025  7042 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.365866  4681 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:04.365844  6940 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.390825  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.366537  6853 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:04.384727  7050 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.417940  3971 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:04.399554  7074 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.437973  6823 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:04.438284  4117 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:04.439735  7074 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.431576  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:04.439855  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:04.402384  6991 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.448239  4121 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:04.399147  4681 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.454591  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.458139  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.458014  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:04.440197  6988 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.435988  6940 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:04.470675  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:04.487299  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:04.490880  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.491866  3971 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.501641  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:04.495230  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:04.479125  7049 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.461629  6991 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:04.517896  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 163983us
I20260709 13:17:04.529093  4116 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:04.505472  6977 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.526078  4113 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
W20260709 13:17:04.532382  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 126587us
I20260709 13:17:04.506017  7068 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.495314  6941 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.514616  6821 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:04.547531  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:04.548457  4039 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:04.546949  7024 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.549904  4121 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:04.518841  6880 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.549907  4117 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:04.492992  6982 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.555332  3969 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:04.495566  6988 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.555653  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:04.559935  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:04.561553  6956 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:04.561995  6956 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:04.312098  6881 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:04.526691  7057 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.577930  7059 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.580111  4044 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.577127  4116 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.584712  4046 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:04.588692  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2087) took 1510 ms. Trace:
I20260709 13:17:04.591729  7014 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:04.600360  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.600346  6852 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.610527  6852 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:04.602902  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.607810  7057 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.589125  4038 rpcz_store.cc:276] 0709 13:17:03.078768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.078883 (+   115us) service_pool.cc:224] Handling call
0709 13:17:03.079180 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:03.989000 (+909820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.567088 (+578088us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b540035d9d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:04.588616 (+ 21528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082150272}
I20260709 13:17:04.608320  7014 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:04.610936  6988 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.602258  4117 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:04.612844  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.557036  6941 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.553319  7049 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.614144  6940 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.626176  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:04.636737  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82034.5us
I20260709 13:17:04.648473  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:04.652160  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 101736us
I20260709 13:17:04.658516  7049 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.660040  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.661162  3967 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:04.661340  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.662302  6759 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:04.663100  6759 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.663816  6759 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:04.665282  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.665673  4114 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:04.644373  7042 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:04.668296  3970 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:04.672833  4038 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:04.673866  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.675287  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.677147  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.678066  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.679412  6977 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:04.675390  4038 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:04.680184  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.573844  6853 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.688323  7050 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.689750  4044 raft_consensus.cc:2368] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:17:04.690804  7014 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.654266  6982 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:04.697513  6852 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.697562  7108 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:04.700230  6941 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.703642  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.705022  6991 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.705420  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.706213  7028 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.707196  7028 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:04.707559  7028 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:04.708163  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.709122  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:04.710356  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 97717.2us
I20260709 13:17:04.710887  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:04.712487  6840 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.002s
I20260709 13:17:04.713469  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.720250  3970 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:17:04.721206  7005 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.005s
I20260709 13:17:04.694010  7059 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.734040  4012 leader_election.cc:400] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:04.705734  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:04.740242  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.741981  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:04.745828  4116 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:04.740978  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:04.738143  6982 raft_consensus.cc:2764] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:17:04.751742  3966 raft_consensus.cc:2410] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:17:04.754041  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58934.5us
I20260709 13:17:04.755046  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.744493  6880 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:04.757927  3971 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:04.756490  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.708369  7028 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.738500  7108 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:04.769012  6880 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:04.799433  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:04.764935  6941 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:17:04.744472  6825 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:04.776444  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:04.765337  7024 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:17:04.776014  4119 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:17:04.777704  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.747414  6988 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:17:04.778574  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:04.803278  7047 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:17:04.781479  4047 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:04.782246  7059 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.740360  6991 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:04.785570  6956 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.815920  6956 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:04.817982  6945 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:04.818437  6945 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:04.819432  6945 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.742267  6840 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.747635  7044 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.821964  3964 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:04.822777  6840 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.789225  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.788518  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2076) took 1656 ms. Trace:
I20260709 13:17:04.824308  4118 rpcz_store.cc:276] 0709 13:17:03.114415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.114523 (+   108us) service_pool.cc:224] Handling call
0709 13:17:03.124189 (+  9666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.967322 (+843133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.757130 (+789808us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540004d154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:04.771197 (+ 14067us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1936871168}
W20260709 13:17:04.790307  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 49407.6us
I20260709 13:17:04.825947  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:04.827265  6992 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.795754  7068 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:04.801327  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 106764us
I20260709 13:17:04.800851  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:04.811271  6964 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:04.777873  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.780387  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.808698  6880 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.820673  6945 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:04.798131  6982 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:17:04.831889  7028 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:04.830245  4012 leader_election.cc:400] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8.
I20260709 13:17:04.830806  4042 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:04.835062  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:04.803937  6825 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:04.813086  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.836261  6991 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:04.813057  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.836733  6825 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.838160  6825 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:04.815198  7050 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.809187  7108 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.850907  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:04.853636  6991 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:04.854084  6991 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:04.854497  6991 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:04.855891  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2087) took 1708 ms. Trace:
I20260709 13:17:04.856413  4681 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:04.830648  4044 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:04.856294  4120 rpcz_store.cc:276] 0709 13:17:03.147217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:03.405374 (+258157us) service_pool.cc:224] Handling call
0709 13:17:03.414991 (+  9617us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:03.416921 (+  1930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:03.416959 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:03.417445 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.592741 (+1175296us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b1800021a60. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:17:04.778213 (+185472us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:04.778280 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.778354 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.855464 (+ 77110us) raft_consensus.cc:1685] finished
0709 13:17:04.855488 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.855723 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23689,"raft.queue_time_us":33359,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3434,"spinlock_wait_cycles":50365824,"thread_start_us":160257,"threads_started":1,"wal-append.queue_time_us":1412407}
I20260709 13:17:04.858780  7050 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:04.859372  7050 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.860824  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 180) took 1644 ms. Trace:
I20260709 13:17:04.861919  7050 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.861238  4040 rpcz_store.cc:276] 0709 13:17:03.216047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.320345 (+1104298us) service_pool.cc:224] Handling call
0709 13:17:04.360477 (+ 40132us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.361109 (+   632us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.361137 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.361639 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:17:04.460602 (+ 98963us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:04.461523 (+   921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:04.462242 (+   719us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:04.860425 (+398183us) raft_consensus.cc:1685] finished
0709 13:17:04.860444 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:04.860605 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1645,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":101,"spinlock_wait_cycles":3456,"thread_start_us":97082,"threads_started":1,"wal-append.queue_time_us":388626}
I20260709 13:17:04.865875  6759 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:04.866650  6759 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:04.867646  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 68295.6us
I20260709 13:17:04.868198  7052 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:04.868688  7052 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:04.868839  6759 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.869537  6759 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:04.869665  7052 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.867709  6828 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:04.876802  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 121833us
I20260709 13:17:04.877866  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:04.879016  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.857949  4012 leader_election.cc:400] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9.
I20260709 13:17:04.874862  6828 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.880854  4042 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:04.882519  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.882952  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.883128  6828 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:04.884332  4043 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:04.888134  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.897257  4038 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:04.899246  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:04.903107  3966 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:04.906098  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:04.895933  6828 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:17:04.906852  3972 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:04.906217  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:04.910441  3964 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:04.909430  4044 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:04.914637  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:04.934823  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:04.937310  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:04.886257  6912 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:04.949952  4040 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:04.943492  3963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.027s	sys 0.017s
I20260709 13:17:04.912814  7044 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:17:04.952503  3963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.027s	sys 0.017s
W20260709 13:17:04.906136  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:04.950348  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:04.898084  6964 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:17:04.953742  4675 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:04.902491  7050 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:17:04.953912  7059 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:04.963860  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57914.9us
W20260709 13:17:04.967947  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.970495  6912 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:04.970448  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:04.970638  6988 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:17:04.961524  6982 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:04.963827  6828 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:04.965011  7045 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:04.999889  6991 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:04.990633  6982 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.000933  6982 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.004860  4045 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:05.008450  4041 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:04.992039  7059 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.010957  7059 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:04.993822  7050 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:04.994688  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:05.020359  7050 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:05.089911  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:05.090749  3963 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:05.027091  6828 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:05.036031  7049 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:05.107260  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116979us
W20260709 13:17:05.115586  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 326566us
I20260709 13:17:05.116266  6853 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.158669  4012 leader_election.cc:400] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:05.159657  4012 leader_election.cc:403] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:05.164377  7014 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.165048  7014 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.167310  7014 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:05.164415  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.180727  6977 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:05.188659  6828 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.203008  6991 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.205899  6853 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:17:05.208997  6853 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:05.220853  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.223129  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:05.225793  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:05.144781  7050 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.230687  7050 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.232945  6988 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:05.233429  6988 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.233752  6988 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:05.237797  4676 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.239253  6977 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:05.239916  6977 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.242964  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:05.245762  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:05.243333  4038 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:05.250010  4681 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:05.251813  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.254142  6871 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:05.255144  7076 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:05.256060  6871 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:05.257174  6871 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:05.255978  7014 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:05.258234  6977 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.259356  4046 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:05.260578  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 109025us
I20260709 13:17:05.261791  6823 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:05.262128  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:05.263100  7059 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:05.265311  7114 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 13:17:05.262207  6823 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:05.266489  6823 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.268239  6823 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.251734  6991 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.271934  6991 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.274330  7044 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:05.276037  6991 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.276188  7044 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:05.289613  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:05.289865  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:05.291623  4683 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:05.294773  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 499816us
I20260709 13:17:05.295892  4039 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:05.297225  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:05.297788  3971 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.302201  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:05.309921  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47882.6us
I20260709 13:17:05.260416  6871 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.312580  6840 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:05.317273  6840 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:05.317687  6840 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.307057  7044 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:17:05.336236  3971 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
W20260709 13:17:05.325140  6881 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.031s
W20260709 13:17:05.321399  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 359177us
W20260709 13:17:05.369771  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.325140  7059 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:05.386518  3970 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:17:05.368813  6881 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.009s	sys 0.031s
I20260709 13:17:05.389703  3970 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:05.364499  6871 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:05.390345  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.393743  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.394431  4117 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:05.398042  4116 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:05.400153  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:05.404605  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.406374  4115 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:05.425235  4119 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:17:05.426703  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:05.427660  4116 raft_consensus.cc:2410] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:17:05.443912  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75395.9us
W20260709 13:17:05.444237  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52338.2us
I20260709 13:17:05.429391  3964 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:05.457476  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:05.467120  4115 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.471192  4119 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:05.477437  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:05.485791  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:05.489682  4121 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.501380  4040 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:05.501564  4039 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:17:05.504531  7005 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.505155  7005 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.507544  7005 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.513264  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:05.518186  4118 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:05.444895  6982 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.526809  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:05.526127  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:05.513993  7052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.023s	sys 0.075s
I20260709 13:17:05.531323  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:05.519292  6991 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:05.540241  3964 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:17:05.532644  7052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.023s	sys 0.075s
I20260709 13:17:05.550441  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.534942  7049 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:05.552246  4114 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.523125  7044 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:17:05.520367  6853 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:05.542923  7028 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:05.565147  4116 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:05.559010  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.558866  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:05.558075  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:05.557170  6999 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.560070  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:05.560875  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.578125  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:05.586814  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 45754us
I20260709 13:17:05.589310  4118 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:05.572813  3970 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:05.554178  7049 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:05.592317  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:05.600049  3964 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:17:05.593004  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.594316  7118 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:17:05.588182  6999 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:05.595996  6840 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.623955  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.629659  4116 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.630827  3968 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:05.631282  3971 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:05.632288  6840 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.603730  7049 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:05.626591  7059 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:05.650275  3964 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:05.654672  3964 pending_rounds.cc:85] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:05.659175  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:05.660041  4039 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:05.655355  3964 pending_rounds.cc:107] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:05.671264  3964 raft_consensus.cc:2889] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:05.654834  6823 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.661651  7059 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:05.718389  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:05.719488  4121 raft_consensus.cc:606] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:05.719879  4121 raft_consensus.cc:614] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:05.689837  4041 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:05.730077  3964 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 13:17:05.755118  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.758526  4116 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
W20260709 13:17:05.761461  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.733012  7127 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:17:05.771387  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:05.772043  3963 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:05.768814  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 254541us
W20260709 13:17:05.773707  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.746783  7057 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:05.690979  6823 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.750952  6877 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.777217  7108 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.708063  7014 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:05.782512  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:05.785171  3971 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:05.729317  6828 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:17:05.789913  6877 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:05.806710  6877 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:05.816289  7028 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.720816  7059 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.821074  7108 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.767746  6982 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.777773  6840 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.794577  7136 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:17:05.795140  7129 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:17:05.795821  7123 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:17:05.795992  3969 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.846665  3969 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:05.798245  6823 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:05.781363  7131 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.783336  4112 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: false } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:05.788686  6852 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:17:05.837860  3970 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:05.839455  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:05.841521  3972 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:05.844558  4117 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
W20260709 13:17:05.845229  4044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.025s
W20260709 13:17:05.849869  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67471.2us
I20260709 13:17:05.792948  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:05.853552  4044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.007s	sys 0.025s
I20260709 13:17:05.854302  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:05.861183  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:05.866906  3971 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:17:05.845229  7126 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.218s	user 0.001s	sys 0.001s
I20260709 13:17:05.871424  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:05.872114  3963 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:05.859561  6877 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:17:05.881052  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 281226us
W20260709 13:17:05.885037  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 97414.3us
I20260709 13:17:05.886262  3972 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:05.852952  6960 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:05.888797  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 357695us
W20260709 13:17:05.903949  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:05.884964  3969 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.874835  6825 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.843201  6840 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.882923  7076 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:05.886441  6828 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:05.884392  6999 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:05.934803  7139 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:17:05.885607  7044 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:17:05.938603  7041 raft_consensus.cc:2764] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:17:05.914100  6877 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:17:05.946347  7108 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:05.947598  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2031) took 1046 ms. Trace:
W20260709 13:17:05.948933  6988 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.715s	user 0.002s	sys 0.011s
I20260709 13:17:05.948050  3967 rpcz_store.cc:276] 0709 13:17:04.901168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.901375 (+   207us) service_pool.cc:224] Handling call
0709 13:17:04.907198 (+  5823us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.907625 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.907655 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.908081 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.201907 (+293826us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:17:05.284292 (+ 82385us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:05.284329 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.284388 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.947271 (+662883us) raft_consensus.cc:1685] finished
0709 13:17:05.947299 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.947531 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1793,"raft.run_cpu_time_us":8825,"raft.run_wall_time_us":288986,"spinlock_wait_cycles":7514496,"thread_start_us":375830,"threads_started":1,"wal-append.queue_time_us":633098}
I20260709 13:17:05.949334  6988 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.950461  4043 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:05.950897  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2430) took 1037 ms. Trace:
I20260709 13:17:05.951511  6988 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:05.873684  7131 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.931651  7146 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:05.959915  4116 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:05.960847  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:05.963152  3969 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:05.951262  4042 rpcz_store.cc:276] 0709 13:17:04.913769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.952117 (+ 38348us) service_pool.cc:224] Handling call
0709 13:17:04.952511 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.963050 (+ 10539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.963079 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:04.966886 (+  3807us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.323708 (+356822us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:05.323746 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.323944 (+   198us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.950681 (+626737us) raft_consensus.cc:1685] finished
0709 13:17:05.950703 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:05.950826 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1010,"raft.queue_time_us":8730,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":23807,"thread_start_us":352257,"threads_started":1,"wal-append.queue_time_us":574654}
I20260709 13:17:05.919281  6960 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:05.987205  4116 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:05.974439  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:05.979766  4120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.020s	sys 0.038s
W20260709 13:17:05.988655  4120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.020s	sys 0.038s
I20260709 13:17:05.979249  4041 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:05.921329  6823 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:05.993409  4043 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:05.912372  6852 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:17:05.977865  7133 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.256s	user 0.002s	sys 0.000s
W20260709 13:17:05.980723  7132 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 13:17:06.012217  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.013881  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:05.985059  7142 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:17:05.981496  6871 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:17:05.977916  6840 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:06.022409  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:06.023162  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237eb348003645f7abcc1c18bd324690"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:05.929483  6759 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:17:05.965451  7050 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
W20260709 13:17:06.089756  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 298959us
I20260709 13:17:06.004547  6823 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.000924  7146 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:06.102712  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:06.069864  7135 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:06.107359  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 217689us
I20260709 13:17:06.028744  6999 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:17:06.117377  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.118822  3970 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:06.119233  3970 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:06.121068  3971 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:06.106216  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 216325us
I20260709 13:17:06.108642  3969 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:06.110853  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.128309  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.119959  3970 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.109505  6828 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:17:06.141243  3970 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.134478  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:06.142411  4676 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.142902  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.143668  3969 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:06.074570  7049 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.145867  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:06.148357  4042 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.149153  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2026) took 1255 ms. Trace:
I20260709 13:17:06.109799  7135 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.158257  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.107684  7076 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:17:06.151510  3965 rpcz_store.cc:276] 0709 13:17:04.893378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.893512 (+   134us) service_pool.cc:224] Handling call
0709 13:17:04.894051 (+   539us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:04.900507 (+  6456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.900540 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:05.013297 (+112757us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4c003a8240. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74718a20 00007fed74729a29 00007fed746ef644 00007fed74716f2d 00007fed74716b93 00007fed7644718b 00007fed76447cb5 00007fed76449004 00007fed76448729 00007fed7644dd96 00007fed76442adb
0709 13:17:05.026540 (+ 13243us) log.cc:844] Serialized 590 byte log entry
0709 13:17:05.216813 (+190273us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:17:05.538006 (+321193us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:05.538049 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.538118 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:05.977154 (+439036us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:06.148965 (+171811us) raft_consensus.cc:1685] finished
0709 13:17:06.148986 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.149100 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2084,"raft.run_cpu_time_us":4139,"raft.run_wall_time_us":308458,"spinlock_wait_cycles":117538688,"thread_start_us":422761,"threads_started":1,"wal-append.queue_time_us":559750}
I20260709 13:17:06.162724  4046 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:06.138964  7059 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:06.167222  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.171154  4042 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:06.181047  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.160048  7152 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.185689  4046 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:06.165699  7135 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:06.153250  7044 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:17:06.146622  7148 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:17:06.194991  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 258688us
I20260709 13:17:06.200152  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:06.217116  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.219298  4039 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:06.184262  7059 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:17:06.224921  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.208711  6991 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.229818  4039 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:06.237303  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.240422  3966 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:06.218303  6828 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.192306  7152 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.225559  7131 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:06.245038  7155 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.245535  6991 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:06.277046  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 68115us
W20260709 13:17:06.284396  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 158731us
I20260709 13:17:06.288518  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:06.295532  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 149770us
W20260709 13:17:06.284008  7145 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:17:06.278728  6823 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:06.299901  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:06.301084  7158 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:17:06.268618  6871 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:17:06.302558  4039 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:06.312018  4046 raft_consensus.cc:2410] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:06.322103  4041 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:06.266103  6828 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.319862  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.294950  7049 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:06.342754  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49357.8us
I20260709 13:17:06.295186  7146 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:06.316275  7131 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.342239  7150 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:17:06.349063  4116 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: false } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:06.362193  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.316715  7148 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:17:06.286988  7155 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.367486  3937 leader_election.cc:400] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
I20260709 13:17:06.367887  3937 leader_election.cc:403] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:06.369953  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.364661  6871 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.371901  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:06.367102  7149 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:17:06.378501  7146 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6.
W20260709 13:17:06.378679  7137 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.546s	user 0.006s	sys 0.000s
I20260709 13:17:06.381732  7160 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:06.371883  7049 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:06.383786  3970 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:17:06.439594  3970 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 3
I20260709 13:17:06.353367  7157 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:06.395056  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.402194  7148 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.402666  6982 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:06.345492  7156 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:17:06.408113  7152 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:06.432137  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.432389  4121 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:06.432924  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2085) took 1037 ms. Trace:
I20260709 13:17:06.458518  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.460179  4121 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:06.434443  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:06.456805  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.423724  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:06.439834  3970 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:17:06.464422  3970 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:06.384910  7155 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:06.442293  4119 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:06.363513  7131 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.437470  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.459087  4113 rpcz_store.cc:276] 0709 13:17:05.395187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.395430 (+   243us) service_pool.cc:224] Handling call
0709 13:17:05.418528 (+ 23098us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.445101 (+ 26573us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.445136 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.457207 (+ 12071us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.784293 (+327086us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.784332 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.784398 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.432701 (+648303us) raft_consensus.cc:1685] finished
0709 13:17:06.432721 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.432856 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4627,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":18128,"thread_start_us":273671,"threads_started":1,"wal-append.queue_time_us":508313}
I20260709 13:17:06.474515  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.467460  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.476567  4121 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:06.477499  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.369117  6991 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.479017  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 275) took 1506 ms. Trace:
I20260709 13:17:06.481074  4120 rpcz_store.cc:276] 0709 13:17:04.972962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.973109 (+   147us) service_pool.cc:224] Handling call
0709 13:17:04.973462 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:04.999797 (+ 26335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:04.999829 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.229604 (+229775us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b2c000875c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:05.230056 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.989066 (+759010us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:05.989106 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.989163 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.345621 (+356458us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b24003a1f48. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed731e59c4 00007fed731e3acb 00007fed7339edc9 00007fed7339ea55 00007fed7339e09d 00007fed75fd010e 00007fed75fe788c 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221
0709 13:17:06.478829 (+133208us) raft_consensus.cc:1685] finished
0709 13:17:06.478851 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:06.478963 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25947,"raft.queue_time_us":29788,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":18185344,"thread_start_us":758631,"threads_started":1,"wal-append.queue_time_us":504789}
I20260709 13:17:06.482733  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.484184  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.485147  7076 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:06.485563  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:06.488809  7108 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:06.479084  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.489140  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.491418  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:06.489287  7186 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:06.475116  6877 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:06.497606  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.494864  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.495306  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:06.515303  4115 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:06.512807  4113 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:06.517654  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.505831  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:06.456568  6982 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.525959  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:06.506697  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.451449  7148 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.544667  4042 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:06.545825  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.489666  7108 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:06.506378  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.505335  7163 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:06.480495  6840 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:17:06.527274  7164 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:06.526877  7181 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:06.556535  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.478407  7156 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:17:06.526068  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.530049  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.457749  7049 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:06.527087  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.529033  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:06.526511  4113 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:06.506373  6828 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:06.521991  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.528450  6960 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:06.537535  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:06.516819  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.441355  7160 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.543740  4114 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:17:06.507400  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.501088  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.500980  7170 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:06.507503  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:06.548197  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63938.4us
I20260709 13:17:06.555640  7130 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:06.560612  4042 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:17:06.563030  4039 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:06.559671  4120 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.567186  4115 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.548418  7108 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.512635  6877 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:06.552954  7163 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:06.603025  7163 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:06.592537  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.599771  7108 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:06.606958  7059 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:06.592029  3966 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:06.597716  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.627687  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.628297  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:06.630295  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 144783us
I20260709 13:17:06.631816  4121 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:17:06.720652  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 80410.3us
I20260709 13:17:06.598192  7181 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:06.729795  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101597us
I20260709 13:17:06.730468  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:06.736641  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.735069  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:06.615317  7050 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.732448  4040 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:06.737246  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:06.738813  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:06.649935  6840 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:06.743571  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 115965us
I20260709 13:17:06.744364  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.742081  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.616334  7044 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 13:17:06.746502  3964 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:06.731071  7198 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.748950  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:06.750911  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.629858  6828 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:17:06.737154  7190 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.758018  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:06.738965  7146 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.598538  7130 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:06.767083  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.732812  7186 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:17:06.751559  7170 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:06.781168  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 241463us
I20260709 13:17:06.742682  7050 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.629362  7164 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:06.858692  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:06.770066  7005 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:06.858614  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:06.860297  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 77386.8us
W20260709 13:17:06.870937  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 112993us
W20260709 13:17:06.857985  7191 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:17:06.871765  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:06.867770  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89256us
I20260709 13:17:06.874379  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:06.786293  7131 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:06.756404  6840 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.764991  6877 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.862972  7203 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.901516  3971 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:06.862229  6960 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:06.775517  7146 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:06.915591  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43906us
I20260709 13:17:06.755638  7198 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.870023  7005 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:06.916500  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:06.909519  7135 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.702s	user 0.007s	sys 0.009s
W20260709 13:17:06.943503  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:06.947974  3971 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:06.961169  7199 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:06.769599  7190 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:06.966868  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50453.2us
I20260709 13:17:06.944443  7171 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:06.876368  7170 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 13:17:06.915485  6982 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:06.968223  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:06.951743  7180 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:06.966141  7201 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 13:17:06.962271  6877 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:06.946090  7005 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:06.952594  7148 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:06.943706  6960 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:06.965744  7173 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:06.969111  7203 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:17:06.873431  7181 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.014673  7050 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:06.952523  7135 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.007892  7210 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.021057  7205 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:06.976439  7171 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.013682  7148 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:07.031749  7202 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 13:17:07.034190  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 159881us
W20260709 13:17:07.027534  7183 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 13:17:07.044440  7170 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:07.044528  7180 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:07.045128  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.030860  7210 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.025592  7211 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:07.032779  7049 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:07.078003  4115 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:07.078122  7210 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.061070  4681 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:07.078431  7194 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:17:07.061251  6823 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.062582  7164 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:07.088165  6871 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.000s
W20260709 13:17:07.095925  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 127795us
I20260709 13:17:07.080233  7168 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.103018  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.082151  7130 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:07.091596  7138 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.010s	user 0.005s	sys 0.000s
W20260709 13:17:07.138716  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 93645.8us
I20260709 13:17:07.086562  7211 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:07.142976  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.144295  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.150600  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2361) took 1049 ms. Trace:
I20260709 13:17:07.153076  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.151019  3963 rpcz_store.cc:276] 0709 13:17:06.101239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.101341 (+   102us) service_pool.cc:224] Handling call
0709 13:17:06.101654 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.212175 (+110521us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.212208 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.213781 (+  1573us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.294955 (+ 81174us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.295000 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:06.295080 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.150395 (+855315us) raft_consensus.cc:1685] finished
0709 13:17:07.150416 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.150544 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157314,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":6115,"thread_start_us":121731,"threads_started":2,"wal-append.queue_time_us":327986}
W20260709 13:17:07.157482  4120 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.556s	user 0.003s	sys 0.006s
I20260709 13:17:07.157831  4120 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:07.160403  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.101863  6991 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.165040  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:07.163295  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 264929us
I20260709 13:17:07.105957  6840 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.108026  6871 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.174499  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:07.151387  7059 consensus_meta.cc:287] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.001s
I20260709 13:17:07.174214  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:07.146222  7148 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.150297  7203 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.215221  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.159835  7146 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:07.247195  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 94093.2us
I20260709 13:17:07.173439  7049 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:07.198818  4119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.010s
W20260709 13:17:07.273717  4119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.000s	sys 0.011s
I20260709 13:17:07.270717  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:07.271164  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71900.3us
I20260709 13:17:07.170173  7171 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.268021  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.108438  6823 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.172127  7205 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.275040  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.285113  7198 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.252504  7130 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.109002  7164 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
W20260709 13:17:07.257025  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47197.8us
I20260709 13:17:07.280416  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.178097  7050 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:07.285789  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:07.272909  7208 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:17:07.201210  7161 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.270560  6840 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:07.308660  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:07.314812  3963 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:17:07.233207  6982 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:07.259217  6999 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:07.315625  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.163339  7224 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 13:17:07.298081  7050 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.335513  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.278785  6852 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.346213  4114 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:07.299254  7148 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:07.374114  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 88726.3us
I20260709 13:17:07.293390  7014 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.292963  7134 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.375355  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2434) took 2117 ms. Trace:
I20260709 13:17:07.353672  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:07.382194  3963 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:07.253019  7219 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:17:07.373090  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.325515  6960 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.379976  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.383064  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:07.391116  3963 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:07.338778  7135 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.279428  7052 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:17:07.358311  7225 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:07.325886  6982 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:07.383584  4047 rpcz_store.cc:276] 0709 13:17:05.241927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.243560 (+  1633us) service_pool.cc:224] Handling call
0709 13:17:05.243932 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.244360 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.244391 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.244907 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.739961 (+495054us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:05.740007 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.740079 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:06.995006 (+1254927us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:07.323714 (+328708us) raft_consensus.cc:1685] finished
0709 13:17:07.323818 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.359315 (+ 35497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3115,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"spinlock_wait_cycles":25856896,"thread_start_us":494632,"threads_started":1,"wal-append.queue_time_us":757404}
I20260709 13:17:07.309469  6759 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:17:07.377780  7014 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:07.374071  7050 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:07.322908  7164 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:17:07.376716  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.378189  6852 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.382135  6828 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.398643  7146 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:07.399554  7171 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:07.450695  7223 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:17:07.456315  6982 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:07.482864  7196 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:07.485255  7238 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:17:07.541612  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.542292  4047 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:07.542704  7216 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:17:07.543372  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:07.546887  7163 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.943s	user 0.010s	sys 0.000s
I20260709 13:17:07.547312  7163 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.548432  3964 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:07.393395  7134 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.551222  7134 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:07.551949  7215 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.400s	user 0.002s	sys 0.000s
I20260709 13:17:07.324214  7161 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:07.553122  7144 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.369s	user 0.007s	sys 0.008s
W20260709 13:17:07.553822  7234 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:17:07.554545  7161 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.352778  7211 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:07.555248  7108 consensus_meta.cc:287] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.949s	user 0.009s	sys 0.002s
I20260709 13:17:07.554476  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2441) took 2275 ms. Trace:
I20260709 13:17:07.556744  7108 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.557071  4044 rpcz_store.cc:276] 0709 13:17:05.279243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.279365 (+   122us) service_pool.cc:224] Handling call
0709 13:17:05.279677 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:05.280602 (+   925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:05.280650 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:05.281214 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:17:05.853947 (+572733us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:05.853985 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:05.854049 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.277397 (+1423348us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:07.554176 (+276779us) raft_consensus.cc:1685] finished
0709 13:17:07.554199 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.554397 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7046,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3860,"spinlock_wait_cycles":3020160,"thread_start_us":572376,"threads_started":1,"wal-append.queue_time_us":745467}
I20260709 13:17:07.559633  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2121) took 1105 ms. Trace:
I20260709 13:17:07.560441  6823 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.559983  4117 rpcz_store.cc:276] 0709 13:17:06.454514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.557718 (+103204us) service_pool.cc:224] Handling call
0709 13:17:06.558040 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.588515 (+ 30475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.588549 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.589109 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.941511 (+352402us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.962464 (+ 20953us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.002144 (+ 39680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.002217 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.559447 (+557230us) raft_consensus.cc:1685] finished
0709 13:17:07.559463 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.559576 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48563,"prepare.queue_time_us":20649,"prepare.run_cpu_time_us":5805,"prepare.run_wall_time_us":19705,"raft.queue_time_us":76939,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7387,"spinlock_wait_cycles":15456128,"thread_start_us":314497,"threads_started":1,"wal-append.queue_time_us":450787}
W20260709 13:17:07.561800  7241 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:17:07.471772  7225 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.471338  7146 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:07.373752  6999 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.339160  7205 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:17:07.403203  7148 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 13:17:07.445367  7049 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.575673  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2128) took 1119 ms. Trace:
I20260709 13:17:07.583739  4121 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:07.468634  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 91992.8us
I20260709 13:17:07.698416  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:07.662582  6823 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:07.700191  7213 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260709 13:17:07.700133  6823 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.702260  6823 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:07.663229  7198 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.702924  7198 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.703907  7050 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.705120  7198 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.695660  4119 rpcz_store.cc:276] 0709 13:17:06.456326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.593839 (+137513us) service_pool.cc:224] Handling call
0709 13:17:06.594358 (+   519us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:06.613904 (+ 19546us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.613936 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:06.614935 (+   999us) log.cc:844] Serialized 590 byte log entry
0709 13:17:07.274120 (+659185us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:07.274180 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.274243 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.575433 (+301190us) raft_consensus.cc:1685] finished
0709 13:17:07.575455 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.575608 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20543,"raft.queue_time_us":3220,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":20299,"thread_start_us":658820,"threads_started":1,"wal-append.queue_time_us":834667}
I20260709 13:17:07.604456  7146 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:07.714635  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:07.478186  6828 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.719302  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:07.718127  7161 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:07.734855  3972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.007s	sys 0.006s
W20260709 13:17:07.735285  3972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.007s	sys 0.006s
I20260709 13:17:07.723366  7198 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:07.711946  7190 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.708700  7049 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.730176  6823 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:07.720367  6840 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:07.708525  7014 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:07.757645  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 384628us
I20260709 13:17:07.773190  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.743605  7161 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:07.747689  7198 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:07.788285  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.746865  7163 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.770296  7205 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.769026  6823 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:07.788054  6877 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.780s	user 0.012s	sys 0.000s
I20260709 13:17:07.801908  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:07.802453  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:07.804556  4042 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:07.805222  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 359294us
I20260709 13:17:07.786132  7226 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:07.791884  7198 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:07.792214  7173 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:07.816298  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.796317  6823 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:07.820616  4042 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:07.800953  7186 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:07.824782  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.813130  7108 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.797660  7205 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:07.832778  7243 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:07.835919  7161 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:07.833431  7242 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:17:07.826057  6988 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:07.828573  6991 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:07.832623  6999 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.844038  7050 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.861002  6991 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.874532  6982 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.876543  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 93) took 6103 ms. Trace:
I20260709 13:17:07.885754  6828 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:07.842517  6840 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.888577  7049 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.884510  7205 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.890317  6991 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:07.891919  7159 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.529s	user 0.014s	sys 0.032s
W20260709 13:17:07.879406  7005 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.866s	user 0.009s	sys 0.000s
I20260709 13:17:07.888103  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2359) took 1787 ms. Trace:
I20260709 13:17:07.900211  6982 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:07.900182  7210 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.799s	user 0.011s	sys 0.000s
I20260709 13:17:07.908859  3967 rpcz_store.cc:276] 0709 13:17:06.100506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.100606 (+   100us) service_pool.cc:224] Handling call
0709 13:17:06.116884 (+ 16278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.211037 (+ 94153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.211075 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.259542 (+1048467us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b2c000014c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:07.286229 (+ 26687us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.782400 (+496171us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:07.782442 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.782538 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.870224 (+ 87686us) raft_consensus.cc:1685] finished
0709 13:17:07.870245 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.888050 (+ 17805us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6944,"raft.queue_time_us":150846,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5113,"spinlock_wait_cycles":12572032,"thread_start_us":582456,"threads_started":2,"wal-append.queue_time_us":581761}
I20260709 13:17:07.858182  6988 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:07.919708  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 107769us
I20260709 13:17:07.919751  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2362) took 1813 ms. Trace:
I20260709 13:17:07.929855  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:07.916637  7171 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:07.920418  3972 rpcz_store.cc:276] 0709 13:17:06.105932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.118380 (+ 12448us) service_pool.cc:224] Handling call
0709 13:17:06.139900 (+ 21520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.016902 (+877002us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18003c4420. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76444bfb 00007fed7644f64b
0709 13:17:07.017032 (+   130us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.017057 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.017572 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.735920 (+718348us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:07.735969 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.736042 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.917554 (+181512us) raft_consensus.cc:1685] finished
0709 13:17:07.917578 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.919676 (+  2098us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139920,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4786,"spinlock_wait_cycles":10321792,"thread_start_us":857770,"threads_started":2,"wal-append.queue_time_us":791588}
I20260709 13:17:07.931870  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2376) took 1163 ms. Trace:
I20260709 13:17:07.916929  7164 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:07.937237  7164 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:07.938661  6988 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:07.938822  7248 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:07.919502  7210 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.939345  7248 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:07.940321  7203 consensus_meta.cc:287] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.000s
I20260709 13:17:07.936568  7265 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.941080  7265 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.942569  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.943104  7265 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.943733  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:07.913976  7005 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.938482  7164 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.921051  7163 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:07.946269  7005 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:07.946455  7164 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:07.947068  7261 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:17:07.944805  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.948338  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.949575  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.884532  3870 rpcz_store.cc:276] 0709 13:17:01.755590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.758353 (+  2763us) service_pool.cc:224] Handling call
0709 13:17:07.858610 (+6100257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:04.728325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:04.728973 (+   648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:04.729021 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:17:04.729038 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:04.729674 (+   636us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:04.729761 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:04.729788 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:04.730251 (+   463us) tablet.cc:701] Row locks acquired
0709 13:17:04.730300 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:17:04.730462 (+   162us) write_op.cc:270] Start()
0709 13:17:04.730708 (+   246us) write_op.cc:276] Timestamp: P: 1783603024730400 usec, L: 0
0709 13:17:04.730727 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:17:04.731466 (+   739us) log.cc:844] Serialized 1686 byte log entry
0709 13:17:05.428301 (+696835us) op_driver.cc:464] REPLICATION: finished
0709 13:17:06.199835 (+771534us) write_op.cc:301] APPLY: starting
0709 13:17:06.207459 (+  7624us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:06.221176 (+ 13717us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:06.230361 (+  9185us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:06.324158 (+ 93797us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:06.357606 (+ 33448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:17:06.365202 (+  7596us) write_op.cc:312] APPLY: finished
0709 13:17:06.412951 (+ 47749us) log.cc:844] Serialized 41 byte log entry
0709 13:17:06.521492 (+108541us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:06.531298 (+  9806us) write_op.cc:454] Released schema lock
0709 13:17:06.546436 (+ 15138us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:06.595748 (+ 49312us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:06.597338 (+  1590us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":264921,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":749818,"apply.run_cpu_time_us":9764,"apply.run_wall_time_us":378416,"num_ops":4,"prepare.queue_time_us":538518,"prepare.run_cpu_time_us":3404,"prepare.run_wall_time_us":3493,"replication_time_us":672344,"thread_start_us":341795,"threads_started":3,"wal-append.queue_time_us":108207}]]}
I20260709 13:17:07.951952  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2048) took 1451 ms. Trace:
I20260709 13:17:07.950081  4044 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:07.954361  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:07.956310  7254 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.953722  7076 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.951920  7246 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.956938  7254 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.957701  7246 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.959076  7254 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.959661  7199 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.956993  7076 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:07.954038  3968 rpcz_store.cc:276] 0709 13:17:06.500662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.501095 (+   433us) service_pool.cc:224] Handling call
0709 13:17:06.528441 (+ 27346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.642201 (+113760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.642234 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.642279 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:06.642316 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.951743 (+1309427us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54001ca554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:07.951784 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.951902 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261137792}
I20260709 13:17:07.961756  7076 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.962214  7076 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.932298  3971 rpcz_store.cc:276] 0709 13:17:06.768478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.948969 (+180491us) service_pool.cc:224] Handling call
0709 13:17:06.949311 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.138995 (+189684us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.139027 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.152352 (+ 13325us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.384531 (+232179us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:07.446895 (+ 62364us) log.cc:844] Serialized 14 byte log entry
0709 13:17:07.902974 (+456079us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18003f4ea0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:17:07.928438 (+ 25464us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.928519 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:07.928564 (+    45us) raft_consensus.cc:1685] finished
0709 13:17:07.931670 (+  3106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:07.931792 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50719,"prepare.queue_time_us":62007,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":62054,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":3079,"spinlock_wait_cycles":23206272,"thread_start_us":295890,"threads_started":3,"wal-append.queue_time_us":533477}
I20260709 13:17:07.966275  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.976840  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:07.946206  7163 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:07.985853  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.988190  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:07.940730  7203 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:07.999737  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.962922  7258 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:07.962620  7076 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.005842  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:08.006969  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.992920  7246 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:07.942642  7146 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:07.995085  6988 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:07.994088  7068 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:07.995285  7161 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:07.998112  6999 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:08.002579  7205 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.004609  7041 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:07.987704  7254 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:17:08.022104  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:07.967428  7199 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.023447  7258 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.046113  7171 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.047497  7253 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.047597  7250 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.054162  7250 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.054796  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2366) took 1315 ms. Trace:
I20260709 13:17:08.055161  3969 rpcz_store.cc:276] 0709 13:17:06.739073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.739505 (+   432us) service_pool.cc:224] Handling call
0709 13:17:06.750222 (+ 10717us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.756040 (+  5818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.756069 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.756507 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:17:06.907252 (+150745us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:06.952079 (+ 44827us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.054286 (+1102207us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b1800306760. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287
0709 13:17:08.054401 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.054483 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.054525 (+    42us) raft_consensus.cc:1685] finished
0709 13:17:08.054599 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.054738 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27446,"prepare.queue_time_us":44799,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":65599,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":4395,"spinlock_wait_cycles":22673024,"thread_start_us":153062,"threads_started":2,"wal-append.queue_time_us":312413}
I20260709 13:17:07.996937  6823 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.020490  7203 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.023487  6828 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.047946  7274 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.057602  7225 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.011654  7275 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:08.059209  7005 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.071046  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:08.071671  7278 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:17:08.072258  7260 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:17:08.050117  7258 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.074616  4047 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:08.023687  7068 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.024935  7224 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.023936  6988 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.044772  6840 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.052343  7198 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:08.079548  7170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.004s	sys 0.018s
I20260709 13:17:08.024049  7161 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.059204  6999 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.061022  7205 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.093780  7210 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.095790  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:08.096093  6977 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:08.096604  6977 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:08.097714  7168 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:08.098351  7168 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.078087  7274 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.101974  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.102145  4047 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:08.068657  6828 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:08.127956  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61170.9us
W20260709 13:17:08.088097  7170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.005s	sys 0.018s
I20260709 13:17:08.066584  7163 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.069129  7203 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.141013  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.143275  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.143883  3971 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:08.145175  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.142511  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:08.124514  6840 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.123430  7249 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:08.139540  7274 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.097700  6977 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.136225  7240 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.156473  4681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 227) took 2060 ms. Trace:
I20260709 13:17:08.140439  7250 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.162163  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.125813  7224 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.091440  7275 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.161918  6977 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.172325  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:08.176117  3971 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.166600  7278 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.171511  7170 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:08.177753  7273 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:08.178157  7170 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:08.178819  7170 consensus_queue.cc:1243] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:08.179286  7170 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:08.179687  7278 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:08.174034  6840 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.179899  7041 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:08.180300  7278 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.183279  6999 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.166760  7076 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.200166  3971 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:08.201175  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.180372  7041 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.206821  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.208096  3971 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:08.176151  6823 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.179581  7160 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.179960  7224 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.179585  7170 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.184003  7068 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:08.208443  7180 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.009s	sys 0.010s
W20260709 13:17:08.214704  3938 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.196:37407 timed out after 1.558s (SENT) [suppressed 1 similar messages]
I20260709 13:17:08.216437  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:08.220945  7180 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.009s	sys 0.010s
I20260709 13:17:08.160568  4681 rpcz_store.cc:276] 0709 13:17:06.096247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.097371 (+  1124us) service_pool.cc:224] Handling call
0709 13:17:06.609991 (+512620us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:17:06.610224 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.093734 (+483510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.156218 (+1062484us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54008da254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:08.156396 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981798912}
I20260709 13:17:08.229051  7275 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.216848  6988 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.235734  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:08.235667  7279 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:08.231902  7146 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.251438  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.254585  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.238727  7161 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.261276  3972 raft_consensus.cc:2410] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:08.262569  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36870 (request call id 84) took 1232 ms. Trace:
I20260709 13:17:08.262952  4115 rpcz_store.cc:276] 0709 13:17:07.028442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.107002 (+ 78560us) service_pool.cc:224] Handling call
0709 13:17:08.260401 (+1153399us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76452735 00007fed7644a9fa 00007fed7b4124c9 00007fed7498ec54 00007fed7498ebe2 00007fed7498eb11 00007fed7498ea8c 00007fed7498dd42 00007fed7478748c 00007fed747868c6
0709 13:17:08.260610 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440573824}
I20260709 13:17:08.263486  7076 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.263943  7076 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.243001  6828 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.265966  7076 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.266709  3964 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:08.277017  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.280843  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.281867  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.281479  3968 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:08.283761  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.280217  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.287005  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.288107  4118 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:08.291859  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.289125  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.284893  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.278688  7203 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.295404  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:08.295708  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.296665  4676 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:08.279285  7068 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.281888  6828 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:08.296933  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.286355  7076 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.298113  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.299736  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.301120  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.301975  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:08.282753  7057 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.000s	sys 0.021s
I20260709 13:17:08.233011  7170 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.283366  7232 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:08.244406  7041 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:08.358973  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2107) took 1793 ms (client timeout 1754 ms). Trace:
I20260709 13:17:08.304665  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:08.579006  4114 rpcz_store.cc:269] 0709 13:17:06.565332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.568043 (+  2711us) service_pool.cc:224] Handling call
0709 13:17:08.358776 (+1790733us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b5400096d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:08.358887 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515854720}
I20260709 13:17:08.550937  7278 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.580420  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.581133  7160 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.581635  4116 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:08.582528  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:08.582965  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:08.355526  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2368) took 1614 ms. Trace:
W20260709 13:17:08.585501  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.584406  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:08.452991  7250 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:08.572377  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.584329  4114 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:08.584945  3965 rpcz_store.cc:276] 0709 13:17:06.741221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.741473 (+   252us) service_pool.cc:224] Handling call
0709 13:17:06.741728 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:07.030573 (+288845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:07.030604 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:07.032070 (+  1466us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.324814 (+292744us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:07.324880 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.355030 (+1030150us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b54004083d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:08.355090 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.355148 (+    58us) raft_consensus.cc:1685] finished
0709 13:17:08.355163 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.355457 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":593,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":663394048,"thread_start_us":241411,"threads_started":1,"wal-append.queue_time_us":404474,"wal-append.run_cpu_time_us":1627,"wal-append.run_wall_time_us":1087069}
I20260709 13:17:08.357853  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2365) took 1619 ms. Trace:
I20260709 13:17:08.385293  7172 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.406080  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.303675  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:08.504412  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2108) took 1914 ms. Trace:
I20260709 13:17:08.588812  4045 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:08.574420  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2476) took 1217 ms. Trace:
I20260709 13:17:08.356158  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:08.410187  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50224.7us
I20260709 13:17:08.591920  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:08.605345  4038 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:08.603838  4044 rpcz_store.cc:276] 0709 13:17:07.356673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.996055 (+639382us) service_pool.cc:224] Handling call
0709 13:17:07.996322 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.996459 (+   137us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:08.004995 (+  8536us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.068147 (+ 63152us) log.cc:844] Serialized 14 byte log entry
0709 13:17:08.573884 (+505737us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b18001fa8c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:17:08.574046 (+   162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:08.574100 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:08.574149 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.574241 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.574364 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":502316,"prepare.queue_time_us":23300,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":514349,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":3997,"spinlock_wait_cycles":18397184,"thread_start_us":59468,"threads_started":1,"wal-append.queue_time_us":131468}
I20260709 13:17:08.587446  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:08.585477  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:08.606751  4044 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.603802  4121 rpcz_store.cc:276] 0709 13:17:06.590387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.666421 (+ 76034us) service_pool.cc:224] Handling call
0709 13:17:06.723781 (+ 57360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.696819 (+973038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.504155 (+807336us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54001b2954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:08.504349 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977065728}
I20260709 13:17:08.595147  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:08.538899  4649 connection.cc:256] RPC call timeout handler was delayed by -1.5098750830002245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:17:08.601135  4118 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:17:08.597108  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.609146  3965 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.597306  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:08.604466  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.609444  3964 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:08.293702  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.612062  3969 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:08.499073  7222 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.128s	user 0.010s	sys 0.000s
I20260709 13:17:08.613101  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:08.614835  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:08.354233  7233 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.897s	user 0.008s	sys 0.002s
W20260709 13:17:08.304189  7197 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 1.394s	user 0.004s	sys 0.007s
I20260709 13:17:08.288602  6759 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:08.617187  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.609171  3963 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:08.341405  7283 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:08.587595  7226 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.619088  7172 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.619444  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.611294  7180 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.611141  7187 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:08.620905  7041 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.304267  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.502827  7198 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.526197  7184 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.611258  7232 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.474658  7237 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:08.595808  7076 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.623360  7161 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.362780  7253 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:08.619714  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.624887  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:08.562400  7214 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.611255  7250 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.695253  4038 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:08.590408  7057 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.001s	sys 0.030s
I20260709 13:17:08.591768  6853 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.358300  7205 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.595463  3966 rpcz_store.cc:276] 0709 13:17:06.738248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.738383 (+   135us) service_pool.cc:224] Handling call
0709 13:17:06.738689 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.755522 (+ 16833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.755551 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.760072 (+  4521us) log.cc:844] Serialized 26 byte log entry
0709 13:17:08.357244 (+1597172us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b1800311560. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1
0709 13:17:08.357403 (+   159us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:08.357440 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.357519 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.357561 (+    42us) raft_consensus.cc:1685] finished
0709 13:17:08.357572 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.357796 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11239,"raft.queue_time_us":11727,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":16968,"spinlock_wait_cycles":6367488,"thread_start_us":15547,"threads_started":1,"wal-append.queue_time_us":176657,"wal-append.run_cpu_time_us":7486,"wal-append.run_wall_time_us":1214632}
I20260709 13:17:08.701707  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.702731  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.703233  3966 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:17:08.361088  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.474954  6956 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:08.704494  6956 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.705369  6956 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.706596  6956 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:08.547475  7199 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.697890  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:08.610347  4115 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:08.633390  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.634127  6977 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.630143  6999 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:08.635036  7245 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.863s	user 0.003s	sys 0.000s
I20260709 13:17:08.305660  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:08.636557  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.735931  6999 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.636487  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:08.738487  6999 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.739725  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:08.741822  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:08.742414  4683 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.554073  7248 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.641853  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.657891  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.581648  7160 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.604724  6828 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:08.673281  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.591145  7068 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.631356  4675 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:08.693989  4114 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:08.665352  7180 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.656191  7283 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.628659  4116 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:08.698895  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.671885  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:08.760879  4112 raft_consensus.cc:606] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:08.709971  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.761281  4112 raft_consensus.cc:614] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:08.719105  3965 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:08.709740  4682 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:08.724094  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.727067  7232 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.666060  7228 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:08.728929  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2046) took 2232 ms. Trace:
I20260709 13:17:08.731638  7199 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.734512  6977 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.735309  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 196) took 2226 ms. Trace:
I20260709 13:17:08.747771  3964 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:08.749630  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 124929us
I20260709 13:17:08.750641  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:08.751529  3963 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:08.668917  7237 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.649052  6759 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.752930  3972 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
W20260709 13:17:08.666708  7028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.117s	user 0.033s	sys 0.024s
I20260709 13:17:08.752993  4121 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:08.757509  7278 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.695163  7214 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:08.721292  6853 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.696295  7161 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.761610  4115 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:08.762566  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:08.790172  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:08.763109  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:08.790498  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:08.789892  4118 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 4.
W20260709 13:17:08.765756  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93927.2us
I20260709 13:17:08.771894  7205 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.777709  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.774981  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.771888  4046 rpcz_store.cc:276] 0709 13:17:06.508449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.508654 (+   205us) service_pool.cc:224] Handling call
0709 13:17:06.509158 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:06.735569 (+226411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:06.735600 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:06.740184 (+  4584us) log.cc:844] Serialized 26 byte log entry
0709 13:17:07.176714 (+436530us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:07.176752 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:07.176841 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:08.353528 (+1176687us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:08.713424 (+359896us) raft_consensus.cc:1685] finished
0709 13:17:08.713443 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.735236 (+ 21793us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28926,"raft.queue_time_us":91264,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":105517,"spinlock_wait_cycles":16762496,"thread_start_us":586507,"threads_started":2,"wal-append.queue_time_us":565203}
I20260709 13:17:08.810204  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:08.810822  4046 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:08.766217  6881 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:17:08.662034  7187 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.819525  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.669849  7184 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.766675  7244 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.783555  4683 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:08.765249  7168 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.785184  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:08.769845  7163 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:08.766319  7228 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:08.766510  3970 rpcz_store.cc:276] 0709 13:17:06.496583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:06.497971 (+  1388us) service_pool.cc:224] Handling call
0709 13:17:06.498231 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:06.897243 (+399012us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:06.910676 (+ 13433us) log.cc:844] Serialized 14 byte log entry
0709 13:17:06.970730 (+ 60054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:06.970839 (+   109us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:06.970911 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:08.728650 (+1757739us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b54003985d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:08.728708 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:08.728847 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13693,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6217,"raft.queue_time_us":16127,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":31262,"spinlock_wait_cycles":933759616,"thread_start_us":43503,"threads_started":1,"wal-append.queue_time_us":180306}
I20260709 13:17:08.792723  4038 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:08.666386  7226 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.793216  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.795363  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.794158  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:08.796514  7250 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.798098  6852 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:08.798355  7161 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.800053  6853 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:08.801770  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:08.801875  7180 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.794745  4120 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:08.765111  7172 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.807441  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:08.787580  7028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.235s	user 0.034s	sys 0.025s
I20260709 13:17:08.794292  7131 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:08.774389  7199 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:08.829985  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44887.9us
I20260709 13:17:08.830411  7210 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.830534  7068 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.002873  4679 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:08.868304  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.013803  4121 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:09.014686  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.869978  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.874469  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.015838  3970 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:08.885149  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:08.820623  6877 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:08.818727  7269 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.001781  4047 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:08.908613  3965 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:08.819729  7176 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.820335  7059 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:08.920099  4046 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
W20260709 13:17:09.007647  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95313.6us
I20260709 13:17:09.030634  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.031263  4047 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:08.940982  7203 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.908079  6988 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.838125  4115 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:08.839844  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:09.015235  4121 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:17:09.036041  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.037586  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.037856  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.038426  4115 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:17:09.039098  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:09.016623  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 243206us
I20260709 13:17:08.874094  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.039844  4038 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:17:08.826799  7244 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.051661  7244 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:08.893227  7198 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:08.888206  4675 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:08.839934  7168 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:08.866597  7226 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:08.823452  7205 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:08.835358  7163 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:08.923695  7057 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.879873  6977 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:08.827380  7299 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:08.882947  6759 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:09.032217  4120 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:09.030104  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.017271  7014 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.019582  7172 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:09.042692  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 202906us
W20260709 13:17:08.886456  7301 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:17:09.046514  7235 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:09.047063  6988 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.018237  7210 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.022724  7131 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:09.027969  7076 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:09.021034  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.118729  7108 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.119349  7108 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.121462  7108 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:09.122248  7210 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.053915  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:09.055249  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.026264  7176 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.025842  7269 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.057124  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.058259  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.059140  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:09.059753  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:09.055162  7265 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
W20260709 13:17:09.062484  7220 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.902s	user 0.015s	sys 0.000s
I20260709 13:17:09.130719  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:09.066982  7300 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.309s	user 0.002s	sys 0.000s
I20260709 13:17:09.067559  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.068980  7250 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.131697  7265 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:09.132172  7250 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.132977  7184 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.134286  7250 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.131578  4684 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:09.069748  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.069890  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.131875  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.060817  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.136178  4115 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
W20260709 13:17:09.136539  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75816.8us
I20260709 13:17:09.137094  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.137602  7226 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.099874  7057 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.138180  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.131816  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.136325  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.139643  7057 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.055006  7161 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.140422  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.140318  7161 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.140987  4121 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.142602  7161 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.143503  7131 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.139343  4117 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.120522  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.101260  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.111364  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.137527  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.101783  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.110828  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:09.110162  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.055619  7198 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.029155  7059 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.069029  7278 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.076053  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:09.183487  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 107505us
I20260709 13:17:09.118883  3972 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:08.825363  7283 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.053529  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.190665  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:09.189849  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.192358  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.193439  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.114799  7052 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.123413  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.195467  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.196130  4043 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:09.208079  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.208683  4043 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:09.209599  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.183995  7059 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.134934  6828 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:09.110638  7299 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.132128  7265 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:09.026206  6877 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: false } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:08.894059  7214 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:09.127789  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68087.5us
W20260709 13:17:09.128000  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68938.6us
I20260709 13:17:09.178656  7198 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.073423  7163 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.102555  6853 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:09.139310  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.205966  7219 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.113577  6759 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.182353  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.059080  7203 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.188355  7176 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.261040  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.267536  3972 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:09.135823  7199 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:09.134660  7205 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.180675  7210 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.278925  7210 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.205446  7180 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:17:09.056290  7228 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.225458  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:08.839540  7237 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.189105  7184 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.226926  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:09.235797  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.313830  4682 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:09.245316  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.204599  4681 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:09.269716  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.055312  6956 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.178087  7235 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:09.279379  7210 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.236490  7214 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.219293  4043 raft_consensus.cc:2410] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:09.312031  4113 raft_consensus.cc:2376] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9. Re-sending same reply.
W20260709 13:17:09.318212  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 180737us
I20260709 13:17:09.189738  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.331714  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.332243  4047 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:09.320684  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:09.329851  4121 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
W20260709 13:17:09.320312  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.333174  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.332311  3972 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:09.334323  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.334580  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.233870  7278 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.337024  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:09.220824  7052 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.365353  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:09.342864  4117 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:09.335071  3972 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:17:09.367234  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.367863  3972 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:09.317842  7184 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.371776  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:09.371439  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.328035  7228 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.360162  4046 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:09.270358  6759 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.380865  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:09.383143  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:09.383603  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 324977us
I20260709 13:17:09.383780  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 404) took 1124 ms. Trace:
I20260709 13:17:09.384915  3972 rpcz_store.cc:276] 0709 13:17:08.251639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.375464 (+1123825us) service_pool.cc:224] Handling call
0709 13:17:09.375898 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.376121 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.376148 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.376200 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:09.376232 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.376285 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.376421 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.362989  7161 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:09.386677  4043 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:09.385032  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 352803us
I20260709 13:17:09.383318  7250 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:09.367054  7187 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.388749  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.336515  7306 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.374205  7057 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:09.387691  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:09.374675  7184 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.378878  7181 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.395596  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.384174  6977 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.386014  7028 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:09.402521  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2389) took 1447 ms. Trace:
I20260709 13:17:09.407406  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.407694  3966 rpcz_store.cc:276] 0709 13:17:07.955416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.703813 (+748397us) service_pool.cc:224] Handling call
0709 13:17:08.704067 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.005411 (+301344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.005440 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.005479 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.005508 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.402347 (+396839us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400279f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:09.402386 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.402478 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692556032}
I20260709 13:17:09.384532  7014 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.313532  7265 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.405068  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.400986  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.415773  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.354265  6956 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.409739  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 406) took 1155 ms. Trace:
I20260709 13:17:09.410890  4043 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:09.416671  3966 rpcz_store.cc:276] 0709 13:17:08.254157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.408975 (+1154818us) service_pool.cc:224] Handling call
0709 13:17:09.409280 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.409461 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.409484 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.409522 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:09.409556 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.409604 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.409687 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.417584  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:09.407724  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2473) took 2098 ms. Trace:
I20260709 13:17:09.399081  7250 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:09.418776  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.385880  7005 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:17:09.452150  6956 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.414505  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.451020  7068 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.405725  7248 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.451598  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.403805  7205 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.471657  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.408588  7187 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.451517  7306 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.406255  7244 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:09.474704  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 60261.5us
W20260709 13:17:09.454663  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 208948us
I20260709 13:17:09.480463  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.488956  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:09.491103  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.492460  3966 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:17:09.415620  7028 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:09.421175  7203 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.420651  7303 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:09.498214  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:09.457353  7286 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:09.450479  7250 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.475209  7187 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.420253  7014 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.508574  4039 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:09.511363  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.494867  7265 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:09.497645  7068 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.471890  7205 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.488466  7309 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.499452  7248 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:17:09.515689  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98162.2us
I20260709 13:17:09.502523  7131 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.523842  7244 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.530218  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:09.502327  7286 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.508158  7187 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.527623  7163 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:09.521581  7068 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.500149  7057 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.505539  7250 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.528523  6759 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:09.503961  7299 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.514418  6825 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.516887  7203 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.543671  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.532868  7131 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.546814  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2399) took 1468 ms. Trace:
I20260709 13:17:09.548754  7052 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:09.546054  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65694.6us
I20260709 13:17:09.543776  7303 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.557119  3972 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:09.542858  7068 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.422922  7235 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:09.560184  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:09.548733  7313 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:17:09.557538  3970 rpcz_store.cc:276] 0709 13:17:08.078476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.108976 (+1030500us) service_pool.cc:224] Handling call
0709 13:17:09.109311 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.109534 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:09.386799 (+277265us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.546404 (+159605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.546467 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.546514 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.546591 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.546747 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15508,"prepare.queue_time_us":378512,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2546,"raft.queue_time_us":13995,"raft.run_wall_time_us":10513,"thread_start_us":422276,"threads_started":2,"wal-append.queue_time_us":162432}
I20260709 13:17:09.542212  7286 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.545727  7306 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:09.566375  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:09.571331  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.555325  6825 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:09.558208  7131 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.555506  7278 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:09.577495  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.582819  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2066) took 1003 ms. Trace:
I20260709 13:17:09.583837  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:09.599473  3970 rpcz_store.cc:276] 0709 13:17:08.579368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.568251 (+988883us) service_pool.cc:224] Handling call
0709 13:17:09.582280 (+ 14029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.582476 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.582504 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.582546 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:09.582586 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.582638 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.582758 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.564059  7303 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.547958  7057 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.558405  7203 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.571436  7240 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:09.607357  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40680 (request call id 37) took 3614 ms. Trace:
W20260709 13:17:09.589675  7315 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:17:09.612464  7160 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:09.579341  7248 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:09.578632  7317 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:09.574752  6825 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.609452  4047 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:09.589180  7168 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.006s
W20260709 13:17:09.610991  7310 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:17:09.640076  7278 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.640679  7278 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.641475  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2394) took 1593 ms. Trace:
I20260709 13:17:09.639832  7168 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.642748  4115 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:09.644373  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.613689  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2114) took 1326 ms. Trace:
I20260709 13:17:09.646809  4119 rpcz_store.cc:276] 0709 13:17:08.287468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.288869 (+  1401us) service_pool.cc:224] Handling call
0709 13:17:09.613521 (+1324652us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:09.613628 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931420416}
I20260709 13:17:09.648049  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:09.648525  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.619148  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.608120  4112 rpcz_store.cc:276] 0709 13:17:05.992193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.992336 (+   143us) service_pool.cc:224] Handling call
0709 13:17:09.606277 (+3613941us) spinlock_profiling.cc:243] Waited 2.73 s on lock 0x7b5400097c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:09.606394 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6275470720}
W20260709 13:17:09.611713  7318 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:09.606722  7303 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.645161  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:09.614682  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 278) took 3836 ms (client timeout 1521 ms). Trace:
I20260709 13:17:09.648619  4119 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:09.653468  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.658448  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.562207  7028 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.674306  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.678419  4112 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.675879  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.679566  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.679986  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.607574  7240 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:09.656654  4116 rpcz_store.cc:269] 0709 13:17:05.778533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.792677 (+ 14144us) service_pool.cc:224] Handling call
0709 13:17:06.342440 (+549763us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b540036dba0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763ca06f 00007fed76442f60 00007fed764447de 00007fed7645027c 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2
0709 13:17:08.581199 (+2238759us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b580032e7d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763a80aa 00007fed7642a447 00007fed76442fe7 00007fed764447de 00007fed7645027c 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c
0709 13:17:09.614458 (+1033259us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400097c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:09.614589 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5141598336}
I20260709 13:17:09.681512  7240 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:09.680797  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:09.684571  7057 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.646184  3964 rpcz_store.cc:276] 0709 13:17:08.048076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.055280 (+1007204us) service_pool.cc:224] Handling call
0709 13:17:09.060449 (+  5169us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.061863 (+  1414us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.061896 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.062387 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.394733 (+332346us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.530115 (+135382us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.543965 (+ 13850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.544059 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:09.641259 (+ 97200us) raft_consensus.cc:1685] finished
0709 13:17:09.641278 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.641416 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13535,"prepare.queue_time_us":119383,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":24313,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":11291,"thread_start_us":452722,"threads_started":2,"wal-append.queue_time_us":395331}
I20260709 13:17:09.686098  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.639936  7014 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:09.689059  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 145442us
I20260709 13:17:09.684701  7278 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.687983  4115 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:09.641812  6999 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.694478  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.696678  4115 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:09.628115  7317 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:09.697264  7317 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:09.695807  7163 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:09.683282  7205 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.687390  4087 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:09.678251  7324 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.674338  7200 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:09.702188  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.702392  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.702816  4115 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:09.703644  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.704214  4115 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:09.697342  7184 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.678623  7248 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:09.714344  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.689248  7170 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.707453  7173 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:09.704916  7324 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.722795  7173 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.724186  7173 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.729266  7248 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.733563  7173 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:09.736322  7173 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:09.738458  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.739159  7187 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:09.741427  4113 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
W20260709 13:17:09.742767  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:09.743225  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.743436  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2122) took 1453 ms. Trace:
I20260709 13:17:09.743763  4113 rpcz_store.cc:276] 0709 13:17:08.290504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.742609 (+1452105us) service_pool.cc:224] Handling call
0709 13:17:09.742961 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.743133 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.743162 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.743202 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.743232 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.743285 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.743376 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.746477  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2404) took 1193 ms. Trace:
I20260709 13:17:09.747056  3966 rpcz_store.cc:276] 0709 13:17:08.553312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.417813 (+864501us) service_pool.cc:224] Handling call
0709 13:17:09.418179 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.495186 (+ 77007us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.736536 (+241350us) spinlock_profiling.cc:243] Waited 71.5 ms on lock 0x7b54004088d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:09.746357 (+  9821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164358016}
I20260709 13:17:09.749097  3938 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:09.751462  4115 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:09.752202  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2120) took 1462 ms. Trace:
I20260709 13:17:09.752622  4115 rpcz_store.cc:276] 0709 13:17:08.289988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.746797 (+1456809us) service_pool.cc:224] Handling call
0709 13:17:09.747092 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.751931 (+  4839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.752145 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.752594  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:09.754323  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:09.754979  4677 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:09.756369  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:09.753647  3938 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:09.753721  3970 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:09.758478  7160 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.760524  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:09.745800  7326 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:09.765388  7214 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:09.765781  7214 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.766124  7214 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.721472  7198 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.418495  4040 rpcz_store.cc:276] 0709 13:17:07.309012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:07.827036 (+518024us) service_pool.cc:224] Handling call
0709 13:17:07.828577 (+  1541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:07.829400 (+   823us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:07.843682 (+ 14282us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.279929 (+1436247us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b1800380ce0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:17:09.407377 (+127448us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.407442 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:09.407489 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.407552 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.407668 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1137,"prepare.queue_time_us":13810,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1933,"raft.queue_time_us":234,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5682,"spinlock_wait_cycles":9086208,"thread_start_us":127074,"threads_started":1}
I20260709 13:17:09.768641  4118 raft_consensus.cc:2368] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:09.769236  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2400) took 1633 ms. Trace:
I20260709 13:17:09.769593  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2134) took 1178 ms. Trace:
I20260709 13:17:09.769939  4118 rpcz_store.cc:276] 0709 13:17:08.590786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.057595 (+466809us) service_pool.cc:224] Handling call
0709 13:17:09.769406 (+711811us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540034d854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:09.769541 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412668288}
I20260709 13:17:09.771204  4118 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:09.771760  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2127) took 1425 ms. Trace:
I20260709 13:17:09.772038  4118 rpcz_store.cc:276] 0709 13:17:08.346115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.770659 (+1424544us) service_pool.cc:224] Handling call
0709 13:17:09.770989 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.771537 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.771705 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.772732  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 405) took 1520 ms. Trace:
I20260709 13:17:09.773116  3972 rpcz_store.cc:276] 0709 13:17:08.251787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.386174 (+1134387us) service_pool.cc:224] Handling call
0709 13:17:09.386473 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.562111 (+175638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.772511 (+210400us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400279554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:09.772677 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392034176}
I20260709 13:17:09.774222  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.774775  3972 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:09.756913  7205 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:17:09.775669  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.775866  7198 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:09.775817  7160 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:09.776587  7160 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:09.776988  7250 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.777405  7160 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.777863  4112 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:09.778976  7250 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.778600  7160 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:09.779259  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2135) took 1236 ms. Trace:
I20260709 13:17:09.779740  7198 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:09.780054  4112 rpcz_store.cc:276] 0709 13:17:08.542387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.778529 (+1236142us) service_pool.cc:224] Handling call
0709 13:17:09.778796 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.778969 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.778993 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.779033 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:09.779072 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.779124 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.779211 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.782032  4112 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:17:09.782063  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2125) took 1490 ms. Trace:
I20260709 13:17:09.769606  3969 rpcz_store.cc:276] 0709 13:17:08.135663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.286794 (+151131us) service_pool.cc:224] Handling call
0709 13:17:09.769031 (+1482237us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400277c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:09.769166 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740657024}
I20260709 13:17:09.782629  4115 rpcz_store.cc:276] 0709 13:17:08.291167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.753856 (+1462689us) service_pool.cc:224] Handling call
0709 13:17:09.781557 (+ 27701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.781759 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.781782 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.781829 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:09.781868 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.781917 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.782013 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.784106  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.784795  3972 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:09.784953  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2137) took 1242 ms. Trace:
I20260709 13:17:09.785513  4115 rpcz_store.cc:276] 0709 13:17:08.542943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.784140 (+1241197us) service_pool.cc:224] Handling call
0709 13:17:09.784429 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.784647 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.784671 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.784709 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.784739 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.784810 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.784897 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.786717  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.786996  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.788069  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.783033  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2136) took 1240 ms. Trace:
I20260709 13:17:09.790817  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.789137  4112 rpcz_store.cc:276] 0709 13:17:08.542671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.781394 (+1238723us) service_pool.cc:224] Handling call
0709 13:17:09.781818 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.782626 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.782972 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:09.791790  3969 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:09.792335  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.792652  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.722743  7324 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:09.795295  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:09.797268  7184 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.789158  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.793404  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:09.800534  7205 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.801040  7205 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.801447  7205 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.802361  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:09.801209  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:09.803571  7244 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.803942  7244 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:09.804289  7244 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.807600  7148 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.808169  7148 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.809814  7205 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.810801  7148 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.812109  7205 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.817287  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.818764  4115 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:09.753083  7278 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:09.756850  7005 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:09.781127  7299 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:09.834830  7244 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.779233  6877 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:09.780408  7198 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.777300  7131 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:09.853374  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 99788us
I20260709 13:17:09.782749  7286 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:09.857936  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2128) took 1421 ms. Trace:
I20260709 13:17:09.858563  4118 rpcz_store.cc:276] 0709 13:17:08.436285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.772671 (+1336386us) service_pool.cc:224] Handling call
0709 13:17:09.772957 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.773147 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:09.835110 (+ 61963us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.857601 (+ 22491us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:09.857650 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:09.857700 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.857761 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:09.857879 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61949,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":83477,"threads_started":2}
I20260709 13:17:09.860123  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.838614  7299 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:09.872056  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.872898  4118 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.838388  7210 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:09.869187  7041 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.205s	user 0.013s	sys 0.010s
I20260709 13:17:09.861637  7203 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:09.866622  7299 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:09.837013  7278 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:09.880852  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2132) took 1337 ms. Trace:
W20260709 13:17:09.881650  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 110090us
W20260709 13:17:09.882104  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.881985  4114 rpcz_store.cc:276] 0709 13:17:08.543475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.829372 (+285897us) service_pool.cc:224] Handling call
0709 13:17:09.880581 (+1051209us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b5400080a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:09.880747 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873495296}
I20260709 13:17:09.882467  7321 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:09.889045  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.899080  4046 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:09.884245  7172 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.004s
I20260709 13:17:09.869501  6825 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:09.908550  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.045210  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.048915  3967 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:17:10.050984  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.051427  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45148.8us
W20260709 13:17:10.057045  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:09.902406  7203 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:10.061688  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.063843  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.051510  7005 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.064729  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:10.062664  7173 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.070852  7173 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:10.072947  7161 consensus_meta.cc:287] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.681s	user 0.007s	sys 0.004s
I20260709 13:17:10.053275  7041 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.067886  4118 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:10.078227  7173 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:10.062901  7240 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.080235  3964 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.073586  7172 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.081166  7172 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.082329  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:10.083050  7172 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.083400  7198 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:10.084733  7068 consensus_meta.cc:287] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.008s
I20260709 13:17:10.085323  7068 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.087584  7068 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.094125  7210 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.095826  7240 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:10.102201  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:09.888578  7321 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.095696  7161 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.098248  7172 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.098727  7187 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.069710  7203 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.113094  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.116081  3968 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:10.118499  4043 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:10.077657  7005 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.098043  7041 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.127928  6988 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.130213  7214 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:10.132022  7333 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:10.132517  7286 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.133608  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.134408  4118 raft_consensus.cc:2376] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9. Re-sending same reply.
I20260709 13:17:10.134557  7283 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.117254  7327 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.117923  7172 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:10.139570  7328 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:17:10.123202  7131 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:10.124039  7161 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:10.144052  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.143605  7203 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.146631  4118 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:10.139896  7327 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:10.161209  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2133) took 1621 ms (client timeout 1636 ms). Trace:
I20260709 13:17:10.158382  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:10.171312  4678 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:10.172747  7327 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:10.163303  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.153878  7059 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.928s	user 0.011s	sys 0.002s
I20260709 13:17:10.146220  7244 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:10.173425  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.167083  7057 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:10.174252  7240 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:10.174947  7240 consensus_queue.cc:1243] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:10.166054  6828 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:10.175549  6828 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:10.175864  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.176283  7184 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:10.176720  7184 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:10.175048  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.177546  7184 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.159637  6825 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:10.179661  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.176322  6828 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.173427  7059 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.167644  7041 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.169337  7205 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:10.169772  7210 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.169802  7028 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.147293  7161 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:10.166417  4120 rpcz_store.cc:269] 0709 13:17:08.539659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.612539 (+ 72880us) service_pool.cc:224] Handling call
0709 13:17:10.161051 (+1548512us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b540004e554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:10.161154 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132513664}
I20260709 13:17:10.188690  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.189292  4120 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:10.178695  7184 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.161962  7172 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.183871  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 283) took 1449 ms. Trace:
I20260709 13:17:10.183785  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.147672  7278 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:10.186165  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:10.174681  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 411) took 1430 ms (client timeout 1729 ms). Trace:
I20260709 13:17:10.196221  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.196863  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.197299  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.176829  4040 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:10.174682  7057 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.180800  7269 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.194768  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.196101  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.182648  7205 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.197429  4039 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:10.199625  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.196456  7028 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:10.201455  3965 rpcz_store.cc:269] 0709 13:17:08.743872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.762322 (+ 18450us) service_pool.cc:224] Handling call
0709 13:17:10.174512 (+1412190us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b5400279a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:10.174626 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223293312}
I20260709 13:17:10.202520  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.202935  7028 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.203974  4038 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:10.194569  7210 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.206095  7210 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.206429  7205 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.208254  7057 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.208726  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2062) took 2181 ms. Trace:
I20260709 13:17:10.209113  3968 rpcz_store.cc:276] 0709 13:17:08.027190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.283360 (+256170us) service_pool.cc:224] Handling call
0709 13:17:10.208522 (+1925162us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54004079d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:10.208660 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3477799168}
I20260709 13:17:10.210305  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.180938  6828 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.210870  3968 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:10.201224  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.168669  7160 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.214560  4047 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:10.215437  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.215636  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.200655  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.196058  4114 rpcz_store.cc:276] 0709 13:17:08.735034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.883324 (+1148290us) service_pool.cc:224] Handling call
0709 13:17:09.903964 (+ 20640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.904216 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.904245 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.904739 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.106802 (+202063us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.106842 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.106917 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.183670 (+ 76753us) raft_consensus.cc:1685] finished
0709 13:17:10.183691 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.183813 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":36580,"threads_started":1,"wal-append.queue_time_us":86491}
I20260709 13:17:10.213492  4044 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:10.203068  3965 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:10.216356  4120 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:10.163681  7324 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.217718  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.219820  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.219905  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.221325  4044 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.221415  4040 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:10.223116  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.223505  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.223868  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.224596  4118 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:10.225337  4039 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.224830  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.227054  3968 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:10.225396  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.231529  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.229585  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.153787  7303 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:10.234086  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.234546  7170 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.217718  7059 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.233234  7180 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:10.238880  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.239604  4114 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:10.234145  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.239838  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.228457  7172 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.240881  4118 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.247112  7324 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:10.247686  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.248698  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.249112  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.249809  4114 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:10.250051  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2147) took 1439 ms. Trace:
I20260709 13:17:10.250854  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.251106  4046 rpcz_store.cc:276] 0709 13:17:08.810582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.382693 (+572111us) service_pool.cc:224] Handling call
0709 13:17:09.397147 (+ 14454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.899600 (+502453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.249841 (+350241us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b540002bcd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:10.249996 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153855872}
I20260709 13:17:10.251875  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.218611  7160 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.238312  7180 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:10.245754  7317 consensus_meta.cc:287] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:17:10.253201  7180 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.253459  7317 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.254014  7237 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:10.254896  4044 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:10.255456  7317 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:10.252981  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.237202  7170 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.256990  7170 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.257543  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.258131  4114 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:10.258251  7160 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.259053  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.258184  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2061) took 2234 ms. Trace:
I20260709 13:17:10.259852  3967 rpcz_store.cc:276] 0709 13:17:08.024281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.742952 (+718671us) service_pool.cc:224] Handling call
0709 13:17:08.743206 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.050119 (+1306913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.257939 (+207820us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400278654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:10.258129 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2735175936}
I20260709 13:17:10.263159  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.263792  4121 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:10.264619  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.265300  4121 raft_consensus.cc:2368] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:10.266750  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.266898  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.267388  4120 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.268100  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.271368  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.272033  3967 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.274961  7161 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.242233  7041 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.276484  7303 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:10.280176  7199 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:10.281046  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 216366us
I20260709 13:17:10.257565  6956 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:10.328284  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:10.331720  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.270262  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:10.290853  7320 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.004s	sys 0.015s
I20260709 13:17:10.308552  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2124) took 2017 ms. Trace:
I20260709 13:17:10.281592  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.329207  4120 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:10.281702  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.333122  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2138) took 1610 ms. Trace:
W20260709 13:17:10.333796  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 63607.6us
I20260709 13:17:10.336515  4113 rpcz_store.cc:276] 0709 13:17:08.290950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.745688 (+1454738us) service_pool.cc:224] Handling call
0709 13:17:09.795271 (+ 49583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.795482 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:10.097600 (+302118us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.308146 (+210546us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.308212 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:10.308261 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.308340 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.308484 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":182496,"prepare.queue_time_us":39869,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":195159,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4858,"thread_start_us":292501,"threads_started":2,"wal-append.queue_time_us":62761}
W20260709 13:17:10.337783  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56167.1us
I20260709 13:17:10.338418  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.339812  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.340073  4120 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:10.337509  4115 rpcz_store.cc:276] 0709 13:17:08.722428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.819514 (+1097086us) service_pool.cc:224] Handling call
0709 13:17:09.819839 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.824907 (+  5068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.824943 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.836097 (+ 11154us) log.cc:844] Serialized 26 byte log entry
0709 13:17:10.050241 (+214144us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:10.058963 (+  8722us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.281984 (+223021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.282062 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.282102 (+    40us) raft_consensus.cc:1685] finished
0709 13:17:10.282114 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.333063 (+ 50949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":237899,"prepare.queue_time_us":10714,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":226187,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":21739,"thread_start_us":182719,"threads_started":1,"wal-append.queue_time_us":250664}
I20260709 13:17:10.341099  4118 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
W20260709 13:17:10.342864  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.293660  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:10.335467  7322 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.637s	user 0.002s	sys 0.000s
I20260709 13:17:10.323174  7173 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.341956  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.389933  4118 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:10.350271  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.390257  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:10.391004  4116 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:10.334311  7320 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.004s	sys 0.030s
W20260709 13:17:10.353746  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.373734  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.273375  7289 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:17:10.394574  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.396592  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56858.7us
I20260709 13:17:10.398295  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.276973  7041 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:10.398566  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.398898  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.331852  6956 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:10.343083  7186 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:10.412935  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.409003  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2072) took 1814 ms. Trace:
I20260709 13:17:10.395885  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.293541  7161 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.099s
I20260709 13:17:10.399523  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.410368  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.404945  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.406476  4121 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:10.413755  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2152) took 1502 ms. Trace:
I20260709 13:17:10.325141  7299 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:10.404958  7248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.010s	sys 0.048s
I20260709 13:17:10.444569  4117 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:10.435961  4043 rpcz_store.cc:276] 0709 13:17:08.911438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.479907 (+568469us) service_pool.cc:224] Handling call
0709 13:17:09.501552 (+ 21645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.119152 (+617600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.413528 (+294376us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b540035d4d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:10.413698 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417929088}
I20260709 13:17:10.433252  3970 rpcz_store.cc:276] 0709 13:17:08.594480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.600721 (+1006241us) service_pool.cc:224] Handling call
0709 13:17:09.605908 (+  5187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.757499 (+151591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.408722 (+651223us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400277754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:10.408937 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":339510528}
I20260709 13:17:10.436244  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.433888  4115 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:10.442001  4118 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:10.403009  7254 raft_consensus.cc:2764] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:10.401386  7327 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:10.444154  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.442891  7176 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.432371  7041 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.445359  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2147) took 1395 ms. Trace:
I20260709 13:17:10.446934  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.397670  7326 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:17:10.434990  7186 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:10.442737  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.403703  7289 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.401326  7068 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:17:10.404234  7323 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:10.490413  7269 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 13:17:10.513648  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 70994.2us
I20260709 13:17:10.514394  7057 raft_consensus.cc:2764] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:17:10.477476  7049 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.515461  7057 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:10.515833  7057 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:10.483732  4041 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.488516  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2409) took 1926 ms. Trace:
I20260709 13:17:10.483359  4117 rpcz_store.cc:276] 0709 13:17:09.049645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.408307 (+1358662us) service_pool.cc:224] Handling call
0709 13:17:10.444285 (+ 35978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.445063 (+   778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.445221 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.516588  7057 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.486240  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.517624  3971 rpcz_store.cc:276] 0709 13:17:08.562093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.533949 (+971856us) service_pool.cc:224] Handling call
0709 13:17:10.174637 (+640688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.174832 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.174861 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.174910 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:10.174950 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.175002 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.488363 (+313361us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b5400279a50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:10.488463 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430672768}
I20260709 13:17:10.518852  3970 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.519248  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.519791  3971 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.487140  4675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 269) took 1680 ms. Trace:
I20260709 13:17:10.516904  7186 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:10.520951  7323 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.514283  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.522038  3968 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:10.446918  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2139) took 1686 ms. Trace:
I20260709 13:17:10.483439  7327 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.489923  7005 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.492244  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:10.488215  7299 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:10.453922  7248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.050s
I20260709 13:17:10.523898  7327 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.520684  7289 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.480522  7059 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.519263  7057 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:10.525134  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78274.2us
I20260709 13:17:10.520056  7326 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:10.445686  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.530966  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.484900  4115 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:10.513381  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.514432  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:10.531507  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85913.7us
I20260709 13:17:10.533630  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.534051  4013 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.524533  4118 rpcz_store.cc:276] 0709 13:17:08.760833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.401475 (+1640642us) service_pool.cc:224] Handling call
0709 13:17:10.441786 (+ 40311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.446606 (+  4820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.446854 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.504983  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2137) took 1837 ms. Trace:
I20260709 13:17:10.527699  4684 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.527616  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.510739  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 412) took 1675 ms. Trace:
I20260709 13:17:10.536942  4112 rpcz_store.cc:276] 0709 13:17:08.667722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.796273 (+1128551us) service_pool.cc:224] Handling call
0709 13:17:09.796586 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:09.796969 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:09.796997 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:09.797464 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:17:09.877815 (+ 80351us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:09.901864 (+ 24049us) log.cc:844] Serialized 14 byte log entry
0709 13:17:09.902086 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:09.902164 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:10.279966 (+377802us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b18002e8ac0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed7a32058f 00007fed7335f571 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd
0709 13:17:10.500672 (+220706us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b18002e8ac0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:10.504699 (+  4027us) raft_consensus.cc:1685] finished
0709 13:17:10.504724 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.504912 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11370,"prepare.queue_time_us":23798,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":668,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":145371,"spinlock_wait_cycles":16179456,"thread_start_us":79894,"threads_started":1,"wal-append.queue_time_us":255637}
I20260709 13:17:10.524048  4119 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:10.540586  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2154) took 1489 ms. Trace:
I20260709 13:17:10.540956  4119 rpcz_store.cc:276] 0709 13:17:09.051420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.523480 (+1472060us) service_pool.cc:224] Handling call
0709 13:17:10.523763 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.540215 (+ 16452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.540454 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.525835  4113 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.542095  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2152) took 1491 ms. Trace:
I20260709 13:17:10.542399  4113 rpcz_store.cc:276] 0709 13:17:09.050938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.483623 (+1432685us) service_pool.cc:224] Handling call
0709 13:17:10.525647 (+ 42024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.541815 (+ 16168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.542040 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.400652  7278 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:17:10.544145  3963 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:10.532086  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2153) took 1480 ms. Trace:
I20260709 13:17:10.544808  4115 rpcz_store.cc:276] 0709 13:17:09.051182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.484173 (+1432991us) service_pool.cc:224] Handling call
0709 13:17:10.484548 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.531682 (+ 47134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.532023 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.515496  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.527837  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.538870  3968 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.538834  3964 rpcz_store.cc:276] 0709 13:17:08.835200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.687531 (+852331us) service_pool.cc:224] Handling call
0709 13:17:09.688583 (+  1052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.080738 (+392155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.510464 (+429726us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400259ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:10.510668 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900067712}
I20260709 13:17:10.549129  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.521598  7323 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.552866  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.554911  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.555279  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.556545  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.560470  4044 raft_consensus.cc:2410] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:10.561314  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.561709  3971 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:10.561837  4044 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:10.560424  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.562552  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.562975  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.557725  4040 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.441161  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:10.559705  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.568625  4039 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:10.557585  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.569283  7152 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.509496  4678 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.571687  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.520594  4675 rpcz_store.cc:276] 0709 13:17:08.806620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:08.807240 (+   620us) service_pool.cc:224] Handling call
0709 13:17:08.832409 (+ 25169us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.070107 (+237698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.486913 (+1416806us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54008d9ad0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:10.487077 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45794560}
I20260709 13:17:10.573349  6999 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.574225  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.574539  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2140) took 1797 ms. Trace:
I20260709 13:17:10.545107  7240 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.575178  6999 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:10.547819  7161 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.575313  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.575997  7161 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.576406  7161 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.576537  4046 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:10.577242  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 130257us
I20260709 13:17:10.579561  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:10.525104  7059 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.575292  3972 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:10.580468  7059 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.544202  7326 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:10.581629  7155 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.582078  7155 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.582464  7155 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.584142  7180 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.585670  7278 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:10.447365  7317 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.586112  7180 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.579900  6956 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.587929  4121 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.588358  6956 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.559345  7269 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.576495  4677 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:10.591136  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2156) took 1539 ms. Trace:
I20260709 13:17:10.590934  6853 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:10.558350  7160 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:10.592056  6853 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:10.592411  6853 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:10.592810  4112 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.593525  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:10.593423  6853 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.594249  4680 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:10.594630  6853 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.594933  4113 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:10.558528  7237 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:10.595708  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2140) took 1411 ms. Trace:
I20260709 13:17:10.595994  7317 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:10.596436  7317 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.597280  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.582355  7326 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.598361  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.598788  7326 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:10.598914  3964 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:10.593382  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2138) took 1409 ms. Trace:
I20260709 13:17:10.564042  3970 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
W20260709 13:17:10.600033  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50990.8us
I20260709 13:17:10.588543  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2155) took 1536 ms. Trace:
I20260709 13:17:10.573277  4038 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.591493  4117 rpcz_store.cc:276] 0709 13:17:09.051937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.590447 (+1538510us) service_pool.cc:224] Handling call
0709 13:17:10.590712 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.590870 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.590894 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.590932 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:10.590960 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.591005 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.591088 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.599881  4112 rpcz_store.cc:276] 0709 13:17:09.184250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.592362 (+1408112us) service_pool.cc:224] Handling call
0709 13:17:10.592617 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.593163 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.593334 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.600754  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.600893  4121 rpcz_store.cc:276] 0709 13:17:09.051667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.587471 (+1535804us) service_pool.cc:224] Handling call
0709 13:17:10.587752 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.588329 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.588494 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.601488  4113 rpcz_store.cc:276] 0709 13:17:09.184801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.594356 (+1409555us) service_pool.cc:224] Handling call
0709 13:17:10.594735 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.595481 (+   746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.595653 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.543308  7299 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.613715  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.499161  3866 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.605957  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.574896  4116 rpcz_store.cc:276] 0709 13:17:08.777391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.401542 (+1624151us) service_pool.cc:224] Handling call
0709 13:17:10.401843 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.402066 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:10.444931 (+ 42865us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.574215 (+129284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.574262 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:10.574313 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.574373 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.574469 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23430,"prepare.queue_time_us":43991,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":24767,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":105496,"threads_started":1,"wal-append.queue_time_us":105792}
I20260709 13:17:10.607434  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.608034  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.615444  3971 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:10.615561  4040 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:10.616261  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.617950  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.618693  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.620581  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.621675  4648 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:10.619079  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.620309  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.586035  7278 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:10.584033  7324 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:10.624919  4012 leader_election.cc:400] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:10.624301  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.626958  4012 leader_election.cc:403] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:10.627239  3964 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:10.625701  7152 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:10.628595  7152 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.629037  7152 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.629190  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.630419  7303 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.630659  7269 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.631206  7269 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.631681  7269 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.635571  7059 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.638346  4118 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.639091  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2142) took 1433 ms. Trace:
I20260709 13:17:10.639410  4118 rpcz_store.cc:276] 0709 13:17:09.205420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.637724 (+1432304us) service_pool.cc:224] Handling call
0709 13:17:10.638047 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.638827 (+   780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.639030 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.642190  7321 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.597357  7170 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.623310  3866 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 9, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 9 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.628131  7323 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.645900  4681 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.646435  7278 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.647346  4682 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:10.647526  7323 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.612695  6982 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:10.635394  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.648561  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.591557  7210 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:10.628366  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:10.662173  4117 raft_consensus.cc:606] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.662508  4117 raft_consensus.cc:614] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:10.662894  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.650566  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.652797  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:10.653239  3967 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:10.664616  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.665297  3967 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.625130  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.652796  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:10.655673  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54995.4us
I20260709 13:17:10.655491  3866 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 5, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 5 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:10.655871  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.625977  7346 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.647816  6877 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:10.617758  7203 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.649314  7324 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:10.672696  3967 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
W20260709 13:17:10.690317  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.655537  7184 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:10.716866  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2417) took 1590 ms. Trace:
I20260709 13:17:10.717783  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.698441  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.706265  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.656190  7180 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.663650  3972 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:10.707813  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.627002  7160 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:10.695919  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:10.711885  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59185.3us
I20260709 13:17:10.719139  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.645701  7186 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.713707  4117 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:10.661820  7210 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.656567  7173 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:10.742690  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.744930  3971 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:10.712989  3866 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 9 to 10, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:10.755160  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:10.712780  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60079.5us
I20260709 13:17:10.756443  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.745457  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2164) took 1348 ms. Trace:
I20260709 13:17:10.757192  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:10.706700  7146 raft_consensus.cc:2764] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:10.718884  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.759989  4038 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:10.718473  7057 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.661782  7028 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:10.659305  7176 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.749063  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.749938  4045 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:10.754315  7210 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:10.785679  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.713826  6877 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:10.757918  4047 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:10.756341  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.757566  4117 rpcz_store.cc:276] 0709 13:17:09.397318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.710594 (+1313276us) service_pool.cc:224] Handling call
0709 13:17:10.713547 (+  2953us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.745193 (+ 31646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.745401 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.792356  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.717063  7278 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:10.728735  7235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.033s	user 0.001s	sys 0.024s
I20260709 13:17:10.743571  7170 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.746032  3967 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:10.745261  7317 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.719015  7205 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.715492  6982 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:10.755746  7173 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.767578  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.769701  7059 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.770180  7214 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:10.719553  7184 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.747819  7323 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:10.773178  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:10.708420  7161 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.776919  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:10.791694  6877 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:10.751212  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.779847  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:10.784483  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.788823  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.762677  4120 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:10.792958  4047 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.753926  7237 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:10.793061  3971 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:10.792537  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:10.716602  7041 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.791993  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:10.761798  7321 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:10.805712  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56743.8us
I20260709 13:17:10.780203  7155 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.808889  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.788127  7057 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:10.810595  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43709.8us
I20260709 13:17:10.816939  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:10.799886  7235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.001s	sys 0.024s
I20260709 13:17:10.767460  7324 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:10.778564  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.818498  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:10.825302  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.823825  4117 raft_consensus.cc:606] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.800869  7160 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:17:10.842150  4117 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.842521  4121 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.750522  7180 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.831879  7059 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:10.848229  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 290) took 1317 ms. Trace:
I20260709 13:17:10.848508  7059 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:10.848997  7059 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:10.849591  7186 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:10.850244  3970 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:10.827632  4011 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:10.827888  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.853278  3963 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
W20260709 13:17:10.828177  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48634.6us
I20260709 13:17:10.827826  7299 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.854290  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.805554  7203 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:10.831386  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:10.833142  7240 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:10.815369  7184 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:10.820987  3965 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:10.842718  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2145) took 1268 ms. Trace:
I20260709 13:17:10.848608  4121 rpcz_store.cc:276] 0709 13:17:09.530608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.836670 (+1306062us) service_pool.cc:224] Handling call
0709 13:17:10.842355 (+  5685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.847947 (+  5592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.848159 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.861294  4117 rpcz_store.cc:276] 0709 13:17:09.574534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.841676 (+1267142us) service_pool.cc:224] Handling call
0709 13:17:10.841983 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.842501 (+   518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.842659 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.857276  4114 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:10.832486  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.858426  3967 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:10.864144  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.862092  3968 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:10.828547  7323 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:10.834656  7321 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:10.857218  4681 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:10.860239  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.865752  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:10.862118  4121 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:10.869369  3968 raft_consensus.cc:2410] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:10.870920  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2151) took 1124 ms. Trace:
I20260709 13:17:10.871462  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.871340  4121 rpcz_store.cc:276] 0709 13:17:09.746625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.861527 (+1114902us) service_pool.cc:224] Handling call
0709 13:17:10.861819 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.870670 (+  8851us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.870855 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.823884  7176 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:10.866707  3967 raft_consensus.cc:2410] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:17:10.872499  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.827602  7237 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.852792  4676 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:17:10.874150  4121 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:17:10.876543  7323 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:10.884169  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.883774  7210 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.889906  7041 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.890967  7180 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:10.893561  3970 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:10.895802  7049 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.898877  7269 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.899048  7321 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.902323  7317 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:10.896255  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.909354  7152 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.910620  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.914606  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.889950  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 284) took 2141 ms. Trace:
I20260709 13:17:10.944913  4114 rpcz_store.cc:276] 0709 13:17:08.748202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.402838 (+1654636us) service_pool.cc:224] Handling call
0709 13:17:10.443259 (+ 40421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.862944 (+419685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.889706 (+ 26762us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400456fd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:10.889876 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945925888}
I20260709 13:17:10.717921  3969 rpcz_store.cc:276] 0709 13:17:09.126147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.819341 (+693194us) service_pool.cc:224] Handling call
0709 13:17:09.819620 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:09.819810 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:09.844750 (+ 24940us) log.cc:844] Serialized 14 byte log entry
0709 13:17:10.507165 (+662415us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18001caaa0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:17:10.716389 (+209224us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.716439 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:10.716487 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.716557 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:10.716668 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55866,"prepare.queue_time_us":26283,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2266,"raft.queue_time_us":66291,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":26478,"spinlock_wait_cycles":7666048,"thread_start_us":143664,"threads_started":1}
I20260709 13:17:10.873387  7214 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.926069  7057 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.927340  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.927628  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36870 (request call id 85) took 1144 ms. Trace:
I20260709 13:17:10.949685  4117 rpcz_store.cc:276] 0709 13:17:09.783607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.862328 (+1078721us) service_pool.cc:224] Handling call
0709 13:17:10.927516 (+ 65188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.950619  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.951121  4117 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.952888  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:10.954047  4114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:10.954546  4114 raft_consensus.cc:606] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.909248  7203 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.949317  7349 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.874738  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.957212  7187 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:10.957628  7187 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:10.958000  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:10.958740  4681 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:10.958465  7187 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:10.959484  7187 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:10.934072  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2152) took 1116 ms. Trace:
I20260709 13:17:10.966764  4121 rpcz_store.cc:276] 0709 13:17:09.818055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.873510 (+1055455us) service_pool.cc:224] Handling call
0709 13:17:10.873847 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:10.932481 (+ 58634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.934011 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:10.934509  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.968571  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.934073  3967 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:10.969543  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2074) took 1224 ms. Trace:
I20260709 13:17:10.969871  3967 rpcz_store.cc:276] 0709 13:17:09.744729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.933579 (+1188850us) service_pool.cc:224] Handling call
0709 13:17:10.933892 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.969288 (+ 35396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.969489 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:10.935595  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 101738us
I20260709 13:17:10.870024  6956 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:10.936955  3970 pending_rounds.cc:85] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:10.909555  7164 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:10.874338  3968 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.908597  7346 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:10.942543  4038 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:10.975265  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 100603us
I20260709 13:17:10.975924  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.976032  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2418) took 1849 ms. Trace:
I20260709 13:17:10.921002  7289 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.932958  4047 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:17:10.964804  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 137199us
I20260709 13:17:10.938953  7299 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:10.986128  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.987639  3967 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.951658  7049 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.973275  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.974054  3970 pending_rounds.cc:107] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:10.943532  4039 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:10.976436  3968 rpcz_store.cc:276] 0709 13:17:09.126384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.873870 (+1747486us) service_pool.cc:224] Handling call
0709 13:17:10.874160 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.975808 (+101648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.975978 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.990617  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:10.990824  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.979193  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:10.979343  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.982748  3963 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:10.990203  3970 raft_consensus.cc:2889] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:10.992004  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.992270  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2421) took 1083 ms. Trace:
I20260709 13:17:10.936117  7059 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.972365  4117 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:10.991613  3968 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:10.992599  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2073) took 1248 ms. Trace:
I20260709 13:17:10.977625  7308 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:17:11.051837  3969 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:10.992642  3963 rpcz_store.cc:276] 0709 13:17:09.909312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.980630 (+1071318us) service_pool.cc:224] Handling call
0709 13:17:10.982534 (+  1904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.992047 (+  9513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.992220 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:11.031354  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:10.968381  7173 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:10.931201  6982 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:11.050920  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71797.9us
I20260709 13:17:11.050393  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2430) took 1138 ms. Trace:
I20260709 13:17:11.049850  3970 rpcz_store.cc:276] 0709 13:17:09.744449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.892826 (+1148377us) service_pool.cc:224] Handling call
0709 13:17:10.893180 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.992385 (+ 99205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.992553 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:10.974581  7168 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:11.099817  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 109254us
W20260709 13:17:11.149449  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 173806us
I20260709 13:17:11.063987  3966 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:11.051426  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59499.2us
W20260709 13:17:11.134580  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.159197  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.158026  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:11.149235  4683 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:11.121268  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:11.159157  3968 rpcz_store.cc:276] 0709 13:17:09.911480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.991025 (+1079545us) service_pool.cc:224] Handling call
0709 13:17:10.991318 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.050143 (+ 58825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.050339 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.162108  3968 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:11.048991  7164 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:10.983494  7317 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:10.983959  7205 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.169833  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:10.983515  7356 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:11.114012  7348 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:17:10.990015  7049 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.173844  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.175019  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:10.985097  6956 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:11.177886  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.176888  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.188002  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:11.194324  4121 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:11.099025  7052 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:11.050163  7214 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.180285  3963 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:11.196380  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.063508  7235 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.197507  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:10.977928  7351 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.212s
I20260709 13:17:11.052623  7176 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:11.186892  7362 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:11.166740  7164 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.188352  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:11.052743  7057 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:11.181843  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.195488  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.216037  4121 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:11.107864  7041 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:11.199492  7049 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.140357  7180 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.201144  4118 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:11.054041  7308 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:11.192456  7240 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:17:11.188177  6881 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.202486  7170 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:11.198150  7052 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.254972  7052 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.206718  4113 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.207960  3970 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:11.220964  7164 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.208380  7351 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:11.206099  7269 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.258227  7170 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.266382  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.267720  7170 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.229530  7152 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.269063  7152 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:11.269944  7363 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:17:11.269596  7152 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.271739  7152 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.273473  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:11.274642  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:11.275583  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:11.276866  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2075) took 1527 ms. Trace:
I20260709 13:17:11.277216  3969 rpcz_store.cc:276] 0709 13:17:09.749758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.946957 (+1197199us) service_pool.cc:224] Handling call
0709 13:17:10.947185 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.052216 (+105031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.276632 (+224416us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400155ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:11.276809 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232865536}
W20260709 13:17:11.186293  7358 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:17:11.265033  7351 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.208206  7365 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.278901  7365 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.210788  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:11.269284  7289 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.279964  4683 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:11.054713  6828 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.214463  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:11.279292  7365 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.281538  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2419) took 2154 ms. Trace:
I20260709 13:17:11.170949  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:11.216114  4043 raft_consensus.cc:2368] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:11.216811  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.179023  7254 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.199555  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:11.289868  7052 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.290807  7351 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.229343  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:11.291359  4117 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:11.208633  7324 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.292835  7052 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:11.290930  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 91454.3us
I20260709 13:17:11.295569  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:11.303740  7237 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.304101  7059 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.307824  7164 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.282955  7205 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:11.313004  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 137331us
I20260709 13:17:11.267925  7184 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.120868  7355 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:17:11.171150  7361 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.217366  7057 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:11.223495  7186 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:11.200730  7357 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:11.231671  7180 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.223460  7248 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.217391  7327 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.232895  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.333863  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.334350  4118 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:11.232895  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.336570  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.234686  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2078) took 1484 ms. Trace:
I20260709 13:17:11.337128  3967 rpcz_store.cc:276] 0709 13:17:09.750266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.970618 (+1220352us) service_pool.cc:224] Handling call
0709 13:17:10.970888 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.988071 (+ 17183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.234438 (+246367us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54002c9f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:11.234620 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38052736}
I20260709 13:17:11.338104  3967 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.235023  7028 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11.
I20260709 13:17:11.312399  7299 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.198258  7356 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.166148  7168 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.202582  7214 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.344653  7214 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.345880  7168 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.347216  7365 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.347672  7161 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.192052  6853 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:17:11.203724  7210 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.202461  7317 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.349519  7365 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.258496  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:11.209683  7176 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.260747  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.265635  7269 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:11.213157  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:11.352038  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 138925us
I20260709 13:17:11.353178  7176 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.244923  7308 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:17:11.356940  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.119725  7155 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.362711  4114 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:11.316480  7152 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.308598  7049 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.291193  7351 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.314706  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:11.370561  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55937us
I20260709 13:17:11.317409  4121 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:11.230152  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.319466  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.321218  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.325769  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:11.325488  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 107176us
W20260709 13:17:11.311537  7359 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:17:11.340409  3964 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:17:11.349208  7317 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.257720  3972 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:11.351848  7269 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.354619  7367 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.281932  3965 rpcz_store.cc:276] 0709 13:17:09.126605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.888834 (+1762229us) service_pool.cc:224] Handling call
0709 13:17:10.926405 (+ 37571us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:10.926643 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:10.926671 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:10.926720 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:10.926765 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:10.926825 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.281364 (+354539us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b540044b6d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:11.281478 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85603584}
I20260709 13:17:11.287662  4683 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:11.359493  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.315910  7041 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:11.361866  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.361142  7356 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.480080  4113 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.278472  3969 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:11.480892  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 414) took 1074 ms. Trace:
I20260709 13:17:11.311383  7164 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.318037  7057 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.274561  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:11.372604  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 142523us
I20260709 13:17:11.373184  4116 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.311554  6956 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.483044  4042 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.377965  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.378407  4118 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
W20260709 13:17:11.369819  7160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.012s
I20260709 13:17:11.471530  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.318362  7059 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:17:11.470144  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 90985.1us
I20260709 13:17:11.329264  7203 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:11.481570  4047 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:11.377312  7176 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.512151  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.340260  7248 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.369766  7283 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 13:17:11.485394  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 109686us
I20260709 13:17:11.485810  6982 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:11.487739  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:11.487865  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:11.488400  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:11.489434  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.472924  7028 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.491382  7214 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.492172  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.482736  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.500178  4119 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:11.374184  7351 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:11.503006  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2089) took 1317 ms (client timeout 1755 ms). Trace:
I20260709 13:17:11.533483  4119 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:11.503085  3970 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:11.377046  7240 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:11.481205  3969 rpcz_store.cc:276] 0709 13:17:10.406723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.278038 (+871315us) service_pool.cc:224] Handling call
0709 13:17:11.278315 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.480645 (+202330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.480838 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:11.535418  7366 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:11.506515  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.508049  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2096) took 1271 ms. Trace:
I20260709 13:17:11.508656  7041 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.482484  6828 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:11.483651  7369 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.552016  7248 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.553309  7369 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:11.555130  7372 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:11.555493  7369 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.557488  3967 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.510841  7317 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.374554  7168 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:17:11.483916  7173 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.479740  7237 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.377195  7199 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:17:11.376744  6999 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.135s
I20260709 13:17:11.366526  7152 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.513175  3972 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:11.377310  6853 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:17:11.368148  7052 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 13:17:11.474932  7367 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.590505  7367 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.592377  4040 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:11.595937  7237 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.358686  7327 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.598062  7155 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:11.516460  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:11.598475  7155 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:11.599400  7214 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.600180  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.517736  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.600992  4117 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.601738  7199 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.602306  7199 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:11.518074  4113 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.510982  7131 raft_consensus.cc:993] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:11.603644  7199 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.604936  7052 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:11.507838  7160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.007s	sys 0.012s
I20260709 13:17:11.607671  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.525993  4116 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.528609  4046 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:11.608390  3972 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:11.530573  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.531996  4120 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:11.510221  7203 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:11.534181  3966 rpcz_store.cc:269] 0709 13:17:10.185333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.515272 (+329939us) service_pool.cc:224] Handling call
0709 13:17:11.502775 (+987503us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b5400307854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:11.502878 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1164897024}
I20260709 13:17:11.535132  7059 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:11.543129  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.615716  3969 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.506659  4115 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.544080  3963 rpcz_store.cc:276] 0709 13:17:10.236176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.061783 (+825607us) service_pool.cc:224] Handling call
0709 13:17:11.062274 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:11.200593 (+138319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.502891 (+302298us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54003985d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:11.507986 (+  5095us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270921088}
I20260709 13:17:11.526582  7164 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.526742  7232 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:11.605934  6999 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:11.548220  3937 leader_election.cc:400] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:11.535149  7240 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.527639  7355 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.549759  7187 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:11.550151  7184 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.533703  7005 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.550561  7368 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:11.551403  6828 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.564530  7346 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:11.564913  7049 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.565392  7357 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.532326  7028 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:11.567629  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:11.651085  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.651546  3967 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.535218  7254 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:11.587527  7374 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.090s	user 0.002s	sys 0.000s
I20260709 13:17:11.604122  7131 raft_consensus.cc:1081] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:11.525328  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2102) took 1245 ms. Trace:
W20260709 13:17:11.606133  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89725.3us
I20260709 13:17:11.605347  7052 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:11.611116  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.656167  3972 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:11.605145  7347 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.343s	user 0.008s	sys 0.005s
W20260709 13:17:11.612542  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.617791  4117 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:11.620095  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.657405  3966 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.627718  7364 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:11.622246  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.623611  3965 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:11.521947  7365 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.598490  7327 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.627663  3937 leader_election.cc:403] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:11.580740  7299 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:17:11.610961  6982 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.612174  7203 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.642763  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.657884  7049 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:11.627563  6999 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:11.638072  7240 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.654518  3964 rpcz_store.cc:276] 0709 13:17:10.279938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.707574 (+427636us) service_pool.cc:224] Handling call
0709 13:17:11.514444 (+806870us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54002599d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:11.525267 (+ 10823us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370251520}
I20260709 13:17:11.680179  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:11.680485  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.656383  3969 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:11.681234  3972 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.682314  3972 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.627789  7164 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.690474  7164 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.655496  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:11.692648  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:11.678686  7049 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.693639  7059 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:11.693823  7049 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.694849  7370 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:11.695161  7049 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:11.697508  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2518) took 1040 ms. Trace:
I20260709 13:17:11.697868  4040 rpcz_store.cc:276] 0709 13:17:10.657285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.657653 (+   368us) service_pool.cc:224] Handling call
0709 13:17:11.697348 (+1039695us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b540028b754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:11.697450 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441701760}
I20260709 13:17:11.668264  7323 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.644479  7346 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:11.646553  7180 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.653081  7028 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.660472  7308 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.672690  3963 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:11.641381  7355 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.731652  7237 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.668352  7365 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.732434  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.723860  7283 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:11.674086  3967 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:11.606619  7152 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.733548  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:11.671249  7366 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:11.734244  3965 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:11.717576  7323 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.649564  7367 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.733570  7283 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.736788  7323 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.737396  7367 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.686442  6982 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:11.737748  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:11.738390  3970 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:11.739056  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.739231  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:11.739981  3970 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:11.679622  7299 consensus_queue.cc:1243] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:11.741511  7160 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.741853  7160 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.742790  7160 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.743929  7160 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:11.688583  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2088) took 1503 ms. Trace:
I20260709 13:17:11.744904  3971 rpcz_store.cc:276] 0709 13:17:10.185061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.825083 (+640022us) service_pool.cc:224] Handling call
0709 13:17:11.688409 (+863326us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b5400277c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:11.688527 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870141312}
I20260709 13:17:11.746155  7308 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.746268  3971 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:11.745546  7203 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.747537  3971 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:11.669042  7357 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.700847  7205 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:11.695319  7370 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.702149  6828 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.702667  7052 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.703933  6999 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.705152  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:11.707338  7199 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.683971  3964 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:11.708907  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:11.728300  7059 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.709247  7352 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:11.718007  7351 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.738404  4121 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:17:11.715480  3938 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.709587  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:11.666497  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154414us
W20260709 13:17:11.677999  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 129879us
I20260709 13:17:11.766005  3967 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
W20260709 13:17:11.766587  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 51178.4us
I20260709 13:17:11.766993  3969 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.767474  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.767993  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:11.672479  7269 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.655016  7254 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.599277  7155 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.729642  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:11.732990  7355 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.733657  7365 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.735037  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:11.687876  7373 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:17:11.776685  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.729050  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:11.729173  7346 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.770776  3964 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:11.761819  4039 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:11.761879  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:11.755527  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50461.7us
I20260709 13:17:11.758930  4683 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.754355  7052 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.761019  7203 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.754369  3963 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.768705  3970 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:11.773809  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2109) took 1244 ms. Trace:
I20260709 13:17:11.776412  3966 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.685822  6877 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.776436  3965 raft_consensus.cc:2376] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11. Re-sending same reply.
I20260709 13:17:11.749087  7205 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.765925  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:11.751823  7326 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:17:11.711854  3972 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:11.754869  6999 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.784456  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.774144  7180 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:17:11.785427  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 100633us
I20260709 13:17:11.760941  7352 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.762740  7351 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.737429  7283 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.787101  3968 rpcz_store.cc:276] 0709 13:17:10.529543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:11.312897 (+783354us) service_pool.cc:224] Handling call
0709 13:17:11.313319 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:11.313681 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:11.313714 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:11.351443 (+ 37729us) spinlock_profiling.cc:243] Waited 7.75 ms on lock 0x7b2c000014c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:11.361026 (+  9583us) log.cc:844] Serialized 26 byte log entry
0709 13:17:11.630228 (+269202us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:11.630275 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:11.630363 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:11.765260 (+134897us) raft_consensus.cc:1685] finished
0709 13:17:11.765279 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:11.773744 (+  8465us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3770,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10406,"spinlock_wait_cycles":17815808,"thread_start_us":253174,"threads_started":1,"wal-append.queue_time_us":304502}
I20260709 13:17:11.755672  6828 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:11.773795  7367 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.753612  7370 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.811456  7367 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.809566  7317 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.813601  7367 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.813799  7324 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:11.814281  7324 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:11.815409  7352 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.779433  7028 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.816936  7352 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.818312  4044 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.820986  7254 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.788894  7327 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:11.789110  7041 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.724623  7321 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.827538  7321 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.829305  7028 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.829897  7321 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.793141  7235 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:11.830782  7235 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:11.831120  7235 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:11.831955  7235 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.794073  7168 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:11.753000  7057 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.832965  7168 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:11.833398  7168 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:11.789819  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 97231.7us
I20260709 13:17:11.834879  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:11.835289  4041 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:11.837531  7235 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.827229  7240 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.842339  3971 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:11.793267  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:11.844875  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51693.9us
I20260709 13:17:11.790469  6853 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:17:11.846206  7052 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:11.788905  7155 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.844440  3965 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:11.800552  7346 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:11.851657  7349 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:11.779313  4676 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:11.855583  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.856949  7028 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:11.857342  7028 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:11.857717  7028 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:11.857175  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.802860  7356 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.805899  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.807132  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:11.862351  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55366.1us
I20260709 13:17:11.863354  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:11.775207  7005 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:17:11.824961  4044 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:11.865105  7005 consensus_queue.cc:1243] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:11.865305  6877 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:11.794315  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.865219  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.865996  7369 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:11.866767  7365 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:11.867283  7365 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.867820  7168 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.846407  7186 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:11.855809  7176 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:11.795645  4683 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:11.783320  7214 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:11.868108  7365 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.827193  7205 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.869010  7387 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:11.841050  7041 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:11.865878  7005 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:11.869787  7355 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:11.869776  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.864457  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.844342  7240 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.865861  7203 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:11.748737  7152 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.759569  7059 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.873107  7028 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.873660  7210 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:11.875025  7184 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.941480  7387 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.942800  7387 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.944857  7210 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.945701  3868 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.947069  7152 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:11.947736  3868 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 7 to 8, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 8 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:11.948406  7161 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:11.945712  7210 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.948817  7161 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.950536  7210 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.950956  7161 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.878249  7356 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:11.875659  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69868.8us
I20260709 13:17:11.882462  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:11.882758  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.952564  4113 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:11.883424  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.883630  7057 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:11.884439  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.886456  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.887774  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:11.895565  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101410us
W20260709 13:17:11.896360  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.958252  4119 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:11.958425  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.897444  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:11.905212  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:11.908913  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:11.959225  4120 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:11.959538  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:11.898490  3866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 228) took 9787 ms. Trace:
I20260709 13:17:11.904871  4680 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:11.921891  4013 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:11.910290  7357 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:11.898032  7155 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.937112  7005 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:11.935333  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65797.6us
W20260709 13:17:11.935557  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71163us
I20260709 13:17:11.898301  7052 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:11.925606  7186 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:11.952464  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:11.934517  7176 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:11.936913  7269 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:11.938468  7235 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:11.964210  4117 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:11.964653  4116 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:11.965819  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:11.966003  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.977423  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.967360  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:11.948930  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:11.971735  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:11.900424  7324 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:11.973564  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:11.964139  7203 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:12.011005  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:11.968446  7155 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:11.968384  7052 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:11.966343  4681 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:11.968355  7355 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:11.984856  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:12.050033  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 65288.1us
I20260709 13:17:11.962816  3866 rpcz_store.cc:276] 0709 13:17:02.110931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:02.111094 (+   163us) service_pool.cc:224] Handling call
0709 13:17:11.898391 (+9787297us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:10.857544 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:10.884887 (+ 27343us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:10.884937 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:17:10.884956 (+    19us) tablet.cc:662] Decoding operations
0709 13:17:10.885583 (+   627us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:10.885663 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:10.885692 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:10.886087 (+   395us) tablet.cc:701] Row locks acquired
0709 13:17:10.886105 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:17:10.886284 (+   179us) write_op.cc:270] Start()
0709 13:17:10.886399 (+   115us) write_op.cc:276] Timestamp: P: 1783603030886222 usec, L: 0
0709 13:17:10.886420 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:17:10.887079 (+   659us) log.cc:844] Serialized 1706 byte log entry
0709 13:17:11.310476 (+423397us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:11.688389 (+377913us) op_driver.cc:464] REPLICATION: finished
0709 13:17:11.793404 (+105015us) write_op.cc:301] APPLY: starting
0709 13:17:11.793493 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:11.793632 (+   139us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:11.793645 (+    13us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:11.794173 (+   528us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:11.794393 (+   220us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:17:11.794426 (+    33us) write_op.cc:312] APPLY: finished
0709 13:17:11.794590 (+   164us) log.cc:844] Serialized 41 byte log entry
0709 13:17:11.794732 (+   142us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:11.794830 (+    98us) write_op.cc:454] Released schema lock
0709 13:17:11.794866 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:11.795280 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:11.795307 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":104780,"apply.run_cpu_time_us":1849,"apply.run_wall_time_us":1853,"num_ops":4,"prepare.queue_time_us":58283,"prepare.run_cpu_time_us":13475,"prepare.run_wall_time_us":159066,"raft.queue_time_us":146032,"raft.run_cpu_time_us":14517,"raft.run_wall_time_us":100739,"replication_time_us":801826,"spinlock_wait_cycles":29842176,"thread_start_us":323848,"threads_started":4,"wal-append.queue_time_us":235802}]]}
I20260709 13:17:11.984894  7199 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.009791  6956 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.030798  7346 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.011260  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:11.967491  7379 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.059543  6877 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:12.017261  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.049412  7355 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:12.019245  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.019275  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.083551  3964 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.013283  7049 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:17:11.938923  7041 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.022122  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.071553  7324 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:12.031313  3938 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:12.089579  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 58357.8us
I20260709 13:17:11.988320  6881 raft_consensus.cc:993] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:11.985574  7168 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:11.989301  7186 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:11.973397  7327 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:12.075598  7346 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:12.081166  7160 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:11.974740  7161 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.012399  7356 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:17:11.985563  7367 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.032809  7361 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:17:12.033106  7155 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.103188  7367 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:12.109397  7367 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.042055  7205 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:12.098034  7346 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.095378  7214 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.113538  7214 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:12.113946  7214 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.042778  7028 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.032449  6828 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.032429  7388 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.096959  6877 raft_consensus.cc:1081] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:12.077986  4041 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:17:12.014984  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.121860  6828 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:12.122810  6828 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.123406  7235 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.008329  4120 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
W20260709 13:17:12.079977  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68790.1us
I20260709 13:17:12.082280  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.018489  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.125659  3963 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:12.124467  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 109542us
I20260709 13:17:12.127456  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:12.131281  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:12.132035  4118 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.133543  4117 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:12.084319  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.019556  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.137286  3966 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:12.026507  6853 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:17:12.083195  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.139051  4039 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:17:12.139668  4115 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:12.140214  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.030439  4112 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:11.986639  7005 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.075286  7370 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.023444  4676 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:12.037508  7203 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.097355  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.098587  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.074755  6956 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.087931  7355 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.098273  7357 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.076992  4044 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:12.126847  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:12.186247  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.189100  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.156556  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.157137  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:12.363426  4117 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:17:12.364360  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.364743  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.165208  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.154726  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.161242  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:12.366483  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.367111  4116 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:12.191959  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.195446  4038 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:17:12.368144  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.196003  3968 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:12.201388  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.369119  4040 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:12.233424  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.126506  7052 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.143839  7240 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:12.149564  7028 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:17:12.311659  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 259201us
I20260709 13:17:12.184387  7361 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:12.333333  7186 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:12.210274  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.373687  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:12.374369  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.335671  3964 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:12.201668  7152 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:12.208079  7370 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.215777  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.143471  7164 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.385149  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.336836  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 297) took 1454 ms. Trace:
I20260709 13:17:12.218323  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.202533  6881 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.189911  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.209378  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.157687  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:12.264339  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.125686  7327 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.385386  7389 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:12.359946  7057 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:12.372854  7326 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.388935  7164 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.397687  7326 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.399345  7164 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:12.399921  7326 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.385811  7240 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:12.371300  7357 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.401155  7240 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.401980  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.403345  7357 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.394954  6956 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.386080  4117 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:12.397102  7370 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.205155  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.319903  7269 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.390789  4121 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:12.405468  7269 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.407771  7269 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.408603  4043 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:12.409933  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.413781  4043 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:12.414279  7355 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.421833  4043 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.385890  4112 rpcz_store.cc:276] 0709 13:17:10.882086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:10.927018 (+ 44932us) service_pool.cc:224] Handling call
0709 13:17:12.230775 (+1303757us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54003a70d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:12.336775 (+106000us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443469184}
I20260709 13:17:12.343961  7155 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.333415  7367 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.433882  4113 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:12.435122  7367 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:12.327965  7214 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.320988  7005 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.437604  7214 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:12.438534  7214 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.439036  7214 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.433101  7346 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.446168  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:12.321365  7041 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:12.172897  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.357268  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:12.357420  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 260140us
W20260709 13:17:12.469280  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.191597  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.472257  4042 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:12.362838  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.370663  4116 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:12.367983  4045 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:12.374269  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:12.200953  7160 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:12.375381  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.376741  3969 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:12.378353  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:12.379565  3966 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.380357  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:12.381457  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.476090  4044 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:12.382037  3967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:17:12.476965  3967 raft_consensus.cc:606] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:12.384053  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.373198  7352 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:12.485057  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 104793us
I20260709 13:17:12.395624  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:12.404963  7389 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:12.149058  7388 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.503376  7388 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.091832  7176 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.504415  4039 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:12.505120  4676 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:12.488338  7379 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.506330  7379 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.411163  4047 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:12.411715  4046 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:12.412189  6881 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.362206  7232 raft_consensus.cc:2764] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:17:12.443491  7346 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.462663  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:12.467504  4683 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
W20260709 13:17:12.469399  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:12.480970  3963 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:12.481439  3964 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:12.355520  7235 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:12.469136  7214 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.483655  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.435632  7155 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:12.485939  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 110635us
I20260709 13:17:12.523571  7235 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:12.525555  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.526402  6881 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:12.526115  7235 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.500942  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:12.489504  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 132341us
I20260709 13:17:12.488715  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:12.488562  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 114366us
I20260709 13:17:12.498708  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.500736  7308 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:12.501596  7389 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.502378  7326 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:12.502895  7041 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.390467  7052 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:12.508216  3938 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:12.485267  7387 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.510324  3965 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:12.510838  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.498656  7254 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:12.508003  7352 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:12.528800  3967 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:12.498967  7367 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:12.531064  4680 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:12.485343  7299 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:12.549296  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:12.526989  6853 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:17:12.553741  7235 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.553334  7299 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.556260  7299 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.554481  7160 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.556957  7308 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.557207  7160 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.529520  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.557636  7160 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.526611  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.553378  7367 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:12.559327  7367 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.559903  7324 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.531167  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.551352  7387 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.562211  7387 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.470218  7355 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:12.530942  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.525218  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.553704  7346 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.529798  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.580025  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.574864  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.529526  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.530366  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.530732  4044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:17:12.583103  4044 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:12.583453  4044 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.539413  6999 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.545830  7379 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:12.585819  7210 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:12.586223  7210 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:12.587007  7210 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.587931  7210 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.564002  3970 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:12.581918  4038 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:17:12.553450  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 45329.1us
I20260709 13:17:12.591179  3963 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:12.591677  4046 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:12.593609  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:12.554209  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55608.5us
I20260709 13:17:12.594187  4038 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:12.594419  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.572146  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.524353  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.517701  3966 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:12.573104  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.596079  3971 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:12.573441  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.596853  4043 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:12.597759  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.575016  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.576128  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.576360  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.593768  3938 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:12.633989  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.597007  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.602094  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:12.644560  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 69627.4us
I20260709 13:17:12.550997  7388 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:12.576118  7308 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:12.645339  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.645469  4040 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:12.642073  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 48376.3us
I20260709 13:17:12.646492  4116 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:12.598978  4043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:17:12.610198  4045 raft_consensus.cc:2410] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:12.612583  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.646418  3967 raft_consensus.cc:2410] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:12.649976  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.649017  4043 raft_consensus.cc:476] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Not starting forced leader election -- already a leader
I20260709 13:17:12.600793  4119 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:17:12.651908  4119 pending_rounds.cc:85] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 6
I20260709 13:17:12.652153  4119 pending_rounds.cc:107] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 5.7
I20260709 13:17:12.652402  4119 raft_consensus.cc:2917] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Aborting config change with OpId 5.7: Aborted: Op aborted by new leader
I20260709 13:17:12.611769  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:12.603669  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.615521  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.653489  4044 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.584632  7346 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.658960  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:12.655480  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 62738.9us
I20260709 13:17:12.652782  4119 raft_consensus.cc:2889] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:12.645008  7240 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:12.635514  7235 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.663169  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:12.597793  7299 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.549412  7352 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.679687  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.680701  4046 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:17:12.667507  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:12.667922  4044 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:12.662850  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47420.5us
I20260709 13:17:12.584923  6999 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.659662  7356 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:12.689200  4045 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:12.589620  7005 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:12.663717  7346 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.644176  7052 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.668972  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.647032  7180 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.678280  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:12.682955  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:12.695938  4116 raft_consensus.cc:2376] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7. Re-sending same reply.
I20260709 13:17:12.691124  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.659535  7214 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:12.671613  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:51840 (request call id 7) took 8301 ms. Trace:
I20260709 13:17:12.672924  7388 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.700562  4119 rpcz_store.cc:276] 0709 13:17:04.360480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:04.360889 (+   409us) service_pool.cc:224] Handling call
0709 13:17:05.635515 (+1274626us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b540036dba0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c3ec4 00007fed764478d7 00007fed7645303c 00007fed764526b3 00007fed7b412d29 00007fed749911d4 00007fed74991162 00007fed74991091 00007fed7499100c 00007fed749902c2
0709 13:17:05.959543 (+324028us) log.cc:844] Serialized 564 byte log entry
0709 13:17:05.983818 (+ 24275us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400097c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76452735 00007fed7b412d29 00007fed749911d4 00007fed74991162 00007fed74991091 00007fed7499100c 00007fed749902c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:06.390272 (+406454us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b540036dba0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c5142 00007fed763a5eaa 00007fed763acd53 00007fed763accd9 00007fed763acc69 00007fed763acc31 00007fed763abdfd 000000000038f354 000000000038f199 00007fed7335f475
0709 13:17:07.322471 (+932199us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b540036dba0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c5142 00007fed763a5eaa 00007fed763acd53 00007fed763accd9 00007fed763acc69 00007fed763acc31 00007fed763abdfd 000000000038f354 000000000038f199 00007fed7335f475
0709 13:17:08.453311 (+1130840us) spinlock_profiling.cc:243] Waited 94.5 ms on lock 0x7b540036dba0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763ccb26 00007fed763c649a 00007fed763c5714 00007fed763a5eaa 00007fed763acd53 00007fed763accd9 00007fed763acc69 00007fed763acc31 00007fed763abdfd 000000000038f354
0709 13:17:12.661497 (+4208186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21211,"raft.queue_time_us":9113,"raft.run_cpu_time_us":24235,"raft.run_wall_time_us":2909910,"spinlock_wait_cycles":2742166400}
I20260709 13:17:12.703307  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.716531  6828 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:12.717703  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.719358  6828 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:12.721017  4113 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:12.722117  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.679544  7240 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:12.693048  7364 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:12.722894  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.725090  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.725395  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:12.729889  3971 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:12.731237  4116 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:12.731669  4116 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:12.732016  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:12.694090  7199 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:12.733990  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:12.751701  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.722723  4113 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:12.754060  3967 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:12.678450  6956 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:17:12.698277  7180 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.753955  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:12.753890  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.755745  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.799381  3965 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:12.699950  7214 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:12.802222  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.755012  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:12.803082  3967 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:12.692261  7203 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:17:12.757614  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:12.729666  7411 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:17:12.714403  7327 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:12.799798  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45976.7us
I20260709 13:17:12.800153  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.757347  7184 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.800877  4113 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:12.694034  7355 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:17:12.678562  7235 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.821398  7184 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.799173  7180 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:12.801901  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67982.4us
I20260709 13:17:12.721095  6828 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:12.804877  7214 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:12.698174  7176 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:17:12.698315  7152 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:17:12.699288  7269 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:17:12.807798  4119 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:12.810223  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:12.857317  7184 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.750245  7321 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:12.856709  7235 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:12.800375  7199 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:12.712029  7052 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:12.821892  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57382.8us
I20260709 13:17:12.846278  6999 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:12.811592  7168 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:12.808490  7203 consensus_queue.cc:1243] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:12.858352  4117 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:12.803586  6881 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:17:12.806146  7283 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:12.960184  7283 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:12.854815  3918 auto_rebalancer.cc:893] Removing replace marker failed: Op aborted by new leader
W20260709 13:17:12.961081  3918 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 237eb348003645f7abcc1c18bd324690 already in progress
W20260709 13:17:12.961355  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 237eb348003645f7abcc1c18bd324690 already in progress
I20260709 13:17:12.963963  7052 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:12.960599  7283 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:12.966980  7369 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:12.967391  7369 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.967730  7369 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:12.946238  7321 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.969365  7199 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:12.895236  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 198451us
I20260709 13:17:12.970474  3968 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:12.856851  7410 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:17:12.930011  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:12.926118  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67180.6us
I20260709 13:17:12.811480  7327 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:12.812024  7364 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:12.797271  7412 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:17:12.995959  7308 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.754879  7367 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:12.981472  7327 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.001995  4118 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:13.005250  7364 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.852638  4681 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:12.879114  6828 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:12.861397  7357 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:12.893503  7176 consensus_queue.cc:1243] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:17:12.948905  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:13.014096  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 65277us
I20260709 13:17:13.015232  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:12.957245  7356 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.970039  7321 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:12.866151  7160 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:12.974242  4041 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:12.864799  7419 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:12.853036  7240 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:12.972080  7186 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:12.986871  4038 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:12.946722  7365 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 13:17:12.988336  7414 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:17:13.019222  6881 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.016806  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:13.041533  4042 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9.
I20260709 13:17:12.975739  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:13.010119  7308 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.011511  7357 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.012825  7041 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:13.013077  7283 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:13.031859  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 221741us
I20260709 13:17:12.859122  7403 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:13.020830  7052 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:13.043272  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67608.6us
I20260709 13:17:13.022661  7356 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.050493  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.089679  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:13.092792  3972 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:13.092456  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:13.091012  4041 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:13.048172  7059 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:13.092461  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:13.093073  4043 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:13.095914  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.097286  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.030531  7419 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.049923  7357 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.127452  4113 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:13.128190  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:13.130314  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:13.136999  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.050395  7425 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:13.130442  4121 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.132309  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:13.143224  4043 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:13.132946  7430 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.098047  7059 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.087736  6877 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:13.139199  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:13.140779  3971 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:13.122933  7421 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:17:13.141280  4119 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:13.141723  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:17:13.051144  6999 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:17:13.135246  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:13.172720  4041 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:13.128512  7403 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.086071  7180 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.128795  7299 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.127931  7203 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:13.145637  7041 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.187386  7160 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.155437  7059 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.195402  7041 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.135668  7269 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:17:13.207536  3971 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:13.202883  7357 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:13.234438  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.254442  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 205644us
I20260709 13:17:13.193389  7437 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.184091  7203 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:13.174093  6877 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.275260  4038 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:13.253716  7436 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.215914  7352 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.151386  7430 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:13.287528  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 147789us
I20260709 13:17:13.194590  7299 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.184300  7403 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.281224  7203 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:13.205036  7346 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.303952  7052 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.334960  7426 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
W20260709 13:17:13.336930  7423 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:17:13.354687  7419 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.357175  3964 raft_consensus.cc:2368] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:13.315910  6999 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:13.350749  7424 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:17:13.283685  7437 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.310869  7352 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.363215  6999 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.361919  7283 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:13.386765  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 248404us
I20260709 13:17:13.388608  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.389317  4120 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:13.333528  7052 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.310050  7436 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.380266  7356 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.407989  3963 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:17:13.408433  3963 pending_rounds.cc:85] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:13.408670  3963 pending_rounds.cc:107] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:13.408927  3963 raft_consensus.cc:2889] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:13.411540  7164 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:13.411994  7164 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:13.412814  7164 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.414515  7164 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.417209  7180 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.388585  6999 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.418162  7437 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:13.392418  7431 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:17:13.385746  7419 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:13.423554  6877 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.427224  3970 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:13.427520  7184 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.430068  7352 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.430739  7041 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:13.407924  7432 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:17:13.444288  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:13.442520  7324 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.445408  4680 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:13.445537  7436 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.480994  7436 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.481526  7436 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.482307  7430 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.483002  3972 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.481451  7184 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.483819  7436 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.446035  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:13.446171  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:13.448133  7346 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.448506  7327 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.449095  3969 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 10. Ops: []
I20260709 13:17:13.449530  7419 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.451543  6828 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.456981  7210 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.405249  7214 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.005s
I20260709 13:17:13.458156  7052 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.445996  7173 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:13.459867  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.471621  7269 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:13.475158  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:13.492242  4677 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.518463  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:13.522744  7434 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:13.526337  7155 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.527042  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:13.527158  3937 leader_election.cc:400] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:17:13.642688  3937 leader_election.cc:403] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 13:17:13.643100  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 116147us
I20260709 13:17:13.644069  7403 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.645380  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:13.645965  7419 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.647645  6828 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.643425  6877 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:13.532691  3970 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:13.650873  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.651479  3970 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:13.652237  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.474167  6999 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:13.535173  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.536603  3967 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.652737  3970 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:13.665366  7327 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:13.662483  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:13.661736  7203 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.672853  7203 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.662648  4677 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:13.664361  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:13.674911  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:13.675324  7434 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:13.675704  7434 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.676173  7173 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:13.675917  4116 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.676868  7173 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:13.537467  4682 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.677042  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:13.486876  7425 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:13.677852  7052 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.678295  7052 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.679072  3966 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:13.679804  3968 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:13.680047  6881 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:13.527354  7164 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.680511  6881 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.676563  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.681037  7164 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.681879  7403 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.682264  7403 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.682613  7403 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.654323  6999 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.683249  7164 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.683496  7425 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.529803  7357 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.684700  6881 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.530730  7041 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.685690  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2551) took 1007 ms. Trace:
I20260709 13:17:13.529888  7299 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.490669  7324 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.686036  4039 rpcz_store.cc:276] 0709 13:17:12.677853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.678002 (+   149us) service_pool.cc:224] Handling call
0709 13:17:13.685494 (+1007492us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400112954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:13.685628 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823098112}
I20260709 13:17:13.535099  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:13.706453  4681 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:13.706700  7324 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.685618  7041 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.533017  7210 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.709049  7351 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:13.709520  7351 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:13.709254  7173 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.710311  7351 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.532722  7283 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:13.711596  7351 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.620630  7370 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.518494  4676 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:13.676262  7434 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.681439  4121 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:13.533164  7214 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.665408  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:13.676934  4116 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:13.735035  7299 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.744534  7299 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.693056  4682 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:13.747043  3938 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:13.747244  7299 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.712085  7131 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:13.741896  7203 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:13.693297  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 170921us
I20260709 13:17:13.748621  7203 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.748945  7131 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:13.749471  7131 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:13.750532  7131 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.750787  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:13.751681  7131 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:13.539737  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 64638.5us
I20260709 13:17:13.685524  6881 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.765053  3970 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:13.766239  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.710670  7210 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.713351  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:13.583309  7155 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.716056  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:13.769567  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53599.4us
I20260709 13:17:13.770304  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:13.771090  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:13.771886  7235 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.772240  7235 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.682277  7052 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.772581  7235 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:13.773061  7176 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.719058  7041 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:13.720651  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:13.689910  7369 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.722s	user 0.011s	sys 0.001s
I20260709 13:17:13.735929  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:13.692569  7321 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.004s
I20260709 13:17:13.757639  4116 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:13.767676  3970 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:13.772493  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:13.780205  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:13.793713  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2234) took 1073 ms. Trace:
I20260709 13:17:13.794555  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.714926  7441 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:13.742059  6877 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.785290  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.750795  7203 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.741671  7444 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:13.795329  3970 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:17:13.807660  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.735663  7389 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:17:13.735954  7370 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.769140  7346 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:13.797996  4120 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:13.692426  7059 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.800557  4114 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:13.768373  7436 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:13.804165  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.809087  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:13.783052  7269 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:13.794096  4116 rpcz_store.cc:276] 0709 13:17:12.720245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.725187 (+  4942us) service_pool.cc:224] Handling call
0709 13:17:13.675414 (+950227us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b4c00092740. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74718a20 00007fed74729a29 00007fed746ef644 00007fed74716f2d 00007fed74716b93 00007fed7644718b 00007fed76447cb5 00007fed76442f30 00007fed764447de 00007fed7645027c 00007fed7b411b17
0709 13:17:13.793651 (+118237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42529152}
I20260709 13:17:13.827489  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.828158  4116 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:13.819729  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:13.829857  4120 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.819959  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:13.831763  7052 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:13.832171  7052 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:13.832995  7052 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.834115  7052 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:13.807049  7430 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.837056  7430 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.839054  7430 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.839771  7439 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:13.820303  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:13.801278  7041 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.774537  6881 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.782896  7210 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:17:13.787240  7164 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:17:13.810179  7299 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:13.795377  7369 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.799919  7321 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.845485  7324 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:13.839071  7155 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.811089  6877 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.806553  7441 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.843887  7269 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:13.866132  7441 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.866473  7269 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:13.855440  7324 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:13.845765  7346 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:13.869956  7403 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.870406  7346 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.872188  7403 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.868112  7324 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:13.865800  7059 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.857864  7370 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.795430  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:13.811158  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:13.812458  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.016780  4042 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:13.949828  3963 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:14.019443  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 223952us
I20260709 13:17:14.021150  7346 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.023134  7441 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:14.024163  7441 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.024967  7346 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.025738  7346 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.027275  7441 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.028374  7346 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.951079  3971 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:13.953667  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.053310  4047 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:13.954981  6877 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:13.959142  4112 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:13.844029  4114 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:13.959775  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:13.950227  3970 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:13.966627  7155 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:14.061877  7155 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.064296  7155 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.975114  6881 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.866068  7005 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:13.976037  4121 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 5.
I20260709 13:17:13.977520  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:13.978130  4649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.512s (SENT) [suppressed 14 similar messages]
I20260709 13:17:13.979746  6828 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:13.981580  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2142) took 1498 ms. Trace:
I20260709 13:17:13.981854  7059 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:13.982285  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:13.982616  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:13.892688  7269 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:13.882019  7321 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.861523  7214 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.885829  7235 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:13.986747  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:13.989959  7173 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.992228  7041 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:13.888674  7324 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.081069  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:14.081552  6828 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.082022  3869 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 10 to 11, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 11 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.083087  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.084054  3965 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:13.993125  7164 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.085454  7164 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.083945  7324 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.087939  4119 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:17:13.883491  7369 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:13.883109  7434 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.090183  7235 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.091006  7434 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:13.891985  7439 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:13.877207  7447 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.278s	user 0.000s	sys 0.010s
I20260709 13:17:13.993251  7317 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.095165  7317 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.014277  7445 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:17:14.015478  4039 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:14.032267  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 225) took 1308 ms. Trace:
W20260709 13:17:14.040004  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 303) took 1429 ms (client timeout 1512 ms). Trace:
I20260709 13:17:14.044178  4115 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:17:13.965741  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:14.058395  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99100.8us
I20260709 13:17:14.056412  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.057272  4120 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:14.057896  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.074187  7152 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.078831  7049 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:14.086259  4682 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:13.978170  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:14.081087  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60324.4us
I20260709 13:17:14.099714  7370 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:14.100081  4114 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.100217  3966 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.100814  7317 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.102232  7269 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.102980  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.103245  7041 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.106037  7041 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.108737  7049 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.088867  7005 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:14.110414  3966 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:14.070852  3964 rpcz_store.cc:276] 0709 13:17:12.483260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.526412 (+ 43152us) service_pool.cc:224] Handling call
0709 13:17:13.981146 (+1454734us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b5400279554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:13.981387 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836383616}
I20260709 13:17:14.111137  4113 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:14.111970  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.112154  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:14.114120  4113 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:14.115612  4112 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:14.118461  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.128700  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.128150  7370 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:14.119994  7417 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.174s	user 0.002s	sys 0.007s
I20260709 13:17:14.129527  3971 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:14.130620  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.130874  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.128815  3972 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:14.110684  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.125550  4045 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.110257  7049 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.118742  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.116678  3968 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.103860  3967 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:14.121214  7351 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:14.133900  3969 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:17:14.154803  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 176826us
W20260709 13:17:14.097447  4117 rpcz_store.cc:269] 0709 13:17:12.610502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.633700 (+ 23198us) service_pool.cc:224] Handling call
0709 13:17:14.039548 (+1405848us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54003d2a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:14.039778 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506052352}
I20260709 13:17:14.149925  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.154541  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.126581  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:14.158217  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46478.6us
I20260709 13:17:14.159555  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.126677  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:14.160840  4678 raft_consensus.cc:2393] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:14.163084  7324 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.163619  7324 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:14.164172  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:14.164944  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.164666  7324 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.165088  7369 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:14.167801  7269 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.097316  4044 rpcz_store.cc:276] 0709 13:17:12.724071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.753637 (+ 29566us) service_pool.cc:224] Handling call
0709 13:17:12.753925 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:12.809611 (+ 55686us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:12.809645 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:12.810143 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:17:14.031244 (+1221101us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b18003a8100. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1
0709 13:17:14.031597 (+   353us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:14.031662 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.031773 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:14.031840 (+    67us) raft_consensus.cc:1685] finished
0709 13:17:14.031850 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:14.032092 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75186,"raft.queue_time_us":106936,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":18810,"spinlock_wait_cycles":39863552,"thread_start_us":100242,"threads_started":1,"wal-append.queue_time_us":160149,"wal-append.run_cpu_time_us":1943,"wal-append.run_wall_time_us":1077809}
I20260709 13:17:14.168533  7269 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.170001  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2196) took 1074 ms. Trace:
I20260709 13:17:14.170396  4115 rpcz_store.cc:276] 0709 13:17:13.095239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.096683 (+  1444us) service_pool.cc:224] Handling call
0709 13:17:14.043465 (+946782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.097632 (+ 54167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.169768 (+ 72136us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003d2a50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:14.169906 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176477056}
I20260709 13:17:14.119374  4676 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:14.171789  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:14.173185  7041 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:14.174288  7041 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:14.175036  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.175891  3969 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.174656  7041 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:14.177253  7041 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.120820  7387 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:14.131400  7370 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.116958  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:14.122278  7422 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.180142  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.179132  7164 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.127203  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:14.118896  7059 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:14.186676  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68157.3us
I20260709 13:17:14.186468  4683 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:14.187319  3971 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:14.189647  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:14.168473  6828 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.191273  7184 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:17:14.110670  7005 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.192529  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.192909  7351 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.193729  7387 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.195843  4677 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:14.199018  7367 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:14.199352  7052 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.202512  7356 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.205919  4114 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:14.119817  7173 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.170966  7269 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.208307  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.213248  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.209522  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.120275  7152 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.219120  7367 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.238561  7367 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:14.239575  7367 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.241546  7059 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:14.242406  3868 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 238) took 12449 ms (client timeout 15000 ms). Trace:
I20260709 13:17:14.242827  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.243089  3869 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.244712  3869 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 7 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.247695  7164 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.248458  7164 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.250700  7164 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.242187  7439 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.251376  7439 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.253057  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.253556  7356 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.256028  7356 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.258297  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:14.259661  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:14.260811  7326 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:14.261390  7326 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:14.242765  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.262984  7326 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.263816  3963 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:14.230757  7369 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:14.261245  3868 rpcz_store.cc:269] 0709 13:17:01.792389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:01.792541 (+   152us) service_pool.cc:224] Handling call
0709 13:17:14.242156 (+12449615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:12.329702 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:12.330271 (+   569us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:12.330306 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:17:12.330323 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:12.330712 (+   389us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:12.330772 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:12.330799 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:17:12.352930 (+ 22131us) tablet.cc:701] Row locks acquired
0709 13:17:12.352962 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:17:12.353132 (+   170us) write_op.cc:270] Start()
0709 13:17:12.353953 (+   821us) write_op.cc:276] Timestamp: P: 1783603032353069 usec, L: 0
0709 13:17:12.354429 (+   476us) op_driver.cc:348] REPLICATION: starting
0709 13:17:12.413782 (+ 59353us) log.cc:844] Serialized 929 byte log entry
0709 13:17:12.497319 (+ 83537us) op_driver.cc:464] REPLICATION: finished
0709 13:17:12.944272 (+446953us) write_op.cc:301] APPLY: starting
0709 13:17:12.947495 (+  3223us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:12.982453 (+ 34958us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:12.982582 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:12.982926 (+   344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:12.983121 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:17:12.983162 (+    41us) write_op.cc:312] APPLY: finished
0709 13:17:12.983342 (+   180us) log.cc:844] Serialized 29 byte log entry
0709 13:17:12.983531 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:12.983611 (+    80us) write_op.cc:454] Released schema lock
0709 13:17:12.983649 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:12.984044 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:12.984082 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":365199,"apply.run_cpu_time_us":1968,"apply.run_wall_time_us":58516,"num_ops":2,"prepare.queue_time_us":353728,"prepare.run_cpu_time_us":3133,"prepare.run_wall_time_us":92379,"replication_time_us":142694,"thread_start_us":462261,"threads_started":2}]]}
I20260709 13:17:14.269094  7173 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:14.269922  4119 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:14.217654  3966 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.187343  7370 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:14.223016  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51284.4us
I20260709 13:17:14.226027  7299 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:14.227926  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.228845  6956 raft_consensus.cc:993] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:17:14.228641  7203 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:17:14.279325  7299 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.229168  7210 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:14.230306  3965 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.229727  7232 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:17:14.233191  4675 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:14.234381  4043 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.237682  6828 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:14.287420  6828 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:14.288256  7370 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.280195  7299 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.289022  6828 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.290827  6828 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.267297  7369 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.236594  7443 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:14.297076  7439 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:14.298269  7369 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.298800  7049 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:14.299417  7049 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.299777  7049 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:14.298894  7152 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.282631  7173 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:14.301568  7173 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.304797  3968 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:14.271127  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:14.272480  4045 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:14.211021  7184 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:14.272050  4680 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.266130  3869 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.278987  7052 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.262465  4013 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:14.278894  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51144us
I20260709 13:17:14.310089  7326 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:14.299865  7370 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.311049  7326 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.262864  7388 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.261164  7005 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.283993  7210 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.279386  6956 raft_consensus.cc:1081] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:17:14.274897  7422 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.285482  7232 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:14.281661  7356 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.307905  3869 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.308406  7184 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.311462  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.284485  7387 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.316742  7317 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:14.323135  7232 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:14.315984  7388 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.327222  7232 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.329181  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.328576  7232 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:14.330370  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:14.330888  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 302) took 1727 ms (client timeout 2278 ms). Trace:
W20260709 13:17:14.331530  4118 rpcz_store.cc:269] 0709 13:17:12.602963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:12.603431 (+   468us) service_pool.cc:224] Handling call
0709 13:17:14.330399 (+1726968us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b5400080554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:14.330624 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799311744}
I20260709 13:17:14.333041  7173 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:14.333701  7269 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:14.293795  7367 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.335517  7379 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:14.285737  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96424.9us
I20260709 13:17:14.336253  7379 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.280468  7059 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.337867  7059 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.338974  7379 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:14.339768  7357 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:17:14.341295  7356 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.343479  7356 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.319469  3964 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:14.329310  7388 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.318945  3972 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
W20260709 13:17:14.345508  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 126352us
I20260709 13:17:14.351058  3869 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 8, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:14.352340  3869 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:14.354286  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 232232us
I20260709 13:17:14.355221  7283 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:14.355697  4086 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9.
I20260709 13:17:14.355949  4011 leader_election.cc:400] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:14.356276  7173 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:14.356491  7283 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:14.357116  7214 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:14.357487  7214 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:14.358031  7434 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:14.358430  7434 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:14.359344  7434 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.359783  7422 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:14.361094  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 98886.7us
I20260709 13:17:14.361666  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.362733  3972 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:14.346088  3969 pending_rounds.cc:85] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:14.324574  3965 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:14.298416  7351 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.320989  7152 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:14.318738  7052 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:14.369375  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58023.3us
I20260709 13:17:14.346793  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.364643  3969 pending_rounds.cc:107] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:14.374369  3969 raft_consensus.cc:2889] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.367726  4013 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.376240  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.360636  7434 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.360610  7321 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.383800  7321 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.387126  7321 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.388019  3965 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:14.382953  7184 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:17:14.388947  7152 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.389366  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:14.395839  7299 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.398119  7210 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.399614  7052 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.381275  7379 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:14.382650  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:14.381711  7232 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:17:14.406708  4115 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:14.381973  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:14.408923  4680 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:14.418795  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.418952  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:14.419015  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53466.1us
I20260709 13:17:14.419096  7387 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:14.419692  7379 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.462805  4682 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:17:14.466688  4114 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:14.465166  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2214) took 1327 ms. Trace:
I20260709 13:17:14.425369  3967 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:14.379681  7059 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.427678  3968 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
I20260709 13:17:14.429749  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.426501  4121 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:14.457273  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74690.4us
I20260709 13:17:14.432147  4041 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:14.427098  4013 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.426828  3965 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:14.466065  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.474242  4115 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:14.457468  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101986us
I20260709 13:17:14.431190  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.467535  4043 rpcz_store.cc:276] 0709 13:17:13.137891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:13.143808 (+  5917us) service_pool.cc:224] Handling call
0709 13:17:13.144060 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.286876 (+1142816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.408473 (+121597us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400020dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:14.465105 (+ 56632us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506528000}
I20260709 13:17:14.427006  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.493222  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.429654  3964 pending_rounds.cc:85] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 4
I20260709 13:17:14.496045  3964 pending_rounds.cc:107] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:14.496361  3964 raft_consensus.cc:2889] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:14.421921  7173 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:14.422139  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.430130  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:14.499003  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 78805.3us
I20260709 13:17:14.421804  4675 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:14.500562  4042 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:14.504205  4119 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:14.419888  7356 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:14.432797  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.425103  7326 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.421836  7438 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:14.441108  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:14.457068  7203 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:14.511284  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:14.511880  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 136545us
I20260709 13:17:14.430757  7152 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.426676  7210 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:14.465611  7379 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:14.450357  7299 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.428836  7365 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.188s
I20260709 13:17:14.454584  7387 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.513022  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.503309  7059 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:14.524161  4038 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:14.526124  4047 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.527421  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:14.515300  3968 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:17:14.528556  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.533887  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:14.493368  6956 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:17:14.550822  4039 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:14.510069  7356 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.537357  3966 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:14.519137  7438 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:14.552559  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.546265  4040 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:14.555166  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.557057  3967 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: [8.5-9.6]
I20260709 13:17:14.432323  7049 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.529553  7357 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.559783  7444 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.579030  7444 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.560181  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.581694  4116 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:14.526994  7210 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.583010  7210 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:14.584932  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.586175  4042 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:14.593505  7478 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:17:14.595378  7387 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.597172  4118 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:14.573629  3967 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:17:14.574934  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.578222  7049 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.557893  4114 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:14.608932  4043 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.610970  7203 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:14.611346  7203 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.554236  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.571733  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.600981  4044 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:14.602504  7444 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.563886  4119 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:14.445201  7214 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:14.614594  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63766.5us
I20260709 13:17:14.567673  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.517002  7041 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.623325  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.624725  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.625322  4042 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.621544  4041 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:14.612183  7203 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.646188  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.562767  7356 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.565240  7059 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.651335  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.654984  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:14.652129  4117 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
W20260709 13:17:14.664387  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.680040  7379 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.681145  7232 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.681751  7232 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:14.682801  7232 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.680688  7379 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.686851  7379 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:14.691509  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.693858  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:14.694576  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48605.6us
I20260709 13:17:14.694924  7379 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.695375  7379 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.695750  7379 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:14.696040  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 189936us
I20260709 13:17:14.695240  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:14.688196  7434 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:14.688927  7369 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.690536  7422 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:14.698129  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.688673  4115 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
W20260709 13:17:14.701381  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80130.2us
I20260709 13:17:14.679388  4038 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:14.705790  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.706199  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.707005  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.707553  4041 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:14.625877  7210 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.653340  7059 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.656697  7357 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.709818  4119 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.710044  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.710561  4112 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:14.718456  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.682889  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:14.719178  4114 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:14.719599  4047 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:14.671872  7052 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.674448  7299 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:14.720597  4042 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:14.717171  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.731215  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.729207  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.733928  4116 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:14.744908  4038 raft_consensus.cc:2368] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12.
I20260709 13:17:14.733759  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.719483  7152 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:14.726249  7369 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.743971  7365 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:17:14.754561  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 247689us
I20260709 13:17:14.729622  7367 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:14.756600  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.757647  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:14.762130  4043 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:14.713055  6956 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:17:14.775439  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 92447.4us
I20260709 13:17:14.780414  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.782049  4045 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 10. Ops: []
W20260709 13:17:14.780584  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46903us
I20260709 13:17:14.776681  4120 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 4. Current term is 5. Ops: []
I20260709 13:17:14.784009  7152 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.779958  4046 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:14.789845  4043 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:14.791352  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:14.783551  7176 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:14.793241  7176 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:14.797127  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.758945  7203 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.760464  7173 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:17:14.807972  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.808636  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.801779  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.809410  4046 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:14.748968  7422 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:14.730630  7438 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.820323  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:14.800074  6828 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:14.802145  6956 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:14.827162  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.840788  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.842211  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.841589  4113 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:14.785194  7152 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.859740  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.820412  7049 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.755425  7357 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.861153  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:14.863395  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.826236  7326 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:14.825955  6828 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:14.831990  7176 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.868327  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.869705  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.870810  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.871407  4046 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 5.
I20260709 13:17:14.873310  7210 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.873104  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.873950  4112 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:14.868355  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:14.874759  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.875814  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.877125  4112 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:14.877445  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:14.872193  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:14.878368  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.878715  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.878988  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:14.879879  7240 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:14.880674  7437 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:14.881136  7437 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:14.881517  7437 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.883232  3972 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:14.886369  7422 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:14.886839  4046 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:14.878403  4117 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:17:14.889393  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.889976  4046 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.896003  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.896944  4039 raft_consensus.cc:2368] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:14.897882  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.898507  4039 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:14.899367  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.900506  4039 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.902155  4046 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:14.907065  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:14.909052  4046 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:14.910526  7356 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.918171  4046 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:14.925702  4039 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:14.925649  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.929337  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.929652  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.933049  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.934298  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.939738  4045 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:14.941090  4042 raft_consensus.cc:2368] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:14.942550  7369 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:14.944139  4043 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:14.951327  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 86092.4us
I20260709 13:17:14.957489  4041 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:14.857606  7052 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:14.867689  6828 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:14.947137  7041 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:14.979429  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:14.994383  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:14.863343  7269 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:14.997391  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:14.999532  4045 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:14.867285  7049 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:15.000881  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 168764us
I20260709 13:17:14.975601  3970 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:15.007134  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.007414  4038 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 6: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:15.007958  4112 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:15.008543  7283 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:15.011374  4116 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:15.008968  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.012530  4112 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:14.991984  7438 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.011565  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.012450  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:15.014142  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 256557us
I20260709 13:17:15.016498  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.015802  4116 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:14.994077  7434 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.023409  4113 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 5: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:14.957293  7356 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:15.024479  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:14.994761  7367 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:15.024988  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:14.960071  7299 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:15.022954  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:15.028501  4045 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:14.951536  7324 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:17:15.029842  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.031497  4046 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:15.033205  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2153) took 1008 ms. Trace:
I20260709 13:17:14.958037  7326 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.039381  4121 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:14.956471  7321 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:17:15.044320  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:15.048943  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.033555  3964 rpcz_store.cc:276] 0709 13:17:14.024722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.417017 (+392295us) service_pool.cc:224] Handling call
0709 13:17:14.429452 (+ 12435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:14.582441 (+152989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.582472 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:14.583026 (+   554us) log.cc:844] Serialized 52 byte log entry
0709 13:17:14.858984 (+275958us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:14.859028 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.859094 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.032994 (+173900us) raft_consensus.cc:1685] finished
0709 13:17:15.033015 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.033143 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23866,"raft.queue_time_us":39389,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":260403,"threads_started":1,"wal-append.queue_time_us":435151}
I20260709 13:17:15.054801  4038 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:17:15.057650  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.061780  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2150) took 1038 ms. Trace:
I20260709 13:17:15.062180  3969 rpcz_store.cc:276] 0709 13:17:14.023663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.273320 (+249657us) service_pool.cc:224] Handling call
0709 13:17:14.315102 (+ 41782us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:14.507945 (+192843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:14.507977 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:14.520315 (+ 12338us) log.cc:844] Serialized 52 byte log entry
0709 13:17:14.828560 (+308245us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:14.828606 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:14.828680 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:15.061512 (+232832us) raft_consensus.cc:1685] finished
0709 13:17:15.061535 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:15.061720 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6152,"raft.queue_time_us":8267,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3839,"thread_start_us":204882,"threads_started":1,"wal-append.queue_time_us":406820}
I20260709 13:17:15.064749  7437 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.071992  7434 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.074177  7041 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.074712  7041 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.075078  7041 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:15.075682  7437 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:15.082926  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57333.1us
I20260709 13:17:15.086992  7356 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:15.087620  7210 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:15.087975  7370 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:17:15.089273  7370 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:15.094347  7422 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.094971  7422 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:14.999476  4117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:17:15.101423  4117 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:15.101848  4117 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:17:15.107208  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58440.5us
I20260709 13:17:15.109902  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.005265  7052 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.039768  7005 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.033622  7324 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:17:15.062915  7049 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.143800  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.144660  4121 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:15.148156  7444 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.122010  7317 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.123752  7326 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.124368  7422 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.125362  4677 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:15.125941  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.119472  7321 consensus_queue.cc:1243] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:15.127007  7059 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.029927  7367 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.131657  7379 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.140434  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.149875  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.021034  7269 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.174086  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.154543  7049 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:15.155730  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.156554  4117 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.158803  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.179034  4112 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:15.160271  4043 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:15.119706  7283 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.155517  4118 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:15.178103  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.181370  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.160223  7005 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:15.184118  4119 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:15.190150  4045 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:15.196987  4039 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:15.185272  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.198989  4117 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.200723  4047 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:15.200152  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 328717us
I20260709 13:17:15.202383  4038 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:15.177881  7184 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.206629  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.207273  4047 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:15.236228  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.237933  4047 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
W20260709 13:17:15.203212  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 186800us
I20260709 13:17:15.177644  7321 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:17:15.171530  7326 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:15.204646  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.180236  7283 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:15.205924  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.213316  7496 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.058s	user 0.003s	sys 0.013s
I20260709 13:17:15.208179  7184 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.257273  4047 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:15.258497  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53927us
I20260709 13:17:15.257035  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:15.240419  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.261806  4044 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:15.262079  4117 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:15.264329  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.265080  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:15.212126  7164 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:15.267849  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.199213  7049 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:15.281610  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.283001  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:15.283291  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:15.283881  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:15.284503  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:15.258064  7283 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.239830  7321 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:15.261476  7184 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.320228  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:15.299332  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 210658us
I20260709 13:17:15.301640  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.302325  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.302755  4045 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:15.305599  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.325695  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.326387  4121 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:15.330173  3967 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:15.330540  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:15.331871  3969 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:15.333643  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.334442  4117 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:15.333626  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:15.329146  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.333729  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.335417  4683 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:15.335856  4041 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:15.299211  7321 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.335443  3964 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:15.299045  7232 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.338661  3968 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:15.341435  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77817us
I20260709 13:17:15.342545  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:15.342491  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.296986  7506 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:15.351524  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.347656  4040 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:17:15.300850  7176 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.356886  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.343513  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.320181  7499 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.357872  3972 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:15.360332  3965 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:15.364598  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:15.300879  7500 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:15.298040  7326 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:15.370047  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85628.6us
W20260709 13:17:15.371541  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 68746.1us
I20260709 13:17:15.377646  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.378341  3967 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:15.378612  3967 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:15.335433  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 305064us
I20260709 13:17:15.351601  7506 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:15.389963  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.390776  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.393678  3965 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:15.397387  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.397946  3971 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.411312  4680 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
I20260709 13:17:15.373622  7317 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:15.387451  7379 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.339231  7005 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.403615  3967 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.391299  7232 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:15.359380  7041 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.396572  7443 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:15.362404  7176 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.396822  7506 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:15.423162  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79602.2us
I20260709 13:17:15.408655  7164 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:15.367175  7499 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.392885  7438 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:15.413767  4678 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:15.443632  3937 leader_election.cc:400] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:15.447556  3937 leader_election.cc:403] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:15.450291  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.451062  3966 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 5.
W20260709 13:17:15.453254  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63365.8us
W20260709 13:17:15.442436  7495 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:17:15.432464  7269 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:15.455292  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 82490.6us
I20260709 13:17:15.455349  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.463639  3967 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:15.442245  7379 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.468600  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.471998  3966 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:15.468679  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.476541  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.477773  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.478909  7514 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:15.477181  3963 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:15.431773  7509 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:17:15.491132  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:15.492504  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.503042  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:15.503772  7504 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
W20260709 13:17:15.490481  7508 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:17:15.505180  7507 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.505607  7507 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.505928  7507 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.504559  7438 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:15.506440  7438 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.506771  7438 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.506090  7528 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:15.508895  7498 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:15.510695  7528 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.511096  7528 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.511399  7528 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.503871  3963 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:15.513695  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.514277  3963 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:15.515110  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.494065  7317 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.517695  7422 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:15.517984  7499 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.517815  7517 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.519140  7517 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.520779  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.521437  3966 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
W20260709 13:17:15.522743  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47734.1us
I20260709 13:17:15.525637  3967 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:15.530212  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.533320  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:15.533855  4121 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.473723  7379 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.537207  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:15.538242  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 102727us
I20260709 13:17:15.562443  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:15.554883  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.537957  7513 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:15.565052  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:15.510644  7326 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.571183  4116 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.572901  7321 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.574431  7514 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:15.575145  7321 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.575441  7514 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.576951  7321 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.530747  7422 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.582029  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:15.480188  7520 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:17:15.597203  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:15.570456  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 178176us
I20260709 13:17:15.585114  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.536942  7356 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.592106  4683 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:15.592836  7523 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:15.593291  7049 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:15.593627  4045 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:15.607300  4045 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:15.594920  7521 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:17:15.596935  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:15.598618  3967 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.601507  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.611378  4046 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:15.592939  7527 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:15.618747  7176 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.619526  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:15.597596  7422 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.627840  4121 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:15.633337  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.630087  4120 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.629245  4045 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.635063  4045 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.632124  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:15.619562  7516 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:17:15.533090  7232 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.630432  4116 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:15.608047  7367 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:15.636092  4086 leader_election.cc:400] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12.
I20260709 13:17:15.640110  4086 leader_election.cc:403] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:15.603489  7523 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:15.627349  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 136287us
I20260709 13:17:15.634680  7041 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.593080  7529 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:17:15.606709  7356 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.638804  7527 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:15.670799  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.565200  7164 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.670178  4113 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:15.644543  7523 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.667755  7510 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:15.689569  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.650491  7499 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12.
I20260709 13:17:15.691004  3971 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:15.683776  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:15.685753  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.688653  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 64109.6us
I20260709 13:17:15.694205  3967 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:15.695070  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.697614  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.706616  7528 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.689101  7534 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:15.714092  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.689692  7510 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:15.717155  7510 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:15.718178  6828 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.705s	user 0.006s	sys 0.006s
I20260709 13:17:15.718425  7517 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.718719  7528 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.721129  4045 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 11. (term mismatch)
I20260709 13:17:15.720853  7506 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.722628  7544 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:15.721582  6828 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.724103  7534 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:15.724619  4121 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:15.725359  4045 pending_rounds.cc:85] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:17:15.725684  4045 pending_rounds.cc:107] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 9.11
I20260709 13:17:15.726015  4045 raft_consensus.cc:2889] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:15.727128  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:15.728518  4045 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.729153  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.729861  3966 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:15.666326  7367 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.736057  4120 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:15.739418  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.740185  3967 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:15.746170  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:15.757561  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.759398  7506 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.847306  7523 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.727989  7534 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.762494  3966 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:15.766181  6828 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.768376  7422 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:15.856714  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 158149us
I20260709 13:17:15.771803  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:15.773032  7367 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.748842  7379 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.861755  4120 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:15.781420  7321 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
W20260709 13:17:15.782138  7497 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.574s	user 0.002s	sys 0.000s
I20260709 13:17:15.862856  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:15.786648  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.793083  7533 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:15.863600  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:15.794448  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.864109  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.795596  7527 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.798309  7356 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.786514  7438 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.814309  7283 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:15.820868  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:15.846289  7184 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.001s
I20260709 13:17:15.850520  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:15.759865  7507 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.868844  7367 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:15.869408  7367 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:15.870298  7367 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.871114  7422 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:15.864003  7533 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.874169  7438 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.875263  7533 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.877117  7507 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.877986  4115 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:15.879356  3967 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:15.880914  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.881505  3967 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:15.881904  7283 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:15.882318  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:15.882598  7184 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.885392  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 272) took 1017 ms. Trace:
I20260709 13:17:15.886371  7184 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:15.887593  4113 raft_consensus.cc:2368] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:15.859823  4045 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:15.770759  7510 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:15.864672  3966 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
W20260709 13:17:15.865123  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.883014  3967 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 6: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:15.885881  4677 rpcz_store.cc:276] 0709 13:17:14.867921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.868091 (+   170us) service_pool.cc:224] Handling call
0709 13:17:15.885124 (+1017033us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54001a0c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:15.885279 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":546094336}
I20260709 13:17:15.900265  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.900965  3966 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.902453  3970 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:15.902537  4086 leader_election.cc:400] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:15.902969  4086 leader_election.cc:403] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:15.904120  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:15.939316  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.939998  3965 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:15.942586  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.943338  3972 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:15.943267  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:15.929176  7379 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:15.961153  4013 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:15.962894  7356 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:15.963552  7356 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:15.964594  7356 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:15.965261  7510 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:15.967335  3965 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:15.971987  3966 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:15.973016  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.973531  4683 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:15.974522  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.956012  7173 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:15.975631  7173 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:15.975790  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:15.976099  7173 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:15.976522  4677 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:15.975344  3966 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:15.980610  7059 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:15.981606  7434 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:15.968242  7527 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:15.998081  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:15.977037  7523 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.002575  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:16.004503  4682 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:16.008839  3966 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:15.999423  4678 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:16.011927  7531 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.338s	user 0.000s	sys 0.006s
I20260709 13:17:16.012377  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:16.009989  3965 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:16.016316  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:16.016885  3966 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.017167  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.024966  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.026552  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:16.027359  4113 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.027822  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.028110  7510 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.028597  7523 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:16.029652  7052 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.031801  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:15.999147  7527 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.042724  7527 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.031267  7059 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.043540  7059 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.045607  7059 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.031107  4677 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.038367  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:16.046644  7367 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.047029  7367 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:16.047363  7367 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.009907  7434 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:16.049718  7434 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:16.050053  7434 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:16.051025  3966 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:16.050863  7434 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.051976  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:16.052120  7434 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.054620  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:16.055725  3972 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:16.057333  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:16.055581  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:16.057986  4120 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:16.058597  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:16.060870  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.061941  3972 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:16.064275  3966 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:16.035774  7379 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:16.072316  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.053236  7210 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.066720  7176 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.066551  7052 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:16.066658  7534 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.068606  7507 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.055321  7059 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:16.090044  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:16.093844  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.094491  4045 raft_consensus.cc:2376] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8. Re-sending same reply.
I20260709 13:17:16.096067  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:16.074690  7210 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.096438  3965 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:16.078840  7356 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:16.100216  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.077437  7527 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:16.057610  7173 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.102298  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.115440  4039 raft_consensus.cc:2376] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8. Re-sending same reply.
I20260709 13:17:16.102973  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.117403  4042 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:16.106513  7367 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.107538  7523 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:16.109592  7232 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.082239  7176 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.081620  7052 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.101589  7356 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.087081  7534 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:16.096134  7530 raft_consensus.cc:2764] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:17:16.096997  7283 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:16.150604  7356 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:16.151103  7283 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.128651  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.129268  7523 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.129664  7214 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:16.130492  7173 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.097889  7210 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.135733  4112 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:16.123315  3965 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:17:16.135450  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2225) took 1388 ms. Trace:
I20260709 13:17:16.104728  7369 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.136688  7052 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.140367  4113 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:16.148125  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 311) took 1278 ms. Trace:
I20260709 13:17:16.148922  7540 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.114717  4677 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:16.153348  4039 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 4.
I20260709 13:17:16.362483  7052 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.081347  7548 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:17:16.161244  4119 rpcz_store.cc:276] 0709 13:17:14.747903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.755195 (+  7292us) service_pool.cc:224] Handling call
0709 13:17:16.135266 (+1380071us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b54003a8ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:16.135399 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947857280}
W20260709 13:17:16.356074  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2220) took 1658 ms (client timeout 2151 ms). Trace:
W20260709 13:17:16.395524  4118 rpcz_store.cc:269] 0709 13:17:14.697807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.697903 (+    96us) service_pool.cc:224] Handling call
0709 13:17:16.231182 (+1533279us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:16.356014 (+124832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1013075712}
I20260709 13:17:16.358922  7210 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.193877  7369 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:16.359563  3963 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:16.135398  7164 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:16.133541  7527 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.136036  7176 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.360311  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:16.361136  7367 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.361300  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2576) took 1334 ms. Trace:
I20260709 13:17:16.401579  4043 rpcz_store.cc:276] 0709 13:17:15.027125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.027271 (+   146us) service_pool.cc:224] Handling call
0709 13:17:16.193301 (+1166030us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540011a8d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:16.361215 (+167914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264382208}
I20260709 13:17:16.361769  7283 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.220659  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.403774  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:16.362396  3966 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:16.198038  4114 rpcz_store.cc:276] 0709 13:17:14.869326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:14.880504 (+ 11178us) service_pool.cc:224] Handling call
0709 13:17:14.880829 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:14.881103 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:15.177419 (+296316us) log.cc:844] Serialized 14 byte log entry
0709 13:17:16.147700 (+970281us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b180044ed20. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287
0709 13:17:16.147808 (+   108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.147855 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:16.147902 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.147967 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.148069 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404532,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":1023,"raft.queue_time_us":64782,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8527,"spinlock_wait_cycles":6209408,"thread_start_us":520668,"threads_started":3,"wal-append.queue_time_us":242355}
I20260709 13:17:16.363404  7523 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.135941  7232 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.365813  7510 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:16.219857  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:16.382331  7434 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:16.150707  7534 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:16.157763  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80629us
I20260709 13:17:16.399387  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:16.400018  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.411198  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.404160  4038 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:16.397804  7184 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.411254  4119 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:16.416144  3966 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:16.419530  4118 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:16.422194  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.424892  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2269) took 1242 ms. Trace:
I20260709 13:17:16.425273  4112 rpcz_store.cc:276] 0709 13:17:15.191040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.199395 (+  8355us) service_pool.cc:224] Handling call
0709 13:17:16.135516 (+936121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.193502 (+ 57986us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.424685 (+231183us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b54003a8ed0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:16.424834 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152065280}
I20260709 13:17:16.426816  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:16.433423  7534 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.434739  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.435359  4044 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.441202  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:16.441563  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.418545  7564 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:16.442492  4046 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:16.442631  7505 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.122s	user 0.000s	sys 0.011s
W20260709 13:17:16.445168  7525 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.969s	user 0.000s	sys 0.021s
I20260709 13:17:16.445997  7052 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.446842  4115 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 5. Current term is 6. Ops: []
I20260709 13:17:16.453104  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.453896  4039 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:16.409690  7369 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.457712  7369 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.459498  4042 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:16.460976  4113 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:16.463506  7527 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.463759  7522 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:16.464118  7522 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:16.433393  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2517) took 1129 ms. Trace:
I20260709 13:17:16.469390  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:16.470513  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.471582  3965 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:16.473897  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.467187  3970 rpcz_store.cc:276] 0709 13:17:15.303967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.304194 (+   227us) service_pool.cc:224] Handling call
0709 13:17:15.338051 (+ 33857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:15.902950 (+564899us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.433106 (+530156us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b5400277254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:16.433295 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297536896}
I20260709 13:17:16.480162  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.489007  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:16.473240  7152 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:16.400954  7164 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.495656  3965 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:16.419278  7184 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.488677  7059 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:17:16.419075  7434 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:16.559545  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 204012us
I20260709 13:17:16.391484  7540 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:16.560577  3966 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:16.564333  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:16.552634  7527 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:16.490418  7356 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.562867  7523 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:16.488459  7522 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.591765  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.593276  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:16.570274  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:16.589272  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:16.609831  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.594520  7510 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:16.623602  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 234796us
I20260709 13:17:16.628257  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2277) took 1156 ms. Trace:
I20260709 13:17:16.632259  4044 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:16.626199  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:16.627245  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.597311  7438 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:16.628684  4121 rpcz_store.cc:276] 0709 13:17:15.472185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:15.638600 (+166415us) service_pool.cc:224] Handling call
0709 13:17:15.638946 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:15.725040 (+ 86094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.627938 (+902898us) spinlock_profiling.cc:243] Waited 85.4 ms on lock 0x7b5400096354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:16.628190 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":196455808}
I20260709 13:17:16.607193  7564 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:16.593768  7523 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.611442  7530 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:16.632324  7510 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.653735  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:16.627128  7214 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.645459  4677 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:16.597520  7527 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.628002  7059 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:16.640901  7210 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:16.667137  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 174905us
I20260709 13:17:16.677992  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.643394  7438 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.668365  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.650023  7506 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:16.653033  7522 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.642570  7152 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:16.610996  7540 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.671315  7510 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.669955  7548 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.665907  7571 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:16.676235  7498 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.698773  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.699000  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:16.700712  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 73553.2us
I20260709 13:17:16.681133  7438 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.703723  4047 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:16.681967  7444 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.704106  4047 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 5
I20260709 13:17:16.705829  4047 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:16.706081  4047 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:16.682439  7232 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.703812  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.680132  7214 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.671202  7530 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.710574  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.679996  7443 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:16.710992  4038 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:16.711536  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.711217  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:16.714340  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.710948  4040 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.716063  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.725704  4045 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:16.720144  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.733708  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.734205  4043 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:16.704049  7283 raft_consensus.cc:2764] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:17:16.717343  7566 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:17:16.739236  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.739539  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71258us
I20260709 13:17:16.718536  7232 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:16.748342  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:16.750017  7573 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:16.751689  7527 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.758440  7299 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:16.758893  7299 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.759279  7299 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.759479  7434 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.701740  7548 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.760031  7434 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:16.735324  7564 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.761060  7582 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:16.762149  7567 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:17:16.762606  7582 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:16.763334  7582 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:16.704659  7498 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.765681  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:16.761402  7548 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.733608  7387 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:16.745190  7422 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:16.705490  7152 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.748553  7356 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.758936  7530 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.770097  7443 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:16.770576  7232 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:16.792205  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 114286us
I20260709 13:17:16.774816  7059 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:16.803805  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2189) took 1135 ms. Trace:
I20260709 13:17:16.790683  7583 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.793252  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.783645  7548 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:16.804390  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67489.2us
I20260709 13:17:16.756673  7176 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:16.802980  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 127516us
I20260709 13:17:16.810778  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:16.804209  3972 rpcz_store.cc:276] 0709 13:17:15.670383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.068084 (+397701us) service_pool.cc:224] Handling call
0709 13:17:16.077029 (+  8945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:16.082566 (+  5537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.082596 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:16.083047 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:17:16.382648 (+299601us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:17:16.382695 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.382918 (+   223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:16.803535 (+420617us) raft_consensus.cc:1685] finished
0709 13:17:16.803559 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.803739 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":13130,"thread_start_us":276833,"threads_started":1,"wal-append.queue_time_us":368137}
I20260709 13:17:16.788592  7443 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:16.788975  7422 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:16.819005  4041 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:16.778952  7387 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.806010  7575 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:16.829007  7575 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.829371  7575 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:16.829586  7173 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:16.830021  7173 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:16.830834  7173 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.831777  7173 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:16.809059  7548 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:16.833000  7548 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:16.833266  7443 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.833623  7544 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:16.834488  7443 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:16.817101  7530 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:16.836951  7387 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.804183  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:16.840399  7184 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.822794  7232 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.805080  7583 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.845006  7583 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.824424  7534 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.825184  7510 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.847100  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2530) took 1121 ms. Trace:
I20260709 13:17:16.846937  7579 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:16.847532  7510 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.817416  7523 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.827704  7059 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:16.847420  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.848834  7164 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.847481  3969 rpcz_store.cc:276] 0709 13:17:15.725476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.146466 (+420990us) service_pool.cc:224] Handling call
0709 13:17:16.146765 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.154211 (+  7446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:16.154246 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:16.154292 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:16.154325 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:16.846871 (+692546us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b54002599d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:16.846927 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:16.847045 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16611072}
I20260709 13:17:16.840830  7585 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:16.842507  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:16.840703  4040 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:16.861227  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:16.821632  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:16.850158  3968 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:16.858804  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:16.865219  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.847810  7579 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.861876  3966 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:16.848224  7527 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:16.893676  3972 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:17:16.819303  7584 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.881114  7544 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:16.894510  7210 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.894766  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:16.931981  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:16.896857  7574 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.148s	user 0.002s	sys 0.000s
W20260709 13:17:16.932960  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71900.3us
I20260709 13:17:16.934105  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.934337  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.934752  4044 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:16.935408  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.935608  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.936084  4047 raft_consensus.cc:2368] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:16.936172  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.897846  7578 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:16.899709  7438 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.937690  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.893044  7527 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:16.906026  7176 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:16.892055  7589 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:17:16.907390  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:16.848290  7530 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:16.914309  7575 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.893486  7579 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.948210  7578 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:16.948592  7578 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:16.949443  7578 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.950017  7579 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:16.915498  4043 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:16.915843  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:16.928826  7210 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.936187  4044 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:16.938446  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.881337  7523 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.942139  7585 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:16.939100  7527 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:16.946434  7587 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:16.947235  4039 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:16.940207  7367 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.946295  7498 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.954006  4086 leader_election.cc:400] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:17.000484  4086 leader_election.cc:403] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:16.954598  7443 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:17:16.962637  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 284796us
I20260709 13:17:16.957563  4045 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:17:16.965233  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 199644us
I20260709 13:17:17.003960  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:16.966303  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 232667us
I20260709 13:17:16.966444  7369 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:16.972126  4047 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.008658  7585 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.009370  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.009626  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:16.989287  7523 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.010183  4043 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.002143  7443 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:17.010821  7443 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:16.950665  7578 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:16.917752  7049 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.013891  7049 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.916651  7214 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.015221  4676 raft_consensus.cc:2410] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:16.946795  7422 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:16.938366  7438 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:16.942008  7544 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:17.006557  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:16.939977  7584 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.021216  7544 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.023618  7584 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.021670  7173 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:17.025288  7173 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.010099  4044 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:17.021445  7369 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.020937  4047 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
W20260709 13:17:17.064019  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 110181us
I20260709 13:17:17.027812  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:17.062176  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.028398  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.069944  4043 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:17.071105  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.073908  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.074501  3965 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:17.030332  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.075209  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.075831  4119 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:17.075793  4046 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:17.079860  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:17.086160  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58434.4us
I20260709 13:17:17.076035  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.086081  3964 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
W20260709 13:17:17.089882  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 86023.5us
I20260709 13:17:17.090492  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.087586  3964 pending_rounds.cc:85] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:17.095582  3964 pending_rounds.cc:107] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:17:17.095852  3964 raft_consensus.cc:2889] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.098256  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.099516  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:17.085588  4047 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:17.106110  7596 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:17.027537  7600 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:17.075131  7214 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.070322  7527 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.110050  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.079358  7510 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.002776  7367 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.124601  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.125028  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.125398  3965 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:17.125898  7575 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:17.117229  7584 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:17.126861  7584 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:17.127899  7584 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.128592  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.129944  7523 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.130353  4119 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:17.132958  7210 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.137840  7369 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.126086  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.139055  4043 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:17.139990  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.140209  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.140796  4044 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:17.106950  7173 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.101220  7498 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:17.143067  4043 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:17.127059  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.143416  3963 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:17.126016  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.144632  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.126257  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:17.148406  3965 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:17.108721  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 298126us
I20260709 13:17:17.142604  7540 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.173183  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:17.166438  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.175137  4113 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:17.145252  3963 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:17.176045  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:17.176702  3963 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:17.167176  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:17.169516  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.167229  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.167595  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.177441  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.182232  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.120054  7422 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:17.187242  7422 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.187678  7422 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.142832  7498 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:17.189563  7498 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.182864  3963 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:17.021183  7530 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.126371  7232 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:17:17.186739  7607 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:17:17.195485  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:17.196662  3963 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:17.171078  7173 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.193523  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:17.221709  3965 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.221947  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.222460  4113 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:17.199834  4046 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:17.177367  7522 raft_consensus.cc:2764] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:17.216501  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.218151  4682 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:17:17.203128  7612 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:17.144686  7548 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.226356  3963 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:17:17.239037  3963 pending_rounds.cc:85] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 9
I20260709 13:17:17.239478  3963 pending_rounds.cc:107] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:17:17.239741  3963 raft_consensus.cc:2889] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:17.193094  7589 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.240511  7589 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.197363  7578 raft_consensus.cc:2764] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:17:17.171242  7299 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.245018  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.253453  4113 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:17.234661  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.253587  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.257463  3965 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
W20260709 13:17:17.265000  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 91897.3us
I20260709 13:17:17.266397  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:17.268028  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:17.198283  7581 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.200013  7576 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.223685  7596 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:17.218530  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:17.215196  7356 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.225980  7232 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:17.299906  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46377.5us
I20260709 13:17:17.299576  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:17.300696  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:17.297115  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62546.1us
I20260709 13:17:17.123121  7600 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.306958  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.243249  7544 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:17:17.307575  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:17.251873  7299 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.217406  7534 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:17:17.308341  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.310468  4040 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:17.315428  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.318419  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:17.277494  7590 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.297927  7571 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.324512  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 225063us
I20260709 13:17:17.281951  7578 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:17.328413  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:17.296608  7522 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:17.298830  7173 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.276679  7444 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:17:17.310693  7369 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.225868  7591 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.119s
W20260709 13:17:17.345537  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.376637  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48308.4us
I20260709 13:17:17.397903  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:17.345300  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.310606  7434 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:17:17.379238  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45074.4us
I20260709 13:17:17.317250  7210 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:17.310137  7575 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:17.319469  7184 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.412488  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.327911  7587 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.411844  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:17.399973  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.333832  7581 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:17.420082  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101086us
W20260709 13:17:17.423718  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.425420  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.316294  7443 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.382650  7176 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.454807  4120 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:17.318074  7356 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.398007  7369 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:17.456377  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 132191us
I20260709 13:17:17.457592  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.415005  7578 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:17:17.426623  7438 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.423400  7583 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.395362  7173 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.444347  7269 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:17.464572  7369 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.379527  7571 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.481171  7367 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:17.532461  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 154934us
I20260709 13:17:17.496622  7544 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:17.454754  7387 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:17:17.598464  7434 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:17.483247  4676 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:17.599098  7614 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:17:17.599501  7544 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:17.600333  7621 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:17.601500  7173 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:17.575306  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 150200us
I20260709 13:17:17.554715  7618 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:17.484241  7438 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.572007  7548 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.571666  7591 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:17.462568  7232 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:17.584079  7611 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:17:17.613656  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:17.462631  7596 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.577682  7540 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.622220  7049 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:17.656680  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:17.623116  7620 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:17:17.625566  7356 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:17.631362  7571 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:17.609638  7438 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.616590  7583 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:17:17.593662  7367 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.617228  7591 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:17.637704  7510 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.002s
I20260709 13:17:17.614368  7600 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.650287  7059 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:17.650477  7443 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.617468  7589 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:17.652789  7587 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:17.653584  7540 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.654606  7590 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:17.655284  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 242830us
I20260709 13:17:17.687538  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.648710  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:17.667917  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89820.3us
I20260709 13:17:17.647217  7210 raft_consensus.cc:2764] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:17.659471  7214 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.634434  7422 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.659641  7522 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:17.685889  7591 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.615245  7618 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.686915  7540 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.690219  7590 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.691533  7530 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:17.684060  7173 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:17:17.694590  7649 raft_consensus.cc:2764] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:17.696647  7641 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:17.698721  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.705278  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:17.707065  7548 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:17.677906  7367 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.736802  4115 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:17.681818  7510 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
W20260709 13:17:17.722451  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 73954.4us
I20260709 13:17:17.740134  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:17.723140  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.682106  7059 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:17.734311  4682 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:17.726065  7581 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.741500  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:17.745640  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:17.742647  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:17.747107  3937 leader_election.cc:400] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:17.747411  3937 leader_election.cc:403] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:17:17.748514  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:17.751672  7571 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.752107  7571 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:17.750483  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.752503  7571 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.755622  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.739218  7367 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:17.758085  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59457.8us
I20260709 13:17:17.763170  4045 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:17.743489  7591 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:17.760983  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:17.775074  4114 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:17.764660  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.776578  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.776857  7523 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:17.777240  7523 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:17.777595  7523 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:17.777686  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:17.777911  3969 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.011s	sys 0.000s
W20260709 13:17:17.778267  3969 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.011s	sys 0.000s
I20260709 13:17:17.778800  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.779124  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.779798  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.761495  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.765691  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.782680  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.781164  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.781419  4044 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:17.782023  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.780496  4041 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:17.753206  7164 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:17.782392  7527 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:17.758944  7049 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:17.753065  7356 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:17.755460  7579 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9.
I20260709 13:17:17.720346  7434 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.797245  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.781558  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.781087  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.806896  4119 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.834964  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:17.811151  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.842782  4113 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:17.807701  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47897.9us
I20260709 13:17:17.739879  7548 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.844298  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:17.807868  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.868687  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:17.869396  7527 raft_consensus.cc:2764] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:17.869859  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.870110  7527 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:17.852591  7059 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.846354  7164 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.871085  7164 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:17.871548  7059 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.873178  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.873436  4041 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:17.873759  4039 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:17.874225  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:17.818396  7628 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 13:17:17.875172  4041 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:17.876258  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:17.847605  7387 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:17.829553  4045 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 13:17:17.832198  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:17.868960  7644 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:17.849757  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.898353  7644 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.898536  4044 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:17.850850  7210 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:17.905824  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.807842  7637 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:17.910866  7637 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.913118  7637 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.755595  7638 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:17:17.911372  7387 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:17.914897  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.849450  7049 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:17.915840  7387 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:17.909215  7650 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:17:17.916224  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.860687  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.920722  7630 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:17:17.862723  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:17.916275  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.863365  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.922621  7530 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:17.923023  7530 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:17.831524  7635 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:17:17.922531  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:17.821326  7603 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.747s	user 0.004s	sys 0.000s
I20260709 13:17:17.865834  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.924571  3970 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:17:17.874523  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.929165  4039 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:17.916436  7637 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:17.818487  4042 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:17.878245  3963 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.929986  7637 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.784042  7587 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:17:17.879211  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.827191  7438 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.880020  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.933871  4113 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:17.934134  7637 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:17.934700  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:17.920048  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.935467  4113 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:17.936077  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:17.936322  4114 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:17.877801  3964 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:17.882709  7369 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.885824  4119 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:17.938977  7369 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.886350  7618 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:17.887467  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:17.891386  7422 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.812343  7590 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:17.939954  7530 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:17.815519  4676 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:17.940235  4678 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 7: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:17.815549  7571 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.897914  3965 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:17.874233  7548 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:17.882289  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.897953  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:17.921303  7630 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:17.923122  3966 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:17.864995  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.942299  4118 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:17.942157  7630 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:17.943365  7630 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:17.936517  4113 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:17.925189  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.925642  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:17.898754  7644 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:17.934706  7438 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:17.921485  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 60897.1us
I20260709 13:17:17.851998  3971 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 6.
I20260709 13:17:17.949589  7595 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:17.950115  7595 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:17.951469  3963 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:17.950927  7595 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:17.953863  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:17.855319  7626 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.281s	user 0.001s	sys 0.001s
I20260709 13:17:17.906275  7581 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:17.806883  4046 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:17.956429  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58553.9us
I20260709 13:17:17.917063  7049 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:17.958779  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:17.968008  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 451) took 1002 ms. Trace:
I20260709 13:17:17.960476  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:17.967965  4047 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:17.968552  3972 rpcz_store.cc:276] 0709 13:17:16.965568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.969752 (+  4184us) service_pool.cc:224] Handling call
0709 13:17:16.997087 (+ 27335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:16.997294 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:17.191112 (+193818us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.967693 (+776581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.967745 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:17.967784 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.967850 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:17.967952 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88484,"prepare.queue_time_us":147472,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4906,"raft.queue_time_us":86268,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":887797,"threads_started":3,"wal-append.queue_time_us":518552}
I20260709 13:17:17.960902  4121 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:17.962988  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:17.978003  4116 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:17.979395  4649 leader_election.cc:400] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:17.981824  4121 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:17.982995  3971 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:17.985726  4114 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:17.991071  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:17.997571  4039 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:17.999250  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:17.979511  7618 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.001554  4046 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:17.967164  7232 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:17:17.970587  7438 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 13:17:18.009876  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 142576us
I20260709 13:17:18.015445  7598 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:18.016011  7598 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.010825  7444 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.003949  7269 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.018736  7269 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.019706  7164 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.023698  7367 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.024395  7164 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:18.025666  4119 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.027397  7367 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:18.007633  7645 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:17:18.006515  7618 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.052193  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:18.035652  7591 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:18.054674  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55500us
I20260709 13:17:18.055514  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:18.056217  7629 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.458s	user 0.001s	sys 0.002s
I20260709 13:17:18.049401  7049 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.057493  7644 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.058316  7658 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:18.035161  7583 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:18.076933  7576 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:18.077644  7576 consensus_queue.cc:1243] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:18.077952  7571 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:18.078550  7644 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:18.082072  7618 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:18.082680  7443 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:18.051541  7540 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.083195  7443 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.064885  7049 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:18.066363  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70951us
I20260709 13:17:18.066792  7598 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:18.068627  7269 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:18.093348  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 115442us
W20260709 13:17:18.105062  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89799.1us
I20260709 13:17:18.071202  7523 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.074416  7530 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:18.060979  7623 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
I20260709 13:17:18.105806  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:18.106990  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:18.110203  4116 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
W20260709 13:17:18.085291  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.110749  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:18.114122  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:18.093454  7595 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:18.118541  4113 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:18.103926  7658 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:18.129536  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.133862  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2295) took 1102 ms. Trace:
I20260709 13:17:18.135109  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:18.135490  7591 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:18.136317  7591 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:18.136742  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:18.137693  7049 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:18.138105  7049 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:18.138844  7049 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.139915  7049 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.139869  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2289) took 1111 ms. Trace:
I20260709 13:17:18.134265  4112 rpcz_store.cc:276] 0709 13:17:17.030939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.031055 (+   116us) service_pool.cc:224] Handling call
0709 13:17:17.063990 (+ 32935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.335415 (+271425us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:17.379824 (+ 44409us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.745327 (+365503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:17.746281 (+   954us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:17.746337 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.133650 (+387313us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003d3954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:18.133693 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.133807 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9891,"prepare.queue_time_us":45924,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":12727,"raft.queue_time_us":30886,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":23818,"spinlock_wait_cycles":623688064,"thread_start_us":345738,"threads_started":1,"wal-append.queue_time_us":370358}
I20260709 13:17:18.145296  7664 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.146101  7664 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.148321  7664 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:18.149341  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:18.142345  4120 rpcz_store.cc:276] 0709 13:17:17.028686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.028824 (+   138us) service_pool.cc:224] Handling call
0709 13:17:17.086132 (+ 57308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:17.455310 (+369178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.139628 (+684318us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54002ab7d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:18.139813 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847245184}
I20260709 13:17:18.137603  7591 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:18.124432  7214 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:18.165362  4118 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:18.159998  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.161222  7591 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.163733  7648 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.122958  7540 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:18.171834  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:18.121047  7595 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.164402  7214 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.191577  7598 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:18.191983  7598 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:18.192327  7598 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:18.191140  7649 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:18.169159  7522 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:17:18.195361  7658 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.200080  7665 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:17:18.184445  7164 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:18.201704  7654 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.204984  7443 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:18.213557  7595 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:18.182428  7591 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:18.222945  7652 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.223526  7652 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:18.225330  7610 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.147s	user 0.000s	sys 0.004s
W20260709 13:17:18.228067  7632 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.610s	user 0.001s	sys 0.001s
I20260709 13:17:18.229239  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:18.229585  7655 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:17:18.230549  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.231408  7443 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.231631  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.235067  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2198) took 1161 ms. Trace:
W20260709 13:17:18.236086  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.214191  7214 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:18.238029  4113 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:18.235464  3969 rpcz_store.cc:276] 0709 13:17:17.073186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.073815 (+   629us) service_pool.cc:224] Handling call
0709 13:17:17.074083 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.172905 (+ 98822us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:17.778596 (+605691us) log.cc:844] Serialized 14 byte log entry
0709 13:17:17.959528 (+180932us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.083580 (+124052us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800116980. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:17:18.083743 (+   163us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:18.083790 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.083837 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.234803 (+150966us) spinlock_profiling.cc:243] Waited 98.2 ms on lock 0x7b54002c9054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:18.234859 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:18.235001 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":118636,"prepare.queue_time_us":260677,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":133485,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":24070,"spinlock_wait_cycles":263801728,"thread_start_us":767675,"threads_started":2,"wal-append.queue_time_us":238236}
I20260709 13:17:18.235221  3966 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:18.246562  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.248255  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.248390  4113 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:17:18.250270  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 193164us
I20260709 13:17:18.252087  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.254227  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.254954  3968 raft_consensus.cc:2368] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:18.257575  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.254839  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:18.253463  3970 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:18.261348  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:18.259497  7587 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:18.262537  7587 consensus_queue.cc:1243] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:18.264305  7652 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:18.261391  7661 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:17:18.265182  7661 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:18.265540  7661 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:18.266340  7661 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.267230  7598 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.267593  7661 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:18.268368  3965 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:18.269380  7598 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:18.261605  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.271287  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:18.307878  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.308538  3964 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:17:18.309908  4047 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:17:18.310308  4047 pending_rounds.cc:85] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 4
I20260709 13:17:18.310520  4047 pending_rounds.cc:107] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:18.310745  4047 raft_consensus.cc:2889] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.311302  4041 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:18.276273  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 232) took 1383 ms. Trace:
I20260709 13:17:18.278764  7523 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:18.314500  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:18.283659  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.284397  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.312347  4040 rpcz_store.cc:276] 0709 13:17:16.892679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:16.892845 (+   166us) service_pool.cc:224] Handling call
0709 13:17:17.233334 (+340489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:17.317494 (+ 84160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.275172 (+957678us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b54001199d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:18.276063 (+   891us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001199d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:18.276210 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":955765504}
I20260709 13:17:18.330127  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.330827  4038 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:18.334199  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2300) took 1301 ms. Trace:
I20260709 13:17:18.334604  4115 rpcz_store.cc:276] 0709 13:17:17.032653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.128343 (+ 95690us) service_pool.cc:224] Handling call
0709 13:17:18.334020 (+1205677us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b54001446d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:18.334142 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1396937600}
W20260709 13:17:18.335310  7625 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.718s	user 0.003s	sys 0.009s
I20260709 13:17:18.336362  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.247732  7443 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.337018  3965 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:18.337826  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.338860  7443 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:18.339435  7443 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.339859  7443 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:18.341039  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.341361  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.346886  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.349589  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.350358  4040 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:18.350893  4649 leader_election.cc:400] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:18.351208  4649 leader_election.cc:403] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:17:18.351632  4043 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:17:18.351986  4043 pending_rounds.cc:85] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 9
I20260709 13:17:18.352203  4043 pending_rounds.cc:107] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:17:18.352465  4043 raft_consensus.cc:2889] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:18.287722  7583 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.338810  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.253758  7176 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:18.357246  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.357838  4046 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.358376  4045 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:18.314054  7438 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:18.368672  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 196890us
I20260709 13:17:18.372704  4046 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:18.271723  7210 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:17:18.374199  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.377385  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.377511  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.441385  4046 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.366783  7664 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:18.358999  7232 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:18.428874  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.443498  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:18.377532  4045 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:18.445104  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.445710  4045 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.374143  7367 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.453236  4040 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.454586  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:18.431248  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.436257  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:18.438781  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:18.435927  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:18.346392  7576 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:18.455812  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:18.375748  7642 raft_consensus.cc:476] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 13:17:18.459365  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.465855  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.463347  4046 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:18.467092  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.467701  4046 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.366963  7564 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 13:17:18.474920  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.472855  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.477406  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.494827  4085 leader_election.cc:400] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:18.474018  7581 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:18.496505  7540 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:18.499315  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:18.501205  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.376072  7438 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.508354  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:18.505448  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.509884  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:18.451771  7595 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:18.514019  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.512501  4046 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:18.515964  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.520465  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.524030  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.522291  4045 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:18.532262  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.532918  3966 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.535751  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.542209  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.464682  7664 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:18.513765  7498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.015s	sys 0.042s
I20260709 13:17:18.556330  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.504330  7630 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:18.567572  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:18.570494  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 334602us
I20260709 13:17:18.507361  7369 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:17:18.457314  7232 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.506083  7648 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:18.464675  7367 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:18.601799  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.521701  7654 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.621718  4043 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:17:18.531486  7642 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:18.531684  7540 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.644990  7590 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.554457  7164 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:18.689679  3969 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:18.697603  3966 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:18.551623  7510 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:18.587020  7585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.015s	sys 0.077s
W20260709 13:17:18.593881  7498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.015s	sys 0.042s
I20260709 13:17:18.726660  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:18.564625  7583 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:18.732252  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:18.728580  7664 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.568838  7522 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.740564  3964 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:18.776115  4649 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:18.790215  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 255154us
I20260709 13:17:18.742833  7369 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:18.813939  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.833961  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:18.834914  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.742049  7184 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:18.838343  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.839007  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.839013  3964 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:18.840816  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.818336  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:18.775534  7672 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:17:18.735491  7564 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:18.743505  7642 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:18.821120  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:18.788211  7585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.016s	sys 0.081s
W20260709 13:17:18.821408  7668 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:17:18.777153  7434 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:18.841454  3964 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:18.847223  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71189.9us
I20260709 13:17:18.737021  4683 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:18.814617  7443 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:18.821369  7647 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.004s	user 0.000s	sys 0.004s
I20260709 13:17:18.850324  7510 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:18.897567  3870 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 6 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:18.900730  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.906374  3968 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:18.907809  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.907233  3969 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:18.913357  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:18.901206  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45913.3us
I20260709 13:17:18.787096  7590 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.849541  7369 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.939603  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.855470  7540 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:18.949417  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:18.908975  7677 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 13:17:18.913712  7671 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
W20260709 13:17:18.913357  7616 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.295s	user 0.001s	sys 0.004s
W20260709 13:17:18.948232  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 258182us
I20260709 13:17:18.856796  7642 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:18.903635  7422 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:18.954739  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:18.916496  7591 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.002s
I20260709 13:17:18.908231  7660 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:18.917644  7587 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:18.907680  7510 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:18.911963  7654 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.961236  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:18.964478  4118 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:18.906627  7527 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.962805  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:18.983456  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.984690  3969 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:18.947093  7548 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:18.917315  7581 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:18.986003  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:18.912691  7434 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.968932  3968 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:18.990830  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:18.966904  7422 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:18.946096  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:18.961891  7522 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:18.900255  7564 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.097054  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2224) took 1109 ms. Trace:
I20260709 13:17:19.003239  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.099241  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.099787  3969 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:18.968748  7591 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:18.970167  7660 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:18.981735  7510 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.104875  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2225) took 1109 ms. Trace:
I20260709 13:17:18.970422  7530 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:18.907029  7648 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.055962  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:19.108477  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2292) took 2078 ms. Trace:
I20260709 13:17:19.108671  3968 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:18.984963  4678 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:19.069919  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 62967.6us
I20260709 13:17:19.005398  7152 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:17:18.985399  7587 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:19.061033  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 98301.3us
I20260709 13:17:19.003160  7685 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:18.992173  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 435886us
I20260709 13:17:19.118510  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.089879  7522 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.105630  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:18.990051  7527 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.105278  3967 rpcz_store.cc:276] 0709 13:17:17.995469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.001007 (+  5538us) service_pool.cc:224] Handling call
0709 13:17:18.001413 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.093606 (+ 92193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.093635 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.108142 (+ 14507us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.315381 (+207239us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:18.315423 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.315491 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.104658 (+789167us) raft_consensus.cc:1685] finished
0709 13:17:19.104677 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.104814 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108866,"raft.queue_time_us":110575,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3660,"thread_start_us":187738,"threads_started":1,"wal-append.queue_time_us":353038}
I20260709 13:17:19.122247  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.122938  3967 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:19.097465  3971 rpcz_store.cc:276] 0709 13:17:17.988011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.988157 (+   146us) service_pool.cc:224] Handling call
0709 13:17:17.988438 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.084787 (+ 96349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.084818 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.103136 (+ 18318us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.446740 (+343604us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:18.446801 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.446890 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.096824 (+649934us) raft_consensus.cc:1685] finished
0709 13:17:19.096857 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.096995 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97768,"raft.queue_time_us":112177,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":8941,"thread_start_us":322094,"threads_started":1,"wal-append.queue_time_us":401398}
I20260709 13:17:19.110184  4117 rpcz_store.cc:276] 0709 13:17:17.029677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.030339 (+   662us) service_pool.cc:224] Handling call
0709 13:17:17.079409 (+ 49070us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:17.104555 (+ 25146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:17.104585 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:17.105153 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:17:17.320869 (+215716us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:17.321072 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:17.321143 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.732689 (+1411546us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:19.104321 (+371632us) raft_consensus.cc:1685] finished
0709 13:17:19.104344 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.108406 (+  4062us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31716,"raft.queue_time_us":29166,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":12254,"spinlock_wait_cycles":46779264,"thread_start_us":213311,"threads_started":1,"wal-append.queue_time_us":456097}
I20260709 13:17:19.012001  7443 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:17:19.075533  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:19.006775  7548 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.104185  7618 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:19.106909  7660 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.014555  7581 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.109395  7367 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:19.120834  7684 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:17:19.132939  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.136274  3965 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:17:19.148612  3968 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:19.149753  3965 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:19.137220  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:19.138553  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.154758  3969 raft_consensus.cc:2410] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:17:19.100214  7695 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.127987  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:19.114786  7644 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.154991  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.155926  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.156553  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.157472  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:19.158059  3965 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [8.5-10.6]
I20260709 13:17:19.168622  3969 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:17:19.130321  7530 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.122654  7685 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:19.176290  3968 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:19.181703  3968 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:19.179101  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103678us
I20260709 13:17:19.183988  3971 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:19.084396  7654 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.146275  7443 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:19.144754  7693 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:19.218432  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60731.7us
I20260709 13:17:19.173699  7598 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:19.164072  7618 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:19.115346  7422 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.163612  7695 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:19.163427  7678 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:19.288105  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 368260us
I20260709 13:17:19.215417  7443 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:19.294553  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:19.215304  7685 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.184928  7649 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:17:19.215183  7689 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:19.227171  7587 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.220901  7590 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.299281  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2320) took 1062 ms. Trace:
I20260709 13:17:19.306571  4119 rpcz_store.cc:276] 0709 13:17:18.236984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.237109 (+   125us) service_pool.cc:224] Handling call
0709 13:17:18.237411 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.245209 (+  7798us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:18.245240 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.258275 (+ 13035us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.555529 (+297254us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:18.555569 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.555634 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.299075 (+743441us) raft_consensus.cc:1685] finished
0709 13:17:19.299095 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.299222 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7394,"raft.queue_time_us":7537,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3849,"thread_start_us":275809,"threads_started":1,"wal-append.queue_time_us":542149}
I20260709 13:17:19.310076  4044 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:19.310989  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:19.284094  7530 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.286031  7596 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.230350  7690 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:19.284652  7369 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.293304  7422 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:19.286114  7598 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:19.183600  7644 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:19.327652  7679 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.342s	user 0.000s	sys 0.001s
W20260709 13:17:19.327945  7694 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:17:19.328349  7674 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:19.293792  7695 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.296386  7540 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 13:17:19.336850  7697 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:17:19.321681  7596 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:19.361040  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:19.372143  7595 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:19.372555  7595 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.372915  7595 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.373960  7709 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:17:19.374274  7299 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:19.374702  7299 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:19.375495  7299 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:19.376101  7675 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:17:19.376928  7701 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:19.363719  7673 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:17:19.381369  7595 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:19.383302  7700 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 13:17:19.384737  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2323) took 1113 ms. Trace:
I20260709 13:17:19.383086  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2221) took 1413 ms. Trace:
I20260709 13:17:19.386436  7644 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:19.385197  4113 rpcz_store.cc:276] 0709 13:17:18.271794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.271915 (+   121us) service_pool.cc:224] Handling call
0709 13:17:18.272230 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.272583 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:18.647536 (+374953us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.061212 (+413676us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.061719 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.061864 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:19.062384 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.062460 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.384535 (+322075us) raft_consensus.cc:1685] finished
0709 13:17:19.384556 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.384681 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":91971,"prepare.queue_time_us":644786,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":43,"raft.queue_time_us":137268,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":4469,"thread_start_us":530494,"threads_started":2,"wal-append.queue_time_us":357354}
I20260709 13:17:19.355829  7618 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.384654  7564 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:19.385527  3963 rpcz_store.cc:276] 0709 13:17:17.969294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.982789 (+ 13495us) service_pool.cc:224] Handling call
0709 13:17:17.983059 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.084672 (+101613us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:18.107735 (+ 23063us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.569241 (+461506us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.569805 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.577683 (+  7878us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:18.578020 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.578207 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.578285 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.895545 (+317260us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b180037fc00. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:19.382911 (+487366us) raft_consensus.cc:1685] finished
0709 13:17:19.382936 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.383035 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156691,"prepare.queue_time_us":65783,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":243480,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":77092,"spinlock_wait_cycles":8777600,"thread_start_us":428089,"threads_started":1,"wal-append.queue_time_us":836990}
W20260709 13:17:19.390131  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 231794us
I20260709 13:17:19.324141  7690 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:19.339442  7434 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.343780  7693 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:19.399564  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.384663  7681 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.326030  7678 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:17:19.391625  7596 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.393293  7523 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:17:19.319064  7689 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.397300  7591 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.401216  7534 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:19.398597  7690 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:19.396415  7644 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:17:19.416163  7527 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.410333  7641 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:19.356663  7443 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:19.452220  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 231684us
I20260709 13:17:19.416394  7498 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:19.420603  7434 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:19.401803  7598 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.470448  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2276) took 1036 ms. Trace:
I20260709 13:17:19.433938  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:19.432233  7548 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.488037  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:19.452453  7595 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:19.488776  4046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.024s
W20260709 13:17:19.490841  4046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.007s	sys 0.024s
I20260709 13:17:19.456485  7581 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.491492  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:19.486841  4045 rpcz_store.cc:276] 0709 13:17:18.434225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.553084 (+118859us) service_pool.cc:224] Handling call
0709 13:17:18.553406 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.627021 (+ 73615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.627052 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.627499 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.003901 (+376402us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:19.060506 (+ 56605us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.070025 (+  9519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.070105 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.470191 (+400086us) raft_consensus.cc:1685] finished
0709 13:17:19.470213 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.470386 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37658,"prepare.queue_time_us":76920,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":135445,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":29023,"spinlock_wait_cycles":10760960,"thread_start_us":376104,"threads_started":1,"wal-append.queue_time_us":513525}
W20260709 13:17:19.475245  7661 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.162s	user 0.010s	sys 0.002s
I20260709 13:17:19.423592  7681 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.516255  7534 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:19.485143  7527 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:19.517050  7527 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.517699  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.519029  7527 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:19.519330  7714 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.519610  7527 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.489953  7674 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:17:19.492606  7443 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.454964  7630 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:19.493537  7707 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:19.494948  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 199338us
I20260709 13:17:19.501263  7434 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:19.530205  7434 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:19.501930  7713 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:17:19.530936  7434 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.532043  7434 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.493315  7723 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.535188  7523 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:19.523618  7715 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
W20260709 13:17:19.524097  7642 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.002s
I20260709 13:17:19.538594  7642 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.539526  7685 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.524912  7689 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:19.525678  7530 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.417634  7693 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.529775  7707 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:19.542017  7707 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.526824  7510 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:19.500969  7688 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:17:19.542771  7681 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.543449  7642 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:19.509039  7654 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.542655  7693 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:19.509150  7164 consensus_meta.cc:287] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.003s
I20260709 13:17:19.535493  7690 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.519045  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:19.546042  7510 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.546154  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.547767  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.544436  7164 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:19.544445  7707 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.501022  7717 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:17:19.543541  7674 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:19.511873  7710 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:19.549182  7527 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.537988  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.516813  7534 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:19.529527  7721 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:19.549659  7714 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:19.553432  7716 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:19.564929  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:19.570822  7676 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.765s	user 0.000s	sys 0.002s
I20260709 13:17:19.557271  7715 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:19.560827  7693 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:19.503751  7184 consensus_meta.cc:287] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.655s	user 0.005s	sys 0.009s
I20260709 13:17:19.576095  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:19.572778  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:19.562244  7674 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:19.562732  7527 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.549401  7723 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:19.575009  7164 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.595669  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.596958  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:19.598502  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:19.600998  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:19.601263  7641 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:19.601822  7641 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:19.601665  7674 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.602897  7674 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.602655  7641 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.604698  7630 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:19.605590  7630 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:19.606427  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2579) took 1266 ms. Trace:
I20260709 13:17:19.606607  7630 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.607731  7523 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:19.606881  3968 rpcz_store.cc:276] 0709 13:17:18.339590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.197749 (+858159us) service_pool.cc:224] Handling call
0709 13:17:19.198322 (+   573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.357265 (+158943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.357298 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.357766 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.490360 (+132594us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:19.490399 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.490467 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.606022 (+115555us) raft_consensus.cc:1685] finished
0709 13:17:19.606179 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.606360 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119956,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4560,"thread_start_us":214128,"threads_started":2,"wal-append.queue_time_us":214300}
I20260709 13:17:19.608804  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:19.609333  3968 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:19.610157  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.590777  7184 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:19.613026  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2229) took 1268 ms. Trace:
I20260709 13:17:19.587566  7633 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:19.619071  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.574057  7434 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:19.615623  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.616094  4118 raft_consensus.cc:2368] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:19.569571  7530 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:17:19.569363  7510 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:19.619702  4113 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:19.613404  3971 rpcz_store.cc:276] 0709 13:17:18.344991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.222440 (+877449us) service_pool.cc:224] Handling call
0709 13:17:19.222818 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.319898 (+ 97080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.391878 (+ 71980us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.392338 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.556789 (+164451us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:19.561657 (+  4868us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.566162 (+  4505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.566257 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.612829 (+ 46572us) raft_consensus.cc:1685] finished
0709 13:17:19.612850 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.612973 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5321,"prepare.queue_time_us":4713,"prepare.run_wall_time_us":53,"raft.queue_time_us":105501,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":6153,"spinlock_wait_cycles":37110912,"thread_start_us":237785,"threads_started":2,"wal-append.queue_time_us":207299}
I20260709 13:17:19.593730  7527 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.624919  3967 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:19.625593  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.625995  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:19.631273  3971 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:19.629326  4113 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:19.618551  3968 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:19.646445  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:19.596174  7164 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:19.623054  7730 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:19.591042  7693 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.626319  7690 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.627166  7633 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:19.664477  3966 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:19.592180  7716 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.651304  7681 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:19.655303  7523 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.654076  7685 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.675302  3971 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:19.676560  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:19.678115  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.683055  3968 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:19.683192  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.683915  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.684692  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 241) took 1731 ms. Trace:
I20260709 13:17:19.684688  3968 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:19.685798  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.686616  3968 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:19.683986  3971 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:19.687410  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.685292  4042 rpcz_store.cc:276] 0709 13:17:17.953768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.954719 (+   951us) service_pool.cc:224] Handling call
0709 13:17:17.955044 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.080034 (+124990us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b180040f960. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76444bfb 00007fed7644f64b
0709 13:17:18.080160 (+   126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.080184 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.080685 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.441438 (+360753us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:18.460350 (+ 18912us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.472043 (+ 11693us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.472170 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:18.915815 (+443645us) spinlock_profiling.cc:243] Waited 28.8 ms on lock 0x7b4800280bd8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:17:18.915885 (+    70us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b180040f960. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:19.555023 (+639138us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:19.684496 (+129473us) raft_consensus.cc:1685] finished
0709 13:17:19.684517 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.684639 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33620,"prepare.queue_time_us":18730,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":61697,"raft.run_cpu_time_us":2620,"raft.run_wall_time_us":450320,"spinlock_wait_cycles":157064064,"thread_start_us":402030,"threads_started":2,"wal-append.queue_time_us":480493}
I20260709 13:17:19.688936  3968 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:19.688912  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:19.689700  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2230) took 1344 ms. Trace:
I20260709 13:17:19.689742  3971 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.690155  3968 rpcz_store.cc:276] 0709 13:17:18.345231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.688351 (+1343120us) service_pool.cc:224] Handling call
0709 13:17:19.688592 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.689485 (+   893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.689652 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.692557  3963 pending_rounds.cc:85] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:19.692868  3963 pending_rounds.cc:107] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:19.693084  3963 raft_consensus.cc:2889] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:19.695811  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.696262  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.696815  3971 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:19.697956  3971 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:19.698493  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2234) took 1352 ms. Trace:
I20260709 13:17:19.698800  3971 rpcz_store.cc:276] 0709 13:17:18.346531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.697505 (+1350974us) service_pool.cc:224] Handling call
0709 13:17:19.697790 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.698265 (+   475us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.698438 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.699968  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:19.700182  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:19.651506  7660 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.701928  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.705358  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2232) took 1359 ms. Trace:
I20260709 13:17:19.706699  4120 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:19.706169  3968 rpcz_store.cc:276] 0709 13:17:18.345959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.690932 (+1344973us) service_pool.cc:224] Handling call
0709 13:17:19.691200 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.691353 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.691377 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.691418 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:19.691447 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.691493 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.705299 (+ 13806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.668785  7730 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:19.701577  3971 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:17:19.680338  7523 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:19.726064  7728 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:17:19.678001  7164 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.730971  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.704077  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.702219  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.706578  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.762617  4114 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:19.762924  4117 raft_consensus.cc:2410] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:19.708442  7690 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.676658  7681 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.708993  4678 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8.
I20260709 13:17:19.710203  7716 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.711261  7232 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.767131  7649 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:19.711613  7660 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.712453  4682 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:19.724479  7701 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:19.734668  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.767520  7693 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.702972  4113 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:19.767907  7701 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:19.768301  4113 pending_rounds.cc:85] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 6
I20260709 13:17:19.767549  7649 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:19.768581  4113 pending_rounds.cc:107] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:19.761135  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2235) took 1400 ms. Trace:
I20260709 13:17:19.728621  7633 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.763792  7690 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.770566  4113 raft_consensus.cc:2889] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:19.767181  7681 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.771137  3971 rpcz_store.cc:276] 0709 13:17:18.361199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.700850 (+1339651us) service_pool.cc:224] Handling call
0709 13:17:19.701299 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:19.717168 (+ 15869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.761075 (+ 43907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:19.773559  7704 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 13:17:19.782354  7690 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.782648  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2324) took 1160 ms. Trace:
I20260709 13:17:19.773705  7596 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.716571  7527 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.771374  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2236) took 1250 ms. Trace:
I20260709 13:17:19.789674  3968 rpcz_store.cc:276] 0709 13:17:18.521344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.770479 (+1249135us) service_pool.cc:224] Handling call
0709 13:17:19.770789 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.771047 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.771078 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.771117 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:19.771148 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.771200 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.771321 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.791175  3968 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:17:19.791745  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2585) took 1265 ms. Trace:
I20260709 13:17:19.792054  3968 rpcz_store.cc:276] 0709 13:17:18.525984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.790661 (+1264677us) service_pool.cc:224] Handling call
0709 13:17:19.790966 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.791527 (+   561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.791695 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:19.775508  7530 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.782998  4112 rpcz_store.cc:276] 0709 13:17:18.622483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.622698 (+   215us) service_pool.cc:224] Handling call
0709 13:17:18.703933 (+ 81235us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:18.787657 (+ 83724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:18.787686 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:18.813535 (+ 25849us) log.cc:844] Serialized 52 byte log entry
0709 13:17:19.120264 (+306729us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:19.120303 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.712948 (+592645us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54001b1a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:19.712998 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.769104 (+ 56106us) spinlock_profiling.cc:243] Waited 8.34 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:19.782416 (+ 13312us) raft_consensus.cc:1685] finished
0709 13:17:19.782437 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.782594 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2199,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6145,"spinlock_wait_cycles":210819328,"thread_start_us":219890,"threads_started":1,"wal-append.queue_time_us":591770}
I20260709 13:17:19.769546  7649 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.795046  7649 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:19.796396  7522 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.797914  3968 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:19.799247  3968 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:19.800213  3968 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.801213  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2568) took 1535 ms. Trace:
I20260709 13:17:19.778239  7164 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:19.801625  3965 rpcz_store.cc:276] 0709 13:17:18.265612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.159433 (+893821us) service_pool.cc:224] Handling call
0709 13:17:19.159760 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.231041 (+ 71281us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:17:19.326526 (+ 95485us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.478648 (+152122us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.496892 (+ 18244us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.497038 (+   146us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:19.497070 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.497137 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.801039 (+303902us) raft_consensus.cc:1685] finished
0709 13:17:19.801059 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.801160 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":986,"prepare.queue_time_us":32236,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":83999,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11982,"thread_start_us":139088,"threads_started":2,"wal-append.queue_time_us":201783}
I20260709 13:17:19.805859  3965 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:17:19.793881  7530 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.818480  7438 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:19.821036  7669 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.978s	user 0.006s	sys 0.016s
I20260709 13:17:19.822777  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 247) took 1385 ms. Trace:
I20260709 13:17:19.779721  7730 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.789354  7695 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.833873  7527 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:19.835199  7701 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.837097  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:19.838070  3970 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:19.842032  4043 rpcz_store.cc:276] 0709 13:17:18.437097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.736090 (+298993us) service_pool.cc:224] Handling call
0709 13:17:18.789255 (+ 53165us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.109034 (+319779us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.109062 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.109103 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:19.109138 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.822532 (+713394us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b540041d554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:19.822576 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.822719 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734956416}
I20260709 13:17:19.844271  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2222) took 1872 ms. Trace:
I20260709 13:17:19.849217  7523 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:19.854889  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:19.856680  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.859580  7534 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.872473  7596 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:19.860703  7736 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:19.868113  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:19.866407  3972 rpcz_store.cc:276] 0709 13:17:17.971960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:17.972089 (+   129us) service_pool.cc:224] Handling call
0709 13:17:17.981451 (+  9362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:18.083857 (+102406us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:18.084153 (+   296us) log.cc:844] Serialized 14 byte log entry
0709 13:17:18.210626 (+126473us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:17:18.454696 (+244070us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:18.455118 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:17:18.455252 (+   134us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:18.455281 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:18.455339 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:19.763625 (+1308286us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:19.844088 (+ 80463us) raft_consensus.cc:1685] finished
0709 13:17:19.844110 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.844219 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104203,"prepare.queue_time_us":858,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":931,"raft.queue_time_us":122688,"raft.run_cpu_time_us":2172,"raft.run_wall_time_us":125968,"spinlock_wait_cycles":72031360,"thread_start_us":362671,"threads_started":1,"wal-append.queue_time_us":650732}
I20260709 13:17:19.870931  7443 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:19.874670  3970 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:19.876513  3972 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:19.875617  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:19.879168  4118 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.880002  7444 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:19.880559  7444 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:19.881639  7444 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.878945  7443 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:19.883414  7443 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:19.886178  7695 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.886703  7701 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.877527  7724 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:19.887641  7724 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.887991  7724 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:19.873452  7534 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.895953  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2556) took 1653 ms. Trace:
I20260709 13:17:19.898068  3967 rpcz_store.cc:276] 0709 13:17:18.242738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.134958 (+892220us) service_pool.cc:224] Handling call
0709 13:17:19.136220 (+  1262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.627936 (+491716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.895729 (+267793us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54004074d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:19.895889 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123493632}
I20260709 13:17:19.900825  4087 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8.
I20260709 13:17:19.901171  4087 leader_election.cc:403] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:17:19.913131  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:19.913597  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:19.915887  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2553) took 1673 ms. Trace:
I20260709 13:17:19.916265  3966 rpcz_store.cc:276] 0709 13:17:18.242080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.907548 (+665468us) service_pool.cc:224] Handling call
0709 13:17:19.915715 (+1008167us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54003133d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:19.915831 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1616222080}
I20260709 13:17:19.916818  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:19.919178  3971 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:19.919493  4649 leader_election.cc:400] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 6 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7.
I20260709 13:17:19.921121  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:19.923461  7681 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:19.923897  7681 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.909539  7633 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:19.927332  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.927887  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.928109  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.928867  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.927937  4045 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:19.929250  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.930061  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.930696  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2277) took 1496 ms. Trace:
I20260709 13:17:19.931066  4046 rpcz_store.cc:276] 0709 13:17:18.434822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:18.566273 (+131451us) service_pool.cc:224] Handling call
0709 13:17:18.566578 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:18.566771 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:18.945011 (+378240us) log.cc:844] Serialized 14 byte log entry
0709 13:17:19.930287 (+985276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.930339 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:19.930464 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.930544 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.930648 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":458826,"prepare.queue_time_us":404892,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":439585,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"thread_start_us":855552,"threads_started":2,"wal-append.queue_time_us":608552}
I20260709 13:17:19.918709  7530 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:19.930734  4043 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:19.901968  7701 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:19.923508  7210 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:19.937846  7210 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:19.939248  7711 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.939603  4040 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:19.940030  7210 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:19.943344  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:19.943853  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.943928  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:19.923533  7698 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:19.925776  7583 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.926534  7681 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:19.925500  7660 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:17:19.952421  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:19.954190  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:19.954772  3938 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:19.955159  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:19.962383  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:19.982161  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:19.983152  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.967414  4046 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:19.964636  7714 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:19.982059  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2590) took 1159 ms. Trace:
I20260709 13:17:19.986573  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:19.949894  7698 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:19.987819  3968 rpcz_store.cc:276] 0709 13:17:18.823062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.804177 (+981115us) service_pool.cc:224] Handling call
0709 13:17:19.804392 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.981740 (+177348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.981769 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.981810 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:19.981842 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.981902 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:19.982003 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177017,"raft.queue_time_us":177239,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62}
I20260709 13:17:19.984262  7674 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.992812  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.993495  4043 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
W20260709 13:17:19.998384  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 299958us
I20260709 13:17:19.981739  4676 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:19.964716  7530 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:19.964458  7540 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:19.982805  7660 consensus_queue.cc:1243] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:19.966045  7630 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.002511  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:20.003087  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:20.003924  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:20.015403  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.016954  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:19.983804  7534 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:19.939791  7711 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.031118  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2583) took 1690 ms. Trace:
I20260709 13:17:20.031488  3969 rpcz_store.cc:276] 0709 13:17:18.340551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.204256 (+863705us) service_pool.cc:224] Handling call
0709 13:17:19.204590 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.394273 (+189683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.394306 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:19.394343 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:19.394376 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.030924 (+636548us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002599d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:20.030968 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.031066 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435747072}
W20260709 13:17:20.033354  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.006282  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.007246  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.008206  7438 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:20.013108  4047 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:19.950017  7583 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:20.047130  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.951968  7581 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.019023  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:20.047847  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.004046  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:20.005578  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:19.985651  7572 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:19.989470  7176 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.981452  7367 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:17:20.041819  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.020956  7717 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:20.046975  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 81485.9us
I20260709 13:17:19.999308  7674 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:19.990000  7730 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:17:20.022567  7654 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.021361  7269 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:20.014446  7530 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:20.023074  7630 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:20.008312  7705 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.073304  7663 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.092232  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:19.965042  7695 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:20.065681  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.097106  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:20.097389  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.098070  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.041610  7540 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:20.105309  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 85539.9us
W20260709 13:17:20.107302  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 117658us
I20260709 13:17:20.158345  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:20.159019  3965 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.068578  7714 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:17:20.115908  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 112897us
I20260709 13:17:20.125839  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:20.146787  3968 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 6.
I20260709 13:17:20.163197  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.163200  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:20.164201  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98607.5us
I20260709 13:17:20.164964  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.168591  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.169512  4047 raft_consensus.cc:2410] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:20.170462  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:20.172704  4045 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:20.173666  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.174163  4045 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:20.175799  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.196045  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.197799  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.061412  7649 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.086s
W20260709 13:17:20.198732  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 167625us
I20260709 13:17:20.127063  7530 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:20.219873  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49454.2us
I20260709 13:17:20.202982  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.126709  7630 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.198837  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.212728  4045 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:20.133697  7705 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.214129  7661 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:20.061332  7581 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:20.215447  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49870.6us
I20260709 13:17:20.215771  7575 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:20.066107  7572 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.368057  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:20.201517  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75563.2us
I20260709 13:17:20.222617  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:20.224107  4116 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:20.227504  4043 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:20.227653  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:20.372145  4113 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:20.230991  4119 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:20.369335  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:20.373484  4121 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:20.369519  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:20.231478  4114 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.231060  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:20.108182  7717 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.246111  4117 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:20.196745  7214 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:20.200261  7693 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:20.063253  7698 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.382526  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.276384  3965 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:20.225206  7571 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.196173  7269 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 13:17:20.232963  7164 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.125968  7654 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.297140  7685 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.297626  3997 heartbeater.cc:646] Failed to heartbeat to 127.2.200.254:44439 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.200.254:44439 timed out after 15.000s (SENT)
I20260709 13:17:20.236137  7598 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:20.368046  7049 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.301775  7210 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:20.426538  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58811.9us
I20260709 13:17:20.307157  4120 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:20.364230  4039 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:20.094561  7176 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.298128  7711 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:20.491055  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 62906.6us
W20260709 13:17:20.381119  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 327264us
I20260709 13:17:20.388111  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.391840  4042 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:20.365361  7633 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8.
I20260709 13:17:20.404441  4113 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:20.365532  7184 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:20.298416  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.196358  7663 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.378393  7527 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.490274  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.409081  7652 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.498457  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.501896  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.502168  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.502349  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:20.376152  7587 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 13:17:20.506172  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 118136us
I20260709 13:17:20.410389  7164 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:20.392655  7579 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.393584  7434 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:20.380420  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:20.515856  4046 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.378661  7649 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:17:20.514070  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.363637  7540 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.382489  7714 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:17:20.523000  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.416322  7598 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:20.571954  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57962.1us
I20260709 13:17:20.572866  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.512331  7214 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:20.512123  7184 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.430022  7049 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:20.529386  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 149029us
I20260709 13:17:20.410655  7571 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.549189  4038 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:20.431401  7685 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.499025  7583 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:20.414491  7578 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:17:20.396863  7724 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.508258  7527 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.576367  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.426935  7708 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.139s
I20260709 13:17:20.530902  7579 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.640285  7527 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.524137  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:20.657279  7747 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:17:20.657639  3965 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:20.658468  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2605) took 1045 ms. Trace:
I20260709 13:17:20.521386  7164 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:20.659912  7756 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:17:20.660914  7750 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:17:20.518404  7434 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:20.546274  7633 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:20.601665  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.562671  4046 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
W20260709 13:17:20.599875  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 52940.7us
I20260709 13:17:20.548251  7674 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:20.609295  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.637336  7695 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:20.664237  7753 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260709 13:17:20.688712  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:20.663218  7665 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.667160  7693 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:20.628017  7530 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.636091  7184 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:20.639178  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:20.582224  7658 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.576792  7564 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.520443  3968 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.594897  7598 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.644778  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.738770  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:20.739382  4041 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:20.739848  7749 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:17:20.569221  7522 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:17:20.606875  7176 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:20.741185  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2598) took 1218 ms. Trace:
I20260709 13:17:20.658870  3966 rpcz_store.cc:276] 0709 13:17:19.613475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.917155 (+303680us) service_pool.cc:224] Handling call
0709 13:17:19.917447 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.994582 (+ 77135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.994618 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.995094 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.261397 (+266303us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:20.267551 (+  6154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.267667 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.658225 (+390558us) raft_consensus.cc:1685] finished
0709 13:17:20.658251 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.658403 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68764,"raft.queue_time_us":71855,"spinlock_wait_cycles":7512832,"thread_start_us":212052,"threads_started":1,"wal-append.queue_time_us":396242}
I20260709 13:17:20.741555  3970 rpcz_store.cc:276] 0709 13:17:19.523181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.876594 (+353413us) service_pool.cc:224] Handling call
0709 13:17:19.885080 (+  8486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.985724 (+100644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.985753 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.986190 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.189012 (+202822us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:20.189059 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.189138 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.740963 (+551825us) raft_consensus.cc:1685] finished
0709 13:17:20.740983 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.741124 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100298,"raft.queue_time_us":101078,"spinlock_wait_cycles":7857536,"thread_start_us":155471,"threads_started":1,"wal-append.queue_time_us":362532}
I20260709 13:17:20.742772  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:20.528378  7752 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:17:20.663059  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2601) took 1125 ms. Trace:
I20260709 13:17:20.581614  7214 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:20.659000  3965 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:20.590797  7587 consensus_queue.cc:1243] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:20.674752  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:20.616386  7681 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.660s	user 0.006s	sys 0.004s
I20260709 13:17:20.749065  3968 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:17:20.673448  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:20.663059  7712 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.691095  7771 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.680796  7674 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:20.691572  7663 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:20.668659  7434 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:20.714478  7649 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.633793  7630 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.743192  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:20.744676  3967 rpcz_store.cc:276] 0709 13:17:19.538053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.899015 (+360962us) service_pool.cc:224] Handling call
0709 13:17:19.899358 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:20.031895 (+132537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.031927 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:20.032476 (+   549us) log.cc:844] Serialized 52 byte log entry
0709 13:17:20.257119 (+224643us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:20.257160 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.257239 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:20.662819 (+405580us) raft_consensus.cc:1685] finished
0709 13:17:20.662839 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:20.662995 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147066,"raft.queue_time_us":144395,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":183956,"threads_started":1,"wal-append.queue_time_us":336057}
I20260709 13:17:20.743497  3966 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:20.752207  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 78836.1us
I20260709 13:17:20.744886  7214 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:20.773202  3966 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:17:20.774256  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 201474us
I20260709 13:17:20.685196  7695 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.788482  4041 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:20.788002  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.765326  7633 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:20.801641  4115 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.767915  7269 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:20.716225  7665 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.765775  7387 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:20.772810  7663 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:20.810678  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.808362  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.792724  7176 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.754122  7658 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.820443  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.754455  7564 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.762542  7681 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.801862  7210 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:20.834640  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.835989  3970 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:20.765352  7712 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.845917  3970 pending_rounds.cc:85] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:20.851119  3970 pending_rounds.cc:107] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:20.851452  3970 raft_consensus.cc:2889] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.783985  7649 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.846431  4043 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 5.
I20260709 13:17:20.793035  7674 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:17:20.792799  7510 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:17:20.816259  7715 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:20.845973  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63584.9us
I20260709 13:17:20.815796  7633 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:20.765455  7771 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.903908  7527 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.842864  7176 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.835688  7769 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:20.817118  7269 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:20.855857  7693 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:20.857817  7663 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.863306  4041 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:20.962414  4112 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:20.977375  7630 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:20.900331  7587 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:20.982143  3970 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:17:20.981412  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:20.994027  3970 pending_rounds.cc:85] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:20.994534  3970 pending_rounds.cc:107] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:20.994781  3970 raft_consensus.cc:2889] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:20.843233  7387 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:20.903127  7772 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.139s
W20260709 13:17:21.023662  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 118690us
I20260709 13:17:21.086233  7782 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:17:21.018904  7758 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 13:17:21.088415  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:20.984335  7770 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:21.094225  4043 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:21.048241  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:21.095134  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 197246us
W20260709 13:17:21.096339  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 407670us
I20260709 13:17:21.034638  7184 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:20.992057  7587 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:20.984977  7746 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:20.948807  7766 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:21.077651  7761 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.084470  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:21.070426  7711 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.103109  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:21.078779  7530 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.016639  7654 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.081542  7685 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.190851  7693 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.202816  3965 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:17:21.210613  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.108163  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:21.089087  7059 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:17:21.054705  7778 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.192s
I20260709 13:17:21.117197  7762 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:20.993692  7663 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.101209  7527 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.106642  7772 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.103467  7658 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.102747  7665 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.219980  3968 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:21.103556  7695 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.103721  7184 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:20.998003  7164 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.226217  4041 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:17:21.188941  7534 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:21.203536  7210 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:21.212014  7444 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:21.230680  4119 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:21.106493  7661 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:17:21.089359  7633 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.227062  7790 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.061524  7768 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.175s
I20260709 13:17:21.229760  7649 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.247700  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2673) took 1077 ms. Trace:
I20260709 13:17:21.229991  7681 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.231374  7685 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:21.258131  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 150286us
I20260709 13:17:21.227201  7711 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.249831  7299 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.241257  7789 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:21.232635  7693 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.273484  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2584) took 2748 ms. Trace:
I20260709 13:17:21.279918  3971 rpcz_store.cc:276] 0709 13:17:18.525599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.780645 (+1255046us) service_pool.cc:224] Handling call
0709 13:17:19.918881 (+138236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:19.919512 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.273284 (+1353772us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003133d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:21.273426 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317140224}
I20260709 13:17:21.265574  4041 rpcz_store.cc:276] 0709 13:17:20.170483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.204424 (+1033941us) service_pool.cc:224] Handling call
0709 13:17:21.225882 (+ 21458us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.247444 (+ 21562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.247644 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.282838  4041 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 4
I20260709 13:17:21.283119  4041 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:17:21.283346  4041 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:21.281414  3971 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:17:21.287283  3971 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:21.289023  3971 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:21.275605  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:21.252697  7772 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.251633  7444 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:21.104214  7770 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.255905  7712 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.233160  7587 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.252954  7534 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.253705  7210 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.225106  7761 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:21.301682  7214 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 13:17:21.225528  7746 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.296103  7269 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.301134  7773 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:21.323808  7444 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.296908  7685 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.328586  7649 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:21.329041  7784 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:17:21.329689  7792 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:21.331250  7434 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.550s	user 0.006s	sys 0.002s
I20260709 13:17:21.308842  7768 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:21.305773  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:21.341248  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.309729  7771 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.238476  7762 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.267486  7184 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.332880  7665 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:21.272121  7790 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.340286  7527 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.332140  7681 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:17:21.380628  7746 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.381477  7790 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:21.363360  7767 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:17:21.334337  7214 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.384356  7214 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.385020  3969 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:21.385275  7783 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:17:21.378185  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 102639us
I20260709 13:17:21.374362  7665 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.386842  7665 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.374655  7654 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:21.389278  7654 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.391399  7654 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.379318  7527 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.393419  7527 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.399684  7665 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.305047  7772 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.368402  7444 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.407164  7762 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.362217  7768 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:21.416182  3937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.001s	sys 0.023s
W20260709 13:17:21.416545  3937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.001s	sys 0.023s
I20260709 13:17:21.360450  7649 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.374799  4677 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:21.348778  7766 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:17:21.298300  7789 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.366523  7434 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:21.424292  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108869us
I20260709 13:17:21.408591  7796 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:21.428750  7788 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:19.820174  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:21.436887  7214 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.437865  7674 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.438452  7714 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:21.410339  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.410190  7164 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.418005  7527 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.460448  7527 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.461058  7665 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.462605  7527 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.463121  7527 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:21.463358  7665 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:21.463583  7527 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.464143  7665 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:21.465996  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2291) took 1460 ms (client timeout 1646 ms). Trace:
W20260709 13:17:21.466388  4046 rpcz_store.cc:269] 0709 13:17:20.005659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.006965 (+  1306us) service_pool.cc:224] Handling call
0709 13:17:21.465815 (+1458850us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b540035d9d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:21.465925 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105260416}
I20260709 13:17:21.467499  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:21.468075  4046 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:21.447466  7770 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.448372  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:21.448911  7210 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.414539  7661 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:17:21.471319  7774 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:21.446183  7387 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.472558  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:21.443562  7663 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.444115  7654 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:21.471089  7714 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.478402  7585 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:21.497285  7585 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:21.498924  7571 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.498564  7585 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.481221  7693 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.499809  7585 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:21.482829  7685 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.487946  4046 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.488817  7761 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.497309  7806 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.501127  7548 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:21.501518  7548 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:21.455734  7788 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.490607  7649 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.493158  7772 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.494832  7434 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.485563  7059 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.506620  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2678) took 1335 ms. Trace:
I20260709 13:17:21.506675  7059 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.500524  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 334) took 1588 ms. Trace:
I20260709 13:17:21.507098  4041 rpcz_store.cc:276] 0709 13:17:20.171623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.282370 (+1110747us) service_pool.cc:224] Handling call
0709 13:17:21.282667 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.284231 (+  1564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.284261 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.284690 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.361304 (+ 76614us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:21.361340 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.361415 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.502502 (+141087us) raft_consensus.cc:1685] finished
0709 13:17:21.502522 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.506554 (+  4032us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":75703,"threads_started":1,"wal-append.queue_time_us":139802}
I20260709 13:17:21.508162  4112 rpcz_store.cc:276] 0709 13:17:19.912472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.912994 (+   522us) service_pool.cc:224] Handling call
0709 13:17:21.500363 (+1587369us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b54003d2a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:21.500469 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369316608}
I20260709 13:17:21.458698  7214 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.502002  7527 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.522877  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:21.496143  7711 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.526608  4041 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:21.528831  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:21.529520  4041 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:21.531746  7788 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.465608  7674 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.497499  7654 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.520992  7534 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.535614  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:21.513631  7548 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.524199  7707 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.532805  7630 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.525332  7695 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.550180  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:21.556912  3968 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:21.533033  7709 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.555362  3965 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:21.558115  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:21.555246  4046 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:21.559060  7787 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:21.501384  7768 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.559520  7695 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.563306  4116 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:21.563009  7422 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.565886  7422 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.567559  7214 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.567756  7778 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:21.568157  7778 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:21.564591  7510 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.569298  7654 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.569205  7510 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.573552  4120 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:17:21.574371  4112 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:21.575815  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2679) took 1352 ms. Trace:
I20260709 13:17:21.568567  7422 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:21.565837  7804 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:17:21.524081  7806 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:21.585090  7808 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:21.585222  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:21.585520  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.585811  4120 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:21.576190  4041 rpcz_store.cc:276] 0709 13:17:20.223785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.551121 (+1327336us) service_pool.cc:224] Handling call
0709 13:17:21.575365 (+ 24244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.575522 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.575546 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.575586 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:21.575622 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.575673 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.575763 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.564257  7444 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:21.582944  7789 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.586442  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2676) took 1415 ms. Trace:
I20260709 13:17:21.586236  4118 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:21.587446  7444 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:21.558624  7707 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.607887  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.611636  4120 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:21.618917  4112 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:21.606894  7444 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.613001  7714 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.612680  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.587800  4043 rpcz_store.cc:276] 0709 13:17:20.171152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.227476 (+1056324us) service_pool.cc:224] Handling call
0709 13:17:21.227826 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:21.276154 (+ 48328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.276185 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:21.300396 (+ 24211us) log.cc:844] Serialized 52 byte log entry
0709 13:17:21.451645 (+151249us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:21.451825 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.452034 (+   209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.586232 (+134198us) raft_consensus.cc:1685] finished
0709 13:17:21.586250 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.586384 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7592,"raft.queue_time_us":27276,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":19692,"thread_start_us":143627,"threads_started":2,"wal-append.queue_time_us":151506}
I20260709 13:17:21.561331  7630 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.621197  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2683) took 1371 ms. Trace:
I20260709 13:17:21.625139  4041 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:21.560370  7709 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.625424  4043 rpcz_store.cc:276] 0709 13:17:20.250227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.620326 (+1370099us) service_pool.cc:224] Handling call
0709 13:17:21.620650 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.620865 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.620901 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.620944 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.620977 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.621028 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.621135 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.627065  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2682) took 1377 ms. Trace:
I20260709 13:17:21.627517  4043 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:17:21.627421  4041 rpcz_store.cc:276] 0709 13:17:20.249953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.586550 (+1336597us) service_pool.cc:224] Handling call
0709 13:17:21.617288 (+ 30738us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.626816 (+  9528us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.627018 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.589587  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:21.629071  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2687) took 1377 ms. Trace:
I20260709 13:17:21.629699  4043 rpcz_store.cc:276] 0709 13:17:20.251198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.626980 (+1375782us) service_pool.cc:224] Handling call
0709 13:17:21.627299 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.627996 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.628170 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.630730  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:21.603825  7768 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.603184  7674 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.638799  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2688) took 1387 ms. Trace:
I20260709 13:17:21.639212  4041 rpcz_store.cc:276] 0709 13:17:20.251415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.628207 (+1376792us) service_pool.cc:224] Handling call
0709 13:17:21.638282 (+ 10075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.638483 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:21.638509 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:21.638552 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:21.638582 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.638634 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.638738 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:21.630949  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:21.649765  7438 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:21.651228  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:21.651495  7810 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:21.652105  7810 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.652500  7438 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:21.654594  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:21.654879  7810 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.655462  7788 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.602866  7806 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.633579  7422 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:21.636301  7714 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.662437  7434 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:17:21.663565  7788 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.658957  7438 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:21.665711  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:21.666288  7630 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.675100  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:21.617915  7778 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.678743  7778 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.691942  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:21.693296  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:21.667053  7714 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.675590  7633 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:21.696812  7534 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:21.697343  7523 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:21.690583  7438 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:21.699329  7714 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.715925  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:21.721175  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:21.698696  7540 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:21.583688  7787 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.714447  7534 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:21.700073  7530 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:17:21.706002  7746 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:17:21.717605  7685 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:17:21.736999  7438 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.726050  7788 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.727847  7707 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.725898  7695 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.724225  7805 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:21.736483  7787 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.725278  7798 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:21.731829  7164 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:21.741322  7759 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.079s	user 0.000s	sys 0.003s
I20260709 13:17:21.737278  7812 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.769958  7812 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.772611  7812 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.741503  7709 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.768545  7798 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.774474  7798 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:21.778995  7685 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:17:21.797202  3937 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.646s (SENT) [suppressed 6 similar messages]
I20260709 13:17:21.803412  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2614) took 1705 ms. Trace:
I20260709 13:17:21.803876  3964 rpcz_store.cc:276] 0709 13:17:20.097769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.164392 (+ 66623us) service_pool.cc:224] Handling call
0709 13:17:20.215061 (+ 50669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.232581 (+ 17520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.232614 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.233112 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.386633 (+153521us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.386672 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.386732 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:21.740666 (+1353934us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:21.803060 (+ 62394us) raft_consensus.cc:1685] finished
0709 13:17:21.803091 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:21.803340 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17117,"raft.queue_time_us":17921,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":34977,"spinlock_wait_cycles":60812160,"thread_start_us":133207,"threads_started":1,"wal-append.queue_time_us":346099}
W20260709 13:17:21.789101  7809 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 13:17:21.812124  7444 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.814472  7444 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.778061  7164 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:21.819832  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63257.8us
I20260709 13:17:21.819298  7214 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:21.804404  7685 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:21.823755  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:21.824435  3964 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.788371  7534 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:21.869689  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:21.879132  4040 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:21.826486  7805 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:21.893448  7805 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.825843  7214 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:21.903254  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 106057us
I20260709 13:17:21.907618  3964 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
W20260709 13:17:21.919970  7754 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.305s	user 0.007s	sys 0.005s
I20260709 13:17:21.921284  7652 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:21.923206  7572 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:21.925346  7724 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.928378  7510 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:21.930800  7665 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:21.934864  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:21.935734  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:21.941147  4040 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:21.941560  4120 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:21.952169  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:21.953336  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:21.953704  7698 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:21.954324  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.954898  4120 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:21.943442  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.944068  4118 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:21.942490  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.956707  4114 raft_consensus.cc:2410] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:21.947959  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:21.944639  7701 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.939916  7690 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:21.949467  4112 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:21.960031  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.961344  4121 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:21.961228  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.961742  4114 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:21.899324  7685 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:21.961998  4120 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:21.956887  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.946492  7652 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:21.958838  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:21.982947  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 73161us
I20260709 13:17:22.036749  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:21.979009  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:22.022954  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.007905  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.008985  7821 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:17:22.059382  7819 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
W20260709 13:17:22.016880  7754 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:22.040272  7782 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.040050  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:21.997162  7717 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:21.991925  7648 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.062187  7510 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:21.963526  7701 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.067147  7812 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.078395  7812 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.080857  7812 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:22.078591  7765 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 1.274s	user 0.003s	sys 0.010s
I20260709 13:17:22.074460  7652 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.082496  7652 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.086959  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 305) took 1713 ms. Trace:
I20260709 13:17:22.089907  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.090984  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.091918  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.087357  4682 rpcz_store.cc:276] 0709 13:17:20.372501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.373772 (+  1271us) service_pool.cc:224] Handling call
0709 13:17:20.374027 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:20.374219 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.374254 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:20.381367 (+  7113us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.637415 (+256048us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:20.637482 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.637568 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.078045 (+1440477us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:22.083781 (+  5736us) raft_consensus.cc:1685] finished
0709 13:17:22.083814 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.086174 (+  2360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15959424,"thread_start_us":119994,"threads_started":1,"wal-append.queue_time_us":317025}
I20260709 13:17:21.962383  7690 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.094976  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.099798  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2681) took 1862 ms. Trace:
I20260709 13:17:22.100196  4046 rpcz_store.cc:276] 0709 13:17:20.236945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.562383 (+1325438us) service_pool.cc:224] Handling call
0709 13:17:21.571549 (+  9166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:21.571974 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:21.718001 (+146027us) log.cc:844] Serialized 14 byte log entry
0709 13:17:21.820944 (+102943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:21.821481 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 13:17:21.821632 (+   151us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:21.821663 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:21.821755 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.099584 (+277829us) raft_consensus.cc:1685] finished
0709 13:17:22.099605 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.099732 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7061,"prepare.queue_time_us":141046,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":1723,"raft.queue_time_us":2034,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":5727,"thread_start_us":187196,"threads_started":2,"wal-append.queue_time_us":171598}
I20260709 13:17:22.103480  7581 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.071619  7798 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.106285  7798 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.104013  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2247) took 1599 ms. Trace:
I20260709 13:17:22.106870  3969 rpcz_store.cc:276] 0709 13:17:20.504235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.574939 (+ 70704us) service_pool.cc:224] Handling call
0709 13:17:20.575265 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.386416 (+811151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.103779 (+717363us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54002c9054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:22.103955 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861778688}
I20260709 13:17:22.095893  4114 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:22.109161  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.115890  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:22.116568  7581 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:22.117401  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2339) took 1889 ms. Trace:
I20260709 13:17:22.085246  7510 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.074400  7782 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.119114  4115 rpcz_store.cc:276] 0709 13:17:20.228233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.228398 (+   165us) service_pool.cc:224] Handling call
0709 13:17:20.228850 (+   452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.803779 (+574929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.117141 (+1313362us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400096d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:22.117330 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316807552}
W20260709 13:17:22.116632  7757 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.502s	user 0.006s	sys 0.004s
I20260709 13:17:22.077667  7648 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.123379  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.124145  4114 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:22.122342  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:22.130389  7789 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.131141  7049 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.118211  7812 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:22.135628  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.135807  7510 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:22.136806  4681 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:22.137564  7782 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:22.137848  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.138398  7648 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.138818  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.169513  3964 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:22.171203  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.171801  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.139727  7164 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:22.140367  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2600) took 2602 ms. Trace:
I20260709 13:17:22.140893  7714 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.142266  7564 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.166930  7730 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:17:22.142501  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.174642  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.174777  7714 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.175201  3969 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:22.175326  3971 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:22.176033  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.142912  7596 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.143136  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.180358  3965 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:22.143491  7690 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:22.140271  7575 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:22.152637  4115 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.154347  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.160625  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:22.164932  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:22.188838  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.166859  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:22.176582  3969 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.189139  4648 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:22.173241  3972 rpcz_store.cc:276] 0709 13:17:19.537775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.877824 (+340049us) service_pool.cc:224] Handling call
0709 13:17:19.897075 (+ 19251us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.986400 (+ 89325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.986429 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.996300 (+  9871us) log.cc:844] Serialized 26 byte log entry
0709 13:17:20.392505 (+396205us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:20.392544 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.392611 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.116063 (+1723452us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:22.140062 (+ 23999us) raft_consensus.cc:1685] finished
0709 13:17:22.140083 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.140272 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88934,"raft.queue_time_us":92105,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":9039,"spinlock_wait_cycles":113643904,"thread_start_us":342843,"threads_started":1,"wal-append.queue_time_us":495058}
I20260709 13:17:22.173724  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.153376  7789 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.185901  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.187417  7575 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:22.202100  7724 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.203713  7714 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.208192  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.209563  7577 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:17:22.212894  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.216843  7444 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.249157  7444 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:22.180109  7596 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:22.245635  7577 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:22.202723  7805 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:22.246908  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:22.183501  7780 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.113s	user 0.012s	sys 0.014s
W20260709 13:17:22.293507  7780 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.013s	sys 0.014s
I20260709 13:17:22.249640  7444 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.168294  7530 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:17:22.163514  7812 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.242000  7724 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.184839  3964 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:22.292755  7805 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 10 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:22.242947  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.389138  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:22.368811  7596 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.251644  7714 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:22.372218  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.247450  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.239533  4115 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
W20260709 13:17:22.380563  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 181279us
I20260709 13:17:22.381006  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.381357  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.408362  4114 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:22.398670  3972 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:22.377067  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 209876us
I20260709 13:17:22.407464  3965 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:22.410171  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.410843  3964 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 6.
I20260709 13:17:22.405239  7648 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.413228  7648 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.413455  7523 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:22.415458  7760 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.773s	user 0.010s	sys 0.000s
I20260709 13:17:22.416515  7583 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.406010  7664 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:22.417106  7664 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.417023  7583 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.417559  7664 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.419106  7583 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.419590  7648 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.421077  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:22.421231  7579 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.422184  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:22.422986  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:22.424086  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.424270  4045 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:22.424850  3972 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:22.426906  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:22.384599  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.438303  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.421734  7444 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.440042  7564 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.438635  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:22.445235  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.401553  7724 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.442948  4041 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:22.443177  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:22.443455  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.478093  4113 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:22.479586  3972 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.476035  7564 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.482215  7564 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.453961  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.477237  3965 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:17:22.471453  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.477952  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.485406  4040 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:22.486189  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.480249  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.482285  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.423538  7701 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:22.409336  7164 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.491379  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:22.492610  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.493319  4113 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:22.494171  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.494931  4113 raft_consensus.cc:2368] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:17:22.495723  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.486493  3968 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:22.496495  4113 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:22.496971  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.497519  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.486925  4041 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:22.487223  4040 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:22.498189  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.499032  3968 raft_consensus.cc:2410] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:22.483283  3938 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:22.488348  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:22.482352  7785 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:17:22.424820  7596 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:22.454509  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48004.5us
I20260709 13:17:22.520838  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:22.449235  7577 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.480705  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:22.498903  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.531054  7577 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.532104  7444 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.518429  7805 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.522287  7648 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:22.536854  7717 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:22.537223  7648 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.439231  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.537920  7717 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:22.538282  7717 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:22.478123  7579 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.539057  7717 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.539570  7579 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.540465  4684 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:22.499578  4678 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
W20260709 13:17:22.545480  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65739.3us
W20260709 13:17:22.547112  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.547854  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.548162  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.548591  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.551872  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:22.511198  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.517659  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.558104  4113 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:22.531641  4040 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:22.562502  7664 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.563191  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.563966  4040 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:22.564697  7664 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.567080  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2285) took 2639 ms. Trace:
I20260709 13:17:22.522841  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.569141  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.482931  7803 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:22.517186  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.567458  4044 rpcz_store.cc:276] 0709 13:17:19.927209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.927312 (+   103us) service_pool.cc:224] Handling call
0709 13:17:19.927617 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:19.938084 (+ 10467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.938115 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:19.939552 (+  1437us) log.cc:844] Serialized 26 byte log entry
0709 13:17:19.985473 (+ 45921us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:19.986081 (+   608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:19.986148 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.565321 (+2579173us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b1800448960. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:22.566772 (+  1451us) raft_consensus.cc:1685] finished
0709 13:17:22.566793 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.566995 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98819,"raft.queue_time_us":10229,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7806,"spinlock_wait_cycles":4176256,"thread_start_us":44172,"threads_started":1,"wal-append.queue_time_us":44290}
I20260709 13:17:22.547953  7049 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:22.574616  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:22.450424  7575 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.509896  3972 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:22.569321  3965 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:22.523960  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.580847  3968 raft_consensus.cc:2368] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:17:22.571379  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.572976  4114 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:22.581640  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.575016  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.582198  3968 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:22.583161  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.583720  3968 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:22.575192  4044 raft_consensus.cc:2376] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11. Re-sending same reply.
I20260709 13:17:22.575414  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.567796  7714 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.585217  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.539485  7812 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:22.587540  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.585934  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.588587  4044 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:22.590121  4114 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:22.590981  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.568624  7789 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.595551  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.595983  3969 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:22.590214  3965 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:22.593159  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.586855  7564 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.597040  4044 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:22.597054  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.596799  4041 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:22.575776  7803 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.604553  3969 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:22.605398  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.606033  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.605490  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.519156  7164 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.609016  3968 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:22.607674  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:22.609973  7803 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.610940  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.611588  4114 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:22.612666  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.608795  3965 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.612489  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.614876  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.616533  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.617273  3969 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:22.618163  3972 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:22.588975  7049 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:22.621273  4117 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:17:22.624507  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:22.626134  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99008.6us
I20260709 13:17:22.626816  4114 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:17:22.626900  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:22.627260  7548 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:22.627790  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.628187  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:22.629961  4114 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:22.630712  7837 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:22.631356  4114 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:22.631383  7837 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:22.592442  7717 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.636276  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:22.638094  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.640419  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2618) took 2042 ms. Trace:
I20260709 13:17:22.641223  3967 rpcz_store.cc:276] 0709 13:17:20.597664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.769566 (+171902us) service_pool.cc:224] Handling call
0709 13:17:20.769862 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.904479 (+134617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:20.904511 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:20.904552 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:20.904593 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.639967 (+1735374us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54004010d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:22.640014 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.640327 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":309085568}
I20260709 13:17:22.642900  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.643092  7837 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:22.643560  4039 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 6.
I20260709 13:17:22.644418  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:22.642937  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:22.645552  7837 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:22.645879  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.646612  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:22.649137  7837 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.650470  7837 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:22.651644  7837 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:22.651960  7837 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:22.653183  7837 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.653739  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.654538  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:22.655018  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.655634  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:22.655025  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.656708  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2670) took 2486 ms. Trace:
I20260709 13:17:22.654644  4677 raft_consensus.cc:2410] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:22.657114  4047 rpcz_store.cc:276] 0709 13:17:20.169773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.214813 (+ 45040us) service_pool.cc:224] Handling call
0709 13:17:20.215098 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.384184 (+169086us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:20.429668 (+ 45484us) log.cc:844] Serialized 14 byte log entry
0709 13:17:20.835202 (+405534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:20.836436 (+  1234us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:20.836510 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.656506 (+1819996us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400119ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:22.656550 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:22.656654 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29230,"prepare.queue_time_us":113763,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":34,"raft.queue_time_us":39301,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":6805,"spinlock_wait_cycles":388356480,"thread_start_us":306109,"threads_started":1,"wal-append.queue_time_us":821670,"wal-append.run_cpu_time_us":2436,"wal-append.run_wall_time_us":1145706}
I20260709 13:17:22.659346  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.659732  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.657234  7837 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.660905  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.662271  7678 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:22.662678  7678 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:22.663035  7678 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:22.666378  4112 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:22.656625  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:22.670598  7587 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:22.671155  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2344) took 2371 ms. Trace:
I20260709 13:17:22.671500  4119 rpcz_store.cc:276] 0709 13:17:20.299337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.373342 (+ 74005us) service_pool.cc:224] Handling call
0709 13:17:20.373603 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:21.252047 (+878444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.670924 (+1418877us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400096854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:22.671078 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970586368}
I20260709 13:17:22.673832  4119 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:22.674142  4119 pending_rounds.cc:85] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 6
I20260709 13:17:22.674341  4119 pending_rounds.cc:107] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:22.674553  4119 raft_consensus.cc:2889] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:22.674639  4676 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:22.668134  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.676517  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:22.677022  4682 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:17:22.677634  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:22.678507  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.679291  7711 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:22.679814  7711 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.660447  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.680943  4047 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:22.681770  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:22.683317  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.683630  4113 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:22.684221  4117 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:22.684258  7049 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.688280  7356 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:22.688719  7356 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.690730  7356 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:22.691169  7356 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.691568  7356 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.689009  7780 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:22.696134  4119 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:22.699867  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 179122us
I20260709 13:17:22.702023  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:22.702499  3972 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:22.707150  4039 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:22.608726  7059 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.709787  3965 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:22.710914  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:22.712307  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.713876  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.705440  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:22.715608  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 127823us
I20260709 13:17:22.725250  3965 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:22.624481  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:22.624547  7812 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.739639  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.747256  3965 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:22.737848  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:22.668174  7837 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:22.708115  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.701056  7780 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.776525  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.612278  7367 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:17:22.798914  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.746348  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:22.801488  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 84571.2us
I20260709 13:17:22.710505  7766 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:22.717497  7701 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:22.861814  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:22.811652  7847 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:22.812376  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 157612us
W20260709 13:17:22.813712  7638 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.308s	user 0.011s	sys 0.011s
W20260709 13:17:22.811661  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 135235us
W20260709 13:17:22.815369  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 97360.9us
I20260709 13:17:22.870901  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.871676  3965 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:22.817867  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:22.822286  3968 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:22.863101  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:22.799540  7833 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.151s	user 0.001s	sys 0.000s
I20260709 13:17:22.872541  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:22.896144  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:22.745822  7790 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:22.863978  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.916961  3965 raft_consensus.cc:2368] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:22.920595  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:22.799134  7820 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:22.922087  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 184334us
I20260709 13:17:22.922945  4043 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:22.923166  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:22.921409  3965 raft_consensus.cc:2410] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:17:22.923727  4011 leader_election.cc:400] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:17:22.918360  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.924337  4011 leader_election.cc:403] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:22.918823  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:22.801440  7837 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.822311  7780 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.926584  4114 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:22.857787  7367 consensus_queue.cc:1243] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:22.933571  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:22.929589  4038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2666) took 2753 ms (client timeout 2122 ms). Trace:
W20260709 13:17:22.916430  7638 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.415s	user 0.011s	sys 0.011s
I20260709 13:17:22.928326  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:22.934286  4038 rpcz_store.cc:269] 0709 13:17:20.168718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.202752 (+ 34034us) service_pool.cc:224] Handling call
0709 13:17:22.919273 (+2716521us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540028b754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:22.922111 (+  2838us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424621824}
I20260709 13:17:22.937477  4041 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
W20260709 13:17:22.937740  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62247.3us
I20260709 13:17:22.938412  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:22.938971  4038 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:22.935165  3965 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:22.868374  7847 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:22.940968  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.942770  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:22.945163  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80441.9us
I20260709 13:17:22.926415  7579 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.919391  7805 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:22.802703  7812 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:22.930416  7837 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:22.958109  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:22.959534  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.967176  4112 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:22.961071  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.866134  7730 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:17:22.930099  7840 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:22.933666  7820 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:22.971786  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:22.943481  7577 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:22.944945  7049 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:17:22.915957  7766 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.989171  3972 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:17:22.943878  7664 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:22.978163  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2663) took 2810 ms. Trace:
I20260709 13:17:22.944065  7847 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:22.996987  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 179198us
I20260709 13:17:22.973240  7839 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.000519  7839 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.000897  7839 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.003369  7856 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.004074  7856 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:22.969565  7805 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.988866  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.984558  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:22.991191  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:22.991411  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:22.969910  7579 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:22.972936  7849 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.992031  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.979794  7534 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:22.976472  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53408us
I20260709 13:17:22.992094  4042 rpcz_store.cc:276] 0709 13:17:20.167922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.171859 (+  3937us) service_pool.cc:224] Handling call
0709 13:17:20.172119 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:20.500555 (+328436us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:22.977928 (+2477373us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54004272d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:22.978101 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488093952}
I20260709 13:17:23.015043  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.013993  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:22.968935  7356 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.017858  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:22.968722  7701 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:17:23.016726  4116 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:17:23.017244  7849 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.045619  4039 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:23.047326  7849 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:23.023010  7755 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 2.039s	user 0.011s	sys 0.008s
I20260709 13:17:23.023135  7711 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:23.023577  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.049890  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.050482  4041 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:23.051229  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.052136  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.053074  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2233) took 4706 ms. Trace:
I20260709 13:17:23.054061  7176 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.054883  7805 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.055231  7701 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.055675  7701 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.056001  7701 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.017073  7705 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.015391  7534 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.058024  7534 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.061668  7846 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:23.062124  7846 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:23.062911  7846 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.024901  7803 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.020591  7164 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.030797  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:23.070963  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:23.071158  7803 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.072016  4040 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 7: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:23.072986  7596 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:23.073412  7596 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.073729  7596 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.021100  7579 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:22.988085  7564 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:22.998654  7664 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:22.988273  7840 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:23.029137  7820 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.014314  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.019052  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.003321  7678 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.039865  7812 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.042083  7766 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.043048  7717 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.045512  7724 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.004s
I20260709 13:17:23.063848  7862 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:23.079037  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 94507.3us
W20260709 13:17:23.100426  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.101884  7841 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:23.053470  3963 rpcz_store.cc:276] 0709 13:17:18.346268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:19.692082 (+1345814us) service_pool.cc:224] Handling call
0709 13:17:19.692369 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:19.956931 (+264562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:19.956959 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:19.957510 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 13:17:20.381635 (+424125us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:20.381669 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:20.382576 (+   907us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:22.920097 (+2537521us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:23.052752 (+132655us) raft_consensus.cc:1685] finished
0709 13:17:23.052788 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.053016 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":263060,"raft.queue_time_us":271171,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":15537,"spinlock_wait_cycles":19163008,"thread_start_us":382642,"threads_started":1,"wal-append.queue_time_us":857762}
I20260709 13:17:23.016291  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.116406  4038 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:23.137229  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.064150  7846 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.141239  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.136130  7664 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:23.155382  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.145071  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:23.185303  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 261727us
W20260709 13:17:23.249061  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.249943  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.250309  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.250633  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.251804  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.252686  7564 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.253347  7564 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.186929  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.253705  7564 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.136169  7861 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.254385  7861 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.116492  7587 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:23.188031  3963 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:23.258206  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2265) took 1124 ms. Trace:
I20260709 13:17:23.258530  3963 rpcz_store.cc:276] 0709 13:17:22.134195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.186343 (+1052148us) service_pool.cc:224] Handling call
0709 13:17:23.187738 (+  1395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.257920 (+ 70182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.258152 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.259538  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.188555  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.191023  3965 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:23.196672  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.188367  7724 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.210908  7812 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:23.158047  7717 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.260733  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.264225  7724 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.188129  7367 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.190201  7862 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.222936  7701 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.236145  7840 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.289904  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2293) took 2442 ms. Trace:
I20260709 13:17:23.290573  7862 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.290762  7367 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.186532  7841 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:23.291764  7841 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.232577  7780 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.292965  7367 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:23.293784  7780 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.294147  4118 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:23.250808  7049 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:17:23.265971  7847 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.238706  7579 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:23.296708  7534 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.297364  7847 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.155995  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:23.261194  4038 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:23.299563  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.301075  7701 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.301194  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.302176  4038 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:23.303035  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.304006  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.290299  4043 rpcz_store.cc:276] 0709 13:17:20.847283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.633622 (+786339us) service_pool.cc:224] Handling call
0709 13:17:22.919390 (+1285768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.923481 (+  4091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.289717 (+366236us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540028b750. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:23.289845 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2956266880}
I20260709 13:17:23.305722  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.305871  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2262) took 1172 ms. Trace:
I20260709 13:17:23.306226  3965 rpcz_store.cc:276] 0709 13:17:22.133429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.939743 (+806314us) service_pool.cc:224] Handling call
0709 13:17:22.940006 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.261405 (+321399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.305649 (+ 44244us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400408dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:23.305815 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576849664}
I20260709 13:17:23.307246  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.220834  7766 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:23.307928  7766 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.264555  3963 raft_consensus.cc:2410] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:23.256690  7861 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.264561  7717 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.239161  7822 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.224517  7839 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.268006  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:23.268025  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.312620  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.313479  3963 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:23.271014  7678 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.272452  4678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 296) took 1093 ms. Trace:
I20260709 13:17:23.276109  7577 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:23.322177  4121 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:23.277112  7792 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:23.278614  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.277627  7564 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.286317  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.287940  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.291164  7862 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:23.263060  7812 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:23.336462  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.310715  3965 raft_consensus.cc:2410] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260709 13:17:23.313242  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.272509  7837 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:23.315057  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 159179us
I20260709 13:17:23.338721  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.246627  4042 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:23.339440  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.245580  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:23.340382  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.340420  3965 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:23.319759  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 442784us
I20260709 13:17:23.322417  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.323629  4045 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:17:23.323597  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70863.3us
I20260709 13:17:23.325702  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.325910  7152 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:23.342185  3963 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.344858  4038 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:23.345046  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.346362  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 341) took 1772 ms. Trace:
I20260709 13:17:23.346751  4116 rpcz_store.cc:276] 0709 13:17:21.573991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.574183 (+   192us) service_pool.cc:224] Handling call
0709 13:17:21.574506 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.031191 (+1456685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.346142 (+314951us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400456fd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:23.346305 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3316010368}
I20260709 13:17:23.323292  7792 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:23.308516  4041 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:23.337294  4040 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:23.345829  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.362769  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.363628  4040 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:23.367380  3963 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:23.368419  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:23.349010  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103565us
I20260709 13:17:23.348752  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.347894  7866 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:23.351502  4043 raft_consensus.cc:2368] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:23.321875  4678 rpcz_store.cc:276] 0709 13:17:22.179383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.185450 (+  6067us) service_pool.cc:224] Handling call
0709 13:17:23.272239 (+1086789us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54008d9ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:23.272370 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185195392}
I20260709 13:17:23.343973  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.351778  7776 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:23.341729  7867 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.353794  7534 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.354725  7837 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.355594  4045 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:23.355763  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.356889  7664 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.358331  7839 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.347829  7152 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.337836  7862 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.350502  4012 leader_election.cc:400] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 6. Current term is 7.
I20260709 13:17:23.342211  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:23.334982  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48752.2us
I20260709 13:17:23.369939  3963 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.327060  7868 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.381758  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.370735  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.356793  7812 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.322100  7822 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.445792  7790 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:23.436568  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 94857us
I20260709 13:17:23.450392  7184 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:23.451713  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:23.376142  3965 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:23.452126  7766 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.453670  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2266) took 1319 ms. Trace:
I20260709 13:17:23.438028  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.441843  7709 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:23.455488  7269 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.434937  7577 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.457799  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.458240  7709 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:23.458395  3968 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:23.458900  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2640) took 1014 ms. Trace:
I20260709 13:17:23.459204  3968 rpcz_store.cc:276] 0709 13:17:22.444129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.873231 (+429102us) service_pool.cc:224] Handling call
0709 13:17:23.457652 (+584421us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:17:23.458848 (+  1196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7008000}
I20260709 13:17:23.460608  3965 rpcz_store.cc:276] 0709 13:17:22.134460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.452875 (+1318415us) service_pool.cc:224] Handling call
0709 13:17:23.453221 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.453377 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.453400 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.453439 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:23.453471 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.453522 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.453616 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.462353  7685 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.462661  3965 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [11.6-13.7]
I20260709 13:17:23.463634  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2267) took 1328 ms. Trace:
I20260709 13:17:23.464107  3965 rpcz_store.cc:276] 0709 13:17:22.134755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.462075 (+1327320us) service_pool.cc:224] Handling call
0709 13:17:23.462394 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:23.463232 (+   838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.463552 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.466940  7822 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.466737  7790 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.466765  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:23.469116  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:23.460593  7862 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:23.455785  7841 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.471102  7792 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.383646  7583 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:23.444712  3938 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:23.472826  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.460352  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.442205  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.454097  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2268) took 1319 ms. Trace:
I20260709 13:17:23.448796  4038 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:23.473470  3972 rpcz_store.cc:276] 0709 13:17:22.135031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.703251 (+568220us) service_pool.cc:224] Handling call
0709 13:17:23.453921 (+750670us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400307354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:23.454042 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426576128}
I20260709 13:17:23.436693  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2301) took 1023 ms. Trace:
I20260709 13:17:23.454942  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:23.353353  7805 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.475152  4040 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:23.475401  4045 rpcz_store.cc:276] 0709 13:17:22.413445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.278369 (+864924us) service_pool.cc:224] Handling call
0709 13:17:23.436620 (+158251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.460412  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.477187  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2306) took 1002 ms. Trace:
W20260709 13:17:23.476460  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 134323us
I20260709 13:17:23.478026  4682 pending_rounds.cc:85] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 7
I20260709 13:17:23.478488  4682 pending_rounds.cc:107] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:17:23.478763  4682 raft_consensus.cc:2889] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.479508  4045 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:23.478618  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:23.370056  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.477504  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2271) took 1333 ms. Trace:
I20260709 13:17:23.482638  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:23.482663  4045 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:17:23.480628  7578 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.481881  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:23.481858  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 111892us
I20260709 13:17:23.381211  7866 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.482653  3965 rpcz_store.cc:276] 0709 13:17:22.144276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.464856 (+1320580us) service_pool.cc:224] Handling call
0709 13:17:23.465446 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.465721 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.465750 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.465800 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:23.465832 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.465983 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.477453 (+ 11470us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.484598  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.484059  7576 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:23.499230  7367 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.499661  7367 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.487807  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.480893  7701 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:23.500025  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:23.500964  7867 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.500803  7701 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.500010  7367 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.499905  7869 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:17:23.502393  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.483840  7780 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.503417  7867 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.505257  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2623) took 1349 ms. Trace:
I20260709 13:17:23.487244  7164 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:23.487342  7776 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:23.522562  7214 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:23.525410  7678 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.502843  7701 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.506001  7861 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:23.507210  7782 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:23.507113  7868 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.509166  7367 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.445875  7152 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.487982  7049 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:17:23.505487  7869 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:23.510742  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:23.491349  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.509162  7664 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:23.515357  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.518023  3963 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:23.509670  4676 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:17:23.525246  4684 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:23.486629  4045 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:23.476420  7583 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.558517  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.513239  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:23.514883  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:23.478072  4040 rpcz_store.cc:276] 0709 13:17:22.474604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.474668 (+1000064us) service_pool.cc:224] Handling call
0709 13:17:23.474945 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.476957 (+  2012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.477139 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.561000  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:23.481354  7812 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:23.558430  4045 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:23.524477  7164 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:23.529201  7868 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.508574  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.392911  7596 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.509598  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.511698  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:23.534488  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.535810  7850 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.553s	user 0.000s	sys 0.002s
I20260709 13:17:23.536365  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:23.541132  7049 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.541396  7869 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:23.545651  7841 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.542265  4011 leader_election.cc:400] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:23.542742  3969 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:23.587019  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2628) took 1429 ms. Trace:
I20260709 13:17:23.587437  3969 rpcz_store.cc:276] 0709 13:17:22.157509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.542309 (+1384800us) service_pool.cc:224] Handling call
0709 13:17:23.542574 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.586721 (+ 44147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.586949 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.589290  4011 leader_election.cc:403] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:23.590277  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48253.7us
I20260709 13:17:23.591168  3969 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:23.592046  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2630) took 1434 ms. Trace:
I20260709 13:17:23.592483  3969 rpcz_store.cc:276] 0709 13:17:22.158063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.588298 (+1430235us) service_pool.cc:224] Handling call
0709 13:17:23.588627 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.591676 (+  3049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.591976 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.595927  3969 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:23.596344  3969 pending_rounds.cc:85] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:23.596577  3969 pending_rounds.cc:107] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:23.596837  3969 raft_consensus.cc:2889] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:23.597537  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2632) took 1439 ms. Trace:
I20260709 13:17:23.597847  3969 rpcz_store.cc:276] 0709 13:17:22.158552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.593661 (+1435109us) service_pool.cc:224] Handling call
0709 13:17:23.593959 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.597289 (+  3330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.597483 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.599942  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 479) took 1441 ms. Trace:
I20260709 13:17:23.600317  3969 rpcz_store.cc:276] 0709 13:17:22.158731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.599140 (+1440409us) service_pool.cc:224] Handling call
0709 13:17:23.599454 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.599634 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.599660 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.599703 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:23.599740 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.599790 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.599887 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.543063  7152 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.360597  7564 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.544389  7776 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.629388  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2260) took 1496 ms. Trace:
I20260709 13:17:23.548066  7367 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.549584  7598 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.552525  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.487879  7716 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.552579  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.542303  4044 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:23.561703  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48550.1us
I20260709 13:17:23.651051  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:23.660475  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:23.661165  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108718us
I20260709 13:17:23.661337  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.661975  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.662540  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.524570  3968 rpcz_store.cc:276] 0709 13:17:22.156237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.503337 (+1347100us) service_pool.cc:224] Handling call
0709 13:17:23.503731 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.503956 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.504701 (+   745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.504780 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:23.504819 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.504875 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.505108 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.565768  3971 raft_consensus.cc:2410] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:23.526604  7805 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:17:23.566453  4116 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:23.524216  7839 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:23.524645  7866 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.568842  4045 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:23.569876  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55054.1us
I20260709 13:17:23.571367  3965 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:23.615725  7534 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:17:23.579689  7049 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.667637  7049 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.580629  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:23.668959  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 88407.2us
W20260709 13:17:23.667657  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.581915  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:23.584051  4684 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:23.672053  4683 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:23.570745  7164 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.673554  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.567399  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:23.602383  7801 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10.
I20260709 13:17:23.679045  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.578405  7868 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.608846  7782 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.560097  7583 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.663897  7716 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:23.612251  7596 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.629472  4042 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:23.672650  7859 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:23.629913  3966 rpcz_store.cc:276] 0709 13:17:22.132811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.139256 (+  6445us) service_pool.cc:224] Handling call
0709 13:17:22.139509 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:22.436311 (+296802us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:22.436342 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:22.436386 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:22.436417 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.629104 (+1192687us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400401854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:23.629164 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.629306 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682053504}
I20260709 13:17:23.631548  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:23.636458  7869 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.614244  7812 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:23.637300  7184 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:23.645450  7874 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:17:23.646598  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.665062  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.666803  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.666991  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:23.723281  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56356.6us
I20260709 13:17:23.723965  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:23.684790  7367 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:17:23.726608  4679 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:23.716722  7859 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:23.722628  4047 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:23.728018  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2328) took 1062 ms. Trace:
I20260709 13:17:23.728379  4047 rpcz_store.cc:276] 0709 13:17:22.665919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.646257 (+980338us) service_pool.cc:224] Handling call
0709 13:17:23.727950 (+ 81693us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.602829  7510 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:23.680807  7817 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:17:23.686147  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:23.731253  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45182.5us
I20260709 13:17:23.732416  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:23.625440  7841 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:17:23.610946  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2320) took 1043 ms. Trace:
I20260709 13:17:23.664057  7648 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.666577  7662 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.664462  7701 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.666096  7871 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:23.689292  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.664958  7664 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.622975  7687 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:17:23.830870  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2323) took 1262 ms. Trace:
I20260709 13:17:23.665796  7839 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:23.630066  7840 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:17:23.674588  7769 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.694407  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.695736  4038 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.701315  7049 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.835224  4041 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:23.679070  7879 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:23.687275  7714 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.688512  7862 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.673909  7861 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:17:23.721827  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.691021  7214 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.691475  7716 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:23.728714  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63727.9us
I20260709 13:17:23.676373  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:23.856297  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 480) took 1692 ms. Trace:
I20260709 13:17:23.729663  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.733464  4043 rpcz_store.cc:276] 0709 13:17:22.567530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.305517 (+737987us) service_pool.cc:224] Handling call
0709 13:17:23.610704 (+305187us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b54000f0854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:23.610863 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103711488}
I20260709 13:17:23.715054  7577 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.762475  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:23.785842  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 136445us
I20260709 13:17:23.751045  7564 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:23.809361  7575 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:23.809535  7587 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:23.810555  7152 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:23.812228  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79873.3us
I20260709 13:17:23.812943  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.813602  7869 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:23.814195  7864 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:23.816999  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2708) took 1119 ms. Trace:
I20260709 13:17:23.817466  7792 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.816532  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:23.687285  7678 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
W20260709 13:17:23.919240  7883 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:23.689700  7782 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.923507  7782 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.735011  7709 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:23.924945  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.727919  7184 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.927935  7184 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.831256  4042 rpcz_store.cc:276] 0709 13:17:22.568587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.343740 (+775153us) service_pool.cc:224] Handling call
0709 13:17:23.830658 (+486918us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54000b8e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:23.830806 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567840640}
I20260709 13:17:23.929143  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.929961  4042 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:23.930795  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.931452  4042 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:23.932327  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:23.835872  3966 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.840626  7049 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:23.824530  7707 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:23.941233  7707 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.943689  7707 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:23.839231  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.944552  3969 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:23.945789  4042 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:23.847457  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.947247  3964 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:23.948879  4042 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
W20260709 13:17:23.950117  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.835170  7839 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:23.950981  3966 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:23.952121  3966 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:23.952644  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2634) took 1731 ms. Trace:
I20260709 13:17:23.952970  3966 rpcz_store.cc:276] 0709 13:17:22.220807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.951663 (+1730856us) service_pool.cc:224] Handling call
0709 13:17:23.951958 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.952448 (+   490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.952596 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.949749  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2714) took 1251 ms. Trace:
I20260709 13:17:23.954206  4042 rpcz_store.cc:276] 0709 13:17:22.698627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.946756 (+1248129us) service_pool.cc:224] Handling call
0709 13:17:23.948622 (+  1866us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.949471 (+   849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.949685 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.857687  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:23.956214  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 98607.7us
I20260709 13:17:23.957052  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.858045  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:23.958693  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2715) took 1259 ms. Trace:
I20260709 13:17:23.959103  4042 rpcz_store.cc:276] 0709 13:17:22.698840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.955083 (+1256243us) service_pool.cc:224] Handling call
0709 13:17:23.955363 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.955534 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.957434 (+  1900us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.957482 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:23.957524 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.957582 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.958640 (+  1058us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.960144  4043 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:23.960822  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2721) took 1144 ms. Trace:
I20260709 13:17:23.961122  4043 rpcz_store.cc:276] 0709 13:17:22.816648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.959455 (+1142807us) service_pool.cc:224] Handling call
0709 13:17:23.959785 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.960535 (+   750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.960745 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.962461  4043 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:23.962978  7709 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:23.964068  7709 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:23.964679  7709 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:23.965662  7709 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:23.857062  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 180769us
I20260709 13:17:23.857179  3972 rpcz_store.cc:276] 0709 13:17:22.163843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.603834 (+1439991us) service_pool.cc:224] Handling call
0709 13:17:23.604187 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.604387 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:23.604694 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:17:23.855889 (+251195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:23.855958 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:23.856008 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.856080 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:23.856231 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1416,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":142,"thread_start_us":250620,"threads_started":1}
I20260709 13:17:23.969895  3972 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:23.970032  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:23.970434  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:23.971902  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.973894  7817 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:23.830039  7837 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:23.976424  7837 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:23.876622  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2305) took 1424 ms. Trace:
I20260709 13:17:23.879191  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2703) took 1183 ms. Trace:
I20260709 13:17:23.837745  7879 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:23.844458  7596 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:23.820363  7648 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.977003  4038 rpcz_store.cc:276] 0709 13:17:22.452409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.474080 (+1021671us) service_pool.cc:224] Handling call
0709 13:17:23.474350 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.834647 (+360297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.876291 (+ 41644us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b540011a3d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:23.876547 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508680576}
I20260709 13:17:23.977963  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2642) took 1533 ms. Trace:
I20260709 13:17:23.978017  7879 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:23.977205  7596 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:23.978348  3972 rpcz_store.cc:276] 0709 13:17:22.444704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.969344 (+1524640us) service_pool.cc:224] Handling call
0709 13:17:23.969697 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.977702 (+  8005us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.977906 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.846855  7840 consensus_queue.cc:1243] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:23.910812  3965 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:17:23.912276  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:23.980109  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2278) took 1789 ms. Trace:
I20260709 13:17:23.906801  4039 rpcz_store.cc:276] 0709 13:17:22.697274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.707869 (+ 10595us) service_pool.cc:224] Handling call
0709 13:17:23.799507 (+1091638us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54000f0d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:23.816914 (+ 17407us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":564385536}
I20260709 13:17:23.980484  3965 rpcz_store.cc:276] 0709 13:17:22.190294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.910133 (+1719839us) service_pool.cc:224] Handling call
0709 13:17:23.910554 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.979862 (+ 69308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.980059 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:23.981606  4039 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:23.983117  3965 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:23.916658  7690 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:23.917165  7864 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:23.918337  7164 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:23.928522  7716 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.832482  4115 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 12. Ops: []
I20260709 13:17:23.875793  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:23.897274  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:23.976903  7837 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:23.983526  4041 rpcz_store.cc:276] 0709 13:17:22.695950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.554618 (+858668us) service_pool.cc:224] Handling call
0709 13:17:23.554947 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.835597 (+280650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.878933 (+ 43336us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540003b454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:23.879119 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644145024}
I20260709 13:17:23.853718  7862 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.017889  3964 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:23.958207  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:23.883598  7805 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:23.993393  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:23.995239  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.004336  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:24.022529  4045 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:23.921202  7881 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:17:23.979079  7596 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:23.830693  7812 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.009871  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 112681us
I20260709 13:17:24.036078  3937 leader_election.cc:400] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:24.036383  3937 leader_election.cc:403] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:23.831631  7859 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.009863  3968 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:24.012996  7840 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:24.001258  7690 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:24.015923  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.063670  4041 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:23.983934  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2644) took 1538 ms. Trace:
I20260709 13:17:24.064927  3965 rpcz_store.cc:276] 0709 13:17:22.445249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.981720 (+1536471us) service_pool.cc:224] Handling call
0709 13:17:23.982254 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.983538 (+  1284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.983882 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.072465  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.073287  4041 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
W20260709 13:17:24.017525  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 201135us
I20260709 13:17:24.024031  7564 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.080221  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2372) took 1178 ms. Trace:
I20260709 13:17:24.080663  4115 rpcz_store.cc:276] 0709 13:17:22.901479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.247764 (+346285us) service_pool.cc:224] Handling call
0709 13:17:23.832298 (+584534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.009518 (+177220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.080007 (+ 70489us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540034e750. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:24.080163 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1343541504}
I20260709 13:17:24.082368  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.084131  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.086324  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:24.023686  4043 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:24.065284  4045 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:24.059954  7805 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:24.093334  7690 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.093684  7805 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.094645  7690 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:24.097174  7864 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.101833  7867 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:24.102783  7867 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:24.066236  7707 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:24.111742  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2625) took 1954 ms. Trace:
I20260709 13:17:23.883989  7577 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.032829  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74701.4us
I20260709 13:17:24.112313  3967 rpcz_store.cc:276] 0709 13:17:22.156749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.538699 (+1381950us) service_pool.cc:224] Handling call
0709 13:17:23.539070 (+   371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.539863 (+   793us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.539899 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.540571 (+   672us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.685416 (+144845us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:23.685455 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.685526 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.111313 (+425787us) raft_consensus.cc:1685] finished
0709 13:17:24.111437 (+   124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.111598 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6592,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":131235,"threads_started":1,"wal-append.queue_time_us":518875}
I20260709 13:17:24.043303  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.043593  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.043975  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.093624  3968 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 13:17:24.114610  3869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 232) took 18820 ms (client timeout 15000 ms). Trace:
I20260709 13:17:24.044654  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.121101  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:24.045500  4119 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:24.121378  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2650) took 1645 ms. Trace:
I20260709 13:17:24.044981  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.049095  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.048496  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.120316  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.123430  4117 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:24.049513  7862 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.049873  7716 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:24.019838  7782 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:17:24.055428  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2711) took 1357 ms. Trace:
I20260709 13:17:24.055845  7839 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.019464  7164 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.017114  4046 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:23.980408  3971 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:24.137925  3870 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.074322  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:24.074959  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:24.111860  7701 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:24.028232  7798 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.028043  7534 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:17:24.127970  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.060452  7790 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:24.128376  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.129618  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.152496  4118 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:24.129849  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2629) took 1972 ms. Trace:
I20260709 13:17:24.026726  3964 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:24.130515  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:24.133858  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:24.132284  4040 rpcz_store.cc:276] 0709 13:17:22.697975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.561760 (+863785us) service_pool.cc:224] Handling call
0709 13:17:23.562097 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.562463 (+   366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:23.562493 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:23.583778 (+ 21285us) log.cc:844] Serialized 26 byte log entry
0709 13:17:23.893045 (+309267us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:23.893091 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:23.893170 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.055174 (+162004us) raft_consensus.cc:1685] finished
0709 13:17:24.055199 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.055361 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":12262,"thread_start_us":290538,"threads_started":1,"wal-append.queue_time_us":451489}
I20260709 13:17:24.157013  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2648) took 1710 ms. Trace:
I20260709 13:17:24.157291  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.139741  3870 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 8 to 10, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 10 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:24.112564  7714 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:24.143743  4120 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:24.158221  3964 rpcz_store.cc:276] 0709 13:17:22.446414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.018957 (+1572543us) service_pool.cc:224] Handling call
0709 13:17:24.026492 (+  7535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.156329 (+129837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.156553 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.121958  3968 rpcz_store.cc:276] 0709 13:17:22.475808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.067282 (+1591474us) service_pool.cc:224] Handling call
0709 13:17:24.093391 (+ 26109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.120750 (+ 27359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.121315 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:24.144470  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69608.3us
I20260709 13:17:24.034922  7367 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:17:24.155051  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:24.154773  3963 rpcz_store.cc:276] 0709 13:17:22.157831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.560969 (+1403138us) service_pool.cc:224] Handling call
0709 13:17:23.616810 (+ 55841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.617053 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:23.657179 (+ 40126us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.129489 (+472310us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.129543 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:24.129586 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.129659 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.129796 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39954,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":170,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":1887,"thread_start_us":471948,"threads_started":1}
I20260709 13:17:24.164346  4041 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:24.166469  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.242586  4040 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:24.243708  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.171175  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.245270  4114 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:24.171805  4043 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:24.177307  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.182276  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:24.248035  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.146523  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:24.183542  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.249429  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.137804  7184 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:24.138232  7780 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:24.250757  7780 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.251142  7780 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.251482  7861 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:24.115631  7214 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:24.251994  7861 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:24.252411  7577 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.208277  4678 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:24.139097  7654 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:24.252939  7861 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.149919  7564 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.181202  7714 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:24.146600  7798 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:24.181969  7575 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.247148  7598 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.004s
W20260709 13:17:24.217537  7888 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:24.221825  7841 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:24.223199  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.220485  7839 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.230676  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:24.202600  7510 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:24.247808  7879 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.186414  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.253216  7534 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:24.253515  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.255733  4047 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:24.342589  7798 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:24.247059  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:24.198180  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.356262  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:24.358686  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2727) took 1083 ms. Trace:
I20260709 13:17:24.359277  4047 rpcz_store.cc:276] 0709 13:17:23.275733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.357804 (+1082071us) service_pool.cc:224] Handling call
0709 13:17:24.358128 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.358350 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.358376 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.358420 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:24.358470 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.358522 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.358626 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.361181  4047 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:24.351052  7868 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 13:17:24.276082  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:24.291751  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.327929  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:24.215260  7880 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:17:24.211747  7701 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:24.236359  7648 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.238967  7838 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:24.348178  7652 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.369513  4045 raft_consensus.cc:2410] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:17:24.362375  7685 consensus_meta.cc:287] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.900s	user 0.009s	sys 0.003s
I20260709 13:17:24.346550  7575 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.369920  4041 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:17:24.264689  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:24.350080  7583 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 13:17:24.352983  7510 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.350811  7841 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:24.459729  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.388998  7782 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:24.464455  4045 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:24.466814  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:24.468254  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.469702  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:24.470846  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:24.473917  7866 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.000s
I20260709 13:17:24.392042  7701 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.477574  4042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.010s	sys 0.025s
W20260709 13:17:24.478025  4042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.010s	sys 0.025s
I20260709 13:17:24.460620  7510 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:24.376775  7868 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.483808  4045 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:24.463394  7782 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:24.401399  7652 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.460376  7583 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.495610  4045 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:24.497094  4043 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:24.501247  4117 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:24.526932  4044 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:24.481335  7866 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.504058  7869 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.003s
W20260709 13:17:24.548892  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.544016  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 457738us
W20260709 13:17:24.550551  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.551612  7685 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:17:24.552459  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.562414  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.548065  7709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.007s	sys 0.007s
I20260709 13:17:24.496637  7837 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.573455  7575 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.493703  7841 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.581619  7583 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.587993  4117 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:24.600050  4675 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:24.600668  7860 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.601152  7860 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.553882  7782 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.627405  7901 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:24.630442  7866 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.593919  7879 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:24.596052  7841 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:24.642346  7868 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.634573  7901 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.645545  7901 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:24.646194  7701 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:24.650048  7790 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:24.678051  7837 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.683216  7714 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.694761  7714 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.825644  7812 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.687353  7780 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.826954  7812 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.206106  3870 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 6 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 7 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:24.705657  7790 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.745482  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.205251  3971 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:24.836755  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2284) took 2287 ms. Trace:
I20260709 13:17:24.837252  3971 rpcz_store.cc:276] 0709 13:17:22.561039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.182989 (+1621950us) service_pool.cc:224] Handling call
0709 13:17:24.200888 (+ 17899us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.836018 (+635130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.836518 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:24.752210  3966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.010s	sys 0.004s
I20260709 13:17:24.752735  3972 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:17:24.753470  3970 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
W20260709 13:17:24.752835  3969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.009s	sys 0.006s
W20260709 13:17:24.259567  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:24.275802  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 462837us
I20260709 13:17:24.295109  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:24.757133  4045 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:17:24.757056  4039 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.006s	sys 0.004s
I20260709 13:17:24.767410  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2733) took 1193 ms. Trace:
W20260709 13:17:24.769348  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.006s	sys 0.019s
I20260709 13:17:24.771003  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:24.773517  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.780640  7049 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:24.783808  7214 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:24.958029  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 271) took 1145 ms. Trace:
I20260709 13:17:24.803911  7598 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.806232  7648 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.815003  7707 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.015s	sys 0.007s
W20260709 13:17:24.824319  7690 consensus_meta.cc:287] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.729s	user 0.012s	sys 0.000s
I20260709 13:17:24.703856  7798 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:24.968101  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:24.957706  4047 rpcz_store.cc:276] 0709 13:17:23.574171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.362287 (+788116us) service_pool.cc:224] Handling call
0709 13:17:24.362632 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.363167 (+   535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.363200 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.365334 (+  2134us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.765568 (+400234us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:24.766407 (+   839us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.766768 (+   361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.766900 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:24.766959 (+    59us) raft_consensus.cc:1685] finished
0709 13:17:24.766970 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.767201 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":102841,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":2230,"raft.queue_time_us":27131,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":19046,"thread_start_us":399498,"threads_started":1,"wal-append.queue_time_us":304974}
I20260709 13:17:24.975553  7798 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:24.121309  3869 rpcz_store.cc:269] 0709 13:17:05.312422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:05.317447 (+  5025us) service_pool.cc:224] Handling call
0709 13:17:24.114499 (+18797052us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:15.008918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:15.009663 (+   745us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:15.009723 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:17:15.009740 (+    17us) tablet.cc:662] Decoding operations
0709 13:17:15.010661 (+   921us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:15.010748 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:15.010775 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:17:15.011458 (+   683us) tablet.cc:701] Row locks acquired
0709 13:17:15.011503 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:17:15.011663 (+   160us) write_op.cc:270] Start()
0709 13:17:15.011800 (+   137us) write_op.cc:276] Timestamp: P: 1783603035011593 usec, L: 0
0709 13:17:15.011856 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:17:15.053053 (+ 41197us) log.cc:844] Serialized 2870 byte log entry
0709 13:17:16.136153 (+1083100us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b18003f2e60. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:16.698169 (+562016us) op_driver.cc:464] REPLICATION: finished
0709 13:17:16.837666 (+139497us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed733420ac 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed79e82ef0
0709 13:17:17.016230 (+178564us) write_op.cc:301] APPLY: starting
0709 13:17:17.016325 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:17.016558 (+   233us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:17.016597 (+    39us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:17.017599 (+  1002us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:17.017880 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:17:17.017959 (+    79us) write_op.cc:312] APPLY: finished
0709 13:17:17.018261 (+   302us) log.cc:844] Serialized 59 byte log entry
0709 13:17:17.018438 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:17.018553 (+   115us) write_op.cc:454] Released schema lock
0709 13:17:17.018620 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:17.019040 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:17.019070 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":770445,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":309844,"apply.run_cpu_time_us":2799,"apply.run_wall_time_us":2799,"num_ops":7,"prepare.queue_time_us":371534,"prepare.run_cpu_time_us":26993,"prepare.run_wall_time_us":354984,"raft.queue_time_us":288559,"raft.run_cpu_time_us":17023,"raft.run_wall_time_us":340318,"replication_time_us":1663450,"spinlock_wait_cycles":42254464,"thread_start_us":819641,"threads_started":4,"wal-append.queue_time_us":264315,"wal-append.run_cpu_time_us":66035,"wal-append.run_wall_time_us":1866367}]]}
W20260709 13:17:24.172326  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2012449549999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:17:24.980082  7837 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:24.878358  3966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.916s	user 0.011s	sys 0.004s
I20260709 13:17:24.981078  7837 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.982107  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 483) took 2585 ms. Trace:
I20260709 13:17:24.982497  3966 rpcz_store.cc:276] 0709 13:17:22.397186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.961190 (+1564004us) service_pool.cc:224] Handling call
0709 13:17:23.961447 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.961632 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:23.961866 (+   234us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.981485 (+1019619us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:24.981603 (+   118us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:24.981705 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.981817 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:24.982039 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23019,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"thread_start_us":1018984,"threads_started":1,"wal-append.queue_time_us":678940}
W20260709 13:17:24.878037  3969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.009s	sys 0.006s
I20260709 13:17:24.837472  7841 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:24.985397  7690 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:24.985972  7690 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:24.985633  7841 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.986371  7690 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:24.987129  7648 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.989084  4112 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:24.989492  7648 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.990173  7859 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:24.990895  7859 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.962334  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.006s	sys 0.019s
W20260709 13:17:24.963968  4039 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.981s	user 0.007s	sys 0.004s
W20260709 13:17:24.963578  7707 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.016s	sys 0.008s
W20260709 13:17:24.966985  4038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.026s
W20260709 13:17:24.967599  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 672410us
I20260709 13:17:24.968071  7598 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:24.969190  7866 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.003575  4117 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:24.971326  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:24.981212  7214 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:24.959138  4045 rpcz_store.cc:276] 0709 13:17:23.812287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.505182 (+692895us) service_pool.cc:224] Handling call
0709 13:17:24.756117 (+250935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.957272 (+201155us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:24.957966 (+   694us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:24.984441  7837 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:24.966954  7049 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:24.982420  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 211803us
W20260709 13:17:24.998574  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 827139us
I20260709 13:17:24.976672  7864 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:25.004302  7859 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.005491  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2722) took 1882 ms. Trace:
W20260709 13:17:25.007691  3965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.000s	sys 0.013s
I20260709 13:17:25.009738  3971 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:25.012914  7780 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.014132  7812 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:24.971117  3967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.003s	sys 0.004s
I20260709 13:17:24.980782  4681 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:25.017247  4038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.007s	sys 0.026s
W20260709 13:17:25.022382  3967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.004s	sys 0.005s
I20260709 13:17:25.022720  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:25.025715  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2724) took 1754 ms. Trace:
I20260709 13:17:25.026623  4118 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:25.027818  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2652) took 2545 ms. Trace:
I20260709 13:17:25.028193  3967 rpcz_store.cc:276] 0709 13:17:22.482044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.120470 (+1638426us) service_pool.cc:224] Handling call
0709 13:17:24.145487 (+ 25017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.145718 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:24.184638 (+ 38920us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.027333 (+842695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.027435 (+   102us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.027533 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.027623 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.027763 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37543,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":838926,"threads_started":1}
I20260709 13:17:25.030330  3967 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:25.030931  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2656) took 1947 ms. Trace:
I20260709 13:17:25.031237  3967 rpcz_store.cc:276] 0709 13:17:23.083480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.029638 (+1946158us) service_pool.cc:224] Handling call
0709 13:17:25.030046 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.030706 (+   660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.030859 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.025745  3963 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:25.032251  3963 pending_rounds.cc:85] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:25.032496  3963 pending_rounds.cc:107] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:25.032810  3963 raft_consensus.cc:2889] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.033654  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2655) took 1950 ms. Trace:
I20260709 13:17:25.033962  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.034309  7780 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:25.035092  7707 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:17:25.035491  7921 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:17:25.026175  4038 rpcz_store.cc:276] 0709 13:17:23.271683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.978197 (+706514us) service_pool.cc:224] Handling call
0709 13:17:23.978525 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.978730 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:24.399180 (+420450us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.025132 (+625952us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.025253 (+   121us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:25.025377 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.025473 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.025652 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":606689,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"raft.queue_time_us":1760,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"thread_start_us":1045621,"threads_started":2,"wal-append.queue_time_us":605596}
I20260709 13:17:25.038697  7049 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.039898  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2653) took 1948 ms. Trace:
I20260709 13:17:24.980789  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.047135  3971 rpcz_store.cc:276] 0709 13:17:23.072721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.903019 (+1830298us) service_pool.cc:224] Handling call
0709 13:17:25.009321 (+106302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.020620 (+ 11299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.020879 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.032585  3967 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.034016  3963 rpcz_store.cc:276] 0709 13:17:23.083165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.004739 (+1921574us) service_pool.cc:224] Handling call
0709 13:17:25.025072 (+ 20333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.033417 (+  8345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.033584 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:25.045900  3965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.000s	sys 0.013s
I20260709 13:17:25.062021  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2657) took 1978 ms. Trace:
I20260709 13:17:25.070637  3967 rpcz_store.cc:276] 0709 13:17:23.083750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.031951 (+1948201us) service_pool.cc:224] Handling call
0709 13:17:25.032322 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.054752 (+ 22430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.061945 (+  7193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.029156  7214 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.019495  4042 rpcz_store.cc:276] 0709 13:17:23.122695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.959962 (+837267us) service_pool.cc:224] Handling call
0709 13:17:23.960217 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.960418 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:24.478443 (+518025us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.004706 (+526263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.004837 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.004978 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.005088 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.005276 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":617739,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":2389,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":156,"spinlock_wait_cycles":32514304,"thread_start_us":986895,"threads_started":2,"wal-append.queue_time_us":504096}
I20260709 13:17:25.023124  7864 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.086818  7598 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:25.088479  7510 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.597s	user 0.011s	sys 0.011s
W20260709 13:17:25.088876  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.092391  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 121423us
I20260709 13:17:25.093904  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:25.097600  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63865.8us
I20260709 13:17:25.098453  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.102495  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2651) took 2622 ms. Trace:
I20260709 13:17:25.102754  7596 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.112896  7869 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.113973  7867 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.115264  7867 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.094941  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:25.117326  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 360) took 1070 ms. Trace:
W20260709 13:17:25.118443  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96068.2us
I20260709 13:17:25.119640  7709 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:25.120684  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 140381us
I20260709 13:17:25.121650  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:25.122205  3970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2275) took 2959 ms (client timeout 1504 ms). Trace:
W20260709 13:17:25.122620  3970 rpcz_store.cc:269] 0709 13:17:22.162898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.173471 (+ 10573us) service_pool.cc:224] Handling call
0709 13:17:25.121951 (+2948480us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b5400279554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.122112 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5889581440}
I20260709 13:17:25.123420  7598 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:25.125773  7841 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:25.126784  3971 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.127451  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2288) took 1850 ms. Trace:
I20260709 13:17:25.127730  3971 rpcz_store.cc:276] 0709 13:17:23.277061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.072464 (+1795403us) service_pool.cc:224] Handling call
0709 13:17:25.126504 (+ 54040us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.127199 (+   695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.127382 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.128980  7214 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.132328  7869 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.133194  7869 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:25.137409  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2736) took 1516 ms. Trace:
I20260709 13:17:25.137880  4041 rpcz_store.cc:276] 0709 13:17:23.574840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.453855 (+879015us) service_pool.cc:224] Handling call
0709 13:17:24.454245 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.504209 (+ 49964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.504243 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.504743 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.065351 (+560608us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.074680 (+  9329us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.081946 (+  7266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.084204 (+  2258us) raft_consensus.cc:1685] finished
0709 13:17:25.084223 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.090872 (+  6649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49450,"raft.queue_time_us":49575,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":22234,"thread_start_us":191010,"threads_started":1,"wal-append.queue_time_us":214281}
I20260709 13:17:25.141750  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2743) took 1154 ms. Trace:
I20260709 13:17:25.142153  4042 rpcz_store.cc:276] 0709 13:17:23.987670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.096452 (+1108782us) service_pool.cc:224] Handling call
0709 13:17:25.141113 (+ 44661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.141360 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.141387 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.141441 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.141479 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.141528 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.141667 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.143901  4042 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: [11.7-12.8]
W20260709 13:17:25.145349  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.144515  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2341) took 1008 ms. Trace:
I20260709 13:17:25.148279  4042 rpcz_store.cc:276] 0709 13:17:24.136176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.143123 (+1006947us) service_pool.cc:224] Handling call
0709 13:17:25.143511 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:25.144262 (+   751us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.144442 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.088928  7510 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:25.150578  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56835.2us
I20260709 13:17:25.108139  7860 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.117682  4047 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:25.124622  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.143901  7184 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:25.164911  7575 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.165310  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:25.167097  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:25.168459  7840 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.168947  4116 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:25.169641  7866 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:25.170360  7866 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:25.165335  7575 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.173799  7575 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:25.177193  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 78873.7us
W20260709 13:17:25.178416  7903 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:17:25.179167  4680 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:25.181030  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61750us
I20260709 13:17:25.164127  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2280) took 2947 ms. Trace:
I20260709 13:17:25.187923  7899 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:25.189913  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.190668  4679 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
W20260709 13:17:25.158684  4675 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 293) took 3210 ms (client timeout 1641 ms). Trace:
W20260709 13:17:25.191275  4675 rpcz_store.cc:269] 0709 13:17:21.934651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:21.935771 (+  1120us) service_pool.cc:224] Handling call
0709 13:17:25.144372 (+3208601us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b54005f19d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.144538 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5376794880}
I20260709 13:17:25.192008  7901 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:25.168908  7840 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:25.193235  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.193429  7701 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:25.194413  4047 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:17:25.194808  7902 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:17:25.195601  7902 consensus_queue.cc:1243] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:17:25.196943  4046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2302) took 2731 ms (client timeout 1577 ms). Trace:
I20260709 13:17:25.197842  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:25.197383  4046 rpcz_store.cc:269] 0709 13:17:22.413669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:22.421962 (+  8293us) service_pool.cc:224] Handling call
0709 13:17:25.145127 (+2723165us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b540035cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.145275 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3471634304}
I20260709 13:17:25.200459  3968 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:25.199047  7812 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:25.164927  7184 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:25.194043  7840 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.188436  7899 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:25.205372  3938 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:25.190827  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.204439  4680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 303) took 1260 ms. Trace:
I20260709 13:17:25.208740  4680 rpcz_store.cc:276] 0709 13:17:23.924532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.925612 (+  1080us) service_pool.cc:224] Handling call
0709 13:17:25.178513 (+1252901us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.179548 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.180704 (+  1156us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54005f19d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.184446 (+  3742us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2804638976}
I20260709 13:17:25.183640  7709 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:25.178460  7652 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:25.117746  4113 rpcz_store.cc:276] 0709 13:17:24.046451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.046565 (+   114us) service_pool.cc:224] Handling call
0709 13:17:24.046850 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.526373 (+479523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:24.526408 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.545959 (+ 19551us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.999332 (+453373us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:24.999822 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.000172 (+   350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.000296 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.116912 (+116616us) raft_consensus.cc:1685] finished
0709 13:17:25.116934 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.117142 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14210,"prepare.queue_time_us":9792,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":21544,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":46206,"thread_start_us":849809,"threads_started":2,"wal-append.queue_time_us":519049}
I20260709 13:17:25.213228  4120 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:25.213483  7598 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:17:25.213698  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.214149  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2663) took 1709 ms. Trace:
I20260709 13:17:25.146209  3965 rpcz_store.cc:276] 0709 13:17:22.479939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.097205 (+1617266us) service_pool.cc:224] Handling call
0709 13:17:24.097529 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:24.097731 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:24.098010 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.101954 (+1003944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.102045 (+    91us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.102152 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.102248 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.102434 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7117,"prepare.queue_time_us":907,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":17886,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":964138,"threads_started":1,"wal-append.queue_time_us":985639}
I20260709 13:17:25.218783  3971 rpcz_store.cc:276] 0709 13:17:23.504296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.128498 (+1624202us) service_pool.cc:224] Handling call
0709 13:17:25.184543 (+ 56045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.213769 (+ 29226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.213798 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.213854 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.213901 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.213954 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.214072 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.185717  3969 rpcz_store.cc:276] 0709 13:17:22.213760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.945278 (+1731518us) service_pool.cc:224] Handling call
0709 13:17:23.945650 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:23.946131 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:23.946455 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:17:24.985322 (+1038867us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:24.986181 (+   859us) log.cc:844] Serialized 26 byte log entry
0709 13:17:24.986417 (+   236us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.081390 (+ 94973us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.081647 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.095496 (+ 13849us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.146911 (+ 51415us) raft_consensus.cc:1685] finished
0709 13:17:25.146927 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.159633 (+ 12706us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5359,"prepare.queue_time_us":199145,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":41465,"raft.run_cpu_time_us":488,"raft.run_wall_time_us":8937,"thread_start_us":1131788,"threads_started":2,"wal-append.queue_time_us":626328}
I20260709 13:17:25.220211  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:25.207775  7899 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:25.207340  7214 raft_consensus.cc:2764] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:17:25.220906  7598 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.252296  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2290) took 1974 ms. Trace:
I20260709 13:17:25.252794  3967 rpcz_store.cc:276] 0709 13:17:23.277609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.073608 (+1795999us) service_pool.cc:224] Handling call
0709 13:17:25.203364 (+129756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.251916 (+ 48552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.251948 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.251998 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:25.252038 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.252104 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.252229 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:25.255492  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.256351  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 52449us
I20260709 13:17:25.257959  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:25.258103  7868 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:25.258737  7868 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:25.259037  7866 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:25.260032  7868 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.260794  7840 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.269215  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.273021  7864 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.274838  3971 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:25.275480  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2665) took 1752 ms. Trace:
I20260709 13:17:25.275574  7510 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.275888  3971 rpcz_store.cc:276] 0709 13:17:23.523527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.241043 (+1717516us) service_pool.cc:224] Handling call
0709 13:17:25.274376 (+ 33333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.275245 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.275424 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.277925  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2300) took 1600 ms. Trace:
I20260709 13:17:25.284890  7575 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.299612  4047 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:25.302280  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:25.302824  7690 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.303860  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:25.302734  7869 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:25.307092  7690 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.249310  7598 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.285723  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2726) took 2011 ms. Trace:
I20260709 13:17:25.298457  3971 rpcz_store.cc:276] 0709 13:17:23.677654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.276910 (+1599256us) service_pool.cc:224] Handling call
0709 13:17:25.277329 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.277533 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.277559 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.277687 (+   128us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:25.277717 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.277767 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.277872 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.292313  7879 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:25.292850  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 120281us
W20260709 13:17:25.292287  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 167795us
I20260709 13:17:25.294504  7707 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:25.295526  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:25.310603  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:25.291266  7184 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.297132  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:25.297446  7530 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:25.321448  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:25.324918  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2742) took 1478 ms. Trace:
I20260709 13:17:25.326339  4038 rpcz_store.cc:276] 0709 13:17:23.846581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.037212 (+1190631us) service_pool.cc:224] Handling call
0709 13:17:25.037641 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.038555 (+   914us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.038584 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.039143 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:17:25.074396 (+ 35253us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.074432 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.074611 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.324609 (+249998us) raft_consensus.cc:1685] finished
0709 13:17:25.324633 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.324839 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":186,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":135,"thread_start_us":34806,"threads_started":1,"wal-append.queue_time_us":139954}
I20260709 13:17:25.328857  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:25.241225  7812 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:25.340386  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2340) took 1205 ms. Trace:
I20260709 13:17:25.340588  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.341085  4041 rpcz_store.cc:276] 0709 13:17:24.127732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.139635 (+1011903us) service_pool.cc:224] Handling call
0709 13:17:25.140059 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.140372 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:25.151717 (+ 11345us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.325187 (+173470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.325251 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.333174 (+  7923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.333267 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.333391 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9398,"prepare.queue_time_us":11096,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"thread_start_us":111822,"threads_started":1}
I20260709 13:17:25.350831  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:25.334513  7866 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:25.354902  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.357383  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46854.9us
I20260709 13:17:25.347009  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:25.358700  3968 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:17:25.358855  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.359527  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2302) took 1658 ms. Trace:
I20260709 13:17:25.310084  4039 rpcz_store.cc:276] 0709 13:17:23.274738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.982331 (+707593us) service_pool.cc:224] Handling call
0709 13:17:23.982575 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:23.982766 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:24.995443 (+1012677us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.202222 (+206779us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.210257 (+  8035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.215430 (+  5173us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.226675 (+ 11245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.226756 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.285646 (+ 58890us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4948,"prepare.queue_time_us":643268,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":97,"raft.queue_time_us":24154,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":4778,"thread_start_us":1081711,"threads_started":2,"wal-append.queue_time_us":78461}
I20260709 13:17:25.361035  7577 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:17:25.359905  3968 rpcz_store.cc:276] 0709 13:17:23.701055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.314393 (+1613338us) service_pool.cc:224] Handling call
0709 13:17:25.357396 (+ 43003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.359248 (+  1852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.359469 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:25.366250  7925 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:25.367177  4115 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:25.367434  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2741) took 1542 ms. Trace:
I20260709 13:17:25.367820  4045 rpcz_store.cc:276] 0709 13:17:23.825168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.019024 (+1193856us) service_pool.cc:224] Handling call
0709 13:17:25.083964 (+ 64940us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:25.140785 (+ 56821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.140818 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:25.141524 (+   706us) log.cc:844] Serialized 52 byte log entry
0709 13:17:25.223064 (+ 81540us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.223098 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.223165 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:25.367230 (+144065us) raft_consensus.cc:1685] finished
0709 13:17:25.367248 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.367378 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38836,"raft.queue_time_us":40354,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":208,"thread_start_us":81091,"threads_started":1,"wal-append.queue_time_us":151166}
I20260709 13:17:25.369516  3968 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:25.369921  7575 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.370203  7869 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.372349  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2293) took 1710 ms. Trace:
I20260709 13:17:25.372695  3969 rpcz_store.cc:276] 0709 13:17:23.661897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.311834 (+1649937us) service_pool.cc:224] Handling call
0709 13:17:25.357432 (+ 45598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.372040 (+ 14608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.372064 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.372121 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.372158 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.372206 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.372300 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.377274  3969 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:25.377838  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 490) took 1161 ms. Trace:
I20260709 13:17:25.378221  7184 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.379019  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:25.382588  7596 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:25.383553  7596 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:25.370127  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 489) took 1651 ms. Trace:
I20260709 13:17:25.384882  7907 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:25.385087  7709 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.385603  7868 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.386093  7868 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:25.387251  7707 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.387063  7868 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.387624  7707 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:25.378108  3969 rpcz_store.cc:276] 0709 13:17:24.216907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.373691 (+1156784us) service_pool.cc:224] Handling call
0709 13:17:25.374015 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.377596 (+  3581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.377783 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.390764  3968 rpcz_store.cc:276] 0709 13:17:23.718600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.362561 (+1643961us) service_pool.cc:224] Handling call
0709 13:17:25.369289 (+  6728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.369875 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.370053 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.393362  4116 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:25.357733  7864 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:25.373203  7685 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:25.406913  4038 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:25.411213  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 65513.4us
W20260709 13:17:25.415270  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 82686.8us
I20260709 13:17:25.413383  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2303) took 1711 ms. Trace:
I20260709 13:17:25.414788  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:25.404361  7685 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.332715  7879 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:25.383491  7790 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:25.424847  3969 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:25.425526  4113 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:25.426684  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:25.428035  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:25.430625  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 492) took 1213 ms. Trace:
I20260709 13:17:25.431018  3965 rpcz_store.cc:276] 0709 13:17:24.217521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.429618 (+1212097us) service_pool.cc:224] Handling call
0709 13:17:25.430047 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.430275 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.430302 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.430359 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:25.430387 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.430452 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.430555 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.425469  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 491) took 1208 ms. Trace:
I20260709 13:17:25.387064  7907 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:17:25.388743  7707 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.433320  3969 rpcz_store.cc:276] 0709 13:17:24.217278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.408932 (+1191654us) service_pool.cc:224] Handling call
0709 13:17:25.424462 (+ 15530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.425227 (+   765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.425408 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:25.426210  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2643) took 2981 ms. Trace:
I20260709 13:17:25.421551  7685 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.434584  3972 rpcz_store.cc:276] 0709 13:17:22.444993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.979198 (+1534205us) service_pool.cc:224] Handling call
0709 13:17:23.979523 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:24.942517 (+962994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.425941 (+483424us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b5400278654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:25.426155 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1776402688}
I20260709 13:17:25.440107  4114 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:25.414438  7860 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:25.442106  7707 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.445266  3969 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.447113  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:25.437995  4119 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:25.449911  7940 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:25.450313  7940 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:25.450721  7940 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.467023  4116 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:25.469240  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.469501  7945 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:25.470182  7945 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.470525  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:25.471635  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.472196  3972 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:25.463243  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.476998  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:25.478698  4038 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:25.488946  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 167575us
I20260709 13:17:25.472342  7945 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.467711  7596 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:25.507689  7510 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.508118  7510 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:25.509056  7510 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.467904  7866 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:25.518364  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.521515  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.522270  4675 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
W20260709 13:17:25.530926  7932 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.445s	user 0.001s	sys 0.003s
I20260709 13:17:25.491600  3965 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:25.533710  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:25.534957  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:25.535126  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.500890  7937 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.536010  7937 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:25.537653  4044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2740) took 1922 ms (client timeout 1835 ms). Trace:
W20260709 13:17:25.538097  4044 rpcz_store.cc:269] 0709 13:17:23.615555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.691071 (+ 75516us) service_pool.cc:224] Handling call
0709 13:17:25.537220 (+1846149us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540041bc54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.537454 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566548224}
I20260709 13:17:25.505504  7782 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:25.543241  4678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 314) took 2077 ms (client timeout 1818 ms). Trace:
W20260709 13:17:25.543835  4678 rpcz_store.cc:269] 0709 13:17:23.466052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:23.466520 (+   468us) service_pool.cc:224] Handling call
0709 13:17:25.542643 (+2076123us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54005c0154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.542993 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675189632}
I20260709 13:17:25.545646  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2336) took 1469 ms. Trace:
I20260709 13:17:25.546166  4043 rpcz_store.cc:276] 0709 13:17:24.076010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.246828 (+170818us) service_pool.cc:224] Handling call
0709 13:17:25.545146 (+1298318us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540002a8d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.545406 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":322022144}
I20260709 13:17:25.547972  4681 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:17:25.550272  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116218us
I20260709 13:17:25.551832  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.553406  4040 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:17:25.557839  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:25.555418  4112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2320) took 1426 ms (client timeout 1699 ms). Trace:
I20260709 13:17:25.575505  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:25.582170  4112 rpcz_store.cc:269] 0709 13:17:24.129262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.129368 (+   106us) service_pool.cc:224] Handling call
0709 13:17:25.555158 (+1425790us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54003a7fd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.555336 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919370496}
I20260709 13:17:25.514938  7598 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:25.573840  7939 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.108s	user 0.003s	sys 0.000s
W20260709 13:17:25.564337  7926 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 13:17:25.640987  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 380318us
I20260709 13:17:25.619860  3938 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:25.638111  3972 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:25.512411  7899 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.552753  7367 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:25.639755  3965 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:25.554992  7780 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:25.594923  7790 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.646507  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 52960.9us
I20260709 13:17:25.653138  3970 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 6. Current term is 8. Ops: []
I20260709 13:17:25.644791  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2289) took 2363 ms. Trace:
I20260709 13:17:25.647851  7049 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.639513  7841 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:17:25.654233  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.668058  7534 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.711745  7534 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.713521  7510 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.714022  7534 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.636540  7798 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:17:25.715140  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
W20260709 13:17:25.674738  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99327us
I20260709 13:17:25.653009  7184 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:25.720376  7184 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:25.720817  7184 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.720953  7790 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.722265  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.652798  7685 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:25.708706  7841 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:25.649639  7838 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 13:17:25.726155  7841 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.727305  7838 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.727752  7838 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:25.728654  7838 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:25.730293  7838 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:25.683724  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 131978us
I20260709 13:17:25.732455  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:25.686298  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2392) took 1506 ms (client timeout 1841 ms). Trace:
W20260709 13:17:25.733179  4114 rpcz_store.cc:269] 0709 13:17:24.180027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.249190 (+ 69163us) service_pool.cc:224] Handling call
0709 13:17:25.686048 (+1436858us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b5400080554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.686231 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2599766912}
I20260709 13:17:25.727289  7841 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:25.735514  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2737) took 2160 ms. Trace:
I20260709 13:17:25.735915  4040 rpcz_store.cc:276] 0709 13:17:23.575050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.458641 (+883591us) service_pool.cc:224] Handling call
0709 13:17:25.552955 (+1094314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.598323 (+ 45368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.735283 (+136960us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540002a8d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:25.735448 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498790784}
I20260709 13:17:25.737733  7868 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:25.696518  7879 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:25.740217  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 486) took 2369 ms. Trace:
I20260709 13:17:25.740670  3970 rpcz_store.cc:276] 0709 13:17:23.370587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.123899 (+1753312us) service_pool.cc:224] Handling call
0709 13:17:25.299606 (+175707us) spinlock_profiling.cc:243] Waited 23.9 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:17:25.299846 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.653699 (+353853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.739951 (+ 86252us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b5400397bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:25.740152 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866834176}
I20260709 13:17:25.745244  7690 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:25.745746  7690 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:25.746697  7690 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.748208  7690 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.749586  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2393) took 1569 ms. Trace:
I20260709 13:17:25.749995  4120 rpcz_store.cc:276] 0709 13:17:24.180249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.473394 (+293145us) service_pool.cc:224] Handling call
0709 13:17:24.473692 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.250866 (+777174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.749219 (+498353us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54003a84d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:25.749517 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679639808}
I20260709 13:17:25.754526  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:25.755465  4675 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:17:25.789002  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71330us
I20260709 13:17:25.690914  3966 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:25.691897  7904 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:25.692915  7714 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:25.693588  7910 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:25.695587  7598 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:25.697482  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:25.702885  7812 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:25.705751  7907 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.706943  3968 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.416838  3971 rpcz_store.cc:276] 0709 13:17:23.701279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.323529 (+1622250us) service_pool.cc:224] Handling call
0709 13:17:25.354021 (+ 30492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.361036 (+  7015us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:25.361379 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.412172 (+ 50793us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.412365 (+   193us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.412414 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:25.412462 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.412525 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.412639 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":4034,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":1098,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3088,"spinlock_wait_cycles":12967552,"thread_start_us":50029,"threads_started":1}
I20260709 13:17:25.704378  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.639689  7652 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.711143  3965 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:25.724224  7899 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.687156  7940 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.790198  3970 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:25.796132  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2654) took 2723 ms. Trace:
I20260709 13:17:25.846091  3966 rpcz_store.cc:276] 0709 13:17:23.073095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:24.984381 (+1911286us) service_pool.cc:224] Handling call
0709 13:17:25.690272 (+705891us) spinlock_profiling.cc:243] Waited 7.84 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:17:25.690519 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.791360 (+100841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.796060 (+  4700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18038144}
I20260709 13:17:25.803776  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.796552  7904 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:25.866487  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57879.3us
I20260709 13:17:25.838523  7907 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.841558  7910 consensus_queue.cc:1243] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:25.872964  7879 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.873960  7879 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.848119  7864 raft_consensus.cc:2764] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:25.880425  3965 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:25.884807  7907 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:25.889284  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 156982us
I20260709 13:17:25.650027  7367 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:25.908252  7367 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:25.909993  7367 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:25.911533  7790 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.806337  7685 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:25.650532  7780 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:25.812533  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.817679  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 357602us
I20260709 13:17:25.665148  3963 rpcz_store.cc:276] 0709 13:17:23.277361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.295338 (+2017977us) service_pool.cc:224] Handling call
0709 13:17:25.295711 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.296091 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:25.296738 (+   647us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.640288 (+343550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.640348 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:25.640405 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.640492 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.640643 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":100108,"prepare.queue_time_us":1949,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":145335,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":10439,"thread_start_us":154657,"threads_started":1}
I20260709 13:17:25.915199  3963 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:25.915494  7780 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.916538  3963 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:25.917647  3963 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 6. Current term is 7. Ops: []
I20260709 13:17:25.918133  3971 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: [11.6-11.6]
W20260709 13:17:25.919126  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 460773us
W20260709 13:17:25.920251  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52978.4us
I20260709 13:17:25.847728  3972 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.850035  7937 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.850178  4675 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:25.850790  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:25.932173  7951 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:25.854067  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 149775us
I20260709 13:17:25.854712  7840 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:25.855583  7214 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:25.954250  3963 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [8.5-11.7]
W20260709 13:17:25.954591  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:25.858048  7869 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:25.860360  7598 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.811259  7812 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.861542  7049 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:25.862406  7940 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.865635  3970 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:25.924619  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:25.961798  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 383137us
I20260709 13:17:25.931056  3966 pending_rounds.cc:85] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:25.965308  3966 pending_rounds.cc:107] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:17:25.965618  3966 raft_consensus.cc:2889] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:25.933434  3968 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:25.916687  7780 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:25.959890  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.963769  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:25.964681  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 320213us
I20260709 13:17:25.962443  7049 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.965029  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.876742  7879 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:25.968058  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:25.970279  3963 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:25.933260  7866 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:25.976737  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:25.980930  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:25.984736  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2295) took 2321 ms. Trace:
I20260709 13:17:25.978623  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:25.994796  4044 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:25.995734  3971 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:25.932910  7945 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:17:25.957703  7937 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:25.982414  7840 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:26.009215  4041 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:26.009794  4041 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:25.952293  7951 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.012979  4046 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:26.017369  7049 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.013845  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:26.020417  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.021283  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.024847  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.996479  3967 rpcz_store.cc:276] 0709 13:17:23.663081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.311810 (+1648729us) service_pool.cc:224] Handling call
0709 13:17:25.352304 (+ 40494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:25.411675 (+ 59371us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:25.598421 (+186746us) log.cc:844] Serialized 14 byte log entry
0709 13:17:25.973117 (+374696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:25.973166 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:25.984497 (+ 11331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:25.984565 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:25.984673 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3268,"prepare.queue_time_us":156207,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":11724,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":9269,"thread_start_us":428843,"threads_started":2}
I20260709 13:17:25.994876  7879 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:26.030566  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.041476  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.984706  7598 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.036470  3968 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:26.049909  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:26.050644  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 73993.1us
I20260709 13:17:26.045907  4041 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.057657  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.056161  3971 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:26.001072  7866 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:25.985404  7941 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:17:26.064078  4649 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.066671  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:25.998720  7812 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.037997  7940 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.040601  7709 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:26.083503  3967 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 8: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:26.066511  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:26.079430  4045 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:26.072022  3972 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:26.084075  7940 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:26.090399  7936 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:26.090793  7940 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.086356  7937 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.096109  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:26.097342  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.097781  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:26.098791  7812 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:26.090997  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63118.3us
I20260709 13:17:26.091133  7709 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.099615  7910 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:26.099746  7867 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:26.101351  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.101661  7910 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:26.102610  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.102855  7910 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.103781  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.103947  7690 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:26.104681  7690 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:26.103991  7184 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.105865  7690 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.107493  7184 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:26.109040  3963 raft_consensus.cc:2368] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12.
I20260709 13:17:26.109606  7709 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:26.109819  7945 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.098052  4046 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.110316  7945 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:26.105751  7949 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.111711  7949 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:26.112072  7949 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:26.113674  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 87865.5us
I20260709 13:17:26.090418  4041 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.115375  7963 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.115794  7963 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.116127  7963 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.090950  7936 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:26.098043  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:26.117818  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2746) took 1194 ms. Trace:
I20260709 13:17:26.111239  4046 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:26.118911  4042 rpcz_store.cc:276] 0709 13:17:24.947282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.163939 (+216657us) service_pool.cc:224] Handling call
0709 13:17:25.209612 (+ 45673us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.465517 (+255905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.465550 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.490063 (+ 24513us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.061438 (+571375us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:26.061473 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.061540 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.117599 (+ 56059us) raft_consensus.cc:1685] finished
0709 13:17:26.117623 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.117758 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59704,"raft.queue_time_us":101596,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":15548,"thread_start_us":570937,"threads_started":2,"wal-append.queue_time_us":504126}
I20260709 13:17:26.127408  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.130442  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:26.148641  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 183937us
I20260709 13:17:26.166448  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:26.168349  3972 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:26.169142  3972 pending_rounds.cc:85] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:26.169361  3972 pending_rounds.cc:107] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:26.169601  3972 raft_consensus.cc:2889] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.171882  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.111292  7955 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.145269  7867 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.074210  7879 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.132524  7860 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:17:26.117823  7936 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.230715  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:26.212172  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.188868  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:26.111258  7945 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.199083  7184 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:26.229779  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:26.198112  7941 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:26.200624  7812 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.237649  4045 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:17:26.188342  7869 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.185783  7367 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 13:17:26.258677  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.258064  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.186666  7685 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.249845  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 146250us
I20260709 13:17:26.249261  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:26.251004  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 135745us
I20260709 13:17:26.256808  4041 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:17:26.267324  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:26.260818  4041 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 6
I20260709 13:17:26.274547  4041 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:26.275182  4041 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.234782  7790 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:26.254598  7867 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:26.182435  7904 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.278564  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.290099  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.236245  7709 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:17:26.296048  3967 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:26.274775  7910 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:26.296051  4045 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.301268  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.303303  3970 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:26.312175  4041 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.204556  7955 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.259562  7812 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.337235  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.329910  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.273475  7869 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.338120  4114 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:26.341665  4114 pending_rounds.cc:85] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 6
I20260709 13:17:26.342228  4114 pending_rounds.cc:107] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:26.342485  4114 raft_consensus.cc:2889] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.339684  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:26.321687  7965 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:17:26.318876  7937 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:26.354640  7868 consensus_meta.cc:287] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.616s	user 0.013s	sys 0.000s
I20260709 13:17:26.355314  7951 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.354530  7937 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.358436  7937 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:26.360603  7966 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:17:26.361106  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.361537  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83046us
I20260709 13:17:26.362942  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.363979  7936 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.317487  7867 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:26.335983  7575 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:26.353341  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:26.338927  7510 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.003s
I20260709 13:17:26.319221  7910 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.318899  7861 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.177s
I20260709 13:17:26.355368  4043 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:17:26.414858  4115 raft_consensus.cc:606] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:26.321956  7598 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.367950  7866 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.338706  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.295279  7685 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.304045  7214 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.365396  7652 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:26.420208  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.419512  4045 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.364964  7714 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:26.377043  4118 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.304342  7938 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.193s
I20260709 13:17:26.405061  4041 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.300252  7184 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:26.406893  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 139544us
I20260709 13:17:26.411379  4039 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:26.416051  4115 raft_consensus.cc:614] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:26.331784  7976 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
W20260709 13:17:26.418222  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 140819us
I20260709 13:17:26.415063  4043 pending_rounds.cc:85] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 6
W20260709 13:17:26.421403  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 320018us
I20260709 13:17:26.439705  4043 pending_rounds.cc:107] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:17:26.440018  4043 raft_consensus.cc:2889] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:26.413924  7971 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
I20260709 13:17:26.441115  4117 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:26.412878  7575 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:26.441337  7868 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.453778  7981 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:26.456643  7685 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.459198  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:26.461688  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.462327  7780 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:26.463634  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.464224  3968 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.464995  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.465495  3968 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.465672  7184 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:26.467329  7967 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:17:26.469547  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.470274  3965 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:26.471061  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.471608  3965 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:26.472360  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.473714  7575 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.475112  7575 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:26.477118  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:26.477780  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:26.479060  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.460523  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.483831  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:26.461588  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:26.446906  7969 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.123s	user 0.003s	sys 0.000s
I20260709 13:17:26.485646  7861 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:26.488539  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:26.490937  7790 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.491348  7790 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.491678  7790 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.491585  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:26.447944  7367 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:26.496438  4045 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:26.497148  3968 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:26.499698  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.502638  4013 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.503535  3968 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:26.503810  3968 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:26.490599  3965 raft_consensus.cc:2410] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:26.507015  3970 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:26.509277  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:26.446380  7949 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.510553  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.511154  4040 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:26.494976  7866 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.495802  7367 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:26.453822  7868 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.518848  3972 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:17:26.513726  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.521137  3968 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.508618  7869 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.508304  7840 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:26.590545  4116 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:26.473809  7867 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:26.616003  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76254.2us
W20260709 13:17:26.615367  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93304.2us
I20260709 13:17:26.616025  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2677) took 1159 ms. Trace:
I20260709 13:17:26.620268  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.621167  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.515205  7780 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:17:26.618628  3964 rpcz_store.cc:276] 0709 13:17:25.456324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.919167 (+462843us) service_pool.cc:224] Handling call
0709 13:17:25.929112 (+  9945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:25.929518 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:25.929546 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:25.930027 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:17:26.148370 (+218343us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:26.148408 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:26.148472 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:26.612435 (+463963us) raft_consensus.cc:1685] finished
0709 13:17:26.612457 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:26.615959 (+  3502us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22052,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":3695,"thread_start_us":217967,"threads_started":1,"wal-append.queue_time_us":325315}
W20260709 13:17:26.635733  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 189235us
I20260709 13:17:26.617097  7840 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:26.640064  4044 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.002s
I20260709 13:17:26.640419  4044 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:26.641189  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.642989  3968 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.632798  7841 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:26.554479  7866 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.636644  7987 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:26.647717  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 151194us
I20260709 13:17:26.647742  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.635365  7869 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:17:26.628324  7937 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:26.650825  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 141622us
I20260709 13:17:26.651080  4120 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:26.634516  7812 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.624279  7707 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:17:26.670083  7910 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:26.671976  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:26.644707  7840 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.639596  7988 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:26.659564  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.661360  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:26.662314  7940 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.571s	user 0.011s	sys 0.000s
I20260709 13:17:26.663367  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:26.689997  4046 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:26.690384  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:26.664889  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:26.691955  7940 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.665354  7951 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:26.648867  7841 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.673838  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.687701  4120 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:26.692927  7983 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:26.668486  7866 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:26.698932  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43974.3us
I20260709 13:17:26.656919  7937 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.700790  7841 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.674672  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:26.721665  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 64615.1us
I20260709 13:17:26.723470  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:17:26.724254  4046 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:17:26.652999  7987 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:26.702425  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:26.702986  7963 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.003s
I20260709 13:17:26.734081  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:26.654059  7955 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:26.752399  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 93786.4us
I20260709 13:17:26.733484  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:26.754597  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 80875.1us
I20260709 13:17:26.753782  4112 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:26.729352  7937 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.756484  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.758905  4680 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:17:26.741923  7812 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:26.737284  7949 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:26.739120  7989 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:17:26.742792  7987 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:26.742785  7904 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:26.752866  7866 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.739774  7707 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:17:26.769556  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67218us
I20260709 13:17:26.743323  7997 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.771967  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.780278  3968 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:17:26.780880  3968 pending_rounds.cc:85] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 7
I20260709 13:17:26.781179  3968 pending_rounds.cc:107] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:26.781883  3968 raft_consensus.cc:2889] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:26.776393  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.765606  7860 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:26.788736  7940 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:26.791190  7977 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:17:26.783712  7936 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:26.792922  7936 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.793259  7936 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:26.793769  7987 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.795984  7987 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.797776  7951 raft_consensus.cc:993] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:17:26.798228  7951 raft_consensus.cc:1081] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:17:26.763635  7812 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:26.801666  7812 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.773787  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.807955  7868 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.810395  7907 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:26.810998  7907 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:26.811990  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.811887  7907 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.813235  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.814174  7949 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:26.814478  4011 leader_election.cc:400] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12.
I20260709 13:17:26.814774  4011 leader_election.cc:403] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:26.815555  7577 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.755630  7963 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.818563  7963 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:26.821077  4681 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:26.814333  7575 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:26.702790  7988 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.825505  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40680 (request call id 41) took 1124 ms. Trace:
I20260709 13:17:26.825281  7997 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.825886  4115 rpcz_store.cc:276] 0709 13:17:25.701628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.714955 (+ 13327us) service_pool.cc:224] Handling call
0709 13:17:26.825281 (+1110326us) spinlock_profiling.cc:243] Waited 699 ms on lock 0x7b540026b1d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:26.825391 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1607303552}
I20260709 13:17:26.826925  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:26.827677  7988 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:26.825521  4040 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:17:26.810524  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 332053us
I20260709 13:17:26.834233  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:26.771984  7707 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:26.828433  7997 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:26.842458  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.843371  4115 raft_consensus.cc:2410] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:26.851055  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:26.851261  4040 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:26.853813  3972 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.855103  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:26.853813  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:26.856426  3964 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:26.858609  3963 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:26.859850  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:26.860543  4040 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:26.841657  7780 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:26.841781  7707 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:26.852988  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.864516  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:26.845237  7941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.015s	sys 0.010s
I20260709 13:17:26.841557  7999 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.865818  3972 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:17:26.866055  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:26.808007  7790 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.873513  3971 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:26.882885  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.895279  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:26.897585  3963 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:26.841468  7575 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:26.862818  7860 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:26.839174  7861 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:17:26.896502  8007 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:26.870747  7941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.016s	sys 0.011s
I20260709 13:17:26.858079  7840 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.891281  7780 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:26.906450  7907 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:26.943454  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:26.871681  7997 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:17:26.873456  7951 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:17:26.866691  7841 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.891672  7955 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:17:26.971606  7780 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:26.985795  7780 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:26.949417  7963 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:26.892304  7999 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:26.952320  8005 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:26.973312  7984 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.197s	user 0.001s	sys 0.001s
W20260709 13:17:26.973603  7973 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.503s	user 0.005s	sys 0.012s
W20260709 13:17:26.973858  7991 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.079s	user 0.002s	sys 0.000s
I20260709 13:17:26.974133  8001 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:17:26.974457  7790 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:26.975610  8000 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:17:26.982247  7840 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:26.989254  4118 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:27.005851  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:26.904986  7867 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:17:26.954716  7577 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12.
W20260709 13:17:26.972558  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77367.1us
I20260709 13:17:26.988512  7841 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:26.950080  7866 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:17:26.958029  7941 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:26.969959  8007 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:17:26.969300  7907 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.010162  8005 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.026549  8014 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.027148  8014 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.028834  7707 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.031101  7707 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.024091  8007 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:27.032100  8007 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:17:27.037396  7941 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.040959  8005 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:27.049896  8018 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.050537  8018 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.024379  7907 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.058782  8014 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.065712  7907 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.067078  7936 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.068782  7907 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.050420  7812 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.070351  7652 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.070899  7652 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.071175  7812 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:27.073675  4044 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
W20260709 13:17:27.076088  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 193298us
I20260709 13:17:27.081727  7907 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.082353  7907 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.084699  7937 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.087986  8021 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.088521  8021 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.089630  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.090197  4042 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.093096  4116 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:27.073505  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.099421  8018 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:27.089046  7652 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:27.100111  8007 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.103396  7879 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.103871  7955 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.106202  7936 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.104372  7955 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.108906  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.111063  4046 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:27.111521  4042 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:27.092588  7367 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.110658  8007 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:27.114647  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.118500  7955 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:27.118827  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.119467  4112 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:27.123322  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.129432  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.130725  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.123607  4046 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
W20260709 13:17:27.123714  7598 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:17:27.131865  4042 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:17:27.116371  7367 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.132808  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.118441  7999 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.133337  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.133946  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.134123  3966 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:27.135208  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.136327  3966 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:27.135356  7907 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.141427  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.142541  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.143918  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.136601  4678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 310) took 1059 ms. Trace:
I20260709 13:17:27.146842  4678 rpcz_store.cc:276] 0709 13:17:26.077253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.084048 (+  6795us) service_pool.cc:224] Handling call
0709 13:17:26.179570 (+ 95522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.190088 (+ 10518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.198078 (+  7990us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:26.266372 (+ 68294us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.135999 (+869627us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b1800434200. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1
0709 13:17:27.136167 (+   168us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.136212 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.136280 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.136337 (+    57us) raft_consensus.cc:1685] finished
0709 13:17:27.136352 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.136544 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117171,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16423,"spinlock_wait_cycles":22143232,"thread_start_us":35432,"threads_started":1,"wal-append.queue_time_us":26537}
I20260709 13:17:27.142460  7510 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:27.150368  7510 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:27.151266  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.153549  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.151254  7510 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.154217  4046 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.154697  7510 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:27.158330  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.162074  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:27.163643  7955 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.164338  7955 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:27.165401  7955 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:27.165738  7955 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:27.166772  7955 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.167934  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:27.170710  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.172274  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.172915  4112 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.168270  7955 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.165728  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:27.165788  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.173761  3966 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:27.173095  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.173723  4681 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:27.176657  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.176721  4648 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:27.177611  3966 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:27.178620  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.180351  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.182334  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.184062  4117 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:27.189647  7910 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.193177  7910 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.190416  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.196112  7910 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.178465  8022 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:27.191720  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.197144  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.197105  8022 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.198047  8022 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.198964  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.199687  4120 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:27.200906  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.201452  4120 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:27.202637  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.192636  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:27.197613  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.178615  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.203992  3966 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:17:27.204542  4121 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:27.205713  4046 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:27.205801  4115 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.209298  4112 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:27.209379  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:27.210023  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.211205  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.212150  4112 raft_consensus.cc:2410] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:27.213209  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.206171  7910 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.216133  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.216455  7510 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.216614  7910 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.216991  7510 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.217512  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.218884  7910 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:27.218847  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.220610  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.221473  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.221621  4112 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:27.222553  4113 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:27.222105  3966 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:27.223242  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.223939  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.226279  4042 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:27.227373  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.228977  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:27.230101  7798 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:27.232005  8021 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.235001  7868 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:27.235441  7868 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:27.223088  7996 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:27.236356  7868 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.239305  7868 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:27.240695  4046 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:27.242491  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.243562  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.244304  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.245329  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.246065  4087 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:27.222783  7510 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:27.250587  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.251305  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.257227  4114 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:27.255831  3966 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:27.256495  3967 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:27.264680  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.265430  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:27.267133  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.266726  8021 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:27.270700  8022 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.271708  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.272298  3969 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:27.274163  8022 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:27.275918  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237eb348003645f7abcc1c18bd324690"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:27.276571  4120 raft_consensus.cc:606] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:27.277501  4120 raft_consensus.cc:614] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:27.278921  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:27.278829  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.280161  4114 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.276098  8021 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.282750  7690 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:27.283381  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.284852  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.281477  8021 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:27.286907  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:27.287101  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.287569  4120 raft_consensus.cc:606] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:27.287685  3967 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:27.289012  3937 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.577s (SENT) [suppressed 8 similar messages]
I20260709 13:17:27.285468  3969 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:27.296622  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.297354  3966 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:27.303854  4114 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:17:27.305984  4112 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:27.265657  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:27.310243  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.310918  3969 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:27.313233  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3838320919999205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
I20260709 13:17:27.311879  7690 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:17:27.314865  7907 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:27.315454  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:27.316232  4678 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:27.317713  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.318758  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:27.313695  3937 connection.cc:256] RPC call timeout handler was delayed by -1.343332091999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:17:27.319309  3969 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:27.319447  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3064320919997954s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:17:27.319901  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3046320919997925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 13:17:27.321067  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:27.320238  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2920320919999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:17:27.321889  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2155320919998758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 13:17:27.322116  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0859320919998936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
I20260709 13:17:27.322966  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.323689  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:27.299185  7577 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:27.325019  3937 connection.cc:256] RPC call timeout handler was delayed by -1.05893209199985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19110000000000002s for a response
I20260709 13:17:27.324523  4112 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:27.325282  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.325865  3966 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.325888  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.328943  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.332538  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.322445  7907 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:27.335969  3967 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:27.333737  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.335383  7049 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:27.332542  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:27.335976  7999 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:27.337715  7999 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.338085  7999 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:27.338603  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.326610  7577 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:27.340276  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.340919  3967 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.340521  7577 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.334339  7690 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:27.341631  7577 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.318152  7367 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:17:27.342723  8014 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.343127  8014 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.336365  7907 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:27.343935  7907 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.340546  7861 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:27.349426  7861 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.349812  7861 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:27.327802  7510 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:27.351341  7510 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:27.351965  7510 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.351315  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.354939  3971 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:27.354851  3970 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.355993  3969 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:27.357722  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.364694  4115 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:27.365131  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:27.341584  7690 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:27.366030  3969 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.372057  4047 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:27.412693  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 84073us
I20260709 13:17:27.343477  8014 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:27.419000  4038 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:27.373588  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:27.421101  3971 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:27.364347  7812 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:27.416318  7690 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:27.445536  3967 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:27.454447  3971 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:17:27.455497  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:27.416509  8019 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.484192  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:27.484860  4115 raft_consensus.cc:606] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:27.427317  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.482478  4041 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:27.424036  3969 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:27.488794  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.489573  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2759) took 1561 ms. Trace:
I20260709 13:17:27.491645  4043 rpcz_store.cc:276] 0709 13:17:25.928357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.953003 (+ 24646us) service_pool.cc:224] Handling call
0709 13:17:25.972366 (+ 19363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.445023 (+472657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.483642 (+1038619us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400020dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:27.489514 (+  5872us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880051584}
W20260709 13:17:27.492601  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65387.7us
I20260709 13:17:27.498085  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.453706  7812 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:27.517932  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.501310  7936 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:27.506131  7910 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:27.501627  7941 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:27.531864  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:27.513381  7367 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:27.533659  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:27.517236  7812 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:27.533592  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.550545  7840 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:17:27.576135  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:27.608006  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.494408  8019 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.540346  7879 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:27.709278  7955 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:27.718428  7955 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.726045  7049 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:27.726662  7049 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:27.572912  7910 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:27.683095  7840 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:27.537262  7936 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:27.790462  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.744511  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:27.541517  7941 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.838488  4120 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:27.998930  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 276) took 1089 ms. Trace:
W20260709 13:17:27.928812  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.041286  7049 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:28.044519  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 589041us
I20260709 13:17:28.021240  4046 rpcz_store.cc:276] 0709 13:17:26.909207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.269052 (+359845us) service_pool.cc:224] Handling call
0709 13:17:27.269353 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.293618 (+ 24265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.293654 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.303470 (+  9816us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.497940 (+194470us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.497968 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.498017 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:27.998535 (+500518us) raft_consensus.cc:1685] finished
0709 13:17:27.998556 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:27.998734 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159,"raft.queue_time_us":17250,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":3235,"thread_start_us":161580,"threads_started":1,"wal-append.queue_time_us":385665}
I20260709 13:17:28.047698  7049 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:27.726945  7976 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:27.830170  7367 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:28.056720  7049 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:27.842242  7868 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:28.075908  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:28.081015  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:27.872216  7879 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:28.084749  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:28.085685  4117 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:28.022850  7904 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:28.048326  7575 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.105891  3966 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.000s
I20260709 13:17:28.109588  3966 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:28.121733  3967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.088s	sys 0.109s
I20260709 13:17:28.054816  8020 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.112903  7907 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.003s
W20260709 13:17:28.122205  3967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.088s	sys 0.109s
I20260709 13:17:28.129958  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:28.139572  4117 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:28.135932  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.029s	sys 0.092s
W20260709 13:17:28.140288  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.029s	sys 0.092s
I20260709 13:17:28.141605  7049 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.117657  7997 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.149134  3970 consensus_meta.cc:287] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.785s	user 0.007s	sys 0.002s
I20260709 13:17:28.116716  7867 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:28.150818  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:17:28.118336  7575 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.161836  3970 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:28.165642  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.120571  7904 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.082865  7976 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.140498  7907 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.174243  3970 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:28.133862  8020 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.124388  7868 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.139232  7910 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.158388  7997 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.148825  7840 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.158085  7867 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.184944  4114 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:28.180073  8019 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:28.190079  7999 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.852s	user 0.006s	sys 0.005s
I20260709 13:17:28.198791  8039 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:28.172078  7879 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.202883  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:28.212903  4681 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:28.217808  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2321) took 1323 ms. Trace:
I20260709 13:17:28.218241  3972 rpcz_store.cc:276] 0709 13:17:26.894027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.897221 (+  3194us) service_pool.cc:224] Handling call
0709 13:17:26.897544 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.897717 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.897742 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.209402 (+1311660us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:28.217525 (+  8123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.217605 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.217747 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:28.224507  3969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.013s	sys 0.038s
W20260709 13:17:28.224887  3969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.013s	sys 0.038s
I20260709 13:17:28.200868  8019 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:28.226004  3972 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 13:17:28.211508  8034 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:17:28.207286  7941 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.181147  7367 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.211090  8036 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.237082  7575 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.237766  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 282) took 1184 ms. Trace:
I20260709 13:17:28.238004  7997 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.203157  7999 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.241072  4040 rpcz_store.cc:276] 0709 13:17:27.053739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.335359 (+281620us) service_pool.cc:224] Handling call
0709 13:17:27.366851 (+ 31492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:27.367486 (+   635us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:27.368084 (+   598us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.453586 (+ 85502us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:27.486280 (+ 32694us) log.cc:844] Serialized 26 byte log entry
0709 13:17:27.486386 (+   106us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:27.486550 (+   164us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.489246 (+  2696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.489313 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.237550 (+748237us) raft_consensus.cc:1685] finished
0709 13:17:28.237571 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.237703 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9238,"prepare.queue_time_us":223,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":6125,"raft.queue_time_us":3256,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":8986,"thread_start_us":85064,"threads_started":1,"wal-append.queue_time_us":320866}
I20260709 13:17:28.226751  8039 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:28.269296  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.268886  7976 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:28.275684  3936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.027s
I20260709 13:17:28.227311  7936 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:28.284488  3936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.008s	sys 0.027s
I20260709 13:17:28.286402  4648 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:28.291038  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:28.289403  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 222290us
I20260709 13:17:28.273167  8036 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.275642  7997 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.292241  3938 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.001s	sys 0.015s
W20260709 13:17:28.308329  3938 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.002s	sys 0.015s
I20260709 13:17:28.239603  8019 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.337611  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:28.337908  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:28.292989  7941 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.290201  7575 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:28.341009  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54703us
W20260709 13:17:28.335076  7861 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.005s
W20260709 13:17:28.335477  8021 consensus_meta.cc:287] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.049s	user 0.006s	sys 0.006s
I20260709 13:17:28.300079  8020 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.353199  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:28.341840  7782 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:28.356029  8042 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:28.356588  8042 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.344549  8050 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:28.357858  8050 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.358332  8050 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.358651  8042 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.360663  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.361416  3963 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:28.361804  3963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2322) took 1467 ms (client timeout 1577 ms). Trace:
W20260709 13:17:28.362133  3963 rpcz_store.cc:269] 0709 13:17:26.894478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.360386 (+1465908us) service_pool.cc:224] Handling call
0709 13:17:28.361720 (+  1334us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:28.363125  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:28.354795  7367 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:17:28.363734  3963 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.332351  7997 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:28.365712  4044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 280) took 1455 ms (client timeout 1773 ms). Trace:
W20260709 13:17:28.366110  4044 rpcz_store.cc:269] 0709 13:17:26.910203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.996684 (+ 86481us) service_pool.cc:224] Handling call
0709 13:17:28.365558 (+1368874us) spinlock_profiling.cc:243] Waited 6.58 ms on lock 0x7b54000b7f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:28.365655 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15140224}
I20260709 13:17:28.369407  7867 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:28.370211  7577 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.028s	user 0.012s	sys 0.000s
I20260709 13:17:28.346642  7861 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.373452  7904 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:28.346907  8021 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.372524  8044 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:28.375432  8021 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:28.345132  7941 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:28.385167  7690 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.894s	user 0.005s	sys 0.006s
I20260709 13:17:28.391091  7868 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:28.390929  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:28.372952  8052 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:28.391757  4675 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:28.392278  8052 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:28.393206  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:28.395040  7941 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.395920  8036 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.390862  7690 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.397925  4120 raft_consensus.cc:2368] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14.
W20260709 13:17:28.398464  8038 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.200s	user 0.000s	sys 0.002s
W20260709 13:17:28.399528  8014 consensus_meta.cc:287] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.946s	user 0.008s	sys 0.000s
I20260709 13:17:28.348573  7936 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:28.402879  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:28.348268  7907 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.405310  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:28.373051  7782 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:28.345253  7575 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.426661  7049 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:28.410328  7868 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:28.400264  8014 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.419705  7861 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.433287  7868 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.435559  8036 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:28.420362  8055 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:28.433841  8007 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:28.437474  7577 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:17:28.393234  8052 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.438926  7782 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.410992  7941 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:28.441831  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:28.443194  7812 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
W20260709 13:17:28.443732  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53939.5us
I20260709 13:17:28.444651  7994 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:28.445590  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2707) took 1593 ms. Trace:
I20260709 13:17:28.469812  3968 rpcz_store.cc:276] 0709 13:17:26.851712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.863169 (+ 11457us) service_pool.cc:224] Handling call
0709 13:17:26.863481 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:26.890968 (+ 27487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.891005 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.295612 (+1404607us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.336278 (+ 40666us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:28.336315 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.336396 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.445357 (+108961us) raft_consensus.cc:1685] finished
0709 13:17:28.445377 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.445526 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19035,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":12870,"thread_start_us":39900,"threads_started":1,"wal-append.queue_time_us":124623}
I20260709 13:17:28.471625  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:28.472257  3968 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:28.426621  7510 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.069s	user 0.009s	sys 0.002s
I20260709 13:17:28.446955  3963 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:28.420392  4675 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:28.450217  7690 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.452306  4649 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:28.453990  7049 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.456422  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:28.465795  4112 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:28.467358  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2721) took 1225 ms. Trace:
I20260709 13:17:28.475812  4044 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 7.
I20260709 13:17:28.477469  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:28.478159  7049 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:28.481384  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.479770  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.482194  3963 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:28.483564  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.483143  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:28.488076  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.489248  3968 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:28.488960  4087 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:28.493669  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.494297  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 274) took 2299 ms. Trace:
I20260709 13:17:28.494776  3968 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:28.496955  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.497622  4115 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:28.498926  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:28.499548  3963 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:28.494657  4039 rpcz_store.cc:276] 0709 13:17:26.192131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.238796 (+ 46665us) service_pool.cc:224] Handling call
0709 13:17:26.256035 (+ 17239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.436127 (+180092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.489961 (+2053834us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003dc554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:28.491187 (+  1226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255079168}
I20260709 13:17:28.506331  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:28.494335  7910 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:28.507321  7910 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:28.465281  8055 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.511091  8055 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.490526  8036 raft_consensus.cc:2764] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:17:28.499172  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:28.513679  7049 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.513888  7868 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.514163  7838 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:28.514727  7838 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:28.513816  7577 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:28.515237  7577 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:28.515559  7577 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.476275  7510 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.517828  4121 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.518800  7510 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.506489  8019 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:28.474578  7812 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:28.521377  4045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2788) took 1697 ms (client timeout 2003 ms). Trace:
I20260709 13:17:28.525334  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:28.541877  4045 rpcz_store.cc:269] 0709 13:17:26.823720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.495674 (+1671954us) service_pool.cc:224] Handling call
0709 13:17:28.521320 (+ 25646us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:28.543387  8035 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 13:17:28.543069  7838 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.508271  7910 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.475488  7941 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.549563  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2427) took 1193 ms. Trace:
I20260709 13:17:28.577365  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.578209  4115 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
W20260709 13:17:28.567718  8058 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260709 13:17:28.620558  4112 rpcz_store.cc:276] 0709 13:17:27.356117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.356954 (+   837us) service_pool.cc:224] Handling call
0709 13:17:27.357267 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.475788 (+1118521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.549219 (+ 73431us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400002654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:28.549492 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2548753152}
I20260709 13:17:28.620846  4120 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:28.654808  3970 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:28.674777  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.650945  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:28.584609  8057 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.089s	user 0.000s	sys 0.002s
I20260709 13:17:28.686012  7994 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.702970  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2327) took 1804 ms. Trace:
I20260709 13:17:28.709909  3967 rpcz_store.cc:276] 0709 13:17:26.899065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.481010 (+581945us) service_pool.cc:224] Handling call
0709 13:17:27.481390 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.139293 (+657903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.139327 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.302303 (+162976us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b2c000014c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:28.302713 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.367779 (+ 65066us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.367826 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.367892 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.675117 (+307225us) raft_consensus.cc:1685] finished
0709 13:17:28.675140 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.702863 (+ 27723us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15059,"raft.queue_time_us":701694,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":8316,"spinlock_wait_cycles":372113664,"thread_start_us":702135,"threads_started":2,"wal-append.queue_time_us":163837}
I20260709 13:17:28.711942  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:28.704605  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 324) took 1933 ms. Trace:
W20260709 13:17:28.705878  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.706054  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 279) took 1796 ms. Trace:
I20260709 13:17:28.717939  4042 rpcz_store.cc:276] 0709 13:17:26.909972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.322388 (+412416us) service_pool.cc:224] Handling call
0709 13:17:27.323882 (+  1494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:27.325795 (+  1913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:27.325822 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:27.328619 (+  2797us) log.cc:844] Serialized 52 byte log entry
0709 13:17:27.526922 (+198303us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:27.560309 (+ 33387us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.685331 (+125022us) log.cc:844] Serialized 14 byte log entry
0709 13:17:27.726017 (+ 40686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:27.726095 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.542810 (+816715us) spinlock_profiling.cc:243] Waited 52.9 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:28.705765 (+162955us) raft_consensus.cc:1685] finished
0709 13:17:28.705789 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.705964 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141315,"prepare.queue_time_us":181509,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":99,"raft.queue_time_us":44346,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":40361,"spinlock_wait_cycles":121743616,"thread_start_us":159884,"threads_started":1,"wal-append.queue_time_us":750845}
I20260709 13:17:28.727586  7994 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.713261  4682 rpcz_store.cc:276] 0709 13:17:26.771593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.771721 (+   128us) service_pool.cc:224] Handling call
0709 13:17:26.786094 (+ 14373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:26.828830 (+ 42736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.828863 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:26.828904 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:26.828929 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.704277 (+1875348us) spinlock_profiling.cc:243] Waited 42.5 ms on lock 0x7b54009fe2d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:28.704344 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.704522 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97719680}
I20260709 13:17:28.740393  7812 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.743757  8050 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:28.749609  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.750497  4115 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:28.750710  8036 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.751252  8036 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.753432  8036 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.753852  7577 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:28.756444  7577 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.751415  7941 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.757091  8050 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:28.712697  3967 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 7: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:28.759788  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.761512  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.766971  3967 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:28.809207  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.809876  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:28.809087  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 331671us
I20260709 13:17:28.809738  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:28.805022  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 327164us
I20260709 13:17:28.812642  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:28.813135  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2417) took 2328 ms. Trace:
W20260709 13:17:28.813691  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 222753us
I20260709 13:17:28.810092  4112 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:28.818996  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:28.813337  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:28.822425  4675 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:28.822461  7709 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:28.823334  7709 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:28.824172  3965 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.027s	user 0.015s	sys 0.041s
I20260709 13:17:28.822477  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2737) took 1466 ms. Trace:
I20260709 13:17:28.825428  4120 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:28.821347  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.826527  4012 leader_election.cc:400] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
I20260709 13:17:28.826833  4012 leader_election.cc:403] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:28.825685  3969 rpcz_store.cc:276] 0709 13:17:27.356317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.225751 (+869434us) service_pool.cc:224] Handling call
0709 13:17:28.226029 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.231754 (+  5725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.231794 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.308261 (+ 76467us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b2c000014c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:28.333383 (+ 25122us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.454787 (+121404us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.454836 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.469362 (+ 14526us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.814085 (+344723us) raft_consensus.cc:1685] finished
0709 13:17:28.814105 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.822381 (+  8276us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5116,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"spinlock_wait_cycles":173370752,"thread_start_us":106569,"threads_started":1,"wal-append.queue_time_us":127981}
I20260709 13:17:28.827551  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:28.828207  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.828361  3963 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:28.814123  4118 rpcz_store.cc:276] 0709 13:17:26.485153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.485356 (+   203us) service_pool.cc:224] Handling call
0709 13:17:26.498946 (+ 13590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:27.005656 (+506710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.812885 (+1807229us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400080a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:28.813062 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1126771456}
I20260709 13:17:28.827912  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.829083  3968 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:28.829748  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.830565  3963 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:28.830552  4112 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:28.830523  3967 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:28.831276  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.827811  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.831887  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.809136  8050 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.833263  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.899721  3963 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:28.900789  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.901401  3963 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:28.902227  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.902789  3963 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:28.872398  8019 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:28.875762  8055 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:28.876332  7868 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:28.877424  3965 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.080s	user 0.016s	sys 0.042s
I20260709 13:17:28.903816  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:28.926133  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.949659  3967 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:28.956025  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 144894us
I20260709 13:17:28.962349  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:28.829612  7860 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:28.971449  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.829717  8036 raft_consensus.cc:2764] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:17:28.972868  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2717) took 1734 ms. Trace:
I20260709 13:17:28.832505  3969 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:28.979926  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:28.979094  3971 rpcz_store.cc:276] 0709 13:17:27.238797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.525014 (+286217us) service_pool.cc:224] Handling call
0709 13:17:27.536473 (+ 11459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:28.140807 (+604334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.140841 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:28.305186 (+164345us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b2c000014c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:28.305592 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 13:17:28.348065 (+ 42473us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:28.348100 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.348163 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:28.957828 (+609665us) raft_consensus.cc:1685] finished
0709 13:17:28.957854 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.972787 (+ 14933us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":673969,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":119,"spinlock_wait_cycles":376421120,"thread_start_us":645892,"threads_started":2,"wal-append.queue_time_us":157261}
I20260709 13:17:28.976200  3963 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:28.961325  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.833765  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:28.977380  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:28.834250  7577 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:28.839361  8066 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:28.981788  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 148104us
I20260709 13:17:28.981700  3967 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:28.983178  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:28.965525  8055 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:28.966355  7994 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:28.989094  3968 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:28.990638  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:28.993876  4119 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:28.994028  7049 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:28.994876  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:28.997320  3968 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:28.989495  4675 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:29.006017  3971 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:28.958231  8050 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.019021  7985 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.020496  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2428) took 1603 ms. Trace:
I20260709 13:17:29.026971  4114 rpcz_store.cc:276] 0709 13:17:27.417407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.417563 (+   156us) service_pool.cc:224] Handling call
0709 13:17:27.451270 (+ 33707us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.192344 (+741074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.020211 (+827867us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400081454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:29.020422 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1686631808}
I20260709 13:17:28.987476  7941 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:29.030987  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:28.993136  8055 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:28.965852  8019 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.034238  7941 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:29.032241  7985 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:29.066756  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:29.060982  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:28.991984  8066 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.032634  7994 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:17:29.040643  8036 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:28.981287  7860 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.000224  3968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:17:29.079639  3968 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:29.066210  7868 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.080124  3968 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:29.069972  7941 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.070346  7985 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.102525  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:29.103490  4112 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:29.071779  7367 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:29.106448  8073 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.107963  8074 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.118942  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2738) took 1762 ms. Trace:
I20260709 13:17:29.123816  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2706) took 2675 ms. Trace:
I20260709 13:17:29.125028  3963 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:29.120594  7955 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:29.140090  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79213.6us
I20260709 13:17:29.144793  3965 rpcz_store.cc:276] 0709 13:17:26.448251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.522536 (+ 74285us) service_pool.cc:224] Handling call
0709 13:17:26.522855 (+   319us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:17:26.613399 (+ 90544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:26.613430 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:17:26.638011 (+ 24581us) log.cc:844] Serialized 78 byte log entry
0709 13:17:26.796784 (+158773us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:28.957006 (+2160222us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.123240 (+166234us) log.cc:844] Serialized 14 byte log entry
0709 13:17:29.123422 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.123492 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.123530 (+    38us) raft_consensus.cc:1685] finished
0709 13:17:29.123542 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.123702 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":115618,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":3692,"raft.queue_time_us":48425,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":5774,"thread_start_us":2425006,"threads_started":4,"wal-append.queue_time_us":213334,"wal-append.run_cpu_time_us":2272,"wal-append.run_wall_time_us":1119708}
I20260709 13:17:29.141635  3972 rpcz_store.cc:276] 0709 13:17:27.356615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.228714 (+872099us) service_pool.cc:224] Handling call
0709 13:17:28.229187 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:28.306937 (+ 77750us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.307021 (+    84us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:28.307794 (+   773us) log.cc:844] Serialized 52 byte log entry
0709 13:17:28.478061 (+170267us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:28.478110 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.118495 (+640385us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b54001554d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:29.118567 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.118624 (+    57us) raft_consensus.cc:1685] finished
0709 13:17:29.118640 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.118882 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1433,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4629,"spinlock_wait_cycles":177738624,"thread_start_us":169887,"threads_started":1,"wal-append.queue_time_us":206156}
I20260709 13:17:29.124526  7999 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:29.152527  3965 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:29.154541  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.159399  3965 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:29.105188  7994 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:29.137517  8036 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:29.171736  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:29.172282  3972 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:29.173177  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:29.173725  3972 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:29.173600  3968 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.176298  3963 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:29.178754  8050 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:29.169138  3965 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.179363  8019 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:29.179723  3965 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.182818  8066 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:29.148962  8073 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.167896  8074 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.173332  8036 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.194168  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.195554  3968 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:29.199427  8079 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.219460  8073 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:29.220950  3965 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:29.221370  3965 pending_rounds.cc:85] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:29.221602  3965 pending_rounds.cc:107] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:29.221908  3965 raft_consensus.cc:2889] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:29.222522  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.224870  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2733) took 1974 ms. Trace:
I20260709 13:17:29.225224  3970 rpcz_store.cc:276] 0709 13:17:27.250738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.179461 (+928723us) service_pool.cc:224] Handling call
0709 13:17:28.195458 (+ 15997us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.655311 (+459853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.224642 (+569331us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400307854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:29.224818 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055910272}
W20260709 13:17:29.264967  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.373970  7049 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:29.374550  7049 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:29.376983  7049 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.387001  7049 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:29.396605  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:29.502326  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 270590us
I20260709 13:17:29.221733  8036 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:29.504205  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:29.505898  8073 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:29.509799  8079 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:29.510344  8079 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:29.511253  8079 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.506524  8055 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.513911  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:29.514523  8055 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:29.509970  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.515754  8036 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:29.515937  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.516513  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2447) took 1085 ms. Trace:
I20260709 13:17:29.516731  8036 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.516968  4115 rpcz_store.cc:276] 0709 13:17:28.431465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.513607 (+1082142us) service_pool.cc:224] Handling call
0709 13:17:29.516454 (+  2847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:29.520023  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:29.521162  8036 raft_consensus.cc:2764] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:17:29.522505  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2739) took 2165 ms. Trace:
I20260709 13:17:29.522889  3969 rpcz_store.cc:276] 0709 13:17:27.357159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.979881 (+1622722us) service_pool.cc:224] Handling call
0709 13:17:28.980368 (+   487us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.074012 (+ 93644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.074042 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.074507 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:17:29.187712 (+113205us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:29.187741 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.187788 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.522264 (+334476us) raft_consensus.cc:1685] finished
0709 13:17:29.522284 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.522446 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21480,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":29615,"thread_start_us":123978,"threads_started":2,"wal-append.queue_time_us":79227}
I20260709 13:17:29.524259  7860 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:29.529440  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:29.533394  8080 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:29.533973  8080 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.536571  8080 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:29.521406  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:29.538555  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.539193  8080 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:29.539472  8036 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.539958  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:29.540800  8036 raft_consensus.cc:2764] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:29.540315  8079 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:29.541842  8036 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:29.542091  8076 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:29.543460  8082 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:29.544008  8082 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:29.545437  8082 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.546813  8082 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.547762  8076 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:29.548272  8076 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.550515  8076 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:29.551363  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2449189900000874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1647s for a response
W20260709 13:17:29.551745  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2251189900000554s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:17:29.548498  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2340) took 1037 ms. Trace:
I20260709 13:17:29.551898  8080 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.552117  3963 rpcz_store.cc:276] 0709 13:17:28.510950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.144101 (+633151us) service_pool.cc:224] Handling call
0709 13:17:29.144410 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:29.176712 (+ 32302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.548258 (+371546us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b54003985d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:29.548437 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72914304}
I20260709 13:17:29.554108  8080 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:29.555325  8080 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:29.556331  7049 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:29.556653  7049 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:29.557283  3937 connection.cc:256] RPC call timeout handler was delayed by -1.1792189899999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:17:29.557647  3937 connection.cc:256] RPC call timeout handler was delayed by -1.1369189899999128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260709 13:17:29.557404  7049 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:29.557962  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0901189900000645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:17:29.558317  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0460189899999932s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18680000000000002s for a response
I20260709 13:17:29.558986  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.560127  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.560846  8076 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:29.561564  8076 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.562633  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.563328  8076 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:17:29.563807  8076 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:29.564677  8076 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.566576  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.566679  8079 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:29.089021  7868 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:29.578441  7868 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.579454  7868 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.575835  8082 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:29.580953  7838 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:29.586226  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:29.587669  7838 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.590516  7838 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:29.591548  8079 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:29.586975  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:29.593532  3968 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:29.598317  8014 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:29.598928  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:29.600332  7860 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:29.600775  7860 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:29.601303  7860 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.600279  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.605007  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.606580  7997 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:29.606876  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.609702  8036 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:29.610106  8036 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:29.610476  8036 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:29.614362  7860 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.617031  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:29.618726  3972 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:29.617937  8076 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:29.620682  8076 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:29.621412  8076 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:29.622377  8076 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.625311  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:29.626153  3972 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:29.633965  3972 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
W20260709 13:17:29.636723  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2421) took 3008 ms (client timeout 2468 ms). Trace:
I20260709 13:17:29.636632  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:29.637692  8022 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:29.638231  8022 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:29.639159  8022 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:29.644047  7860 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:29.646549  4119 consensus_meta.cc:287] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.006s
I20260709 13:17:29.647034  4119 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
W20260709 13:17:29.637174  4116 rpcz_store.cc:269] 0709 13:17:26.628250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.628394 (+   144us) service_pool.cc:224] Handling call
0709 13:17:29.636495 (+3008101us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b54003a8ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:29.636627 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1036986112}
W20260709 13:17:29.651597  7577 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.009s
I20260709 13:17:29.654539  7577 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
I20260709 13:17:29.655974  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:29.656306  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2451) took 1208 ms. Trace:
W20260709 13:17:29.653982  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47163.2us
I20260709 13:17:29.653007  8036 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.657581  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:29.648224  7985 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.431442  4681 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:29.658208  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:29.656601  4675 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.434764  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.435330  4041 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.438006  8014 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:30.438532  8014 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.439121  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.432497  7985 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:29.656641  4118 rpcz_store.cc:276] 0709 13:17:28.448202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.829124 (+380922us) service_pool.cc:224] Handling call
0709 13:17:28.950976 (+121852us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:28.981983 (+ 31007us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:28.982013 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:28.989240 (+  7227us) log.cc:844] Serialized 52 byte log entry
0709 13:17:29.601669 (+612429us) spinlock_profiling.cc:243] Waited 5.48 ms on lock 0x7b18002e8be0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:17:29.654299 (+ 52630us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:29.654343 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:29.654840 (+   497us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:29.656003 (+  1163us) raft_consensus.cc:1685] finished
0709 13:17:29.656021 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:29.656245 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30471,"raft.queue_time_us":33704,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4959,"spinlock_wait_cycles":12614016,"thread_start_us":52424,"threads_started":1,"wal-append.queue_time_us":658646}
I20260709 13:17:30.440824  8019 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:30.441335  8019 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.441927  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2436) took 2313 ms. Trace:
I20260709 13:17:30.442265  4121 rpcz_store.cc:276] 0709 13:17:28.128421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.128573 (+   152us) service_pool.cc:224] Handling call
0709 13:17:28.128914 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.518188 (+389274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.441704 (+1923516us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54003a75d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:30.441867 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893938560}
W20260709 13:17:29.660272  4120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.014s	sys 0.017s
I20260709 13:17:30.443327  8019 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:29.800937  8089 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.443965  8089 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:29.970064  8036 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:29.608965  8079 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.444972  8036 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:30.445349  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.446491  8079 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:29.997104  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:30.447540  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.447737  4041 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:30.448884  3968 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:30.173914  3993 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3de0 after lost signal to thread 2854
I20260709 13:17:30.448702  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.450239  4041 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:30.450487  3993 debug-util.cc:398] Leaking SignalData structure 0x7b08000acf40 after lost signal to thread 3904
W20260709 13:17:30.451777  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800323d00 after lost signal to thread 3996
W20260709 13:17:30.260959  8076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.005s	sys 0.011s
I20260709 13:17:30.452050  7049 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:30.452268  8076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.005s	sys 0.011s
I20260709 13:17:30.301064  8097 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:30.274386  8096 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.453614  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:30.453570  8096 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.331387  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.454994  8089 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.455331  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:30.455747  8096 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.332517  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.456221  3963 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:30.335803  4040 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:30.454918  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:30.457566  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.457772  3969 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.336825  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.438015  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:30.458824  3967 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:30.349319  3964 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 3.488s	user 0.015s	sys 0.052s
I20260709 13:17:30.459929  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:30.456743  4039 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.360409  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:30.364264  7941 consensus_meta.cc:287] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.216s	user 0.004s	sys 0.014s
I20260709 13:17:30.461083  4678 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:30.461611  4678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 312) took 2274 ms (client timeout 2103 ms). Trace:
I20260709 13:17:30.455916  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:30.369234  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.364580  7577 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:30.394246  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:30.391218  7575 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.463403  7575 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.463301  7577 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.463969  7575 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.465329  7577 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.405884  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.466835  4045 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.467069  4680 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:30.412889  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.467610  8097 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.468722  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.469359  4047 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:30.470141  8097 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.424140  8073 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.462358  3970 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:30.471038  8073 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.459473  3964 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:17:30.472826  3964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2712) took 3619 ms (client timeout 1654 ms). Trace:
I20260709 13:17:30.472967  8073 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.473258  8044 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.466087  7577 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:30.454947  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.477988  4038 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:30.478860  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.479429  4038 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:30.480195  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.481523  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.458935  4046 raft_consensus.cc:2410] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:30.484225  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.485062  4116 raft_consensus.cc:2410] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 13:17:30.485581  4046 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:30.486929  4046 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:30.487855  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:30.488471  4119 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.474326  7577 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.493167  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.497390  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:29.089247  7709 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:30.500489  7709 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:30.500980  7709 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:30.501734  3964 rpcz_store.cc:269] 0709 13:17:26.853172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:26.853606 (+   434us) service_pool.cc:224] Handling call
0709 13:17:30.472734 (+3619128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:30.444471  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2454) took 1923 ms. Trace:
I20260709 13:17:30.448725  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.452994  7936 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:30.458232  4040 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:30.503422  7936 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.470160  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.505606  4047 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:30.502822  4120 rpcz_store.cc:276] 0709 13:17:28.520866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.829683 (+308817us) service_pool.cc:224] Handling call
0709 13:17:28.830093 (+   410us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:29.058821 (+228728us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:29.058863 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:29.062423 (+  3560us) log.cc:844] Serialized 26 byte log entry
0709 13:17:30.443550 (+1381127us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:17:30.443590 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:30.444108 (+   518us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003d3954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:30.444147 (+    39us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:30.444194 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:30.444204 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:30.444404 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":130,"spinlock_wait_cycles":487551744,"thread_start_us":1338182,"threads_started":1,"wal-append.queue_time_us":582044}
I20260709 13:17:30.466024  7575 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:29.168371  7994 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.508495  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:30.440435  8014 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:30.509707  7994 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.509845  7577 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:30.462019  4678 rpcz_store.cc:269] 0709 13:17:28.186912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.189289 (+  2377us) service_pool.cc:224] Handling call
0709 13:17:30.360243 (+2170954us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:17:30.461545 (+101302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8275712}
I20260709 13:17:30.512961  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.382493  8099 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.513657  8099 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.461289  7941 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.514523  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:30.462991  4113 raft_consensus.cc:2410] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:30.421766  7367 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:30.515544  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:30.516053  7941 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:28.476017  3966 rpcz_store.cc:276] 0709 13:17:27.241539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:28.137639 (+896100us) service_pool.cc:224] Handling call
0709 13:17:28.154275 (+ 16636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:28.154469 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:28.292045 (+137576us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.465677 (+173632us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.466827 (+  1150us) log.cc:844] Serialized 14 byte log entry
0709 13:17:28.467009 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:28.467057 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:28.467104 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:28.467175 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:28.467296 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":279035,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1135,"raft.queue_time_us":2111,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":7645,"spinlock_wait_cycles":3828224,"thread_start_us":291454,"threads_started":2}
I20260709 13:17:30.515565  8099 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:30.516625  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2339) took 3274 ms (client timeout 2500 ms). Trace:
I20260709 13:17:30.517083  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:30.517303  4675 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:30.517889  3964 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:30.517776  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:30.518687  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:30.516319  7367 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.519732  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:30.520721  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:30.521287  3964 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:30.522367  3964 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:17:30.517061  4113 rpcz_store.cc:269] 0709 13:17:27.242331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:27.243043 (+   712us) service_pool.cc:224] Handling call
0709 13:17:30.394126 (+3151083us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327eee 0000000000375939 00007fed7b39b1e0 00007fed7b4640c4 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:17:30.516543 (+122417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31803776}
I20260709 13:17:30.507315  4039 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:30.524389  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:30.517187  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:30.525804  3966 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.526029  3963 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:30.516243  3965 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:30.520735  3967 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:30.531426  3967 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:30.534898  4045 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:30.532668  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:30.530431  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:30.545779  4038 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:30.547667  3970 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:30.549537  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.550525  4119 raft_consensus.cc:2368] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14.
I20260709 13:17:30.551687  7997 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.552232  7997 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:30.552888  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 104675us
I20260709 13:17:30.554133  7997 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:30.554598  7997 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.554998  7997 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.556699  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:30.557060  7997 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:30.557504  8106 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:30.557744  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.558059  8106 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:30.558959  8106 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.560364  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.561110  4113 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:30.562162  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.562796  4117 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:30.565120  4675 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:30.565451  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.548985  7988 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:30.569231  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.569578  7988 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:30.570463  7988 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.567551  4117 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:30.513284  7936 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:30.544718  7709 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:30.576728  8074 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:30.577289  8074 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.577628  7049 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:30.523887  3964 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:30.593174  3966 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:30.595127  4086 connection.cc:256] RPC call timeout handler was delayed by -2.0314448720000655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 13:17:30.587105  3970 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:30.595564  4086 connection.cc:256] RPC call timeout handler was delayed by -2.0298869700000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1545s for a response
W20260709 13:17:30.596586  4086 connection.cc:256] RPC call timeout handler was delayed by -2.0114330549999977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:17:30.597061  4086 connection.cc:256] RPC call timeout handler was delayed by -1.966886969999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1615s for a response
W20260709 13:17:30.597399  4086 connection.cc:256] RPC call timeout handler was delayed by -1.9407869700000902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
W20260709 13:17:30.597731  4086 connection.cc:256] RPC call timeout handler was delayed by -1.8939869700000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1696s for a response
W20260709 13:17:30.598067  4086 connection.cc:256] RPC call timeout handler was delayed by -1.8856953209999574s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20030000000000003s for a response
W20260709 13:17:30.600832  4086 connection.cc:256] RPC call timeout handler was delayed by -1.8648441139998795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:17:30.603688  4086 connection.cc:256] RPC call timeout handler was delayed by -1.8446991490000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
W20260709 13:17:30.605360  4086 connection.cc:256] RPC call timeout handler was delayed by -1.6302869700000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
I20260709 13:17:30.604866  3969 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:30.600243  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:30.644299  4086 connection.cc:256] RPC call timeout handler was delayed by -1.5579607269999087s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.191s for a response
W20260709 13:17:30.644892  4086 connection.cc:256] RPC call timeout handler was delayed by -1.542489741000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:17:30.645572  4086 connection.cc:256] RPC call timeout handler was delayed by -1.3978448719999506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22080000000000002s for a response
W20260709 13:17:30.646003  4086 connection.cc:256] RPC call timeout handler was delayed by -1.3852607269998316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
W20260709 13:17:30.647830  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 47657.2us
I20260709 13:17:30.643831  4012 leader_election.cc:400] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14.
I20260709 13:17:30.650923  4012 leader_election.cc:403] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:30.666709  4041 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:30.667637  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.590986  8098 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.670514  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:30.673614  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 1.01602e+06us
I20260709 13:17:30.647119  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:30.672643  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.675958  4119 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:30.675993  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.676409  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.677115  4113 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:30.603322  7598 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:30.606438  8074 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.679412  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:30.680472  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:30.684144  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:30.673120  8089 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.672468  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.670686  7936 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:30.671227  8073 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.605722  8099 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:17:30.685079  7997 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:30.688647  7367 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:30.706450  4121 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:30.708519  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:30.709345  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 256328us
I20260709 13:17:30.710438  8117 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.711434  7577 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:30.697541  7994 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:30.716086  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:30.685648  7598 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.721498  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:30.712556  8104 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.713991  7936 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.714176  8099 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:30.714972  7997 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:30.715976  8044 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.729074  8097 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:30.686292  8098 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.697335  8089 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.727010  7598 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.718406  8117 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:30.788091  8117 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.751051  8074 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.752818  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:30.754590  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.789088  8074 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.790565  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.791101  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.791340  4041 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:30.791699  4045 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:30.791877  8074 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:30.792321  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.715804  7782 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:30.793078  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.699350  8073 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.792688  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.795233  8073 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:30.766394  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44979.9us
I20260709 13:17:30.767606  7367 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:30.792634  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.769595  4043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:17:30.797248  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:30.797473  4047 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:30.797833  4043 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Received request to transfer leadership
I20260709 13:17:30.769727  8079 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:30.731003  7652 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:30.793426  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.770033  8097 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.770804  7575 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:30.724092  8050 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.805992  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.771678  7997 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.815129  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:30.817405  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:30.817584  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.818349  4047 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:30.819535  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:30.768131  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53596.6us
I20260709 13:17:30.775902  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:30.737877  7936 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.793486  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.796437  7367 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.805161  4039 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:30.809573  4045 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:30.825008  3971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:48572
I20260709 13:17:30.825555  3971 raft_consensus.cc:606] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:30.825857  3971 raft_consensus.cc:614] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:30.827265  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.827518  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:30.828156  4120 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:30.832285  8098 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.834681  8089 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:30.838371  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.839558  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.841228  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.841476  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.841818  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.842015  4114 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:30.842564  4113 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:30.843432  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.845022  4120 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:17:30.847234  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer b8c8b10100a146e6a81f308505fe9f46 from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:17:30.847924  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 73115us
I20260709 13:17:30.745918  8104 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.849294  8044 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:30.849728  8044 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:30.849907  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.851493  8104 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:30.851677  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.821516  7598 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:30.793040  7782 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:30.816870  8050 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.814463  7690 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:30.854624  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.854852  7690 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.855230  4041 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:30.856068  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.817102  7652 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:30.849560  4675 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:17:30.857678  3993 debug-util.cc:398] Leaking SignalData structure 0x7b080031a1e0 after lost signal to thread 4071
I20260709 13:17:30.858381  4112 raft_consensus.cc:2410] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:17:30.814575  7575 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:30.860870  3993 debug-util.cc:398] Leaking SignalData structure 0x7b080039e4c0 after lost signal to thread 4145
W20260709 13:17:30.861166  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800383480 after lost signal to thread 4146
I20260709 13:17:30.861524  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.862247  4039 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:30.859531  7575 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.856577  4041 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:30.862370  4043 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:30.854350  7782 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:30.864131  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:30.878441  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57165.1us
I20260709 13:17:30.878906  4120 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:30.818290  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:30.865837  4040 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:30.883388  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:30.886593  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:30.820886  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 157343us
I20260709 13:17:30.892607  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:30.894886  4040 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:17:30.896102  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.896252  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:30.899801  4040 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:30.876433  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.862974  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.901546  4041 raft_consensus.cc:2410] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:17:30.897513  7367 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.006s
W20260709 13:17:30.903417  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 196868us
I20260709 13:17:30.874369  8044 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:30.874974  8074 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:30.854367  8050 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:30.874837  7690 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:30.910989  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.913769  4041 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:30.914740  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.915509  4041 raft_consensus.cc:2368] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:30.916275  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:30.916893  4041 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:30.919554  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:30.905668  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:30.857759  7652 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:30.895933  8097 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:30.888501  7598 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:30.908905  7782 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:30.894987  8073 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.060949  4041 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
W20260709 13:17:31.061427  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 136802us
I20260709 13:17:30.902901  7985 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:30.913146  7575 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.065343  4043 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:30.905483  8099 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:17:31.070549  4040 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:30.986056  8074 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:31.089643  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.090194  4043 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:31.090507  4043 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:31.083395  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.086462  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.093878  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:30.903576  8126 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:17:30.985016  7709 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.154s
I20260709 13:17:31.094586  4040 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:31.070200  7910 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.092360  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.070410  7838 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:17:31.098732  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.077474  7782 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.101359  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.080541  8097 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.080057  8073 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:31.102723  4040 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:31.103649  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.104194  8080 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.102509  7999 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.115633  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.085546  7985 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.079483  7936 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:31.083081  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 188631us
I20260709 13:17:31.109740  4043 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.114145  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 527) took 1463 ms. Trace:
I20260709 13:17:31.098783  8124 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.105445  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 287204us
I20260709 13:17:31.083650  7598 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.105816  7994 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14.
I20260709 13:17:31.107544  7782 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.117975  4040 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.128109  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:31.106722  7910 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:31.112434  4041 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:31.111239  8073 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:31.126746  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.127393  3968 rpcz_store.cc:276] 0709 13:17:29.650299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:29.650446 (+   147us) service_pool.cc:224] Handling call
0709 13:17:29.650771 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:30.449306 (+798535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.113898 (+664592us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54001ca554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:31.114083 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834990848}
I20260709 13:17:31.129191  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.117342  7999 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:31.137022  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58524.6us
I20260709 13:17:31.138969  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.130533  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:31.120486  8106 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:31.145334  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.141229  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.149230  4041 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:31.150745  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.151571  7049 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.152786  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.154085  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.110973  8097 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.158375  4040 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:31.158890  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.164059  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.164698  7049 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.161115  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:31.166390  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:31.167128  7709 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.167263  8136 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.167553  7709 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:31.167994  7709 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.168447  8050 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:31.168840  8050 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.169171  8050 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.171773  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:31.173283  7367 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.173645  7367 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.174113  7367 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.174135  7049 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.175462  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:31.175956  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:31.177119  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.182852  8121 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.173575  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.126211  7868 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:17:31.140089  7937 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:31.160851  8116 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.144569  8098 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:31.136703  8104 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:17:31.190279  3968 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:31.186435  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.188599  7049 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.197165  4042 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:31.158639  8106 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.161990  8126 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.170768  7994 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.161619  8134 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.184700  7955 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:31.137368  8124 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:31.189425  8127 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:31.257390  8099 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.188017  8125 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.301739  8125 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:31.302161  8125 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.306129  8124 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:31.171531  8136 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.307359  7838 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:31.308295  8136 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.316685  8073 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:31.321218  8131 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
W20260709 13:17:31.322973  8133 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:17:31.323123  8125 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.324456  8097 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.298935  7367 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:31.282727  8130 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
W20260709 13:17:31.286674  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 110790us
I20260709 13:17:31.137600  8135 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
W20260709 13:17:31.269681  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 83319.7us
I20260709 13:17:31.287882  7955 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.171902  8074 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.267122  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.331190  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.268329  8106 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.338740  7367 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:31.286396  7577 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.280951  8080 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.257754  8018 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:17:31.271522  8126 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:31.298440  8129 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:17:31.291858  7994 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:31.352670  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 176018us
I20260709 13:17:31.354324  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.338810  7955 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.374176  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.375012  7367 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:17:31.377115  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.327545  7910 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.375876  4120 raft_consensus.cc:2410] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:31.376144  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.258433  7999 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.371234  8124 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:31.390033  8146 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:31.377414  8097 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.393246  8097 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.379123  8136 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.395009  7994 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.395743  8136 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.398721  7999 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.405539  3972 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:31.406175  3971 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:31.328089  8099 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.377878  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.383795  8105 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:31.375475  8125 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:31.388068  7782 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.353272  8134 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:17:31.392588  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2801) took 1059 ms. Trace:
I20260709 13:17:31.428418  4044 rpcz_store.cc:276] 0709 13:17:30.333189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.839178 (+505989us) service_pool.cc:224] Handling call
0709 13:17:30.839503 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:30.912577 (+ 73074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:30.913002 (+   425us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:30.979604 (+ 66602us) log.cc:844] Serialized 26 byte log entry
0709 13:17:31.354255 (+374651us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:31.354291 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:31.354365 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:31.392397 (+ 38032us) raft_consensus.cc:1685] finished
0709 13:17:31.392418 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:31.392535 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67445,"raft.queue_time_us":75523,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":63659,"thread_start_us":270873,"threads_started":1,"wal-append.queue_time_us":333313}
I20260709 13:17:31.430246  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.431232  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.431739  4044 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:31.432081  8044 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.410218  4119 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:31.410737  4117 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:31.411334  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:31.435328  7598 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.437624  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.418845  8105 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:31.439528  8105 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.440920  8105 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.442026  7575 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:17:31.444204  8099 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.448344  4039 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:31.432487  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.450443  4044 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
W20260709 13:17:31.383711  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800110e40 after lost signal to thread 4709
W20260709 13:17:31.451494  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800300620 after lost signal to thread 4710
W20260709 13:17:31.452059  3993 debug-util.cc:398] Leaking SignalData structure 0x7b080023d860 after lost signal to thread 7840
W20260709 13:17:31.452348  3993 debug-util.cc:398] Leaking SignalData structure 0x7b08003058e0 after lost signal to thread 7861
W20260709 13:17:31.452625  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800310d80 after lost signal to thread 7904
W20260709 13:17:31.452879  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800310de0 after lost signal to thread 7907
I20260709 13:17:31.452702  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.458566  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.411819  7868 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.462797  7868 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.463186  7868 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.464082  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.464792  4045 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:31.464900  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.465708  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.466238  3937 leader_election.cc:400] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:31.466552  3937 leader_election.cc:403] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.466789  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.467402  4045 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:31.467478  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.468325  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:31.374749  8117 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.003s
I20260709 13:17:31.481918  8117 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.484171  8117 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:31.421849  4118 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:31.425601  3968 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:17:31.438649  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.486306  4042 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.412101  4113 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.468911  8082 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.468923  8149 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:31.470291  7985 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.422252  7709 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.489900  8082 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.490402  8082 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.490873  8018 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:31.491569  7709 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:31.470996  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:31.492946  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.494483  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.495265  8051 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:31.495908  8051 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:31.496343  8051 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:31.497187  8051 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.499249  8040 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:31.499694  8040 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.500048  8040 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.412837  8098 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.477401  7598 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:31.507349  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:31.453601  3993 debug-util.cc:398] Leaking SignalData structure 0x7b0800337dc0 after lost signal to thread 8007
I20260709 13:17:31.560423  4042 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:31.561578  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.562693  4042 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:31.352108  8126 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.546034  7049 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:31.565275  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57987.5us
I20260709 13:17:31.536501  4113 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:17:31.565079  7049 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.355422  8080 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.566395  4113 pending_rounds.cc:85] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 7
I20260709 13:17:31.571142  4113 pending_rounds.cc:107] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:17:31.571228  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.571491  4113 raft_consensus.cc:2889] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:31.528623  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:31.575788  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.578727  8097 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.583642  7049 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:31.580291  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 172745us
I20260709 13:17:31.581212  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.581386  3969 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:31.585907  7049 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:31.559404  8098 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.589115  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.587522  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.590606  4045 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:31.573987  8149 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.559414  7652 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.584524  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.593765  4042 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:31.594352  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.594658  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.595909  4042 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:31.598075  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.598220  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.600963  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.601673  3964 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:31.602605  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.603163  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.603530  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.604301  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.604696  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.605412  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.605754  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.606360  3966 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:31.607370  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.608129  3967 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:31.608531  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.608903  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.609721  3965 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:31.610442  4045 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:17:31.610649  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.612871  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.613476  4045 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:31.615664  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.616120  4043 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.614272  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.619024  4045 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.620573  8139 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:31.621017  8139 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:31.621858  8139 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.622888  8139 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.625313  8124 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.625823  8124 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.627800  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.628888  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.629526  4043 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:31.630060  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:31.604205  3971 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:31.603144  3964 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:31.633638  8138 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:31.634064  8138 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:31.634938  8138 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.636154  8138 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:31.639159  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:31.639581  4046 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:31.640269  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:31.640959  4046 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.641594  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.642139  4046 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:31.642689  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.643321  4116 raft_consensus.cc:2368] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:17:31.644073  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.639825  4675 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:31.645130  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.646412  4120 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:31.648180  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:31.592303  8098 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.668322  4042 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:31.649349  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.647985  8040 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.644876  4681 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:31.651731  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:31.652398  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.653440  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.651790  3938 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:31.657037  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.643239  4046 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:31.597694  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 185430us
I20260709 13:17:31.683923  4045 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:31.684123  4042 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 9. Ops: []
I20260709 13:17:31.686041  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:31.688258  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.686108  3965 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:31.677098  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 286836us
I20260709 13:17:31.675920  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:31.691933  4011 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.676208  4047 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
W20260709 13:17:31.676946  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 108216us
I20260709 13:17:31.694990  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:31.695442  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.696976  4046 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.698568  4042 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:17:31.697762  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.696130  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.702090  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.703929  3937 leader_election.cc:400] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:17:31.704298  3937 leader_election.cc:403] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:31.669816  8099 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.715245  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.718791  3970 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:31.719280  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.597743  8155 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.720566  7709 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:17:31.681329  7988 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:31.724917  4680 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:31.669586  7985 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:31.725503  7985 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.725852  7985 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:31.718654  4115 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:31.729517  7367 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:31.729905  7367 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:31.730211  7367 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:31.701573  8018 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:31.733269  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.627600  8150 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:31.710379  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.681458  8142 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:31.597142  7652 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.757965  7367 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.705754  7941 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:31.742436  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.737251  4114 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:31.700209  8119 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:31.767835  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.772552  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:31.737176  4046 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:31.714900  8117 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:31.714653  8079 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.685153  8102 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:31.717921  7997 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:31.724201  8149 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:31.768934  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.717167  7575 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:31.761649  4675 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:31.734486  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:31.825764  7367 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:31.724128  8097 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:31.701376  8137 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:17:31.695036  7812 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:31.785163  4043 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:31.733531  8018 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:17:31.789354  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.781862  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.836720  4046 raft_consensus.cc:2376] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13. Re-sending same reply.
I20260709 13:17:31.819355  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:31.837919  3967 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
W20260709 13:17:31.769277  8050 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 13:17:31.821507  4042 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.750752  7598 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:31.823173  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 99813.8us
I20260709 13:17:31.783450  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.819517  7575 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.770774  8119 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:31.787497  8102 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:31.744910  8099 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.842871  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.852133  3967 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:31.828156  7997 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:31.741717  8106 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.855078  4042 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:31.826871  8117 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:31.857404  7367 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:31.844228  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 88883.6us
I20260709 13:17:31.861233  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.862672  7367 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:31.858350  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.863762  4120 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:31.848057  7575 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:31.786934  8155 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:17:31.823254  7910 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:31.872726  4041 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:31.820353  7985 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.853603  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:31.883330  4046 raft_consensus.cc:2376] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9. Re-sending same reply.
I20260709 13:17:31.863991  7367 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.764104  8142 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.845266  8080 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:31.852620  8119 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:31.869020  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 154563us
I20260709 13:17:31.907958  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.869531  8163 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:17:31.870410  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:31.870755  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.848097  8050 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.920912  8050 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:31.921730  8050 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:31.922209  8050 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:31.923080  8050 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.885643  8117 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.886272  7868 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.927807  8164 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:31.929039  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67871.9us
I20260709 13:17:31.929205  7868 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.844604  7812 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.930267  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.931075  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.931620  7812 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.932369  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.887239  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:31.934685  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 331) took 1060 ms. Trace:
I20260709 13:17:31.935055  4679 rpcz_store.cc:276] 0709 13:17:30.873945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.874773 (+   828us) service_pool.cc:224] Handling call
0709 13:17:31.887070 (+1012297us) spinlock_profiling.cc:243] Waited 9.74 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:17:31.934611 (+ 47541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22393088}
I20260709 13:17:31.888936  8106 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.889744  8157 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:17:31.895946  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.897615  8149 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:31.896036  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:31.937722  8149 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:31.938758  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:31.938647  8149 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.939884  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:31.933396  8165 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:31.940565  8165 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.940971  8165 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:31.941213  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:31.933908  8164 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:31.939961  8149 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:31.882464  8051 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:31.945923  8051 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.948050  8051 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.944999  8164 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:31.948704  8164 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:31.937242  8171 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:31.951542  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 256612us
I20260709 13:17:31.952315  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.953497  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.954208  8106 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:31.954607  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.957834  8106 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:31.949661  8165 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.958218  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:31.959023  8106 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:31.959388  8106 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:31.959707  8106 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:31.959668  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:31.962284  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.968338  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:31.979171  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:31.954411  8170 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:31.961066  7955 consensus_meta.cc:287] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.002s
I20260709 13:17:31.983125  4120 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:31.965939  8105 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 13:17:32.010471  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:31.961340  8073 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.911152  8082 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.968091  7868 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.028236  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.028858  3972 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:32.025266  4044 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
W20260709 13:17:32.026077  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93755.4us
W20260709 13:17:32.030550  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 122680us
I20260709 13:17:31.994541  8155 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:17:32.035295  4120 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.042299  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.044165  3969 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:32.015751  8080 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.031339  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:32.020105  8040 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.048868  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.055472  4120 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:32.034889  8105 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.032210  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:32.018688  7955 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.046232  7910 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:31.960668  8018 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:31.969570  7598 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:32.053092  7936 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:32.105974  7652 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:31.985448  7997 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:31.968000  8102 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:32.133147  8161 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:17:32.134497  8163 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:32.134924  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2830) took 1336 ms. Trace:
I20260709 13:17:32.170472  4039 rpcz_store.cc:276] 0709 13:17:30.798500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:30.862779 (+ 64279us) service_pool.cc:224] Handling call
0709 13:17:32.134725 (+1271946us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54002e9d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:32.134865 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232723712}
I20260709 13:17:32.171841  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.172366  4039 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.138106  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2366) took 1240 ms. Trace:
I20260709 13:17:32.174717  4041 rpcz_store.cc:276] 0709 13:17:30.897359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.266846 (+369487us) service_pool.cc:224] Handling call
0709 13:17:32.137886 (+871040us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b54000df054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:32.138031 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244825984}
I20260709 13:17:32.175763  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.176931  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:32.139546  8139 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.000s
I20260709 13:17:32.141017  4047 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
W20260709 13:17:32.141523  8159 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:17:32.142395  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.211028  4044 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.122546  7910 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:32.157011  8143 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:17:32.157974  8099 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.136264  3868 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 4 to 6, term changed from 5 to 7, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:17:32.213315  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 193962us
I20260709 13:17:32.183947  3969 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:32.216068  4121 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.222745  4039 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:32.223929  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.192994  3972 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
W20260709 13:17:32.198894  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 188501us
I20260709 13:17:32.232142  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:32.217260  4677 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.231061  7985 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.236306  8150 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:32.236931  3870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 94) took 22583 ms (client timeout 15000 ms). Trace:
I20260709 13:17:32.229672  8139 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:17:32.210541  8082 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.237733  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:32.240942  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:32.241894  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:32.213492  8142 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.238284  3868 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.248448  4044 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:32.250159  4044 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:32.251187  4121 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:32.257053  3868 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:17:32.273728  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 242455us
I20260709 13:17:32.272706  4044 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:32.240302  8150 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:32.280083  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:32.252595  8117 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:17:32.272226  8126 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.687s	user 0.012s	sys 0.008s
I20260709 13:17:32.274330  4120 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:32.289008  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.276796  3868 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 8, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.286365  3972 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.292835  3967 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.293030  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.297785  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.297995  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.243168  8105 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:17:32.293076  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 268264us
I20260709 13:17:32.253738  8143 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:17:32.237404  3870 rpcz_store.cc:269] 0709 13:17:09.644284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:09.644637 (+   353us) service_pool.cc:224] Handling call
0709 13:17:32.227279 (+22582642us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:25.284277 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:25.285028 (+   751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:25.285109 (+    81us) write_op.cc:435] Acquired schema lock
0709 13:17:25.285141 (+    32us) tablet.cc:662] Decoding operations
0709 13:17:25.285838 (+   697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:25.285940 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:25.285967 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:17:25.286453 (+   486us) tablet.cc:701] Row locks acquired
0709 13:17:25.286498 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:17:25.286669 (+   171us) write_op.cc:270] Start()
0709 13:17:25.286813 (+   144us) write_op.cc:276] Timestamp: P: 1783603045286608 usec, L: 0
0709 13:17:25.286847 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:17:25.287585 (+   738us) log.cc:844] Serialized 1749 byte log entry
0709 13:17:25.878059 (+590474us) op_driver.cc:464] REPLICATION: finished
0709 13:17:25.907095 (+ 29036us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed733420ac 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed79e82ef0
0709 13:17:26.260987 (+353892us) write_op.cc:301] APPLY: starting
0709 13:17:26.276911 (+ 15924us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:26.318688 (+ 41777us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:26.328646 (+  9958us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:26.362165 (+ 33519us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:26.362482 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:17:26.362543 (+    61us) write_op.cc:312] APPLY: finished
0709 13:17:26.362869 (+   326us) log.cc:844] Serialized 41 byte log entry
0709 13:17:26.363072 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:26.363175 (+   103us) write_op.cc:454] Released schema lock
0709 13:17:26.363231 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:26.363662 (+   431us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:26.363689 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6172358,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":356088,"apply.run_cpu_time_us":3030,"apply.run_wall_time_us":118115,"num_ops":4,"prepare.queue_time_us":285404,"prepare.run_cpu_time_us":43494,"prepare.run_wall_time_us":130275,"raft.queue_time_us":420730,"raft.run_cpu_time_us":48107,"raft.run_wall_time_us":251261,"replication_time_us":591043,"spinlock_wait_cycles":61043968,"thread_start_us":842716,"threads_started":4,"wal-append.queue_time_us":166830,"wal-append.run_cpu_time_us":279332,"wal-append.run_wall_time_us":1985124}]]}
I20260709 13:17:32.280113  8150 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:32.314646  3868 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 14, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.315822  4044 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:32.313928  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.337352  8187 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.281586  7910 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.310141  8117 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:32.340824  3868 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.313278  7936 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:32.340216  7690 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.344684  7936 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:32.345316  7936 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:32.345499  8184 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:32.347294  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.317595  8150 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:32.345712  8162 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
I20260709 13:17:32.347826  7955 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.343187  8125 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:17:32.354982  3868 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.318338  7985 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:17:32.289572  8119 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.296406  8126 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.356535  3868 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 12, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.378654  7782 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:32.170424  8097 consensus_queue.cc:1175] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "293c0ff21e6f4e9f93555aaba177566b" responder_term: 8 status { last_received { term: 7 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:17:32.338030  8163 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:17:32.364790  8079 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.564s	user 0.003s	sys 0.005s
W20260709 13:17:32.394814  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.381817  8117 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.355013  8177 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:17:32.402328  8126 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:32.346426  8189 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 13:17:32.404919  4118 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:32.407462  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 68404us
I20260709 13:17:32.403575  3859 maintenance_manager.cc:419] P 8dad18bff2f044b2a76f2e5726c72315: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033395
I20260709 13:17:32.418419  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:32.442559  4115 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:32.422178  8178 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:17:32.341393  8116 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:17:32.423086  8098 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.015s
I20260709 13:17:32.455716  3965 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:32.429769  8079 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
W20260709 13:17:32.425042  7999 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.026s	user 0.011s	sys 0.000s
I20260709 13:17:32.422288  8187 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:17:32.457854  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:32.424597  8138 consensus_meta.cc:287] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.788s	user 0.001s	sys 0.008s
I20260709 13:17:32.432188  8164 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:32.438375  8153 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.860s	user 0.004s	sys 0.000s
I20260709 13:17:32.443693  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.470057  4117 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:32.470105  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.444789  3868 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 9 to 13, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:17:32.453698  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 135986us
I20260709 13:17:32.423388  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.456815  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.442637  7598 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:32.446225  8119 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.405086  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.441982  8044 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:32.460793  3967 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:32.457854  4677 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:32.496896  4043 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:32.452327  8184 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:32.466765  7941 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.669s	user 0.000s	sys 0.024s
I20260709 13:17:32.455479  8116 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:32.502354  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 97342.9us
W20260709 13:17:32.503333  8204 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:17:32.496634  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.505079  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:32.506631  8124 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.878s	user 0.010s	sys 0.003s
I20260709 13:17:32.507171  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.508960  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:32.508028  3868 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.511956  4043 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:32.497946  7985 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:32.520928  7985 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:32.519352  3965 raft_consensus.cc:2376] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10. Re-sending same reply.
I20260709 13:17:32.519444  4115 raft_consensus.cc:606] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.522670  4115 raft_consensus.cc:614] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:32.518142  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.463056  8106 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.520306  3868 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 11, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 11 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.455729  8098 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.505151  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:32.527793  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.531468  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.532078  3965 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.533356  7838 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:32.521803  8119 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.534948  8119 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:32.500159  7598 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.535837  8119 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.537925  7598 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.541076  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.541913  3967 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:32.542697  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.516623  7941 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:32.515105  8116 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:32.545135  3868 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.549952  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.555584  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.553349  3965 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:32.557255  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.561178  4041 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:32.562994  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.564064  3967 raft_consensus.cc:2410] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:32.565567  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.566499  3967 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.567191  3868 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 8 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:32.522149  8124 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:32.573971  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 59286.9us
I20260709 13:17:32.577407  4041 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:32.579638  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:32.579068  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:32.565511  7575 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.679s	user 0.016s	sys 0.006s
I20260709 13:17:32.587987  7575 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:32.590277  7575 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:32.591734  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2851) took 1090 ms. Trace:
I20260709 13:17:32.592137  4045 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:32.580469  3968 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:32.583016  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.594026  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.594355  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.594656  3968 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:32.583310  8116 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.583724  8189 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:32.584295  8206 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:32.585675  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:32.586733  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:17:32.595660  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.597386  3868 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 6 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:32.592104  4042 rpcz_store.cc:276] 0709 13:17:31.501408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.048708 (+547300us) service_pool.cc:224] Handling call
0709 13:17:32.049051 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:32.049361 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.049388 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.049850 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.279542 (+229692us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:32.279579 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.279642 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.591523 (+311881us) raft_consensus.cc:1685] finished
0709 13:17:32.591545 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.591675 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":53065,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2623,"thread_start_us":163321,"threads_started":1,"wal-append.queue_time_us":442122}
W20260709 13:17:32.641449  8192 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:17:32.704757  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:32.636745  7999 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:32.640409  8126 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:32.702816  8214 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:17:32.591523  8184 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:32.705792  4012 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.785s (SENT) [suppressed 13 similar messages]
I20260709 13:17:32.703992  3968 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:32.545639  7985 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:32.737277  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 132536us
I20260709 13:17:32.737773  8187 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.704571  7598 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.736435  3868 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.704407  7936 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.735760  3967 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:32.740617  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.744158  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.755379  3968 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.756049  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.755514  3868 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.741509  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:32.742669  8116 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:32.729900  8207 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:32.759069  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2856) took 1256 ms. Trace:
I20260709 13:17:32.760263  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.769979  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.769366  3868 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 8, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.728574  8150 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.747213  8164 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:32.766183  8217 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:17:32.764977  7999 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:32.781637  7575 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.755066  7598 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.783586  8136 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.783448  7575 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.791567  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.773784  3868 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 9, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:32.771915  3968 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:32.764950  8119 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:32.766994  8201 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:32.792606  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:32.808645  8201 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:32.809231  8098 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.809587  8201 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.809182  4679 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:32.811306  7598 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.813978  7936 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:32.815599  7575 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:32.777769  8216 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:17:32.796650  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:32.796576  4121 raft_consensus.cc:2368] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:32.795578  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.822357  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.797564  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:32.800355  4119 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:32.824034  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:32.797750  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:32.801826  3868 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 11, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 11 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:32.803052  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:32.770334  8106 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.803862  8135 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:32.808243  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:32.795445  8187 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:32.816229  8124 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.817941  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.798909  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.792121  7997 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:32.820111  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.827549  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:32.882524  4043 raft_consensus.cc:2368] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:32.834121  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.882853  4047 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:32.883158  4120 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:32.883355  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:32.824795  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.882315  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.836305  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:32.885504  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.884529  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.886235  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 397) took 1494 ms. Trace:
I20260709 13:17:32.819011  8102 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:32.886650  4113 rpcz_store.cc:276] 0709 13:17:31.391580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.392284 (+   704us) service_pool.cc:224] Handling call
0709 13:17:31.411983 (+ 19699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.572039 (+160056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.886030 (+1313991us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b5400080f50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:32.886174 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44438272}
I20260709 13:17:32.887112  4043 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:32.888569  4043 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:32.886468  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.889528  4040 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:32.889765  4043 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:32.890412  4040 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:32.892508  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:32.893149  3969 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:32.893718  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:32.895609  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:32.896462  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 190763us
I20260709 13:17:32.823082  8119 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:32.901963  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74522.4us
I20260709 13:17:32.903753  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:32.897544  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2373) took 1133 ms. Trace:
I20260709 13:17:32.904961  4117 rpcz_store.cc:276] 0709 13:17:31.764607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.940992 (+176385us) service_pool.cc:224] Handling call
0709 13:17:32.888644 (+947652us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b540034dd54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:32.897474 (+  8830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1214850432}
I20260709 13:17:32.835234  8117 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:32.910145  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:32.911886  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:32.916505  3969 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:32.839926  8082 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:32.917860  4114 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:32.835433  8079 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:32.835917  8135 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:32.917760  3868 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.920022  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:32.920432  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:32.927183  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:32.933136  3969 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:32.972417  4040 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:32.972103  3868 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.921994  8150 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:32.881450  8149 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:32.975222  8124 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.915977  7838 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.920516  7937 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:32.920359  7936 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:32.996731  3972 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:17:33.002192  3972 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:32.998920  3868 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:32.923058  8117 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:32.919008  8106 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:17:33.003975  3972 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.004797  3868 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 8, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.017108  3868 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:33.005966  8100 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:32.943239  8187 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:33.019524  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:17:33.021723  4040 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Received request to transfer leadership
I20260709 13:17:33.022639  4040 raft_consensus.cc:614] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:32.998639  7910 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.023110  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49084 (request call id 81) took 2147 ms. Trace:
I20260709 13:17:33.020073  3868 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:32.951267  8082 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.019265  8135 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.014791  7936 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:33.008729  8124 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:33.026419  7985 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.023643  8100 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:33.027719  3963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2363) took 1428 ms (client timeout 1553 ms). Trace:
I20260709 13:17:33.003718  7838 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:32.998593  8105 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:32.954972  8079 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.027673  8126 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:33.037909  8197 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:17:33.226923  8164 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:17:33.240505  8164 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:33.240895  8164 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:33.241725  8164 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.242380  8079 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.033341  4040 rpcz_store.cc:276] 0709 13:17:30.875893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.003510 (+2127617us) service_pool.cc:224] Handling call
0709 13:17:33.023049 (+ 19539us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:33.243218  8079 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.243764  8079 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:33.189352  4677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 334) took 1538 ms (client timeout 2027 ms). Trace:
I20260709 13:17:33.244796  7838 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:33.088550  4112 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:33.020979  7598 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:33.001073  8149 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.065651  8117 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:32.952836  8213 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:17:33.064316  8119 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:33.219451  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 131548us
W20260709 13:17:33.224030  3963 rpcz_store.cc:269] 0709 13:17:31.599621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.610401 (+ 10780us) service_pool.cc:224] Handling call
0709 13:17:33.027514 (+1417113us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b54001ca554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:33.027653 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582740352}
I20260709 13:17:33.224237  3868 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:33.087433  7690 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.234496  7936 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.235394  8082 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.235751  8100 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:33.223579  8224 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.321s	user 0.003s	sys 0.003s
I20260709 13:17:33.237162  8124 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.087468  7997 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:17:33.242842  8164 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:33.258302  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:33.247640  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.284278  4040 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:33.289330  3968 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.282159  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2379) took 1606 ms. Trace:
I20260709 13:17:33.293958  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:33.246986  8102 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.305606  8227 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:17:33.305905  8102 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.306972  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2870) took 1254 ms. Trace:
I20260709 13:17:33.308071  8102 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:33.247777  8105 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.309891  8105 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.307363  4044 rpcz_store.cc:276] 0709 13:17:32.052104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.591250 (+539146us) service_pool.cc:224] Handling call
0709 13:17:32.591621 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:32.636526 (+ 44905us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.641750 (+  5224us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:32.642334 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 13:17:32.882108 (+239774us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:32.882148 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.882217 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.306757 (+424540us) raft_consensus.cc:1685] finished
0709 13:17:33.306776 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.306917 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":87561,"thread_start_us":145322,"threads_started":1,"wal-append.queue_time_us":293821}
I20260709 13:17:33.297104  8082 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.313288  8082 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.313944  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:33.315027  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.315392  8082 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.297106  7838 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.316413  3963 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:33.281234  8199 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:17:33.297009  7937 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:33.316601  7838 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.321509  7937 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.303195  3971 rpcz_store.cc:276] 0709 13:17:31.675882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.982891 (+307009us) service_pool.cc:224] Handling call
0709 13:17:31.983171 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.983552 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:32.164843 (+181291us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.456833 (+291990us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.457508 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.457994 (+   486us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:32.914118 (+456124us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.281847 (+367729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.281923 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.281964 (+    41us) raft_consensus.cc:1685] finished
0709 13:17:33.281975 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.282104 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":476486,"prepare.queue_time_us":589364,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":29836,"raft.queue_time_us":326132,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":30247,"thread_start_us":732854,"threads_started":3,"wal-append.queue_time_us":407985}
I20260709 13:17:33.330156  3937 leader_election.cc:400] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:33.268944  7690 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.335857  3937 leader_election.cc:403] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:33.246246  4677 rpcz_store.cc:269] 0709 13:17:31.651236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.668615 (+ 17379us) service_pool.cc:224] Handling call
0709 13:17:33.040649 (+1372034us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54005618d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:33.187677 (+147028us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872836352}
I20260709 13:17:33.296108  3868 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 9 to 12, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:33.268078  7598 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.332387  8100 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.339568  3868 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 10 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:33.341490  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:33.341856  3971 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:33.335392  3968 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:33.345512  3971 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:33.343012  8245 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:33.346894  7598 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:33.352706  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2376) took 1696 ms. Trace:
I20260709 13:17:33.355712  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2871) took 1065 ms. Trace:
I20260709 13:17:33.356163  4042 rpcz_store.cc:276] 0709 13:17:32.290407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.725400 (+434993us) service_pool.cc:224] Handling call
0709 13:17:32.725789 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:32.726172 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:32.726200 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:32.738753 (+ 12553us) log.cc:844] Serialized 52 byte log entry
0709 13:17:32.953944 (+215191us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:32.995924 (+ 41980us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.998919 (+  2995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.998989 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.355487 (+356498us) raft_consensus.cc:1685] finished
0709 13:17:33.355506 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.355646 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2713,"prepare.queue_time_us":45428,"prepare.run_wall_time_us":39,"raft.queue_time_us":3880,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":13420,"spinlock_wait_cycles":5730048,"thread_start_us":188189,"threads_started":1,"wal-append.queue_time_us":585741}
I20260709 13:17:33.359354  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.364023  8244 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.364609  8244 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.364993  8244 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.365131  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.366427  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.366683  3965 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:33.366804  4120 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:33.367316  3868 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:33.352402  8082 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:17:33.370371  7598 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:33.370720  7598 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:33.371459  7598 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.372601  7598 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.373999  7690 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:33.374954  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.378849  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2846) took 1982 ms. Trace:
I20260709 13:17:33.379235  4046 rpcz_store.cc:276] 0709 13:17:31.396188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.907178 (+510990us) service_pool.cc:224] Handling call
0709 13:17:31.962831 (+ 55653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:31.963115 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:31.963476 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.032339 (+1068863us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b1800169a80. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a
0709 13:17:33.378308 (+345969us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b1800169a80. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:17:33.378533 (+   225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.378584 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:33.378627 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.378690 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.378795 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133855,"prepare.queue_time_us":177,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":15713,"spinlock_wait_cycles":15557248,"thread_start_us":55451,"threads_started":1,"wal-append.queue_time_us":138642,"wal-append.run_cpu_time_us":7474,"wal-append.run_wall_time_us":1085615}
I20260709 13:17:33.389004  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.389711  4042 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:33.390667  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.391222  4042 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:33.399770  3868 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:33.401291  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.401930  4044 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:33.405030  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.405620  4040 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:33.353222  3970 rpcz_store.cc:276] 0709 13:17:31.655996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.888150 (+232154us) service_pool.cc:224] Handling call
0709 13:17:31.888484 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.888865 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:17:32.032065 (+143200us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.245154 (+213089us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.259286 (+ 14132us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.259840 (+   554us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:17:32.896072 (+636232us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b180042a000. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:17:32.896303 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.342347 (+446044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.342429 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.352494 (+ 10065us) raft_consensus.cc:1685] finished
0709 13:17:33.352515 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.352646 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61617,"prepare.queue_time_us":864378,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":108212,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":22949,"spinlock_wait_cycles":16175872,"thread_start_us":721616,"threads_started":3,"wal-append.queue_time_us":256808}
I20260709 13:17:33.415892  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.420114  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.387209  7598 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.425501  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.408993  8079 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.425253  3868 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 7, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 7 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:33.435941  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:33.437651  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.441251  3868 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 5 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:33.444355  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.445412  3970 raft_consensus.cc:2410] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:17:33.445740  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85649.5us
I20260709 13:17:33.424852  8150 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.452322  3963 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:33.434901  8149 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.444249  8116 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:33.459920  4120 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.430766  8229 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:33.433135  7598 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.483789  8098 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:33.484349  8098 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.454807  8150 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.484946  7598 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.478740  7838 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.486338  8098 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.448603  7575 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:17:33.466814  8116 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.502096  8116 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:33.494295  8185 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.600s	user 0.003s	sys 0.000s
I20260709 13:17:33.495584  8150 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.496425  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.530910  3968 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:32.767742  4039 rpcz_store.cc:276] 0709 13:17:31.502635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.225700 (+723065us) service_pool.cc:224] Handling call
0709 13:17:32.225946 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.226354 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:32.232504 (+  6150us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.758517 (+526013us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.758716 (+   199us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:32.758770 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:32.758827 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.758894 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:32.759008 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7201,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":3224,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":11756,"thread_start_us":525336,"threads_started":2,"wal-append.queue_time_us":283945}
W20260709 13:17:33.524196  8173 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.498s	user 0.003s	sys 0.000s
I20260709 13:17:33.533100  8207 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.524755  8136 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:33.534574  8136 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.525682  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 549) took 1051 ms. Trace:
I20260709 13:17:33.536990  3972 rpcz_store.cc:276] 0709 13:17:32.474349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.015406 (+541057us) service_pool.cc:224] Handling call
0709 13:17:33.015726 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.016038 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.016066 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.019786 (+  3720us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.426971 (+407185us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:33.427020 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.427096 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.525459 (+ 98363us) raft_consensus.cc:1685] finished
0709 13:17:33.525485 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.525626 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":226995,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":399393,"threads_started":1,"wal-append.queue_time_us":438668}
I20260709 13:17:33.447188  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:33.560736  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 113597us
I20260709 13:17:33.561738  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:33.566766  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:33.575470  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 136113us
I20260709 13:17:33.565703  8245 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:33.577169  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:33.567356  8079 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.577154  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:33.581929  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:33.578591  7598 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:33.577677  8245 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.608691  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2850) took 2107 ms. Trace:
I20260709 13:17:33.609887  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:33.580178  8079 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:33.585942  8150 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:33.609345  4038 rpcz_store.cc:276] 0709 13:17:31.501094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.914574 (+413480us) service_pool.cc:224] Handling call
0709 13:17:31.914946 (+   372us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:31.960565 (+ 45619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:31.960594 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:31.967875 (+  7281us) log.cc:844] Serialized 52 byte log entry
0709 13:17:32.313068 (+345193us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:32.343419 (+ 30351us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.343848 (+   429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.343948 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:32.794758 (+450810us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b180032e720. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:32.893660 (+ 98902us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b180032e720. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1
0709 13:17:32.894116 (+   456us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180032e720. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:33.002804 (+108688us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b180032e720. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:33.493732 (+490928us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:33.608381 (+114649us) raft_consensus.cc:1685] finished
0709 13:17:33.608407 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.608617 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30239,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3899,"raft.queue_time_us":1727,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":16098,"spinlock_wait_cycles":48905856,"thread_start_us":278169,"threads_started":1,"wal-append.queue_time_us":325056}
I20260709 13:17:33.614557  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.586483  8149 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.617182  4039 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:33.608052  8097 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:33.609724  7598 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:33.610978  8100 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.611480  8136 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:33.616827  8079 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.610186  8245 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:33.633630  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.634006  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:33.629822  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2801) took 1049 ms. Trace:
I20260709 13:17:33.617203  8082 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:33.622881  8150 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:33.638566  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:33.637332  3970 rpcz_store.cc:276] 0709 13:17:32.581088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.446066 (+864978us) service_pool.cc:224] Handling call
0709 13:17:33.446366 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.446555 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:17:33.454583 (+  8028us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.629324 (+174741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:33.629397 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:33.629485 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.629563 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.629741 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8645,"prepare.queue_time_us":8344,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":13335,"thread_start_us":168480,"threads_started":1,"wal-append.queue_time_us":165072}
I20260709 13:17:33.646031  8165 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:33.646203  8255 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:33.650871  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2397) took 1957 ms. Trace:
I20260709 13:17:33.651439  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2799) took 1087 ms. Trace:
I20260709 13:17:33.652006  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2796) took 1121 ms. Trace:
I20260709 13:17:33.652487  8194 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.634442  8100 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.654215  4039 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:33.627902  8149 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:33.656523  8116 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.657887  8244 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.658360  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.644565  4649 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:33.658389  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.629335  7598 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.635857  8097 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:17:33.660192  8150 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.663965  4047 rpcz_store.cc:276] 0709 13:17:31.693815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:32.346234 (+652419us) service_pool.cc:224] Handling call
0709 13:17:32.882661 (+536427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.883238 (+   577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.650661 (+767423us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b54000ca150. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:33.650807 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1232599424}
I20260709 13:17:33.664054  3969 rpcz_store.cc:276] 0709 13:17:32.564008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.370491 (+806483us) service_pool.cc:224] Handling call
0709 13:17:33.370796 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.371160 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.371189 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.371593 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.465180 (+ 93587us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:33.465227 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.465298 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.651232 (+185934us) raft_consensus.cc:1685] finished
0709 13:17:33.651252 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.651385 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6221,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":37760,"thread_start_us":86917,"threads_started":1,"wal-append.queue_time_us":200264}
I20260709 13:17:33.682447  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.683682  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.684454  3969 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:33.664453  3971 rpcz_store.cc:276] 0709 13:17:32.530400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.346735 (+816335us) service_pool.cc:224] Handling call
0709 13:17:33.347026 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.365601 (+ 18575us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:33.365903 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.380654 (+ 14751us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18001cb640. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:33.550027 (+169373us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.550484 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.550618 (+   134us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:33.550652 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.550726 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.651748 (+101022us) raft_consensus.cc:1685] finished
0709 13:17:33.651832 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.651953 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33020,"prepare.queue_time_us":280,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":61,"raft.queue_time_us":24809,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":12817,"spinlock_wait_cycles":24058240,"thread_start_us":131183,"threads_started":1,"wal-append.queue_time_us":195068}
I20260709 13:17:33.685163  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.651901  8126 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:33.637814  8082 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.685766  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:33.687565  3969 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:33.688102  3969 pending_rounds.cc:85] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 7
I20260709 13:17:33.688339  3969 pending_rounds.cc:107] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:33.688576  3969 raft_consensus.cc:2889] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:33.689615  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45170us
I20260709 13:17:33.668740  8194 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:33.720268  8044 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.720849  8044 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.721124  8194 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.722332  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2478) took 1986 ms. Trace:
I20260709 13:17:33.722380  8194 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.721185  8048 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:33.725225  8048 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:33.726105  8048 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.726800  8036 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:33.722839  4118 rpcz_store.cc:276] 0709 13:17:31.735663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.737456 (+  1793us) service_pool.cc:224] Handling call
0709 13:17:31.769045 (+ 31589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.438718 (+669673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.721974 (+1283256us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54003a7ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:33.722243 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453118080}
W20260709 13:17:33.728811  8200 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.225s	user 0.000s	sys 0.005s
I20260709 13:17:33.731755  8048 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:33.690594  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:33.735066  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44540.9us
I20260709 13:17:33.736825  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:33.737761  8242 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:33.693557  3969 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:33.738309  8242 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.686412  8126 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:33.741772  8126 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.742766  8126 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.719400  8100 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.681066  8149 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.727031  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 293) took 2657 ms. Trace:
I20260709 13:17:33.747479  4045 rpcz_store.cc:276] 0709 13:17:31.070179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.695929 (+625750us) service_pool.cc:224] Handling call
0709 13:17:31.721828 (+ 25899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:32.592576 (+870748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.726794 (+1134218us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54000b7f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:33.726968 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2001064192}
I20260709 13:17:33.749406  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.751037  3969 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:33.751255  8149 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:33.752209  3969 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:33.752667  8195 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:33.749419  4675 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:33.753814  8175 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:33.695670  8207 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.754479  8207 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.754858  8207 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:33.700822  4677 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:17:33.757236  8135 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:33.701195  4680 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.761062  8044 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:33.701778  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:33.761857  4679 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:33.703197  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:33.763319  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 60204.4us
I20260709 13:17:33.764070  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:33.695117  8116 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.715229  3968 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:33.770761  3968 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:33.719228  8244 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.752794  8196 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.699780  8245 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.763198  8142 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.776976  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.777223  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:33.778332  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2371) took 2123 ms. Trace:
I20260709 13:17:33.778734  4044 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:33.779716  4042 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:33.778729  3966 rpcz_store.cc:276] 0709 13:17:31.654621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.654724 (+   103us) service_pool.cc:224] Handling call
0709 13:17:31.700349 (+ 45625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:31.715433 (+ 15084us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:17:31.861535 (+146102us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.214367 (+352832us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:32.227125 (+ 12758us) log.cc:844] Serialized 26 byte log entry
0709 13:17:32.227268 (+   143us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:32.231618 (+  4350us) log.cc:844] Serialized 14 byte log entry
0709 13:17:32.234539 (+  2921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:32.234621 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.728199 (+1493578us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:33.778139 (+ 49940us) raft_consensus.cc:1685] finished
0709 13:17:33.778161 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.778278 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46500,"prepare.queue_time_us":254870,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":9103,"raft.queue_time_us":2976,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":25394,"spinlock_wait_cycles":8493824,"thread_start_us":420034,"threads_started":2,"wal-append.queue_time_us":560417}
I20260709 13:17:33.711850  7598 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.770608  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:33.771013  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 132504us
I20260709 13:17:33.669963  8255 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.771641  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:33.773000  3969 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:33.773367  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:33.773777  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:33.773940  4043 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:33.774813  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:33.775230  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.775712  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.776885  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:33.691309  8082 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:33.788226  4121 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:33.837038  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:33.839702  4039 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:33.837602  3968 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:17:33.836668  4040 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:33.842252  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:33.847262  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.836556  8089 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:17:33.850507  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.851125  4114 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:33.852331  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.852929  4114 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:33.853983  4680 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:33.854813  8106 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:33.855325  8106 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.855121  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:33.857661  4675 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:33.860225  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:33.785081  8105 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:33.861181  8105 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.861604  8105 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:33.863369  4113 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:33.863765  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.867426  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:33.784973  8170 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:33.873581  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:33.852238  3918 auto_rebalancer.cc:893] Removing replace marker failed: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:17:33.879288  3918 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:17:33.861618  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.881865  8199 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.883091  8242 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:33.883486  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2798) took 1329 ms. Trace:
W20260709 13:17:33.879611  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:17:33.883937  8134 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.884524  8187 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.846782  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:33.883496  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:33.895836  3965 rpcz_store.cc:276] 0709 13:17:32.554046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.367658 (+813612us) service_pool.cc:224] Handling call
0709 13:17:33.410125 (+ 42467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:33.433669 (+ 23544us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:33.450417 (+ 16748us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.854877 (+404460us) log.cc:844] Serialized 14 byte log entry
0709 13:17:33.877802 (+ 22925us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:33.878247 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:17:33.878377 (+   130us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:33.878410 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.878476 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:33.883294 (+  4818us) raft_consensus.cc:1685] finished
0709 13:17:33.883313 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:33.883428 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":713310,"prepare.queue_time_us":302830,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":64540,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":8888,"thread_start_us":87425,"threads_started":1,"wal-append.queue_time_us":195949}
I20260709 13:17:33.889315  8245 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.861097  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:33.889914  8019 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:33.890553  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:33.892369  8165 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:33.893441  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:33.786286  8100 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:33.857327  8106 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:33.899385  3964 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:33.878156  8142 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:17:33.900094  3965 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:17:33.900542  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59287.4us
I20260709 13:17:33.900744  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:33.909564  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:33.916952  3969 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:33.785372  8196 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:33.954874  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54224.8us
I20260709 13:17:33.898986  8134 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:33.916860  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:33.910235  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:33.931649  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:33.945477  4039 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:33.908219  7575 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:33.958317  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:33.960093  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50630.9us
I20260709 13:17:33.956374  3968 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:33.887037  8079 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.965462  3970 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:33.851253  8207 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.905640  8170 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:33.929157  8242 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:33.968112  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:33.920567  8136 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:33.919490  8184 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.966931  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:33.974084  8048 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:17:33.974260  8189 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:33.974787  7709 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:34.015420  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 281241us
I20260709 13:17:33.977123  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:33.977787  3938 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:34.017625  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.978358  7367 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.961797  8119 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:33.979377  8194 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:33.979789  8187 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:33.908478  8244 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:17:33.986563  3937 leader_election.cc:400] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:33.928081  8100 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:33.977735  8164 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:17:33.962603  8089 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:33.965395  8116 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:34.003489  4678 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:34.012203  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 550) took 1217 ms. Trace:
W20260709 13:17:33.997759  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:33.961970  8257 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:33.982620  8243 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:33.975607  8207 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:34.020483  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:33.978672  8170 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:33.988523  3964 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:34.029654  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:33.980650  8242 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:33.960285  8152 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:17:34.003971  8106 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.003621  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:33.989594  8268 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:34.043838  8116 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:33.974328  8199 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:17:34.136824  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:34.129361  8184 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.136569  3966 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:34.149121  4039 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.010850  8264 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.129000  3963 rpcz_store.cc:276] 0709 13:17:32.794619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.454098 (+659479us) service_pool.cc:224] Handling call
0709 13:17:33.467839 (+ 13741us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.468135 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:33.853692 (+385557us) log.cc:844] Serialized 14 byte log entry
0709 13:17:34.011868 (+158176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:34.011924 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:34.011969 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.012035 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.012149 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":385494,"prepare.queue_time_us":385863,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":47,"raft.queue_time_us":95,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":13557,"thread_start_us":157841,"threads_started":1}
I20260709 13:17:34.032212  8238 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:33.989867  8080 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.140s
W20260709 13:17:34.141228  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 111643us
W20260709 13:17:34.171049  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 189183us
I20260709 13:17:34.172562  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.009027  8150 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:17:34.128334  8155 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.149935  4121 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.155594  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:34.157184  3964 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:17:34.175400  4121 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:34.166589  4039 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
W20260709 13:17:34.168047  8269 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:17:34.119925  8119 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.156257  8116 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.027653  7709 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.179064  4649 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:34.229497  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50496.6us
I20260709 13:17:34.179299  8155 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.179854  8152 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:34.180295  8242 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.187071  7598 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:34.148633  8124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.010s	sys 0.016s
I20260709 13:17:34.150302  8097 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.173923  8104 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.161464  8268 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:34.170076  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 211819us
I20260709 13:17:34.141971  8257 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.269731  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:34.228371  4121 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.171844  8238 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.271413  4121 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.271718  8238 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.271963  8285 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.272712  8285 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:34.260679  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 50002.3us
W20260709 13:17:34.261480  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88990.6us
W20260709 13:17:34.258301  8124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.010s	sys 0.016s
I20260709 13:17:34.264570  4119 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:34.271232  8270 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:34.281586  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.233284  8117 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:34.171301  8184 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.259140  8207 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:34.233752  8152 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:34.290805  4682 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:34.263489  8079 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.263265  8150 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.301326  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.306833  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:34.303694  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 326140us
I20260709 13:17:34.307860  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:34.282850  8284 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.287563  8117 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:34.289583  8255 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.300442  8194 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.269876  8245 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:17:34.305013  4121 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:34.298089  8149 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.301976  8124 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:34.334707  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:34.305141  8207 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:34.305644  4678 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:34.277568  8104 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.315816  8126 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:34.348006  8082 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.349226  8245 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:34.349762  8155 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.323347  8284 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:34.353344  8274 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:34.311233  8270 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.312316  8150 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.357582  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:34.361611  8267 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:34.321980  7709 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:34.363268  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.364620  8184 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.324842  8079 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.299226  8268 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.373780  8245 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:34.373268  8135 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.000s
I20260709 13:17:34.368434  8124 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.383453  3971 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:34.387108  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:34.371445  4678 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:34.344584  8194 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.309389  8089 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:17:34.399787  3967 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:34.385738  8100 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.416116  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:34.406504  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 136796us
I20260709 13:17:34.417598  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.418231  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:34.417217  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.393850  8149 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.422122  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.420554  8270 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:34.419150  3967 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:34.413964  8124 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.429515  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.394086  7598 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:34.433393  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.434146  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.439141  4118 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:34.440114  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:34.434746  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:34.435968  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.441632  4113 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:34.436374  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:34.371269  8152 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.444872  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:34.426723  8244 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:34.423225  8102 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:34.394001  8238 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.456022  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2803) took 1368 ms. Trace:
I20260709 13:17:34.455725  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.426584  8270 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.430464  8097 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:34.457875  3972 rpcz_store.cc:276] 0709 13:17:33.087175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.538472 (+451297us) service_pool.cc:224] Handling call
0709 13:17:33.538823 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:33.539186 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.539215 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:33.539841 (+   626us) log.cc:844] Serialized 52 byte log entry
0709 13:17:33.919575 (+379734us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:33.919615 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.920349 (+   734us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.455793 (+535444us) raft_consensus.cc:1685] finished
0709 13:17:34.455815 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.455960 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5743,"raft.queue_time_us":1176,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":10601,"thread_start_us":379335,"threads_started":1,"wal-append.queue_time_us":611332}
I20260709 13:17:34.459630  8102 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:34.478700  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:34.452665  8155 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.459744  8244 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.451015  8170 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:17:34.419552  8207 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.474089  7575 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.465778  8264 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:34.487679  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.468878  8270 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.480216  8102 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.493178  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.485970  8244 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:34.484593  8257 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.444018  8245 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.502557  4121 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
W20260709 13:17:34.508214  8278 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:17:34.509887  8136 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:34.510514  8283 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:17:34.511132  8279 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:17:34.511586  8098 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:34.513655  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:34.454921  4678 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:34.582152  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 125204us
W20260709 13:17:34.584437  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70846.6us
I20260709 13:17:34.587060  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.587291  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.481623  8292 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:17:34.512446  8082 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.525489  8136 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.631986  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:34.600741  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:34.582935  8163 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:17:34.645455  8082 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:34.646071  8265 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:17:34.647118  8265 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:34.647758  8265 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:34.649997  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.651209  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.652204  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:34.583792  8098 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:34.646174  8082 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:34.584164  7910 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:34.628153  8019 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.588800  8135 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.594502  8284 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.592443  7598 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:34.586781  8104 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.654151  8164 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:34.588596  7937 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:34.675534  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2805) took 1487 ms. Trace:
I20260709 13:17:34.630748  8074 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:17:34.681034  8280 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:17:34.681183  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.696656  8089 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.699612  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.497172  8264 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.682842  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.685288  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.701982  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:34.698235  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 46357.1us
I20260709 13:17:34.713231  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2817) took 1001 ms. Trace:
I20260709 13:17:34.713760  3966 rpcz_store.cc:276] 0709 13:17:33.712375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.966512 (+254137us) service_pool.cc:224] Handling call
0709 13:17:34.136392 (+169880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.157367 (+ 20975us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.713020 (+555653us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002599d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:34.713171 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337458048}
I20260709 13:17:34.714133  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.714982  3967 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:34.715557  8170 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:34.716054  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.716361  8170 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:34.713161  3969 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:34.688470  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:34.697615  4677 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.001s
W20260709 13:17:34.661761  8187 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.033s	sys 0.094s
I20260709 13:17:34.717738  4677 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:34.652508  4678 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.719014  4112 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:34.524924  8287 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 13:17:34.690505  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:34.712793  8079 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:34.636613  8150 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:34.718026  8187 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.033s	sys 0.095s
I20260709 13:17:34.695814  3970 rpcz_store.cc:276] 0709 13:17:33.188255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.677143 (+488888us) service_pool.cc:224] Handling call
0709 13:17:33.697655 (+ 20512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:33.965884 (+268229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.675283 (+709399us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54004079d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:34.675470 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615459200}
I20260709 13:17:34.678803  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.656781  8194 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:34.701838  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:34.715114  4681 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:34.715301  7575 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 13:17:34.727079  8291 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:17:34.727670  8165 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:34.648531  8265 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.733343  8238 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:34.699013  8089 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.687191  8135 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:34.741617  8289 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:17:34.743141  8265 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:34.715036  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:34.745337  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 104570us
W20260709 13:17:34.745478  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43577.9us
I20260709 13:17:34.746121  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:34.746459  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:34.749811  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:34.757288  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:34.716813  8170 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:34.762537  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:34.754200  8105 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.000s
I20260709 13:17:34.765882  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:34.767216  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:34.753010  7575 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:34.753386  8257 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:34.694809  8116 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.752388  8100 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:34.769825  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.686244  7910 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.778904  7910 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:34.781188  8298 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.147s	user 0.000s	sys 0.003s
I20260709 13:17:34.782435  8264 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.764221  8074 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:34.755577  8104 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:34.774451  8257 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.789602  8284 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.787317  8080 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:34.800328  8170 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.801750  8184 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:34.804390  8196 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.805215  8304 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:34.807591  8089 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.811751  7367 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:34.859038  7367 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:34.812404  8134 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:34.769165  8105 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:34.813651  8273 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.536s	user 0.002s	sys 0.000s
I20260709 13:17:34.762315  8079 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:17:34.814847  8119 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.815356  7690 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:34.816615  8116 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.774055  8150 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:34.883164  8150 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:34.883569  8150 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:34.857352  4678 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:17:34.885257  4678 pending_rounds.cc:85] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 11
I20260709 13:17:34.885537  4678 pending_rounds.cc:107] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:17:34.885783  4678 raft_consensus.cc:2889] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:34.886767  8143 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
W20260709 13:17:34.818783  8266 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.662s	user 0.000s	sys 0.002s
I20260709 13:17:34.819969  8285 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:34.823072  8270 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.775877  7575 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:34.841786  8264 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.891316  8264 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.891652  7575 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:34.848273  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 157900us
I20260709 13:17:34.893483  8264 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:34.764294  8098 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.847901  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:34.899842  8280 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:34.830482  7937 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:34.901705  7937 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.904129  8287 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:34.865947  8295 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.186s	user 0.000s	sys 0.004s
I20260709 13:17:34.848816  8284 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.867522  8124 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.860424  8134 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:34.868883  7367 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:34.925961  7367 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:34.870661  8244 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.872233  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2498) took 1089 ms. Trace:
I20260709 13:17:34.874949  8299 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:34.876268  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2814) took 1389 ms. Trace:
I20260709 13:17:34.867558  8242 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:34.878739  8293 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:17:34.890400  8136 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.829705  8257 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.851331  8184 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:34.852748  8194 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:34.900256  4675 raft_consensus.cc:2376] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9. Re-sending same reply.
I20260709 13:17:34.860973  8304 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:34.907518  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.917881  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:34.985601  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.986007  3964 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:34.905664  8287 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:34.919106  4046 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:34.985555  3938 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:34.850936  8080 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.882712  7690 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:34.931423  4119 rpcz_store.cc:276] 0709 13:17:33.782519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.782656 (+   137us) service_pool.cc:224] Handling call
0709 13:17:33.782954 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.281397 (+498443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.871986 (+590589us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400003054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:34.872169 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1106766592}
I20260709 13:17:34.938793  3971 rpcz_store.cc:276] 0709 13:17:33.487259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.766239 (+278980us) service_pool.cc:224] Handling call
0709 13:17:33.781756 (+ 15517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.410432 (+628676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:34.875993 (+465561us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b540044bbd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:34.876194 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383266176}
W20260709 13:17:34.969583  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.972877  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:34.973405  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:34.974646  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:34.829869  8135 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:34.972431  8098 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:34.935715  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:34.922219  8189 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:34.998425  4681 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:34.918941  8102 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:34.996780  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 309) took 1379 ms. Trace:
W20260709 13:17:35.005492  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.019452  8080 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.031076  4038 rpcz_store.cc:276] 0709 13:17:33.617563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.618119 (+   556us) service_pool.cc:224] Handling call
0709 13:17:33.618492 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:33.618847 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:33.618873 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:33.621966 (+  3093us) log.cc:844] Serialized 52 byte log entry
0709 13:17:33.920962 (+298996us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:33.921003 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:33.921066 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:34.785250 (+864184us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:34.992875 (+207625us) raft_consensus.cc:1685] finished
0709 13:17:34.992899 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:34.996696 (+  3797us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":511,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4522,"spinlock_wait_cycles":34349440,"thread_start_us":279482,"threads_started":1,"wal-append.queue_time_us":359172}
I20260709 13:17:35.008867  8196 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.020479  8044 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:35.045914  8194 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:35.046489  8287 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:35.046850  8287 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:35.047053  8306 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:35.047601  8306 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:35.046850  8194 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.048411  8306 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.049453  8287 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.050036  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.050776  4119 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:35.050796  8287 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:34.968528  8299 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:35.065307  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.036607  4678 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:35.062247  8196 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.040707  8184 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.091274  8136 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.067771  7690 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.091920  8196 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.083458  8105 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:35.105741  8304 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.089419  8270 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.093012  8284 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.116506  8299 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.166922  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.170450  3964 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:35.170639  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.172574  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.176040  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 2881) took 1401 ms. Trace:
I20260709 13:17:35.176595  4046 rpcz_store.cc:276] 0709 13:17:33.774397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.774546 (+   149us) service_pool.cc:224] Handling call
0709 13:17:33.843083 (+ 68537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:34.995195 (+1152112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.175415 (+180220us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540045f954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:35.175773 (+   358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2474140032}
I20260709 13:17:35.177814  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.179688  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:35.180730  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 114165us
W20260709 13:17:35.186179  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.180773  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 286129us
I20260709 13:17:35.188923  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.190761  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:35.192009  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.193476  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.195322  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.195268  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.195639  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:35.197201  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.198731  4041 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:35.200186  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.173743  3964 raft_consensus.cc:2410] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:17:35.173661  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.260331  8105 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:35.262593  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.092288  7690 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:35.269670  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.273089  8036 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:35.273608  8036 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:35.274217  8119 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.275492  8119 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.276137  8116 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.277238  8284 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.278200  8284 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.279383  8119 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.109970  8244 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.171000  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.285310  8284 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.275727  8036 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.286552  8036 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.286952  8117 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.288160  8117 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:35.290426  7999 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:35.293073  3972 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:35.294210  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:35.295207  3972 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:35.296237  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.297763  7709 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.298507  7709 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.299283  8150 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:35.277511  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 82113.4us
I20260709 13:17:35.305104  3972 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:35.089277  8124 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.317441  8187 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:35.285251  8050 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:17:35.320046  8189 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:35.308166  3969 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:35.280447  8116 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.321496  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.111129  8184 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:35.333688  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.334656  8170 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.335381  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.336683  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.337488  4043 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.339030  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:35.340504  8199 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:35.341040  8199 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:35.342455  8199 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.336522  4044 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:17:35.349747  8102 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:35.350023  8307 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.284s	user 0.003s	sys 0.000s
I20260709 13:17:35.351930  7937 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:35.353245  8308 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.288s	user 0.000s	sys 0.002s
I20260709 13:17:35.353546  8284 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.354342  8284 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.355180  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:35.356287  8310 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260709 13:17:35.309861  7999 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.358284  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.358143  7999 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.358129  8314 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:35.359714  8314 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:35.360308  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:35.320713  8050 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:35.357635  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108178us
I20260709 13:17:35.359146  3969 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:35.359076  4045 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.320886  7709 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:35.320539  8257 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.376479  4046 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:35.372934  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.377554  3965 raft_consensus.cc:1217] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[9.7-12.9]   Dedup: 9.7->[10.8-12.9]
I20260709 13:17:35.361513  8284 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.394183  3965 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [9.7-12.9]
I20260709 13:17:35.363780  8050 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:35.395521  8165 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:35.361099  8314 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.396520  8050 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.390825  8199 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:35.398208  8050 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.362823  8164 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.430611  3971 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:35.433313  8244 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.433761  8302 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:17:35.436668  4121 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:17:35.437136  4121 pending_rounds.cc:85] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 8
I20260709 13:17:35.437358  4121 pending_rounds.cc:107] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:17:35.437621  4121 raft_consensus.cc:2889] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:35.438130  3970 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:35.382292  7999 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:35.396569  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.440896  4046 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
W20260709 13:17:35.441936  8333 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:17:35.411578  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.411551  8257 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.413702  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:35.415305  4675 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:17:35.448627  3972 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:35.451843  8312 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:35.419274  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.453040  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:35.453444  8137 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.454119  4042 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.454702  8149 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:35.455333  8149 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.375034  8280 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:35.456462  8280 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:35.457082  8137 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.422317  4681 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:35.457968  8149 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.422782  4047 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.424919  8304 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:35.425612  8306 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:35.427253  4114 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:35.466106  8306 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.428045  3968 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:35.428685  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.469934  4113 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:35.429029  8116 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:35.468657  8306 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.430681  8245 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:35.475545  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:35.398355  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:35.476643  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 78433.3us
I20260709 13:17:35.478143  4119 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:35.479496  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.458804  8280 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.447926  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:35.353269  7937 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:35.481212  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:35.481603  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.481982  4113 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.482355  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:35.480830  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:35.455875  4045 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:35.460733  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.452605  8312 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.460736  8244 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:35.453132  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93087.4us
I20260709 13:17:35.463470  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:35.465879  8304 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.367847  8150 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.486349  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.484303  7937 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:35.484624  4112 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:35.456707  3938 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:35.489017  8116 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:35.453766  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.494757  4113 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
W20260709 13:17:35.496086  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.489899  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:35.495841  8116 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.504900  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.509718  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:35.509671  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53231.9us
I20260709 13:17:35.502856  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.526484  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.506803  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.529397  3968 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:35.516014  4114 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:35.548504  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:35.560293  4047 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:35.517957  8116 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:35.563651  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82936.1us
I20260709 13:17:35.566337  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:35.571019  3965 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:35.575803  4045 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.565758  8149 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.566671  8306 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:35.615748  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.617161  3964 raft_consensus.cc:2410] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 13:17:35.618654  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44382.5us
I20260709 13:17:35.516945  7937 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.582012  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.577015  8098 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:35.615835  8124 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.633371  8124 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.633730  8124 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.635135  3966 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:17:35.638444  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:35.638950  8334 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:17:35.642269  8098 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:35.642738  8098 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.643100  8098 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.561926  8164 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:35.622022  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:35.624159  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 160951us
I20260709 13:17:35.624495  8312 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.616003  8284 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:35.630255  7937 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.645498  3972 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:35.650023  4042 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:35.581647  8149 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.649399  4680 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:35.653896  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.696019  8149 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.706278  4115 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:35.708752  8119 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:35.709115  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 225224us
I20260709 13:17:35.709703  8080 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.711673  8336 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:17:35.714685  3964 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:17:35.722592  3964 pending_rounds.cc:85] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 10
I20260709 13:17:35.722899  3964 pending_rounds.cc:107] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:17:35.707006  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:35.665050  8257 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:35.723152  3964 raft_consensus.cc:2889] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:35.737393  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.745069  4041 raft_consensus.cc:2410] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:35.743716  4039 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:35.753768  4045 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:35.724730  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.756557  4047 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
W20260709 13:17:35.765929  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.766600  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.705142  8164 consensus_queue.cc:1243] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:35.770920  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:35.776885  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.770360  8137 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:35.779026  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.779292  8100 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:35.779526  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:35.779701  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.780846  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:35.780946  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.781718  4045 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:35.782361  8313 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:17:35.782717  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.789207  4038 raft_consensus.cc:2410] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 13:17:35.777031  8080 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.790970  8196 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.791513  8196 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.792091  8080 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.793146  4681 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:35.793558  8196 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.776751  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:35.795030  4045 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:35.801698  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.805228  4680 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:35.804225  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:35.819115  8242 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.799s	user 0.013s	sys 0.004s
I20260709 13:17:35.821293  8136 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:17:35.821661  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 62712.8us
I20260709 13:17:35.823993  4043 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:35.824312  8150 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:35.824839  8143 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:35.825495  7598 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:35.800984  8100 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.839659  7598 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:35.840346  8341 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:17:35.842712  8339 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:35.843230  7598 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.837946  8184 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:17:35.844202  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 186594us
W20260709 13:17:35.845311  8117 consensus_meta.cc:287] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.005s
W20260709 13:17:35.830252  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.817360  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.835515  8150 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.806535  8164 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:35.845270  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:35.849645  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.807468  8306 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:35.836054  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:35.850281  3968 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:35.831985  8196 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:35.813066  8194 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:35.846494  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:35.855916  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.857995  4039 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:35.875913  3971 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:35.817896  8244 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:35.861078  8124 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.861361  8149 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:35.864903  8143 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:35.866665  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 159485us
I20260709 13:17:35.874475  8196 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:35.876688  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:35.880046  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:35.852487  8313 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.887207  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 329) took 1575 ms. Trace:
I20260709 13:17:35.899417  3969 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:35.889578  4041 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:35.835995  8304 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:35.888675  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:35.896020  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:35.872843  8150 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.898252  7709 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:35.898644  8196 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:35.864488  8098 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.904451  3965 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:35.905236  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:35.904254  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.906625  4046 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:35.908056  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:35.909273  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:35.900199  8105 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:35.915901  8242 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:35.920467  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.910137  8304 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:35.921291  4043 raft_consensus.cc:2410] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:35.913734  8313 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:35.926113  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.929257  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:35.930609  4040 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 14. Ops: []
I20260709 13:17:35.931085  3966 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:35.933674  3968 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:35.932411  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:35.931917  4040 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:17:35.989432  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70680.8us
I20260709 13:17:35.912196  8194 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:35.919239  8242 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:35.998602  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48020.6us
I20260709 13:17:35.899670  4682 rpcz_store.cc:276] 0709 13:17:34.311726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.311878 (+   152us) service_pool.cc:224] Handling call
0709 13:17:34.315498 (+  3620us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:34.320223 (+  4725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:34.320260 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:34.320993 (+   733us) log.cc:844] Serialized 52 byte log entry
0709 13:17:35.255800 (+934807us) spinlock_profiling.cc:243] Waited 4.09 ms on lock 0x7b1800475180. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:17:35.404401 (+148601us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:35.404944 (+   543us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.413364 (+  8420us) log.cc:844] Serialized 14 byte log entry
0709 13:17:35.413580 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.413702 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:35.638238 (+224536us) spinlock_profiling.cc:243] Waited 36.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:35.886816 (+248578us) raft_consensus.cc:1685] finished
0709 13:17:35.886837 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:35.887017 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14557,"prepare.queue_time_us":15695,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":13225,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":4618,"spinlock_wait_cycles":93080192,"thread_start_us":70302,"threads_started":1,"wal-append.queue_time_us":1188089}
I20260709 13:17:36.007203  8282 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.008894  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:36.010288  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.011276  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 90554.6us
I20260709 13:17:35.946638  8313 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:35.923380  8304 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:36.024147  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 190792us
I20260709 13:17:36.012959  8242 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.034222  3968 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:36.035619  8292 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.038507  8124 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.035678  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.033053  4121 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:35.989190  8116 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.030040  8313 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:36.046311  4116 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:36.031059  8304 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:36.057852  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 152731us
I20260709 13:17:36.045413  8292 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:36.131450  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.124686  8292 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.151432  8150 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:36.152278  7937 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:36.154850  4047 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:17:36.155771  8338 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.624s	user 0.002s	sys 0.010s
I20260709 13:17:36.040947  8282 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.159487  8143 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:36.159988  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 133973us
I20260709 13:17:36.167541  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:36.163228  4041 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:36.172887  4041 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:36.097347  8050 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:17:36.149638  8194 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:36.177814  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 163770us
I20260709 13:17:36.181778  4046 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:36.183028  4041 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:17:36.179354  4040 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:36.134476  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.185395  4042 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:36.142134  7936 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:17:36.180001  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 161485us
I20260709 13:17:36.192207  4046 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:17:36.197067  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.197757  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.202590  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.203482  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.206614  4046 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:36.208060  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.191608  8257 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:36.211478  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.215152  4119 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:17:36.218243  4046 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:36.193375  7936 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.175688  7575 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.205s
W20260709 13:17:36.227779  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100270us
I20260709 13:17:36.232589  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.234977  4046 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:36.195489  8196 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:36.241904  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74450.8us
I20260709 13:17:36.194133  7937 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:36.242638  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 224457us
W20260709 13:17:36.236790  8199 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.839s	user 0.010s	sys 0.003s
I20260709 13:17:36.200251  8194 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:17:36.248896  4113 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:36.249104  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:36.256386  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.261628  8270 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:36.243386  8164 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:17:36.250474  8299 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:36.274511  8152 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.277128  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2829) took 1249 ms. Trace:
I20260709 13:17:36.277583  3963 rpcz_store.cc:276] 0709 13:17:35.002716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.416744 (+414028us) service_pool.cc:224] Handling call
0709 13:17:35.417338 (+   594us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:35.417894 (+   556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.417930 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:35.418613 (+   683us) log.cc:844] Serialized 52 byte log entry
0709 13:17:35.532046 (+113433us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:35.532084 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.532155 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.148617 (+616462us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:36.248038 (+ 99421us) raft_consensus.cc:1685] finished
0709 13:17:36.248061 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.251878 (+  3817us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6725,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"spinlock_wait_cycles":263140096,"thread_start_us":112994,"threads_started":1,"wal-append.queue_time_us":112408}
I20260709 13:17:36.279484  8355 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:17:36.280844  8150 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:36.285211  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.291729  4047 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:36.296247  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.297048  4046 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:36.298189  4046 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:17:36.297994  8304 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.298659  8270 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.299347  8270 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.300199  8304 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.307075  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:36.310094  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62603.6us
I20260709 13:17:36.291368  8150 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:17:36.328034  4047 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:36.333158  8117 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.333778  8117 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:36.335760  8284 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.308162  7575 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.322634  8105 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.337751  8284 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.338337  8105 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.339883  8284 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.340263  8105 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.290450  7936 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.343899  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.345166  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.346675  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.337661  7575 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.351547  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:36.353886  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:36.361889  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 131710us
W20260709 13:17:36.362996  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:36.363579  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 132968us
I20260709 13:17:36.363718  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.348562  8242 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.371064  4044 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:36.362208  8194 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:36.365000  8299 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:36.371395  8257 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:36.365701  8270 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.369652  7709 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:36.384658  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61491.1us
I20260709 13:17:36.385833  8355 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:17:36.390117  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46340.8us
I20260709 13:17:36.390799  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.377170  8196 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:36.393378  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:36.392419  4044 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:36.381080  8357 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:17:36.395501  8359 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:17:36.369912  8292 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.401002  4115 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:36.386721  8355 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:17:36.404026  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:36.406662  4682 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:36.411374  4047 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:36.413290  8364 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:36.417352  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:36.421387  4044 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:36.422518  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:36.401981  8359 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:36.409746  8257 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.436640  4044 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:17:36.437600  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55742.1us
I20260709 13:17:36.435850  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:36.441272  4040 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:36.440361  4682 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:36.435667  8124 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.444674  4678 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:17:36.446972  8292 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.447592  7937 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:36.438532  8359 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:36.429293  8150 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.450307  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:36.450822  8150 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.427434  8355 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:36.456872  8280 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:36.457345  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66598.5us
I20260709 13:17:36.425233  7575 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.458693  7367 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:36.458958  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:36.459549  7367 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:36.460189  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:36.460454  8270 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:36.461069  8270 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:36.462054  8270 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.435634  8364 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:36.465849  8364 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:36.466709  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:36.457484  8280 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.459903  7367 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.466866  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:36.470849  8242 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:36.470613  7367 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.435757  8299 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:36.456993  8355 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.467077  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2509) took 1945 ms. Trace:
I20260709 13:17:36.471653  8299 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:36.466769  8364 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:36.472422  8299 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.456475  8313 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.474542  8313 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.475025  8364 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.476156  8364 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:36.471836  8355 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.481295  8364 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:36.450253  8359 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.477481  7367 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:36.492156  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.477335  8150 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.493080  7598 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.493091  8304 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:36.493728  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:36.477662  4120 rpcz_store.cc:276] 0709 13:17:34.521619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.521800 (+   181us) service_pool.cc:224] Handling call
0709 13:17:34.591324 (+ 69524us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:36.455335 (+1864011us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:36.455383 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:36.455426 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:36.455464 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:36.466564 (+ 11100us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54001b1a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:36.466616 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.466910 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3073,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":4285752704}
I20260709 13:17:36.503589  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:36.501039  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 92977.9us
I20260709 13:17:36.456573  8100 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.509352  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.510138  4044 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:36.493793  7598 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:36.511281  4040 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:36.504527  8194 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:17:36.511169  3965 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:36.517097  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57002us
I20260709 13:17:36.521865  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2443) took 1051 ms. Trace:
I20260709 13:17:36.524938  3971 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:36.525650  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:36.529860  4045 rpcz_store.cc:276] 0709 13:17:35.470359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.782409 (+312050us) service_pool.cc:224] Handling call
0709 13:17:36.521640 (+739231us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000299d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:36.521797 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26619776}
I20260709 13:17:36.467176  8164 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:17:36.542641  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.543604  7910 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:17:36.545032  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:36.493178  8152 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:17:36.525262  8304 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:36.548858  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51664.2us
I20260709 13:17:36.568313  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:36.571409  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:36.572086  3963 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.559896  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:36.573814  3969 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:36.574958  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.547866  8375 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.575899  8375 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:36.594884  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 128091us
I20260709 13:17:36.597154  8282 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:36.597751  8282 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:36.598269  8282 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.604820  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:36.570976  8359 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:36.668005  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:36.669023  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 182245us
I20260709 13:17:36.673830  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:36.677738  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.699841  4040 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:36.579284  8375 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.605094  8292 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:36.716020  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 265775us
I20260709 13:17:36.719862  8383 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:17:36.720876  8384 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.721436  8384 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:36.723701  8384 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:36.724304  8384 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:36.724985  8194 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.725828  8257 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:17:36.727276  8374 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:17:36.728466  8380 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:17:36.670083  8313 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.737130  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:36.730028  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.741735  3965 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:17:36.742913  8149 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:36.745734  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:36.747448  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:36.748423  4682 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:36.750490  3938 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:36.753257  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 146937us
I20260709 13:17:36.754179  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:36.709713  7575 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:17:36.711272  8292 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.771409  7575 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:17:36.771613  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54836.9us
I20260709 13:17:36.772542  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:36.748430  8372 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:36.717545  8242 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:17:36.771966  7575 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:36.787714  8335 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.222s	user 0.000s	sys 0.020s
W20260709 13:17:36.795423  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 44996.2us
I20260709 13:17:36.774109  8292 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.816161  8163 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.817413  8313 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:36.823391  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 69320us
I20260709 13:17:36.774515  8384 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:36.792194  8134 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.835403  8098 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:36.822410  8163 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.828984  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:36.829370  8306 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:36.829569  7598 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:36.833597  8282 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:36.831656  8080 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.811589  8149 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:36.844730  3970 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:17:36.830416  8350 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.692s	user 0.006s	sys 0.006s
I20260709 13:17:36.847275  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:36.810070  7575 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:36.832103  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:36.844117  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2422) took 1951 ms. Trace:
I20260709 13:17:36.863721  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:36.887513  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 312605us
W20260709 13:17:36.888928  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 116482us
I20260709 13:17:36.829667  8360 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:36.847537  8299 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.837893  8356 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:36.830587  8382 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:36.849445  8149 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.766989  8304 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.846715  8280 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:36.926510  4043 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:36.847260  8306 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:36.914705  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:36.915371  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.848065  8080 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:36.849103  8359 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:36.861625  3967 rpcz_store.cc:276] 0709 13:17:34.891983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:34.894725 (+  2742us) service_pool.cc:224] Handling call
0709 13:17:35.172538 (+277813us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:17:35.172943 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:35.302240 (+129297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:35.302283 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:35.302981 (+   698us) log.cc:844] Serialized 26 byte log entry
0709 13:17:35.531286 (+228305us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:35.531330 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:35.531417 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:36.783876 (+1252459us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:36.843516 (+ 59640us) raft_consensus.cc:1685] finished
0709 13:17:36.843543 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:36.843707 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128507,"raft.queue_time_us":240313,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"spinlock_wait_cycles":131996160,"thread_start_us":227858,"threads_started":1,"wal-append.queue_time_us":228478}
I20260709 13:17:36.837229  8050 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:36.865461  8244 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:36.864780  8313 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:36.896343  7910 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:17:36.926071  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.885031  8196 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:17:36.962834  8270 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:36.963402  8270 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.964272  4044 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:17:36.965003  8342 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.116s	user 0.015s	sys 0.010s
I20260709 13:17:36.918133  8116 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:36.967048  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 119891us
I20260709 13:17:36.967963  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:36.938310  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.938560  4040 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:36.970927  4120 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:36.902514  8360 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.931911  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:36.930397  4041 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:36.840711  8355 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.939929  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.942451  4119 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:17:36.943362  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.944105  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.944802  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.945775  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.949208  8206 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:36.920221  8382 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.950147  8306 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.922683  7598 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:36.916266  8356 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.957818  4112 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:17:36.936789  8050 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:36.959581  8257 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.960494  8313 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.961879  8199 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:37.032302  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.929528  4115 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:37.033366  4115 pending_rounds.cc:85] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 7
I20260709 13:17:36.924700  8149 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:36.936262  8359 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:36.985821  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:36.977641  3964 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.032977  4120 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:36.937930  8244 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:36.988834  8098 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:36.990535  8393 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:36.991425  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:36.992039  4114 raft_consensus.cc:2410] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:36.992723  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:36.992847  8381 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:36.993343  4121 raft_consensus.cc:2410] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:17:36.994273  8382 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:36.999831  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:36.987058  4119 pending_rounds.cc:85] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 9
I20260709 13:17:36.958473  8384 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.021718  3963 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:37.021883  4112 pending_rounds.cc:85] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 5
I20260709 13:17:37.026389  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:36.846885  8163 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.031734  8257 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.033507  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2835) took 2026 ms. Trace:
I20260709 13:17:37.034042  4115 pending_rounds.cc:107] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:37.064128  4115 raft_consensus.cc:2889] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:37.063903  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.035621  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:37.065200  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65432.7us
I20260709 13:17:37.056237  4112 pending_rounds.cc:107] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:17:37.066179  4112 raft_consensus.cc:2889] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:37.061743  4118 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
W20260709 13:17:37.028961  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.066540  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.032030  8199 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:37.062388  3969 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:37.054412  4119 pending_rounds.cc:107] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:37.082288  4119 raft_consensus.cc:2889] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:37.036610  8244 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:37.066994  7367 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.083398  7367 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.067687  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.063740  3970 rpcz_store.cc:276] 0709 13:17:35.007458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.438954 (+431496us) service_pool.cc:224] Handling call
0709 13:17:36.844280 (+1405326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:36.862900 (+ 18620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.033326 (+170426us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003138d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:37.033455 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3230825344}
W20260709 13:17:37.066937  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.105795  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.125422  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.126325  4119 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:37.127645  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61191.2us
I20260709 13:17:37.128513  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.128943  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.130157  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.133741  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:37.134645  3963 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:37.138422  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.065245  8393 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:37.053272  8098 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.067862  8364 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:37.144368  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:37.145798  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:37.146800  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 177146us
I20260709 13:17:37.148388  3969 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.151978  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.152719  8280 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.153182  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.153373  8280 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.155772  8280 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.149168  8390 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.156910  8116 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.157452  8116 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.158259  8257 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.158941  7709 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:37.159365  8116 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.159837  8301 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.160334  8301 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:37.161988  8397 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:17:37.162457  8301 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:37.163030  8394 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:17:37.163160  8301 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.120743  8080 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.163653  8301 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.164340  8080 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.169325  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.170073  4041 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:17:37.170383  8391 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:17:37.156304  7910 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.171175  7910 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.126883  8163 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.127523  8184 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:37.150302  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.148490  4115 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.175482  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.181196  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.181854  8117 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:37.182389  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.153172  8264 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.183236  8264 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.183568  7937 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.184044  7937 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.145440  8389 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.185336  8389 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.186105  7937 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.184267  3967 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:37.159518  7709 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.173395  4112 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:37.187463  8389 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:37.188589  8396 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:17:37.189066  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.189808  8383 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.190295  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.191401  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.191649  8282 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:37.192178  4118 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:37.193035  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.190253  8383 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.196099  8383 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.198873  7709 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.203399  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.203325  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.204916  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.204820  4040 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:37.207286  7937 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.207792  7937 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.209285  8382 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.139084  8312 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:37.210376  7937 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.132839  8299 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.192498  8282 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:37.196607  8383 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:37.211380  8383 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:37.133019  8356 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.212191  8383 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.204139  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.133149  8270 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.215373  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.217206  8301 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.217507  8355 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.217795  4085 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:37.068063  8360 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.069996  8381 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.156981  8390 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.219211  8364 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.131866  8105 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.202993  8199 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.177372  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.224578  3969 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:37.261142  4119 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:37.266144  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:37.146160  8292 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.271270  4045 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:37.271811  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.232370  3964 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:37.222803  3963 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:37.241389  4047 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:17:37.242871  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 82342.6us
I20260709 13:17:37.242426  3970 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:37.172731  8098 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.250283  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.273286  4118 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:37.252597  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.173077  7910 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.275242  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.297868  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:37.298991  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46485.8us
I20260709 13:17:37.300289  4119 raft_consensus.cc:2410] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:37.278425  4115 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:37.282389  8126 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:37.304291  8126 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:37.304813  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.305589  8126 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.307125  8126 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.255726  8301 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.294368  3963 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:37.143371  8375 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.315665  8375 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.296844  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.301450  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.305538  4119 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.270215  8360 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:37.325881  3970 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:37.221853  8050 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.317421  4118 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:37.258306  7575 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.301570  8355 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:37.333881  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:37.342415  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.343639  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.343736  8134 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.332931  8301 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:17:37.333089  8282 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.345757  8282 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.344659  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.349094  4118 raft_consensus.cc:2410] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:17:37.349234  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.350369  4040 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:37.354422  4039 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:37.355862  3869 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 6 to 8, term changed from 7 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.358606  3869 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 8 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 9 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.347872  8282 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.333420  8264 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.360988  8389 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:37.365483  8292 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:37.368065  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 217580us
I20260709 13:17:37.329241  4119 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:37.361969  3869 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:37.388911  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.396173  7367 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.397881  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.406635  8244 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.407301  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.416020  3969 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:37.416471  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:37.416877  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.417111  3970 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:37.417985  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.418521  3970 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:37.417865  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.419348  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:37.411681  8411 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:37.420727  3969 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:37.410450  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.423236  8359 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.365558  8389 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:37.419283  8244 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.424448  8354 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:37.453317  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.336849  8393 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.338882  8149 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.429971  7936 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.430508  8292 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.401149  8206 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:37.450525  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.450861  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:37.474871  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.457808  7367 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:37.461005  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:37.462862  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.469359  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:37.476486  4042 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:37.472383  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:37.476895  4682 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:37.477046  4112 pending_rounds.cc:85] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 7
I20260709 13:17:37.479730  3972 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:37.480042  4112 pending_rounds.cc:107] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:37.480336  4112 raft_consensus.cc:2889] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:37.481222  4047 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:37.482195  4040 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:37.428644  8381 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.488350  3967 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:37.509856  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:37.510339  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.510792  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:37.511207  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.512827  8359 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.457088  8282 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:37.533104  8420 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:17:37.543102  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.544974  3970 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:37.514616  8355 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:37.477921  8163 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
W20260709 13:17:37.547230  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 272072us
I20260709 13:17:37.479359  8292 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.559401  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:37.539357  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:37.561462  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89334us
I20260709 13:17:37.548648  8355 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:37.561611  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.544389  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:37.554013  8264 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:37.579530  8142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.304s	user 0.013s	sys 0.020s
I20260709 13:17:37.558277  8364 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.550626  8126 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:17:37.579169  4678 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:37.573789  8389 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.626516  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:37.627310  4677 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:37.590626  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2447) took 1093 ms. Trace:
I20260709 13:17:37.561882  8390 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.620354  8149 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.624330  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:37.629379  3964 rpcz_store.cc:276] 0709 13:17:36.497161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:36.497409 (+   248us) service_pool.cc:224] Handling call
0709 13:17:37.590405 (+1092996us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b5400440054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:37.590522 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027937024}
I20260709 13:17:37.633735  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:37.616345  8142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.013s	sys 0.020s
I20260709 13:17:37.641495  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.550397  8282 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:37.644483  8398 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:37.646216  8282 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.650208  8381 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:37.651230  8381 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:37.651531  8381 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:37.652377  4116 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:37.655300  8206 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:37.655603  8050 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:37.657042  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 62176.4us
I20260709 13:17:37.658706  8383 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:37.664163  8413 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:17:37.656953  8264 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:37.666181  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:37.667575  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.577023  7575 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.670866  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.678164  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:37.687996  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70518.9us
I20260709 13:17:37.693302  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:37.696681  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:37.689639  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.699481  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.700459  4121 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.701568  4681 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:37.709118  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67723.2us
I20260709 13:17:37.710443  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.711014  4113 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.713708  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.715320  3972 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:37.717123  3869 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 9 to 11, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 11 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:37.698088  8080 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:37.720790  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.683722  8124 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:37.724888  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.730796  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:37.730796  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:37.698774  8117 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.716850  7575 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.738984  3966 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:37.690404  8098 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:17:37.716125  8304 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.709048  8184 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:17:37.757881  4117 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:37.699288  8105 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:17:37.699946  8384 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:17:37.735818  8117 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.652345  8381 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.757861  7575 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.666206  8264 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.733480  8424 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:37.756358  8163 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.771055  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61085.9us
W20260709 13:17:37.766038  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72815.9us
I20260709 13:17:37.759240  8313 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:17:37.781962  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 92397.3us
I20260709 13:17:37.786105  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.787667  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.787820  4113 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:37.765378  8194 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.772033  8098 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:17:37.796259  8421 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:37.770359  8304 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.798640  8304 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:37.801177  8414 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:17:37.790666  8163 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.806763  8163 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:37.808652  8194 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.810580  8392 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:37.801088  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 94009.5us
I20260709 13:17:37.770569  7598 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:37.815131  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:37.787997  7575 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.815665  8433 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.816100  8313 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:37.830338  8313 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.816751  8126 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.817837  8355 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.818941  8282 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:37.789172  8382 consensus_meta.cc:287] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.579s	user 0.010s	sys 0.000s
I20260709 13:17:37.771171  8117 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.815294  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:37.861198  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45992.8us
I20260709 13:17:37.862114  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.862871  8163 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:37.864406  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.864964  8382 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.865365  8382 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.865693  8382 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.866730  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.865727  8134 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:37.867698  8134 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.868041  8134 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.872696  8163 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:37.873102  8163 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.873432  8163 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:37.873909  4115 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:37.875255  8199 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.877553  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.879391  8389 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:37.879745  8389 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:37.880048  8389 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.881524  8282 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.883352  8194 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.885082  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2521) took 2640 ms. Trace:
I20260709 13:17:37.885442  4117 rpcz_store.cc:276] 0709 13:17:35.282115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:35.284930 (+  2815us) service_pool.cc:224] Handling call
0709 13:17:35.285386 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:37.764318 (+2478932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.884801 (+120483us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54002ac6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:37.885010 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5631589120}
I20260709 13:17:37.887367  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.825086  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:37.889340  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64330.4us
I20260709 13:17:37.825649  4681 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:37.892514  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.791934  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:37.895363  4112 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:37.826310  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.826433  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.825075  4121 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:37.827732  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:37.787151  8424 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:37.791905  8098 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:37.905948  4682 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:37.811923  8381 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:37.825977  8124 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:37.918730  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57840us
W20260709 13:17:37.931474  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 105117us
I20260709 13:17:37.825712  8292 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.933185  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.895473  3869 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 6 to 10, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 10 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:37.938220  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.928890  8424 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.857702  8126 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:37.947451  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.955988  8126 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:37.955842  8117 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.883585  8282 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:37.957930  8117 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:37.961781  8389 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:37.895366  8105 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:37.973402  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.974223  8353 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:37.974829  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:37.975559  8353 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:37.936885  8355 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:37.978245  8194 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:37.978806  8194 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:37.983413  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:37.985035  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51945.7us
I20260709 13:17:37.948071  4112 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:37.987982  3964 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:17:37.991137  8429 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:17:38.004554  4116 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:17:38.006899  8080 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:38.011348  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 117347us
I20260709 13:17:38.011981  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.012163  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:37.933658  7936 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:38.020185  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 193937us
I20260709 13:17:38.018579  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.019301  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.946173  8384 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:38.005693  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:38.015497  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:38.025707  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:37.994616  8282 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:37.999348  8390 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:38.028672  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.995152  8124 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:38.032377  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:37.999107  8304 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:38.026358  8117 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:38.049021  8117 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.049381  8117 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.052091  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:38.053642  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.053979  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:38.054520  3963 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.056342  8384 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:37.961802  8098 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.057459  8098 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:38.057708  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:38.058370  4113 raft_consensus.cc:2368] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.053592  3965 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:38.058797  8430 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:17:38.059861  8194 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:38.060745  8433 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:38.061820  8432 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:17:38.008028  8105 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:38.040129  8196 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:38.010984  8080 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:38.074798  8080 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.075876  8134 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.037721  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:38.057296  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.063694  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2460) took 1109 ms. Trace:
I20260709 13:17:38.071192  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:38.065631  8124 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.073338  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:38.073808  8196 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:38.081763  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 95568.2us
I20260709 13:17:38.084558  4119 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:17:38.084955  4119 pending_rounds.cc:85] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 8
I20260709 13:17:38.085156  4119 pending_rounds.cc:107] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:38.085372  4119 raft_consensus.cc:2889] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.079037  3971 rpcz_store.cc:276] 0709 13:17:36.954762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:37.249334 (+294572us) service_pool.cc:224] Handling call
0709 13:17:37.303150 (+ 53816us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:37.556088 (+252938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:37.556121 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:37.562628 (+  6507us) log.cc:844] Serialized 26 byte log entry
0709 13:17:37.779986 (+217358us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:37.780033 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:37.780155 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:38.063483 (+283328us) raft_consensus.cc:1685] finished
0709 13:17:38.063503 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:38.063634 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":274398,"raft.queue_time_us":234656,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":3722,"thread_start_us":97753,"threads_started":1,"wal-append.queue_time_us":232757}
W20260709 13:17:38.089779  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.091092  3963 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:38.042402  8390 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.092798  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.092818  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.062613  8433 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:38.101254  4113 raft_consensus.cc:2368] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
W20260709 13:17:38.103615  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.093887  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:38.102607  4121 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:38.105492  4121 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:38.108562  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.109248  4041 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:38.065958  8304 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:38.110555  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.040863  8282 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.111950  8406 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.086341  8196 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:38.088549  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2865666810000675s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
W20260709 13:17:38.116948  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2838666810000632s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 13:17:38.117249  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0264666810001017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 13:17:38.088183  8389 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:38.109617  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.120362  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.122141  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.122469  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.104050  8390 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.123699  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.106889  8433 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.126466  4113 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:38.129570  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:38.134794  4043 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:38.135780  4038 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:38.112447  8406 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.145063  8406 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.146989  8437 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.147514  8437 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.150923  8437 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.157568  8282 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.127259  7575 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.159477  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.160323  7575 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.136706  8433 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:38.161605  8428 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
I20260709 13:17:38.162539  8124 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.171993  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.057338  8384 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.129051  7910 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:38.147392  8313 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.171244  7598 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:38.199733  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.188381  8406 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.190764  8050 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:38.209213  8050 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:38.207733  8383 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.549s	user 0.006s	sys 0.003s
I20260709 13:17:38.221297  3966 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:38.221858  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.223881  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:38.229279  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:38.230680  3967 raft_consensus.cc:1217] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Deduplicated request from leader. Original: 8.6->[9.7-12.9]   Dedup: 9.7->[10.8-12.9]
I20260709 13:17:38.229156  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:38.237957  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.238262  3967 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [9.7-12.9]
I20260709 13:17:38.198613  8313 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.202023  8304 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.193071  8105 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.249920  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.236989  8404 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.226655  8406 raft_consensus.cc:2764] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:17:38.246507  3937 leader_election.cc:400] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.251819  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.256788  3937 leader_election.cc:403] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.293911  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.294196  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.295570  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.296635  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:38.297294  7367 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.242664  8134 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.297528  4041 raft_consensus.cc:2410] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 13:17:38.218721  8117 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.249011  7910 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:38.297930  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 64229.1us
I20260709 13:17:38.296731  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.249276  8392 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:17:38.207369  8264 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:38.301218  3937 leader_election.cc:400] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.298687  4044 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:38.231263  7598 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:17:38.304844  3937 leader_election.cc:403] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:38.303303  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.304602  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.302305  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:38.307286  8434 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:17:38.307511  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:38.310570  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.312137  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:38.313938  8435 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:38.314076  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.316529  4041 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:38.317194  8163 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.317641  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.318377  4041 raft_consensus.cc:2368] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.319290  8163 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.320139  8382 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:38.300253  8439 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:17:38.326131  8117 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.326647  8404 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.257053  8389 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:17:38.327108  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 201610us
I20260709 13:17:38.241768  8126 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.305660  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:38.386587  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80998.8us
I20260709 13:17:38.251704  8194 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:17:38.301757  8355 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.301584  8393 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.333933  8242 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:38.329902  8359 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:38.334301  8392 consensus_queue.cc:1243] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:17:38.377554  8383 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.402717  8383 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.403203  8383 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.400646  8404 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:38.400673  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.405936  8406 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:38.406618  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:38.407143  8406 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:38.407549  8406 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:38.409623  8382 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.410661  8050 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.411919  8196 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.413475  8390 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.414551  8383 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.417773  8313 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:38.420135  7598 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:38.408284  8406 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.446007  7598 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:38.457672  7910 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:38.404577  8433 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.432004  8359 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.463770  8390 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:38.464324  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:38.448802  8242 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.392827  8312 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:17:38.464877  8381 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 13:17:38.467422  7598 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.467629  7910 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:38.483788  8406 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:38.494581  4116 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:38.485018  4675 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:38.486547  8242 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:38.551010  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 248765us
I20260709 13:17:38.553632  4041 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:38.554126  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:38.561041  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 169256us
I20260709 13:17:38.561326  4046 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:38.563186  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.564020  4119 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:38.566699  4041 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:38.553383  8105 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.568557  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:38.570500  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.558614  8381 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:38.536989  7910 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.571177  4038 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:38.582723  8304 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:38.584690  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.585834  8304 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.587598  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.588670  8304 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:38.574805  8105 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.591967  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.593178  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.570827  8382 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:38.596103  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.596637  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.571411  8359 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.604456  8384 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:38.606547  8105 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:38.609136  8424 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.602s	user 0.004s	sys 0.007s
I20260709 13:17:38.620844  8424 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.609839  4113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:38.622304  4113 raft_consensus.cc:606] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:17:38.578136  8196 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.613207  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.602558  8304 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:38.612193  7910 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.603206  8433 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.630577  8242 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:38.633589  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.594868  8382 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.700734  4681 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 13. Ops: []
W20260709 13:17:38.822880  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:38.700843  8458 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:17:38.699353  8384 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:38.850630  4675 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:38.814829  8242 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.835767  8440 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:38.870183  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:38.822378  8460 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:38.835566  8433 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.834861  8438 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:38.862478  8164 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:38.847697  8382 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:38.883641  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 259477us
I20260709 13:17:38.830101  8304 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:17:38.884670  3937 leader_election.cc:400] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:38.889866  8381 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:38.905754  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:38.884667  8164 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.905910  8381 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.907768  8164 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.898559  8382 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:38.908605  8382 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:38.911237  8382 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:38.905315  8452 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:17:38.912453  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:38.878947  8459 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:38.918098  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:38.846442  8384 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.922472  8460 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:17:38.927228  8460 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:38.927623  4113 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:38.928457  4115 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:38.929055  8466 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:38.929636  8406 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:38.930132  8406 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.928857  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:38.932150  4675 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:38.929504  8466 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:38.874826  8242 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.928332  8460 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:38.940287  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:38.940909  4116 raft_consensus.cc:606] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:38.941277  4116 raft_consensus.cc:614] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:38.884290  8433 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.883843  8438 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.879122  8440 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.926425  8459 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:38.908007  8381 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:38.950376  7598 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.939646  8164 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:38.935488  8466 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:38.971014  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:38.942836  8460 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.966153  7598 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:38.971036  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48646.8us
I20260709 13:17:38.971756  4115 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:38.974080  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:38.981705  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:38.982538  4116 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:38.989825  4675 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:38.991048  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:38.989431  4044 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:38.991976  4120 pending_rounds.cc:85] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 7
I20260709 13:17:38.992425  4120 pending_rounds.cc:107] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:17:38.992669  4120 raft_consensus.cc:2889] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:38.988626  4115 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:38.994060  7598 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:38.965363  8424 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.000825  7598 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.005863  8360 raft_consensus.cc:993] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:17:39.006386  8360 raft_consensus.cc:1081] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:17:39.007771  8384 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:38.965003  8164 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:38.994637  8406 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.013579  8459 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.021426  8126 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.021499  7598 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:39.025415  8457 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.439s	user 0.006s	sys 0.005s
I20260709 13:17:39.025954  8466 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:39.030407  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.033236  8461 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:17:39.038519  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:39.046779  4116 raft_consensus.cc:606] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.047176  4116 raft_consensus.cc:614] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:39.012941  8360 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.058107  8460 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.058507  8134 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:39.058913  8134 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:39.059190  8438 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.051504  8126 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.089047  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:39.089731  4116 raft_consensus.cc:606] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.051849  8360 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.086304  8126 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.065321  8134 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.117827  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.120671  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:39.104089  8433 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.125552  7598 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.127063  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.141876  7598 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:39.142078  3968 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.122745  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.143225  3938 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:39.144305  3966 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:39.145426  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.143221  7598 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.126192  8134 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:39.136914  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:39.137460  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 1.11356e+06us
I20260709 13:17:39.149600  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.151225  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:39.139304  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:39.138914  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 146126us
I20260709 13:17:39.136655  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.122743  8406 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:39.147531  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e32744704d014399851a0661c8929ded"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:39.153414  4116 raft_consensus.cc:606] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.153837  4116 raft_consensus.cc:614] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:39.152407  3967 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:39.113217  8404 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:17:39.154624  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.145430  8384 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:39.152901  8433 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.152881  8438 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:39.120265  8474 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:17:39.175675  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.171689  7598 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.158360  8050 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.174139  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:39.180290  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.181491  3966 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:39.197847  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.169255  8393 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:39.202076  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.171249  8164 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.158680  8406 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.181170  8384 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:39.210116  7598 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.214870  8440 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.217020  8393 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:39.219071  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65463.2us
I20260709 13:17:39.222282  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.228402  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.203038  7936 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.231550  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:39.179961  8050 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.211916  8474 consensus_queue.cc:1243] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:39.245361  8474 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.245893  8474 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.247879  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.249275  8440 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:39.249513  8389 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.249305  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:39.250083  8466 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.250681  8382 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:39.252882  8440 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:39.253758  8440 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.247891  8474 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.218017  8393 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.275369  8358 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.275019  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.277760  4121 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:17:39.274225  8050 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.278578  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.278936  8126 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.279340  3972 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:39.273469  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.281257  3969 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:39.283670  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:39.284788  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:39.285652  3968 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
W20260709 13:17:39.295539  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154285us
I20260709 13:17:39.296255  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.297609  3972 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:17:39.296655  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51747.4us
I20260709 13:17:39.298301  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.234997  7910 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:39.301699  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.300652  3967 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:39.309943  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.266660  8406 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.249413  8360 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.235529  8164 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:17:39.290480  8126 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.318609  8126 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.318972  8126 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.314234  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.322089  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.322479  8433 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:39.322727  3968 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:39.322890  8433 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.323218  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.263780  8404 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:39.317574  8438 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.318130  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.304850  8050 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:39.242977  7936 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.326712  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.332077  4040 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.303421  8401 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:39.333032  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.334165  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.336561  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.337173  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.337709  4039 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.338157  4121 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:39.290172  8358 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.388898  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.388113  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.357266  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.389444  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.368273  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:39.265062  8384 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:39.371230  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.372848  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:39.391721  4112 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:39.373202  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.323247  8433 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.398629  3969 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.395709  4039 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:39.391144  4114 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:39.390924  3963 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:39.400082  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.400490  8489 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:39.400406  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.400082  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.402400  4116 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:39.402552  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.400796  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.403613  4040 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:39.370750  3869 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 6 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 9 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.403760  4046 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:39.365404  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.397022  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.405293  3966 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.405781  4120 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:39.324344  8484 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:39.375222  8453 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.788s	user 0.005s	sys 0.007s
I20260709 13:17:39.443615  4112 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:39.408098  4045 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.359814  8356 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.466547  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.445015  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.456194  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.401325  8482 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.445108  8264 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:17:39.467788  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.479182  4120 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:39.467935  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65467.3us
I20260709 13:17:39.444255  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.468773  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.339349  8404 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.340003  8401 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.561955  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.443107  8478 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:17:39.584810  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.420572  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.593385  3964 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:39.557492  4113 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:17:39.420286  8474 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:39.407876  4038 raft_consensus.cc:2368] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:17:39.556321  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:39.546569  3965 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:39.606361  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2418) took 1603 ms. Trace:
W20260709 13:17:39.549007  3937 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.519s (SENT) [suppressed 6 similar messages]
I20260709 13:17:39.332914  8438 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.596221  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.536700  3969 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:39.532123  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.611200  4114 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:39.476961  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.601410  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.529443  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.498027  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.613090  3966 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.555989  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:39.613183  4116 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:39.420715  8479 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:39.507375  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.615744  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.588935  8495 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.397485  8460 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:39.331588  8050 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:39.607834  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45959.5us
I20260709 13:17:39.477288  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.605140  4113 pending_rounds.cc:85] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 7
I20260709 13:17:39.497553  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.607635  4117 rpcz_store.cc:276] 0709 13:17:38.003262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.003376 (+   114us) service_pool.cc:224] Handling call
0709 13:17:38.003672 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:39.100281 (+1096609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.100313 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:39.100731 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:17:39.304132 (+203401us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:39.304173 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:39.595031 (+290858us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:39.595080 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:39.595127 (+    47us) raft_consensus.cc:1685] finished
0709 13:17:39.595140 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:39.606299 (+ 11159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521309440,"thread_start_us":178221,"threads_started":1,"wal-append.queue_time_us":212954}
W20260709 13:17:39.651324  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 153850us
I20260709 13:17:39.650588  4113 pending_rounds.cc:107] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:17:39.651582  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.605547  4041 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.638280  4115 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:39.551110  8476 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:39.638447  4044 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:39.589612  3967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:17:39.589550  8242 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.419857  8484 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.646246  4681 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:39.649571  4042 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:39.649700  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:39.614675  8282 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.616686  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:39.650746  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.654493  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.651968  4113 raft_consensus.cc:2889] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:39.407665  8491 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.248s
I20260709 13:17:39.664359  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.445200  8440 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.677033  8440 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.678295  4043 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:39.681030  8440 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.687379  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.688105  4039 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:39.689098  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.636859  8497 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:39.639087  8479 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:39.660722  4115 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:39.524216  8080 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.497560  8489 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:39.668625  8358 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.669117  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.669948  8242 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:39.671782  8460 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:39.672261  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.657768  8050 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.674578  8360 raft_consensus.cc:993] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:17:39.669117  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.737814  4113 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:39.701364  7910 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:39.658512  3967 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:39.740900  3967 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.468698  8098 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.692203  4116 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
W20260709 13:17:39.692262  8490 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 13:17:39.714740  3869 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 6 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 8 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:39.649996  7936 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:39.573494  8466 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:17:39.746274  8466 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:39.746706  8466 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:39.747547  8466 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.748335  8460 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.717012  8080 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.658063  8476 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:39.662474  8392 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:39.676204  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:39.754801  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78672.7us
I20260709 13:17:39.646198  8474 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:39.739537  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 190557us
W20260709 13:17:39.739861  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 80752us
I20260709 13:17:39.716343  8479 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.742686  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.744777  8134 raft_consensus.cc:1081] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:17:39.713878  8164 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:39.714228  8312 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:39.750186  4047 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:39.750285  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:39.770836  4116 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:39.771834  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:39.752436  3967 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.756479  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.760622  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:39.774672  4113 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.775048  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.778842  3963 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:39.783810  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:39.786586  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.788213  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.789127  3968 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:39.757917  7936 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.715602  8484 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:39.748129  8441 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.748739  8466 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.750469  8098 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.772547  4116 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:39.792222  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.802786  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.769351  8264 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.762516  8392 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:39.763664  8390 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:39.770766  7910 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:39.762761  8126 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.813297  4116 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:39.780536  8460 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:39.780750  8393 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:39.800194  3968 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:39.824208  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.820317  3967 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.817298  4086 leader_election.cc:400] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:17:39.825451  4086 leader_election.cc:403] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:17:39.826450  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:39.826803  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.820402  3963 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:17:39.788358  8491 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:39.797214  3971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.008s	sys 0.012s
W20260709 13:17:39.835395  3971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.008s	sys 0.012s
I20260709 13:17:39.814061  8356 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:39.812294  4113 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:39.798465  8194 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:39.823096  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.834373  3968 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:39.761562  4041 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:39.822216  4038 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:39.715999  8497 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.853377  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.604872  8482 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.854182  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.794898  8312 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.648918  8495 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.863788  4113 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:17:39.854593  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78056us
I20260709 13:17:39.867130  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.870824  4041 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.745782  8489 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.880040  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.881464  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.816143  8264 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.918548  8264 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.920044  7910 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.924733  7598 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:39.925236  7598 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:39.925704  8098 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.926059  7598 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.927402  7598 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:39.928182  8312 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:39.929230  8080 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.929759  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.856726  8134 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:39.930866  8134 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:39.822332  8460 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.931468  8134 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:39.885035  8511 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:39.932782  8511 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:39.885233  8499 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:17:39.935655  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.936470  4042 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.934298  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.840225  8360 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:17:39.858309  8438 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:39.956429  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.957180  3972 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.887301  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.821836  8390 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:39.840617  8491 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.880996  8404 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.897842  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.899786  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.903039  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.904655  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:39.906013  4013 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:39.964809  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 59082.2us
I20260709 13:17:39.802130  8476 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.822707  8393 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:39.912858  8392 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.914134  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.916054  8468 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:39.930204  8433 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.000s
I20260709 13:17:39.938946  3969 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:39.820116  8441 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:39.944715  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:39.975539  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.976212  4112 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:39.948102  3967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:17:39.977483  3967 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:39.977844  3967 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:39.948374  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.978652  4113 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 9.
I20260709 13:17:39.949932  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:39.979513  3968 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:39.974736  3964 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:39.941604  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:39.943770  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.938021  4046 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:39.955639  8355 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:39.957819  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:39.924635  8495 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:39.969609  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:39.970834  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67892.6us
I20260709 13:17:39.983027  4042 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:39.964148  4682 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:39.919835  8440 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:39.973567  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:39.984710  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:39.989686  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:39.987816  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:39.994130  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:39.991519  4118 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:40.007788  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:40.010223  4038 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:40.011642  4038 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:39.991259  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.015688  4112 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:39.989965  8282 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:39.962790  8474 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.042062  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:39.972513  8312 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.051282  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:40.047190  4044 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:39.992034  8476 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.045598  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:40.035681  3967 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.060587  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.061813  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.062497  4112 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:40.064888  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:39.992411  8356 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:40.065992  3968 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:40.081875  4112 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:39.972213  8194 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:40.017161  8098 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:40.086439  8406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.013s
I20260709 13:17:40.047251  8126 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.017422  8404 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.053248  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:40.086766  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 215058us
I20260709 13:17:39.962714  8438 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:17:40.055481  8312 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.065943  8460 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.049616  8495 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:17:40.102692  8098 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:40.099392  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 86104.8us
I20260709 13:17:40.095283  8282 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:40.103332  8406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.004s	sys 0.014s
I20260709 13:17:39.984802  8433 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.018409  8440 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:40.100021  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 112272us
I20260709 13:17:40.112785  4041 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:40.137180  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:40.135186  3967 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.138360  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:40.135763  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.139195  8519 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.139992  8519 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:40.140314  8356 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.140386  8519 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.140501  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.140928  8356 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.141594  8356 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.119526  8312 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.119964  8497 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.146420  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.133780  8510 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:40.152213  8495 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:17:40.145890  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 156249us
I20260709 13:17:40.166994  4040 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:40.115727  8404 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.171134  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.156432  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:40.126178  8098 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.120903  8511 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.121384  8506 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:40.186282  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:40.225855  4117 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:17:40.230334  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 188337us
I20260709 13:17:40.166359  8495 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.195124  7598 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.234444  7598 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.170392  8497 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:40.127950  8482 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.144511  8126 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.169806  8393 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:40.186615  8406 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:40.174422  4677 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:40.175190  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.242805  7598 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.236311  8495 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.177383  8460 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:17:40.175932  8510 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.224324  8521 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:40.281536  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.247367  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72262.3us
W20260709 13:17:40.257244  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100917us
I20260709 13:17:40.258190  8392 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:40.283409  8392 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.283856  8392 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:40.259052  8404 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.260747  8484 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.289794  4043 raft_consensus.cc:2368] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:17:40.290791  8484 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.291965  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.241472  8497 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.309799  8497 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:40.311246  8498 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.626s	user 0.003s	sys 0.000s
I20260709 13:17:40.312798  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:40.265858  8050 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
I20260709 13:17:40.266978  8440 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.242880  8406 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.269450  8510 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.273540  8433 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.275347  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.350409  4113 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:40.351557  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.277127  8164 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:40.281965  8384 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:40.239686  8126 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.353411  8126 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:40.353772  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2425) took 2309 ms (client timeout 1783 ms). Trace:
W20260709 13:17:40.354161  4118 rpcz_store.cc:269] 0709 13:17:38.048394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:38.056964 (+  8570us) service_pool.cc:224] Handling call
0709 13:17:40.353570 (+2296606us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b54003a7fd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:40.353679 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4398541184}
I20260709 13:17:40.292403  8393 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.257251  8441 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.293200  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.293871  8392 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.362064  8401 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.362540  8356 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.363425  8392 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.364560  8356 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.296445  8134 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.241628  8491 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.246272  8381 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:40.301898  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.301307  8515 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:40.313090  4041 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:40.313305  4120 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
W20260709 13:17:40.264293  8479 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.501s	user 0.002s	sys 0.006s
I20260709 13:17:40.305085  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.407606  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:40.411078  4116 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.315358  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.412009  4046 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.319384  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.320077  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.323238  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 600) took 1163 ms. Trace:
I20260709 13:17:40.333216  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.412901  3970 rpcz_store.cc:276] 0709 13:17:39.159795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.550115 (+390320us) service_pool.cc:224] Handling call
0709 13:17:39.550384 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:39.781574 (+231190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:39.781609 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:39.781654 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:39.781686 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:40.322992 (+541306us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54003976d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:40.323043 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:40.323174 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531218176}
I20260709 13:17:40.334481  8509 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:40.335052  8050 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.335311  8304 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:40.332468  8468 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:40.336974  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:40.345536  8495 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.435951  8098 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.437027  8495 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.282524  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:40.433804  8468 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:40.440048  8468 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:40.440315  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 157877us
I20260709 13:17:40.426560  8478 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.446789  8478 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.447876  8050 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.448662  4121 raft_consensus.cc:2368] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:17:40.448882  8478 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.449419  7910 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:40.450464  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2443) took 1048 ms. Trace:
I20260709 13:17:40.353042  8384 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.450838  4121 rpcz_store.cc:276] 0709 13:17:39.402092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:39.402387 (+   295us) service_pool.cc:224] Handling call
0709 13:17:40.450268 (+1047881us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b540004d154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:40.450405 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2255436160}
I20260709 13:17:40.451473  8384 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:40.414616  8479 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.453917  8479 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.352964  8164 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.294328  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.366820  8513 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:40.369380  4114 raft_consensus.cc:2368] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:40.346938  8406 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.243214  8506 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.372677  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:40.461404  4677 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:40.374707  8126 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.464381  4046 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:40.465323  8126 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.377842  8390 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.380645  4047 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:40.466240  4113 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:40.394647  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 47916.3us
I20260709 13:17:40.402849  3869 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 5 to 8, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 8 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:40.404192  4039 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:40.414165  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 81035.5us
I20260709 13:17:40.469024  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.469547  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:40.414897  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 171425us
I20260709 13:17:40.415467  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:40.470166  4677 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:40.470975  8304 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:40.471498  8304 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:40.472325  8304 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.419450  8404 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:40.474900  8404 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.476944  8404 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.397384  8438 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:40.457607  8513 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:40.426088  4119 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:40.428193  4681 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:40.478673  8513 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.434072  4112 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:40.425197  8392 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.479837  8466 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:40.281432  8521 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.481465  8521 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.446476  8134 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.272629  8519 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:40.483565  3868 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 229) took 19848 ms (client timeout 15000 ms). Trace:
I20260709 13:17:40.359529  4118 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:40.485627  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:40.485916  4115 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:40.486582  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:40.487308  8495 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:40.487947  8495 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.488286  8495 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.488633  8495 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.445360  8312 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.446100  8522 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:17:40.359177  8393 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.454694  4675 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:17:40.454969  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 409438us
I20260709 13:17:40.408512  8381 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:40.423987  8476 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:40.456640  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:40.244158  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103726us
I20260709 13:17:40.470122  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:40.495347  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:40.525568  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55489.7us
I20260709 13:17:40.525866  4119 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:40.527320  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:40.528002  4119 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.528600  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:40.482601  8521 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.479859  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:40.503064  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:40.497064  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.551204  4115 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:40.552183  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.552902  4121 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:40.484261  8519 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.480254  8392 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.529345  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:40.495643  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.533236  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:40.560859  3968 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.535981  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:40.537406  8390 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.537920  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:40.567641  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:40.538098  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:40.539508  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 82921.2us
I20260709 13:17:40.540017  7910 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:40.544190  4680 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:40.547711  4118 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:40.553344  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.485019  4112 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:40.490232  8438 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:17:40.479849  8513 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.558688  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:40.573323  4116 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:40.562124  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63726.1us
I20260709 13:17:40.562960  3966 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:40.573807  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:40.574182  3966 pending_rounds.cc:85] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:17:40.574467  3966 pending_rounds.cc:107] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:40.574682  3966 raft_consensus.cc:2889] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:40.571501  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:40.563663  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:40.576238  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:40.576716  3969 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:17:40.588661  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.522897  8441 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:40.581496  3968 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:40.589423  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:40.595451  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.522449  8476 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.555562  8466 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:40.596549  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.547144  8510 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:40.595901  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:40.599995  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.600301  4116 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:40.601609  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.602862  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:40.603389  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.618968  4045 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:40.609503  4041 raft_consensus.cc:2368] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11.
I20260709 13:17:40.610006  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.611785  4046 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:17:40.617187  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.609004  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:40.617641  4038 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:40.617862  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:40.614187  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.624729  4047 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:40.575551  8459 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:40.555610  8433 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:17:40.607913  4112 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.647687  3969 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:40.632716  4116 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:40.592355  8460 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:40.638744  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49410.4us
I20260709 13:17:40.577666  7910 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.616427  4044 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:40.641717  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45894us
W20260709 13:17:40.642493  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 66338.6us
I20260709 13:17:40.618228  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.606559  8491 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:40.596956  8509 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:40.651928  4039 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.637588  4119 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:40.641196  8050 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.607529  8523 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:17:40.483956  3868 rpcz_store.cc:269] 0709 13:17:20.635450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:20.635616 (+   166us) service_pool.cc:224] Handling call
0709 13:17:40.483338 (+19847722us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:33.895545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:34.153966 (+258421us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:34.156109 (+  2143us) write_op.cc:435] Acquired schema lock
0709 13:17:34.159030 (+  2921us) tablet.cc:662] Decoding operations
0709 13:17:34.322438 (+163408us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:34.322519 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:34.322546 (+    27us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:17:34.350773 (+ 28227us) tablet.cc:701] Row locks acquired
0709 13:17:34.350794 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:17:34.350949 (+   155us) write_op.cc:270] Start()
0709 13:17:34.351058 (+   109us) write_op.cc:276] Timestamp: P: 1783603054350896 usec, L: 0
0709 13:17:34.351083 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:17:34.351833 (+   750us) log.cc:844] Serialized 12599 byte log entry
0709 13:17:35.095507 (+743674us) op_driver.cc:464] REPLICATION: finished
0709 13:17:35.122677 (+ 27170us) write_op.cc:301] APPLY: starting
0709 13:17:35.122758 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:35.124931 (+  2173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:35.125054 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:35.255695 (+130641us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:35.256347 (+   652us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=64
0709 13:17:35.256425 (+    78us) write_op.cc:312] APPLY: finished
0709 13:17:35.257343 (+   918us) log.cc:844] Serialized 212 byte log entry
0709 13:17:35.257702 (+   359us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:35.265337 (+  7635us) write_op.cc:454] Released schema lock
0709 13:17:35.265453 (+   116us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:35.383568 (+118115us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b1800384f40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed79e82ef0 00007fed79e83489 00007fed79e8571a
0709 13:17:35.383708 (+   140us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:35.383737 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3167943,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":26920,"apply.run_cpu_time_us":9621,"apply.run_wall_time_us":149422,"num_ops":32,"prepare.queue_time_us":174536,"prepare.run_cpu_time_us":38970,"prepare.run_wall_time_us":627516,"raft.queue_time_us":189266,"raft.run_cpu_time_us":8901,"raft.run_wall_time_us":297748,"replication_time_us":744264,"spinlock_wait_cycles":67922688,"thread_start_us":578885,"threads_started":4,"wal-append.queue_time_us":238368,"wal-append.run_cpu_time_us":17033,"wal-append.run_wall_time_us":1632534}]]}
I20260709 13:17:40.654381  8514 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.654878  7910 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.687134  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:40.666430  8498 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:17:40.664016  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:40.650525  8511 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:40.612977  8489 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:40.650110  8460 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.594825  8390 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.659896  8356 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:40.665695  8282 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.614208  8476 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.649085  8080 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:40.644968  8126 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.701304  8126 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.613009  8466 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.704167  8466 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.614981  8441 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.640686  8515 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:40.646883  8519 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:40.691782  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:40.708312  8515 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:40.663561  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54687.3us
I20260709 13:17:40.709229  8515 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.710451  8515 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.710379  8519 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.659237  4047 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:40.692974  4044 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:40.684222  4115 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:40.650894  8474 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:40.713723  8126 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.684654  3937 leader_election.cc:400] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:17:40.714509  3937 leader_election.cc:403] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:40.715716  3937 leader_election.cc:400] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:40.716008  3937 leader_election.cc:403] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:40.716104  8466 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.716568  4039 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:40.717885  7598 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:40.696013  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:40.723052  8497 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:40.723584  8497 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.724438  8497 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.688710  8050 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:40.728529  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64335.3us
I20260709 13:17:40.729576  8050 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:40.719187  8438 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:40.730834  8438 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:40.733098  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:40.733978  3969 raft_consensus.cc:2410] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:40.735585  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:40.736195  3969 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:40.737908  7598 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:40.688478  8509 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:40.747045  4677 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:40.659690  8520 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:17:40.699270  8460 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:40.696553  8491 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:40.716150  8476 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.716447  8474 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:17:40.696820  8489 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:40.751322  4114 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:40.648497  8510 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.696736  8511 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:40.693251  8459 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:40.768704  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:40.774124  3967 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:40.693022  8381 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.767097  8489 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:40.738721  8356 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.769039  8511 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:40.699112  8514 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:40.770717  8491 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.800251  7936 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:17:40.800884  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83463.3us
I20260709 13:17:40.776836  8478 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:40.777742  8098 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:40.806172  8529 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:40.806416  8491 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.814301  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:40.815871  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 119938us
I20260709 13:17:40.817885  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:40.821542  3969 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:40.789160  8312 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.818542  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:40.797447  8536 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.250s	user 0.001s	sys 0.000s
I20260709 13:17:40.820912  4045 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:40.811395  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:40.822371  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:40.822747  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:40.828095  4044 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:40.822944  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.828591  4039 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
W20260709 13:17:40.829897  8532 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:17:40.835031  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:40.847189  4044 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:40.848739  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.795724  8506 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.807718  8393 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:40.883666  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.879267  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44310.9us
I20260709 13:17:40.885867  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:40.889940  4046 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:17:40.823519  8264 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.833370  8304 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:40.826293  8478 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:17:40.937716  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50003.9us
I20260709 13:17:40.828003  8080 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.842053  8098 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:40.942991  4038 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:40.944661  4117 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:40.940794  8466 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:40.978531  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:40.825733  8474 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:17:40.888307  8312 raft_consensus.cc:2764] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:17:40.997375  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:40.998225  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 168548us
I20260709 13:17:40.936110  8393 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:41.005313  8393 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:41.005757  8393 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:41.009073  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.009756  3969 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:41.010591  8514 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:41.011600  8539 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 13:17:41.011883  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:40.879931  8509 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.013852  8478 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:40.939174  8392 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:41.016011  4043 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:41.019194  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:41.000916  8164 consensus_meta.cc:287] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.004s
I20260709 13:17:41.021988  3937 leader_election.cc:400] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:17:41.022921  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:41.027525  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49089.6us
I20260709 13:17:41.028503  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:40.940997  8304 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.039661  8555 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.013432  8098 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:40.944366  8264 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.019492  8356 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:41.052109  8510 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:40.983043  8547 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
W20260709 13:17:41.055907  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 364175us
I20260709 13:17:41.043344  8476 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.029740  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:41.060901  3967 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:41.041168  8543 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:17:41.025967  8164 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:41.090873  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61193.4us
W20260709 13:17:41.095839  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67431.9us
I20260709 13:17:41.031497  8474 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.100405  7598 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:41.117090  8511 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.117847  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:41.123157  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.119539  8164 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:41.120003  8381 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:41.120812  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.111385  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:41.122818  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.028012  8466 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:17:41.130661  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.125082  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.125061  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.129755  4086 leader_election.cc:400] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11.
I20260709 13:17:41.133203  4086 leader_election.cc:403] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:41.132344  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.135133  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:41.102119  8523 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:41.135224  4038 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:41.117873  8551 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.006s
I20260709 13:17:41.137197  8459 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11.
I20260709 13:17:41.121948  8390 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:41.149518  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.156032  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:41.156582  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.157145  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.151729  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.154712  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.158713  3963 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:41.158325  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.159709  4038 raft_consensus.cc:2368] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15.
I20260709 13:17:41.158003  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.137401  8547 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:41.162050  3967 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:41.196154  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.196419  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.195680  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.159647  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.161317  8134 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:41.200529  3963 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:41.136749  8513 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:17:41.154814  8406 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.002s
I20260709 13:17:41.197599  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.198414  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.145787  8549 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.138058  8164 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.200268  4038 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:41.137199  8404 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
W20260709 13:17:41.198079  8468 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.758s	user 0.010s	sys 0.000s
I20260709 13:17:41.198396  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.204741  3971 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:41.161636  8520 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:41.154855  8555 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:17:41.217100  8134 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:41.217989  8134 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.218267  8468 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.205478  8098 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.220242  8468 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.203307  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.222910  3967 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.225188  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:41.225732  4041 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:41.161808  8392 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:41.207535  8404 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:17:41.208382  8553 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:17:41.208999  8558 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:17:41.155098  8510 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:17:41.202600  8476 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:41.139859  8080 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.158895  8515 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:17:41.204456  8406 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.228084  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:41.215447  8495 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.726s	user 0.006s	sys 0.003s
I20260709 13:17:41.240793  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.201333  8390 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:41.197089  8460 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.218291  8545 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:41.232924  7910 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.530s	user 0.002s	sys 0.007s
I20260709 13:17:41.217344  8511 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:41.227582  8282 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.001s
I20260709 13:17:41.222618  8547 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:41.226374  8520 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:41.292083  3967 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:41.288110  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.237834  8404 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:41.241900  8356 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:41.298048  8356 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.298414  8356 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:41.304010  8384 consensus_meta.cc:287] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.852s	user 0.008s	sys 0.000s
I20260709 13:17:41.272535  8392 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:41.304998  8282 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:41.295532  7910 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.306110  8406 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.307504  7910 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:41.298326  8404 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.309034  8404 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:41.309563  8489 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:17:41.309962  8489 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.312388  8489 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.314407  8460 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.288023  8495 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.293898  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.305568  8392 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.317332  8547 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.318670  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.325040  3970 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.276520  8476 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:41.320988  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:41.296234  8390 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:41.325933  3964 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:17:41.304461  8384 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.338294  3964 pending_rounds.cc:85] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:17:41.340042  3964 pending_rounds.cc:107] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:17:41.340445  3964 raft_consensus.cc:2889] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:41.325681  8304 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.334084  8495 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.343474  8390 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.295914  8545 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:41.376670  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.377487  3968 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:41.390908  3968 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 13:17:41.392611  8560 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:17:41.388494  8559 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:17:41.390085  8356 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.395946  8356 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:41.351846  3858 maintenance_manager.cc:643] P 8dad18bff2f044b2a76f2e5726c72315: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.906s	user 0.192s	sys 0.072s Metrics: {"bytes_written":30840,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":108924,"dirs.run_cpu_time_us":489,"dirs.run_wall_time_us":11740,"drs_written":1,"lbm_read_time_us":73161,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":201834,"lbm_writes_1-10_ms":7,"lbm_writes_10-100_ms":6,"lbm_writes_lt_1ms":21,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":148101,"threads_started":3,"update_count":32,"wal-append.queue_time_us":106024}
W20260709 13:17:41.402398  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44824.7us
I20260709 13:17:41.406734  3859 maintenance_manager.cc:419] P 8dad18bff2f044b2a76f2e5726c72315: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9123 bytes on disk
I20260709 13:17:41.407867  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.411296  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.412497  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.414817  4118 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:41.352783  8520 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.388526  8393 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.423146  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.419631  8519 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:41.460793  3858 maintenance_manager.cc:643] P 8dad18bff2f044b2a76f2e5726c72315: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.047s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":398,"lbm_reads_lt_1ms":4}
I20260709 13:17:41.422802  3968 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:41.421161  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2485) took 1129 ms. Trace:
I20260709 13:17:41.417737  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.422295  4119 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:41.410866  8390 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:41.476349  8390 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.473696  3972 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:41.475260  4043 rpcz_store.cc:276] 0709 13:17:40.292034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.336656 (+ 44622us) service_pool.cc:224] Handling call
0709 13:17:40.337017 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:41.018806 (+681789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:41.420951 (+402145us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54000f0d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:41.421106 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560819072}
I20260709 13:17:41.478538  8390 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:41.421237  4112 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:41.416087  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 282201us
I20260709 13:17:41.485973  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.486649  4119 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:41.487466  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.488463  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.475898  4118 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.416934  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.470120  3969 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:41.494256  4119 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:41.497008  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.499584  4112 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:41.505432  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:41.506078  4039 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.507295  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:41.508096  4038 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:41.508908  4041 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:41.514362  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.516117  3969 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:41.520362  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.522419  4119 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:17:41.522634  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:41.522800  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2462) took 1368 ms. Trace:
I20260709 13:17:41.523358  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.524396  4038 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:41.525578  4119 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:41.518930  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.528012  8513 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:41.528429  8513 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:41.528820  8513 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:41.523622  4112 rpcz_store.cc:276] 0709 13:17:40.131841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.336746 (+204905us) service_pool.cc:224] Handling call
0709 13:17:41.420712 (+1083966us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b58008f03d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763a80aa 00007fed7642a447 00007fed76442fe7 00007fed764447de 00007fed7645027c 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c
0709 13:17:41.500054 (+ 79342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540810496}
I20260709 13:17:41.529703  8545 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:41.530578  4112 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:41.537482  4112 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:41.509953  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.527293  4116 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:41.528905  4045 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:41.540171  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.543495  4112 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:41.528142  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.549964  4112 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:41.551041  4039 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:41.547591  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.569442  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:41.551126  4112 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:41.621932  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74419.4us
W20260709 13:17:41.585877  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57790.9us
I20260709 13:17:41.624189  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:41.521188  8479 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.516005  8404 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:41.519603  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 115793us
I20260709 13:17:41.558544  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:41.645373  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76039.3us
I20260709 13:17:41.649101  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:41.650878  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:41.653080  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100879us
I20260709 13:17:41.653694  4649 leader_election.cc:400] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15.
I20260709 13:17:41.653966  4649 leader_election.cc:403] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:41.656140  4116 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:41.599040  8468 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:41.653162  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:41.662838  3970 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:41.521597  8460 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 13:17:41.602442  8384 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.678191  4118 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:41.568392  7910 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:41.687016  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.521463  8519 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:17:41.648605  8312 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:41.646564  8489 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.695525  4121 raft_consensus.cc:2368] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:17:41.545976  8392 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:17:41.535728  8511 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.129s
I20260709 13:17:41.588171  8521 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:17:41.698951  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.655459  8433 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.701333  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:41.667879  8545 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:41.668404  8516 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:41.705834  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:41.694980  8547 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:41.709760  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.717428  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:41.651698  8404 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:41.649881  8479 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:41.724463  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:41.737558  4682 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:17:41.737612  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 84006.3us
I20260709 13:17:41.739194  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:41.740324  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.740917  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.741473  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.742002  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:41.742514  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:41.743058  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:41.745841  8546 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.925s	user 0.004s	sys 0.000s
I20260709 13:17:41.697712  7910 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:41.709391  8489 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.750164  7910 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:41.751811  4679 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:41.752177  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:41.753865  4120 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:41.750092  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:41.725440  8570 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:17:41.758683  4113 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:41.762197  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:41.766140  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.766304  4013 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:41.767148  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.719241  8393 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.719764  8516 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:41.722915  8509 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.765643  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:41.766741  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.770736  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:41.764170  8312 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:41.775992  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:41.763705  7910 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:41.774892  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:41.726298  8545 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:41.787331  4118 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:41.786084  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:41.786408  4680 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:41.785066  3967 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:41.795171  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:41.788100  8516 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:41.796542  4039 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 7.
I20260709 13:17:41.798166  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:41.821887  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 82755.2us
I20260709 13:17:41.787962  8433 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.815711  3966 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:41.792865  8390 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:17:41.879730  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 93698.8us
W20260709 13:17:41.887426  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 234292us
I20260709 13:17:41.888553  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:41.878588  8550 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:17:41.800123  8489 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:41.897215  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:41.784031  8515 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.098s
I20260709 13:17:41.894359  7910 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.897516  8521 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:17:41.903079  8577 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
W20260709 13:17:41.903978  8573 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
W20260709 13:17:41.904788  8575 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 13:17:41.936558  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 279495us
W20260709 13:17:41.943980  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 401030us
I20260709 13:17:41.930017  8523 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:41.794008  8509 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.931468  8393 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:41.947326  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2602) took 1453 ms. Trace:
I20260709 13:17:41.896832  8355 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:41.953158  4114 rpcz_store.cc:276] 0709 13:17:40.494192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.495412 (+  1220us) service_pool.cc:224] Handling call
0709 13:17:41.947142 (+1451730us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:41.947255 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438681344}
I20260709 13:17:41.932940  8433 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:17:41.998517  3971 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 13:17:42.000326  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.894367  8312 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.931705  7910 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:41.969749  8355 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:42.017089  8355 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:41.993178  8547 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:42.043907  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.066735  8486 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:17:42.067690  8580 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:17:42.067373  8486 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.071237  8486 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:41.947613  8583 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
W20260709 13:17:42.065822  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 159889us
I20260709 13:17:42.098307  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.099524  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:41.997663  8393 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.044962  8466 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.071760  8539 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:17:41.969823  8545 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.090274  8404 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:42.089214  8515 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:42.091640  8479 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.071811  8547 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.101449  8489 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:17:42.133260  4682 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:42.135304  3963 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:42.115592  8404 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:42.138200  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:42.110270  8433 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:17:42.108456  8466 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.140089  8521 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:42.116581  8080 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:17:42.125025  8595 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:42.131554  8358 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:42.137218  7936 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.163326  4040 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:42.138060  8515 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:42.166661  8599 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 13:17:42.169478  8588 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:17:42.137257  8606 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.140017  8566 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:42.170984  8433 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:42.198391  4039 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:17:42.204746  4040 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:17:42.205994  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 318714us
W20260709 13:17:42.176229  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 175987us
I20260709 13:17:42.137676  8582 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15.
I20260709 13:17:42.171988  3964 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:42.171177  8304 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.256074  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 212251us
I20260709 13:17:42.171850  8595 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:42.258988  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.160267  8404 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.219419  8489 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:42.217600  8433 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:42.259469  8601 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.302309  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.189236  8358 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.259584  8509 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.194100  7936 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.265403  8595 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.293717  8489 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:42.313663  8612 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.314184  8612 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.315555  8358 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.316085  8612 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:42.317788  8596 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:17:42.304988  7910 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.259198  8304 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.336973  7910 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:42.331073  8514 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:42.331676  8356 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:42.311818  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47690.1us
I20260709 13:17:42.335748  8355 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.347083  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:42.310514  8600 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.316629  8612 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:42.339761  8514 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:42.358578  8513 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.829s	user 0.009s	sys 0.001s
I20260709 13:17:42.359277  8404 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.359063  8513 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.360244  3968 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:42.366178  3937 leader_election.cc:400] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:17:42.366822  3937 leader_election.cc:403] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:17:42.312932  8509 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:42.371892  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 122693us
I20260709 13:17:42.378573  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.360311  8404 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:42.338124  8610 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:42.321574  8433 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.307634  8312 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.408195  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.345854  8476 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:42.356091  8393 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.385749  8521 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:42.375692  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:42.419736  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.419399  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:42.423259  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.359176  8514 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.449100  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:42.450510  3964 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:42.308609  8601 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.452013  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:42.415027  8516 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.522s	user 0.011s	sys 0.000s
I20260709 13:17:42.322926  8515 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.405171  8610 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:42.466539  4045 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
W20260709 13:17:42.410023  8468 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.005s	sys 0.022s
W20260709 13:17:42.465536  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 206626us
I20260709 13:17:42.499492  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:42.415102  8466 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.423152  8592 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.410459  8612 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:17:42.471597  8616 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:17:42.471917  7936 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.407461  8621 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.122s
I20260709 13:17:42.478159  8624 raft_consensus.cc:2764] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:42.465785  4677 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:42.524688  8404 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.478729  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 355) took 1320 ms. Trace:
I20260709 13:17:42.375561  8356 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:17:42.380077  8600 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.429323  8547 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:42.399889  8509 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.500839  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:42.427596  8513 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:42.505479  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 125809us
I20260709 13:17:42.471108  8611 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:42.418274  8312 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.510288  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:42.471658  8304 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:42.499464  8468 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.007s	sys 0.026s
I20260709 13:17:42.446293  8476 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:17:42.499179  8610 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:42.530126  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 121983us
W20260709 13:17:42.535955  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.526125  4044 rpcz_store.cc:276] 0709 13:17:41.158107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.477832 (+1319725us) service_pool.cc:224] Handling call
0709 13:17:42.478199 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.478412 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.478438 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.478489 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:42.478518 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.478569 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.478669 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:42.560026  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59393us
I20260709 13:17:42.528867  3938 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:42.508004  8393 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
W20260709 13:17:42.557061  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46941.8us
I20260709 13:17:42.498850  8516 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.563853  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.562281  8468 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:42.571692  8468 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.574400  8623 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:42.575240  8600 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.574930  8623 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:42.589046  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 60506us
I20260709 13:17:42.572606  8618 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:42.572286  8602 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.515962  8592 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.591711  8304 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:17:42.588847  8404 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:42.596812  8393 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:42.598328  8641 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.578564  8616 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.566668  8625 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.584571  8476 consensus_queue.cc:1243] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 14.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:42.624065  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2593) took 2567 ms. Trace:
I20260709 13:17:42.553869  8521 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.628772  4117 rpcz_store.cc:276] 0709 13:17:40.057065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.419506 (+362441us) service_pool.cc:224] Handling call
0709 13:17:40.419789 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:40.998431 (+578642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.621134 (+1622703us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400096354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:42.623989 (+  2855us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201354112}
I20260709 13:17:42.592460  8601 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.599073  8621 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:42.562819  8611 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.616739  8602 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.616390  8393 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:42.635529  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74536.8us
W20260709 13:17:42.643389  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79619.6us
I20260709 13:17:42.616123  8545 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:17:42.664366  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.648928  8637 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:42.659252  8602 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:42.675308  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:42.660244  8460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.954s	user 0.011s	sys 0.016s
I20260709 13:17:42.616369  8618 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.659096  8393 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:42.630231  8625 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.684412  8264 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.684918  8603 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.685431  8625 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:42.681125  8460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.011s	sys 0.017s
I20260709 13:17:42.695626  8393 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.697064  8630 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:17:42.699287  8635 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:17:42.682365  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.704734  8609 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.125s
I20260709 13:17:42.706970  8642 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.708436  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:42.709234  8642 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:42.673679  8637 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:42.711740  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:42.711685  8637 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.712553  8642 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:42.712981  8642 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:42.713191  8637 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.713554  8642 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.715915  8602 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.724589  8312 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:42.725149  8574 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.020s	user 0.005s	sys 0.004s
I20260709 13:17:42.725862  8516 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.726454  8602 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.717175  8595 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.727949  4680 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:42.730437  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:42.730697  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:42.731178  3967 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:42.733745  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:42.734370  4041 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:42.735711  8595 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.747151  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:42.748288  8588 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.088s	user 0.002s	sys 0.000s
I20260709 13:17:42.750265  4041 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:42.758693  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.760737  3968 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:42.761883  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:42.719373  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.719789  8610 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:42.766016  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46738.9us
I20260709 13:17:42.767081  8610 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.681452  8601 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:42.628099  8616 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.673098  8545 consensus_queue.cc:1243] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:42.722728  8466 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:42.775808  3968 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:42.770629  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:42.771672  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:42.772192  4112 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:17:42.757189  8460 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.809206  3966 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:42.816033  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:42.816285  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:42.816959  4042 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:42.817406  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 2998) took 1687 ms (client timeout 1934 ms). Trace:
W20260709 13:17:42.817741  4042 rpcz_store.cc:269] 0709 13:17:41.130129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.816067 (+1685938us) service_pool.cc:224] Handling call
0709 13:17:42.817356 (+  1289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:42.782135  8466 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:42.827000  8655 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:42.827392  8589 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.933s	user 0.010s	sys 0.007s
I20260709 13:17:42.829532  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2483) took 1185 ms. Trace:
I20260709 13:17:42.830184  4120 rpcz_store.cc:276] 0709 13:17:41.643635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.754558 (+110923us) service_pool.cc:224] Handling call
0709 13:17:41.788618 (+ 34060us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:41.798058 (+  9440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:41.798088 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:41.798659 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 13:17:41.893565 (+ 94906us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:42.111560 (+217995us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.257394 (+145834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.257475 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:42.755833 (+498358us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:42.828844 (+ 73011us) raft_consensus.cc:1685] finished
0709 13:17:42.829119 (+   275us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:42.829378 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41034,"prepare.queue_time_us":116670,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":61071,"raft.run_cpu_time_us":7615,"raft.run_wall_time_us":88021,"spinlock_wait_cycles":2559360,"thread_start_us":375283,"threads_started":3,"wal-append.queue_time_us":13439}
I20260709 13:17:42.832275  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.832914  3968 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:42.805800  8626 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:42.838264  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.840651  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:42.841308  4114 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.837703  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.838965  3963 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:42.845959  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:42.856153  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 73068.5us
I20260709 13:17:42.863014  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:42.863301  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:42.863855  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.865074  3963 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:42.866704  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.819475  8460 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.865242  8609 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:42.872483  8645 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:42.885188  3969 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:42.866525  8356 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:42.874228  8625 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:42.835788  8655 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.880584  8609 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:42.887393  8645 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:42.874069  8595 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:17:42.901142  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.902101  3964 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:42.902395  3963 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:42.907696  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.895991  8625 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.875946  8466 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.899936  8609 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.918915  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:42.918756  8663 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:42.922462  8626 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:42.930070  3964 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
W20260709 13:17:42.917659  8658 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:42.929440  4114 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:17:42.897913  8642 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.900730  8645 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:42.939754  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:42.940018  8626 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:42.942233  8655 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.957087  8626 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.895567  8356 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.950066  8661 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:42.952134  3964 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:42.952932  8595 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:42.960716  3964 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:42.954692  8611 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:42.942512  8657 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:42.959489  4119 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:42.961588  3964 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.965605  3964 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:42.958294  8466 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:42.959496  8660 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:17:42.981040  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:42.982383  8356 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:42.986124  8626 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:42.988659  8489 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:42.989828  8489 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:42.966955  8595 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:42.991021  8595 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:42.992147  8513 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:43.006109  8460 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:42.989463  3967 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:43.023435  3964 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:17:42.974907  8625 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:42.992552  8513 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:43.027159  8513 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.028174  8513 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:42.975244  8642 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:43.023927  3964 pending_rounds.cc:85] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 7
I20260709 13:17:43.033964  3964 pending_rounds.cc:107] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:17:43.034777  3964 raft_consensus.cc:2889] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.046383  8098 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:43.053066  8098 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:43.053704  3967 pending_rounds.cc:85] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:17:43.062937  3967 pending_rounds.cc:107] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:17:43.063258  3967 raft_consensus.cc:2889] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:43.051615  8603 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:43.061228  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 309993us
W20260709 13:17:43.125687  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:43.061101  8384 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.079310  8603 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.233937  8603 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:43.236975  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 162380us
I20260709 13:17:43.238219  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:43.238808  8652 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:43.240847  8495 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:43.243090  8495 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:43.244067  8495 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.225461  8384 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.211315  8654 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.172s
I20260709 13:17:43.285276  8098 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.286062  8654 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:43.286410  8654 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:43.287216  8654 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.118985  8545 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:43.455451  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2511) took 2229 ms. Trace:
I20260709 13:17:43.337356  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:43.376936  8134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.005s	sys 0.020s
W20260709 13:17:43.473387  8134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.006s	sys 0.020s
I20260709 13:17:43.456169  3965 rpcz_store.cc:276] 0709 13:17:41.227155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.227289 (+   134us) service_pool.cc:224] Handling call
0709 13:17:41.227572 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.668611 (+1441039us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:42.844873 (+176262us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.890829 (+ 45956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:42.890882 (+    53us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:42.890926 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:43.050867 (+159941us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b180020e1e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:43.455085 (+404218us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54002599d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:43.455150 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:43.455345 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34303,"prepare.queue_time_us":220278,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1565,"raft.queue_time_us":6689,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":3322083328,"thread_start_us":200612,"threads_started":2,"wal-append.queue_time_us":95801}
I20260709 13:17:43.316718  8460 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:43.456357  8625 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:43.498348  4086 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.009s	sys 0.008s
W20260709 13:17:43.534458  4086 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.009s	sys 0.008s
W20260709 13:17:43.485958  8670 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:17:43.542951  8486 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:43.543700  8486 consensus_queue.cc:1243] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:43.388543  8645 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.551575  8134 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:43.472616  8545 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:43.540539  8460 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.544853  8625 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:43.535651  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 578085us
I20260709 13:17:43.632248  8134 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:43.926330  8545 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.162511  8645 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:44.245198  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.259107  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.260208  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2541) took 1017 ms. Trace:
I20260709 13:17:44.260622  3964 rpcz_store.cc:276] 0709 13:17:43.242440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.258776 (+1016336us) service_pool.cc:224] Handling call
0709 13:17:44.260137 (+  1361us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.277308  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.277812  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.233336  8098 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.234815  8654 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.279783  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.280611  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2539) took 1038 ms. Trace:
I20260709 13:17:44.280964  3965 rpcz_store.cc:276] 0709 13:17:43.241939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.255632 (+1013693us) service_pool.cc:224] Handling call
0709 13:17:44.280543 (+ 24911us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.273947  8609 consensus_meta.cc:287] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.335s	user 0.019s	sys 0.000s
I20260709 13:17:44.257216  8545 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.278860  8645 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.302199  3965 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:44.288936  3964 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:44.306388  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2538) took 1064 ms. Trace:
I20260709 13:17:44.306838  3964 rpcz_store.cc:276] 0709 13:17:43.241669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.261598 (+1019929us) service_pool.cc:224] Handling call
0709 13:17:44.261930 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:44.306104 (+ 44174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.306326 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:44.284186  8650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.017s	sys 0.050s
W20260709 13:17:44.317430  8620 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.893s	user 0.028s	sys 0.035s
I20260709 13:17:44.319885  8667 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.322090  8134 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.322352  8592 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:44.311333  8519 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:44.326231  8519 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:44.309721  8466 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.332s	user 0.007s	sys 0.004s
I20260709 13:17:44.312532  8645 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.299963  8384 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:44.312107  8650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.017s	sys 0.051s
W20260709 13:17:44.319914  8628 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.723s	user 0.028s	sys 0.031s
I20260709 13:17:44.310138  8460 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:44.330438  8519 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:44.347947  4649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.043s	sys 0.095s
W20260709 13:17:44.349403  4649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.043s	sys 0.096s
W20260709 13:17:44.349824  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 968281us
I20260709 13:17:44.351970  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3014) took 2191 ms. Trace:
I20260709 13:17:44.352397  4046 rpcz_store.cc:276] 0709 13:17:42.161043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.161192 (+   149us) service_pool.cc:224] Handling call
0709 13:17:42.170104 (+  8912us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:42.170443 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:42.170474 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:42.170953 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:17:42.401198 (+230245us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:42.401256 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:42.401332 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:44.319312 (+1917980us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:44.351633 (+ 32321us) raft_consensus.cc:1685] finished
0709 13:17:44.351655 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.351892 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75001,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":8250,"spinlock_wait_cycles":5849856,"thread_start_us":228249,"threads_started":1,"wal-append.queue_time_us":409190}
I20260709 13:17:44.302949  8609 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.304441  8545 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.320605  8667 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:44.355696  4678 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.000s	sys 0.018s
W20260709 13:17:44.355512  8495 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.108s	user 0.014s	sys 0.003s
I20260709 13:17:44.362409  8625 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:44.378082  4678 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.001s	sys 0.018s
W20260709 13:17:44.386027  4648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.037s	sys 0.067s
W20260709 13:17:44.387583  4648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.037s	sys 0.067s
W20260709 13:17:44.377991  8495 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.014s	sys 0.003s
I20260709 13:17:44.387418  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2965) took 1568 ms. Trace:
I20260709 13:17:44.390399  3963 rpcz_store.cc:276] 0709 13:17:42.818534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.910269 (+ 91735us) service_pool.cc:224] Handling call
0709 13:17:42.911354 (+  1085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.911557 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:43.090003 (+178446us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.387051 (+1297048us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:44.387106 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:44.387158 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.387225 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:44.387360 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6932,"prepare.queue_time_us":41689,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":841207,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":5037,"thread_start_us":719153,"threads_started":3,"wal-append.queue_time_us":1256766}
I20260709 13:17:44.380620  8591 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:44.401309  8441 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.401892  8510 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:44.418296  8591 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.418673  8510 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.421512  8510 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.386998  8519 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:44.421859  8545 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.422375  8519 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.424506  8519 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.405908  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:44.425820  8667 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.407413  8579 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.426718  8579 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:44.417631  8513 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.389s	user 0.010s	sys 0.004s
I20260709 13:17:44.429562  8645 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.406683  8686 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:44.430598  8686 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.388211  8625 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.432688  8625 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.433313  8686 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.434056  8579 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.434710  8625 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.444798  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2475) took 3023 ms. Trace:
I20260709 13:17:44.445271  4116 rpcz_store.cc:276] 0709 13:17:41.421712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.542105 (+120393us) service_pool.cc:224] Handling call
0709 13:17:41.542399 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:41.656523 (+114124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.444478 (+2787955us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54003d3454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:44.444706 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260974464}
I20260709 13:17:44.446570  8609 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:44.447654  8671 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:17:44.420557  8591 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:44.470811  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.477562  3963 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:44.483748  8511 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:44.475309  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.484664  8652 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:44.492635  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.524296  3963 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:44.526507  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.528206  3965 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
W20260709 13:17:44.530807  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.531831  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.486145  8515 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.549444  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.550206  3970 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:44.550787  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.551684  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.553390  4044 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [12.7-13.8]
I20260709 13:17:44.554972  4116 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:44.556277  4047 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:17:44.539198  8510 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.557879  8510 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.560114  8510 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:44.560629  8633 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.561231  8633 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.563335  8633 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:44.585466  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.586966  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:44.615070  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.615890  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.616218  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.524124  8622 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:44.636646  4085 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.830s (SENT) [suppressed 4 similar messages]
I20260709 13:17:44.526490  8609 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:44.638648  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.660995  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.526858  8610 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:44.528131  8513 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:44.662473  4042 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:17:44.663875  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.667326  4039 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:44.541603  8441 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.669438  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.544961  8360 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:44.560665  8510 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.673014  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:44.673727  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.686295  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:44.673972  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.677109  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.551149  8581 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.581663  8495 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.669153  8384 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.683455  8441 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.669157  8609 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.685483  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.581820  8521 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.581487  8549 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.686357  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.688273  3970 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11.
I20260709 13:17:44.707379  4041 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:44.690275  3964 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:44.524686  8511 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.691190  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.695340  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.529402  8652 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.709918  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.711411  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.712210  3964 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:44.713596  4039 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:17:44.680738  8685 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:44.635272  8515 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.670423  8610 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.666144  8460 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:44.730585  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.704360  4043 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:17:44.731634  4043 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 5
I20260709 13:17:44.731899  4043 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:17:44.732131  4043 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.669241  8466 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.731238  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:44.705387  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.708592  4042 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:44.659412  8650 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 13:17:44.715181  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:44.740753  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.723340  8521 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.725472  8566 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:44.673230  8513 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.773065  3972 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:17:44.747344  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.773857  4039 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:44.688923  4117 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:44.684273  8360 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.664522  8622 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.779448  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2954) took 3015 ms. Trace:
I20260709 13:17:44.698947  8510 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:44.815259  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:44.725625  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.807845  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:44.825261  3964 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:44.824481  3971 rpcz_store.cc:276] 0709 13:17:41.763841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.766890 (+  3049us) service_pool.cc:224] Handling call
0709 13:17:41.793575 (+ 26685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.003754 (+210179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.772671 (+2768917us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400307354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:44.779386 (+  6715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470454144}
I20260709 13:17:44.826037  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.767601  8566 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:44.767966  8441 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:44.768935  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 237515us
I20260709 13:17:44.768458  8673 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:44.736304  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.741047  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.841964  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.687094  8695 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:17:44.843441  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.768877  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.843690  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:44.844188  3966 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:44.844528  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.845144  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:44.799247  4680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 351) took 2478 ms. Trace:
W20260709 13:17:44.833235  3937 connection.cc:256] RPC call timeout handler was delayed by -1.7068514800000685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 13:17:44.846271  4046 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:44.789938  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.790306  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:44.850489  4043 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:44.706185  8384 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:44.854384  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 320499us
I20260709 13:17:44.846153  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:44.844569  3965 raft_consensus.cc:2376] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10. Re-sending same reply.
I20260709 13:17:44.744216  4041 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:44.729610  8460 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.772261  8466 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.845822  4680 rpcz_store.cc:276] 0709 13:17:42.320320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.320492 (+   172us) service_pool.cc:224] Handling call
0709 13:17:42.322927 (+  2435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.728308 (+405381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.770407 (+2042099us) spinlock_profiling.cc:243] Waited 405 ms on lock 0x7b54001a0c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:44.799148 (+ 28741us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":931043584}
I20260709 13:17:44.705348  8495 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.851922  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.834216  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:44.791544  8688 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.857031  8673 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.858310  8652 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.858987  8513 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:44.859143  8384 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:44.860729  8510 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:44.861338  8694 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:17:44.861829  4039 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:44.848032  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:44.822006  8654 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:44.705520  8581 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.714978  8549 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.731465  8685 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:44.862097  4041 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 13:17:44.994870  8701 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
W20260709 13:17:44.993530  8696 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:17:45.006999  8509 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.009603  4115 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:45.010020  4115 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:45.010713  4115 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.011940  8521 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.013109  8622 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.014070  8685 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.016711  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2969) took 2060 ms. Trace:
I20260709 13:17:45.017405  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2957) took 2243 ms. Trace:
I20260709 13:17:45.019912  3969 rpcz_store.cc:276] 0709 13:17:42.774348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.775703 (+  1355us) service_pool.cc:224] Handling call
0709 13:17:42.776006 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:42.885720 (+109714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.016145 (+2130425us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400279054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:45.017348 (+  1203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249892224}
I20260709 13:17:45.021030  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:45.011818  4115 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:44.986536  8594 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.026964  8569 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:45.027477  8569 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:45.025756  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.017901  3967 rpcz_store.cc:276] 0709 13:17:42.956381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:43.053188 (+ 96807us) service_pool.cc:224] Handling call
0709 13:17:43.053529 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:43.063977 (+ 10448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:43.064011 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:44.235676 (+1171665us) log.cc:844] Serialized 52 byte log entry
0709 13:17:44.485874 (+250198us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:44.684497 (+198623us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.684826 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 13:17:44.685207 (+   381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:44.685283 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.007956 (+322673us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b180035b960. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:45.012634 (+  4678us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b180035b960. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:45.016530 (+  3896us) raft_consensus.cc:1685] finished
0709 13:17:45.016549 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.016661 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40781,"prepare.queue_time_us":167300,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":3275,"raft.queue_time_us":6842,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":14922,"spinlock_wait_cycles":20918528,"thread_start_us":389135,"threads_started":2,"wal-append.queue_time_us":490339}
W20260709 13:17:44.862416  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54718.7us
I20260709 13:17:45.037410  3971 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:17:44.957615  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 102436us
I20260709 13:17:44.862210  4043 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 7
I20260709 13:17:45.043257  4043 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:45.043637  4043 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:44.832825  8438 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:44.983712  8695 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:45.065932  4115 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
W20260709 13:17:45.067085  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2468) took 3647 ms (client timeout 2181 ms). Trace:
W20260709 13:17:45.045152  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4638699170002383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:17:45.064240  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.069541  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.047559  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.070704  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3693699170000855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
W20260709 13:17:45.071151  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3225699170002372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
W20260709 13:17:45.071506  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3216699170002357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.169s for a response
W20260709 13:17:45.071834  3937 connection.cc:256] RPC call timeout handler was delayed by -1.1254699170001459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
W20260709 13:17:45.072160  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0147699170001943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 13:17:45.085448  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.088999  3964 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:45.091387  8520 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:17:45.092335  8509 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:45.067615  4115 rpcz_store.cc:269] 0709 13:17:41.419953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:41.523112 (+103159us) service_pool.cc:224] Handling call
0709 13:17:45.009455 (+3486343us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b5400395920. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c3dc0 00007fed7644fe18 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6
0709 13:17:45.067008 (+ 57553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428338944}
I20260709 13:17:45.095678  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.095803  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.097007  3963 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:45.098096  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:45.099911  3969 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:44.827363  8687 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:44.851766  8355 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.114161  3971 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.044957  8610 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:44.862776  8693 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:45.062291  8384 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.028513  8569 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.862437  8699 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:45.124836  3970 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:17:45.142720  8705 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:17:45.095319  8695 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:45.061930  8688 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:44.867841  8515 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.144500  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.098646  8511 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.146270  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.158567  8709 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:45.025630  8654 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:45.163000  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.167276  3964 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:45.140194  8510 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:45.183699  3971 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:45.115329  8633 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:45.189569  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.178458  8705 consensus_queue.cc:1243] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:17:45.182543  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 296067us
I20260709 13:17:45.119194  3969 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:45.154785  8610 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:45.061159  8594 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.200707  8594 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.184288  3967 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:45.202728  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.203289  3967 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:45.204156  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.213227  8616 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.160913  8384 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.180393  8699 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:45.226534  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.204685  3967 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:45.228871  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.229468  3967 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:45.233532  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:45.234385  8587 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:45.234789  8587 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.235134  8587 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.235239  8514 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.239009  8623 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.240835  8709 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.130227  8687 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.244096  8687 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.246572  8466 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.190516  8510 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:45.247658  8510 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:45.252175  8673 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.253615  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.254062  8654 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.255908  8566 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.258057  8566 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.259419  8495 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.185981  8569 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:45.261469  8613 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.262032  8613 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.262718  8392 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.263213  8392 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.264629  8613 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.265228  8392 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.188453  8685 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:17:45.266103  8685 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:45.266435  8685 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:45.267231  8685 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.267622  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.267848  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.267122  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:45.269465  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.271132  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.272639  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.272801  8460 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.273046  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.274847  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.254465  4046 raft_consensus.cc:2410] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:17:45.098134  8438 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.113777  8521 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:17:45.179656  8513 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.181329  8695 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:45.157667  8693 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.197751  4043 pending_rounds.cc:85] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 8
I20260709 13:17:45.285995  4043 pending_rounds.cc:107] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:17:45.286252  4043 raft_consensus.cc:2889] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.198648  8549 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.273626  4115 raft_consensus.cc:2410] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:17:45.269980  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.290632  4116 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:45.291453  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.291806  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.292063  4116 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:45.292511  3967 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:45.292881  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:45.293387  4116 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:45.191988  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.275862  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.275990  4114 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:45.296959  8479 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:45.297212  3964 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:45.297540  8479 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.268740  4119 raft_consensus.cc:2410] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:17:45.299427  4119 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:45.189980  3971 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:45.301381  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.301525  8438 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.277659  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:45.278538  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 46435.1us
I20260709 13:17:45.278996  4121 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:17:45.278407  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46304.7us
I20260709 13:17:45.287065  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.289336  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:45.269443  4117 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:45.273411  8610 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.332558  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.303045  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.347209  3966 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:45.302095  4042 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:45.268687  8685 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:45.495697  4117 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:45.497205  4117 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:17:45.365235  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 84794.1us
I20260709 13:17:45.436743  4116 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:45.457782  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.303265  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.463022  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.476159  3971 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:45.499442  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.500197  3971 raft_consensus.cc:2410] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:45.483589  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.478588  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.476591  4013 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:45.490309  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.501516  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.502508  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.500754  4121 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:45.367858  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.458125  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:45.347939  8708 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:17:45.477531  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:45.505632  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.506247  4118 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:45.492944  4682 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.477006  4046 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:45.493873  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.477130  4112 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:45.504793  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.508544  3964 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:45.505460  4119 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:45.478283  4045 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:45.509181  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.509765  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.509213  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2553) took 1020 ms. Trace:
I20260709 13:17:45.510341  3964 rpcz_store.cc:276] 0709 13:17:44.488908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.508112 (+1019204us) service_pool.cc:224] Handling call
0709 13:17:45.508384 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.508999 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.509157 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.512415  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.515056  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:45.515539  4120 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:45.515794  4120 raft_consensus.cc:614] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:45.518546  4119 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:45.519277  4112 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:45.520408  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:45.506438  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:45.454576  4678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 361) took 4914 ms. Trace:
I20260709 13:17:45.401441  8688 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.527189  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:45.281944  8586 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.225s
I20260709 13:17:45.536042  4116 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:45.524886  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.291023  8513 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.549006  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.596256  4116 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:45.557905  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.548293  4120 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:45.526448  4121 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:45.546379  4114 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:45.511896  8650 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:45.602890  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:45.562664  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.518500  8438 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:45.597793  4116 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 13:17:45.548683  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.620249  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.517585  8521 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:45.525946  8520 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:45.522609  8642 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:45.549168  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.544339  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.568933  8693 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.571870  8606 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:45.547735  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.577195  8699 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.571625  8581 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.563552  8360 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.545885  8691 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:45.545706  8384 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.583369  8610 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.626196  4684 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:45.586748  8618 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.551893  8479 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.548065  8709 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.622594  8438 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:45.635648  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.655560  4683 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:45.645787  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.634250  8606 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:45.627393  8587 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.626765  8521 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.626535  8520 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.633131  8642 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.644680  8691 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:45.656708  8438 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:45.802801  3869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 95) took 20361 ms (client timeout 15000 ms). Trace:
W20260709 13:17:45.475895  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.804262  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:45.474723  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.805019  4675 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 12.
W20260709 13:17:45.806319  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.540908  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:45.722945  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.724498  3965 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:45.726763  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 638) took 1066 ms. Trace:
I20260709 13:17:45.810632  3964 rpcz_store.cc:276] 0709 13:17:44.659713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.724666 (+1064953us) service_pool.cc:224] Handling call
0709 13:17:45.725587 (+   921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.726069 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.726114 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.726185 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:45.726254 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.726361 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.726526 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.540791  4678 rpcz_store.cc:276] 0709 13:17:40.513319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:40.522787 (+  9468us) service_pool.cc:224] Handling call
0709 13:17:40.574461 (+ 51674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:40.638054 (+ 63593us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:41.353732 (+715678us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b18002c6aa0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:17:41.462945 (+109213us) log.cc:844] Serialized 14 byte log entry
0709 13:17:42.958173 (+1495228us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b18002c6aa0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:17:44.477160 (+1518987us) log.cc:844] Serialized 14 byte log entry
0709 13:17:45.187402 (+710242us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:45.294437 (+107035us) log.cc:844] Serialized 52 byte log entry
0709 13:17:45.296787 (+  2350us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:45.296832 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.344559 (+ 47727us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.368016 (+ 23457us) raft_consensus.cc:1685] finished
0709 13:17:45.368039 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.427501 (+ 59462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97891,"prepare.queue_time_us":1809970,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":75,"raft.queue_time_us":247677,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":54635,"spinlock_wait_cycles":21838464,"thread_start_us":1917771,"threads_started":6,"wal-append.queue_time_us":556975,"wal-append.run_cpu_time_us":2002,"wal-append.run_wall_time_us":1249051}
I20260709 13:17:45.728223  3971 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:45.813599  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.729522  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.791278  7936 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.733299  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.778589  8513 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.735098  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3029) took 1157 ms. Trace:
I20260709 13:17:45.624756  4114 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:45.585564  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.738812  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.739734  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:45.746336  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.751914  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.757534  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2511) took 1062 ms. Trace:
I20260709 13:17:45.759048  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 641) took 1098 ms. Trace:
I20260709 13:17:45.760787  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:45.761580  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2535) took 3003 ms. Trace:
I20260709 13:17:45.764065  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 640) took 1103 ms. Trace:
I20260709 13:17:45.773876  4116 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:17:45.665599  8520 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.665619  8521 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.669198  8587 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.671217  8606 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.673089  8609 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.777287  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.777802  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:45.676944  8633 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:45.667573  8642 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.661104  8691 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:45.674001  8695 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.640249  4679 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:45.660816  8510 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.807412  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.816673  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 643) took 1126 ms. Trace:
I20260709 13:17:45.813982  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 639) took 1154 ms. Trace:
I20260709 13:17:45.835202  8705 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:45.932682  7910 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:45.933346  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.933449  7910 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.934211  4114 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 7.
I20260709 13:17:45.934408  4046 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:45.816542  7936 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:45.935473  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.936249  4046 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
W20260709 13:17:45.884279  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.826807  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2984) took 1113 ms. Trace:
W20260709 13:17:45.834617  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 293713us
I20260709 13:17:45.936846  3969 rpcz_store.cc:276] 0709 13:17:44.660245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.762502 (+1102257us) service_pool.cc:224] Handling call
0709 13:17:45.763070 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.763501 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.763531 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.763603 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:45.763649 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.763712 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.763819 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.931617  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.953351  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.953614  8510 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.938090  7910 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:45.954569  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:45.955192  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.953598  3969 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:17:45.839672  8523 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:45.960244  3969 pending_rounds.cc:85] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 7
I20260709 13:17:45.955869  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.888455  8433 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:45.960701  3969 pending_rounds.cc:107] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:17:45.961342  3969 raft_consensus.cc:2889] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.931092  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.962416  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 2987) took 1173 ms. Trace:
I20260709 13:17:45.963073  8441 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:45.963927  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.956825  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.929795  3967 rpcz_store.cc:276] 0709 13:17:44.690615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.815286 (+1124671us) service_pool.cc:224] Handling call
0709 13:17:45.815953 (+   667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.816320 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.816347 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.816399 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:45.816429 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.816500 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.816612 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.958477  8695 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:45.958235  8549 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:17:45.959074  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79490.8us
W20260709 13:17:45.803369  3869 rpcz_store.cc:269] 0709 13:17:25.440886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:25.441115 (+   229us) service_pool.cc:224] Handling call
0709 13:17:45.802506 (+20361391us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:40.830287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:40.830834 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:40.830878 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:17:40.830894 (+    16us) tablet.cc:662] Decoding operations
0709 13:17:40.831718 (+   824us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:40.831811 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:40.831835 (+    24us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:17:40.832456 (+   621us) tablet.cc:701] Row locks acquired
0709 13:17:40.832499 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:17:40.832706 (+   207us) write_op.cc:270] Start()
0709 13:17:40.879598 (+ 46892us) write_op.cc:276] Timestamp: P: 1783603060832615 usec, L: 0
0709 13:17:40.879631 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:17:41.037359 (+157728us) log.cc:844] Serialized 3403 byte log entry
0709 13:17:41.696517 (+659158us) op_driver.cc:464] REPLICATION: finished
0709 13:17:42.190342 (+493825us) write_op.cc:301] APPLY: starting
0709 13:17:42.252707 (+ 62365us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:42.476676 (+223969us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:42.509311 (+ 32635us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:42.690050 (+180739us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:42.690307 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:17:42.690352 (+    45us) write_op.cc:312] APPLY: finished
0709 13:17:42.690625 (+   273us) log.cc:844] Serialized 81 byte log entry
0709 13:17:42.774786 (+ 84161us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76447e28 00007fed79e82581 00007fed79e81d58 00007fed79e869f1 00007fed79e869a9 00007fed79e86939 00007fed79e86901 00007fed79e85b2d 000000000038f354 000000000038f199
0709 13:17:42.867911 (+ 93125us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.876269 (+  8358us) write_op.cc:454] Released schema lock
0709 13:17:42.877819 (+  1550us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:42.899101 (+ 21282us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:42.900667 (+  1566us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3615350,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":458513,"apply.run_cpu_time_us":68365,"apply.run_wall_time_us":719306,"cfile_cache_hit":30,"cfile_cache_hit_bytes":31455,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6224,"cfile_init":2,"lbm_read_time_us":19437,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":11,"num_ops":8,"prepare.queue_time_us":349210,"prepare.run_cpu_time_us":23714,"prepare.run_wall_time_us":1951238,"replication_time_us":763023,"spinlock_wait_cycles":10742656,"thread_start_us":639082,"threads_started":3,"wal-append.queue_time_us":185145,"wal-append.run_cpu_time_us":1441,"wal-append.run_wall_time_us":1072441}]]}
I20260709 13:17:45.929256  4038 rpcz_store.cc:276] 0709 13:17:44.577598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.581271 (+  3673us) service_pool.cc:224] Handling call
0709 13:17:45.222798 (+641527us) spinlock_profiling.cc:243] Waited 3.93 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:17:45.223010 (+   212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:45.261582 (+ 38572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.261614 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:45.262128 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:17:45.484233 (+222105us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:45.484276 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.734446 (+250170us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b54004272d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:45.734519 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:45.734593 (+    74us) raft_consensus.cc:1685] finished
0709 13:17:45.734605 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.734865 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3738,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":96870016,"thread_start_us":221705,"threads_started":1,"wal-append.queue_time_us":222834}
I20260709 13:17:45.964440  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.838730  8393 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.961524  4677 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:45.920183  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 642) took 1238 ms. Trace:
I20260709 13:17:45.962881  3969 rpcz_store.cc:276] 0709 13:17:44.789556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.952597 (+1163041us) service_pool.cc:224] Handling call
0709 13:17:45.953110 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.962126 (+  9016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.962347 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.932197  4044 rpcz_store.cc:276] 0709 13:17:44.694614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.845377 (+150763us) service_pool.cc:224] Handling call
0709 13:17:45.755428 (+910051us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.755930 (+   502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.755961 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.756035 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:45.756078 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.756171 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.757107 (+   936us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b540041cb50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:45.757308 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092012288}
I20260709 13:17:45.955868  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.942451  3972 rpcz_store.cc:276] 0709 13:17:42.757882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:42.758036 (+   154us) service_pool.cc:224] Handling call
0709 13:17:44.772838 (+2014802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:44.778567 (+  5729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.761131 (+982564us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b5400307350. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:45.761348 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4523787008}
I20260709 13:17:45.937161  3970 rpcz_store.cc:276] 0709 13:17:44.660475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.847738 (+187263us) service_pool.cc:224] Handling call
0709 13:17:45.758519 (+910781us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400279554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:45.758777 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247186176}
I20260709 13:17:45.895854  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.931002  3971 rpcz_store.cc:276] 0709 13:17:44.659988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.516983 (+856995us) service_pool.cc:224] Handling call
0709 13:17:45.517164 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.812988 (+295824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.813663 (+   675us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400279a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:45.813904 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":483099520}
I20260709 13:17:45.945144  3965 rpcz_store.cc:276] 0709 13:17:44.713447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.855764 (+142317us) service_pool.cc:224] Handling call
0709 13:17:45.826554 (+970790us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400278654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:45.826724 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591844224}
I20260709 13:17:45.960814  3968 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:45.893999  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:45.951781  3966 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:45.969341  3964 rpcz_store.cc:276] 0709 13:17:44.681806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.811759 (+1129953us) service_pool.cc:224] Handling call
0709 13:17:45.812302 (+   543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:45.812673 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.812703 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:45.919777 (+107074us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:45.919834 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:45.919910 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:45.920078 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:45.896867  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.891283  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.933723  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:45.977324  3968 pending_rounds.cc:85] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:45.984627  3968 pending_rounds.cc:107] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:45.984933  3968 raft_consensus.cc:2889] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:45.986315  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:45.986660  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:45.931964  8705 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:45.991135  4683 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:45.937049  7936 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:45.879734  8623 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:17:45.997905  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:45.932598  8633 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:46.002007  4118 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:46.005517  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.006611  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.008616  4120 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:17:46.010349  4120 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:46.010999  3972 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:17:46.006039  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:46.012853  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.015354  4039 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:17:45.875072  8641 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.125s
I20260709 13:17:45.993608  8705 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.020010  4121 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:46.021692  4041 raft_consensus.cc:2410] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:17:45.960666  8523 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:45.861176  8686 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:17:46.024537  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.026705  4113 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:46.026614  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.030431  8441 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:46.036269  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.039970  3967 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:46.042729  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.047191  4115 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:46.042834  3969 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:46.048333  4047 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:46.026197  4116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:46.050490  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.051201  4116 raft_consensus.cc:606] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:17:46.049196  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.051584  4116 raft_consensus.cc:614] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:46.053653  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.062400  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.060286  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:46.057212  4043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.009s	sys 0.004s
I20260709 13:17:46.068147  4039 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:46.072281  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.073580  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 2988) took 1247 ms. Trace:
W20260709 13:17:46.074586  4043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.009s	sys 0.005s
I20260709 13:17:46.073988  3966 rpcz_store.cc:276] 0709 13:17:44.822810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.844909 (+ 22099us) service_pool.cc:224] Handling call
0709 13:17:46.063814 (+1218905us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54002c9554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:46.070465 (+  6651us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153275648}
I20260709 13:17:46.075032  4038 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:46.078244  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.083061  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.077196  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:46.087602  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.086334  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.085212  4044 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:46.098618  3963 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:46.096633  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.099819  3965 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.094141  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.100615  4675 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:46.101851  4046 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:46.095189  8623 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:46.105720  8356 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:46.106781  8624 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:17:46.108261  8523 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.104197  4041 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:46.112394  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.116233  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.117654  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.126346  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:46.127981  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.111305  8606 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.134354  8495 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:46.136011  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.135138  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.142661  8521 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.115218  8549 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:17:46.152912  7910 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.153462  8609 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:46.135612  8641 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:17:46.135185  8495 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.145776  8521 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:46.167704  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 139318us
I20260709 13:17:46.151007  8622 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:46.174192  4039 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:46.188148  4038 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:46.169212  8609 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:17:46.199070  4087 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 12.
I20260709 13:17:46.202711  4087 leader_election.cc:403] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:17:46.208134  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.189697  8622 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.206938  8521 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.225692  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:46.230922  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.233709  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.235512  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.237419  7936 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.198624  8549 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:17:46.240414  4041 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:17:46.241448  8624 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:46.243939  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.244840  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:46.244726  8642 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.246109  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:46.251564  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:46.209432  8438 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.219791  8609 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:17:46.273778  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63899.7us
I20260709 13:17:46.276167  4042 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:46.259743  8642 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:46.275554  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:46.245296  8587 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
W20260709 13:17:46.278194  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88229.6us
I20260709 13:17:46.278743  8642 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:46.295121  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 51296.2us
W20260709 13:17:46.312495  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 175181us
W20260709 13:17:46.314427  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64212.7us
I20260709 13:17:46.311043  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3054) took 1079 ms. Trace:
I20260709 13:17:46.275215  8624 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.323810  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 365) took 1129 ms. Trace:
I20260709 13:17:46.320277  4044 rpcz_store.cc:276] 0709 13:17:45.231926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.133666 (+901740us) service_pool.cc:224] Handling call
0709 13:17:46.139216 (+  5550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.158114 (+ 18898us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:46.184409 (+ 26295us) log.cc:844] Serialized 14 byte log entry
0709 13:17:46.310483 (+126074us) log.cc:844] Serialized 14 byte log entry
0709 13:17:46.310636 (+   153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:46.310679 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:46.310756 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.310831 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.310959 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10838,"prepare.queue_time_us":17905,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"thread_start_us":100910,"threads_started":1}
I20260709 13:17:46.331926  8355 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:46.321319  8641 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:46.334694  8691 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:46.337136  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 61670.7us
I20260709 13:17:46.300449  8441 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:17:46.337455  8433 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.338043  8661 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:46.338511  8650 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.332551  8355 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:46.333798  8613 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.349934  8438 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.351763  8742 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:17:46.352469  8736 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:46.324990  4043 rpcz_store.cc:276] 0709 13:17:45.194761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.194964 (+   203us) service_pool.cc:224] Handling call
0709 13:17:45.197565 (+  2601us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:45.306318 (+108753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:45.306353 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:45.306947 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 13:17:46.094610 (+787663us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:46.147509 (+ 52899us) log.cc:844] Serialized 14 byte log entry
0709 13:17:46.317676 (+170167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.317804 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:46.317847 (+    43us) raft_consensus.cc:1685] finished
0709 13:17:46.317858 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:46.323719 (+  5861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7250,"prepare.queue_time_us":22087,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":109323,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":15676,"thread_start_us":828962,"threads_started":2,"wal-append.queue_time_us":752696}
I20260709 13:17:46.334625  8610 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:46.336889  8633 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.356729  8355 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.358134  8623 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:46.354815  8661 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.363190  8624 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:46.363795  4085 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11.
I20260709 13:17:46.363579  8586 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:46.369453  8433 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.370276  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2551) took 1881 ms. Trace:
W20260709 13:17:46.371958  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.341558  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.342233  8641 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:46.373431  4047 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:46.373518  8495 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:46.374698  8691 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.375078  3965 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:46.407811  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.375167  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:46.337638  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.397259  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2525) took 1013 ms. Trace:
I20260709 13:17:46.397406  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.398372  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.433321  4038 rpcz_store.cc:276] 0709 13:17:45.383219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.137991 (+754772us) service_pool.cc:224] Handling call
0709 13:17:46.161118 (+ 23127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:46.188691 (+ 27573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.396512 (+207821us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5400020dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:46.396718 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50838784}
I20260709 13:17:46.393253  8610 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:46.374706  8622 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.400115  3963 rpcz_store.cc:276] 0709 13:17:44.488401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:45.110391 (+621990us) service_pool.cc:224] Handling call
0709 13:17:46.080843 (+970452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:46.111017 (+ 30174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:46.370056 (+259039us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54002c9550. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:46.370193 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2129685760}
W20260709 13:17:46.444938  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.445621  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.446019  7936 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 12.
I20260709 13:17:46.446909  8520 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:46.447343  8520 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:46.448438  8520 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.449035  3964 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:46.449723  8520 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:46.450353  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.433670  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:46.454015  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.390180  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.409276  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:46.455024  4675 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:46.411877  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.405834  8641 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:46.412575  8523 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:46.458801  8523 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:46.399040  8661 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:46.414629  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59527.8us
I20260709 13:17:46.459896  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.460353  3967 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:46.459868  8523 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.414739  8633 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:46.415434  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51794.5us
I20260709 13:17:46.403394  8586 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:46.420444  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:46.421064  8609 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:46.465107  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:46.465673  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.421787  8650 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:46.422322  7910 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.419400  3866 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 9 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:46.414091  8433 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:46.424711  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.424903  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.427549  4040 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:46.431207  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.431663  8642 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.431989  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.432698  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.398974  8623 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:46.440719  3966 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:46.441193  8610 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.485092  8523 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:46.459738  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.458922  3971 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:46.466761  8650 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.470444  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.469179  8686 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:46.477888  8703 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:46.478302  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:46.486080  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65761.4us
I20260709 13:17:46.478842  8356 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:46.479612  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:46.486948  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.489283  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.494757  4043 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:46.494670  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.491536  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:46.478495  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 106817us
I20260709 13:17:46.493525  4042 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:46.467173  8609 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.474248  8510 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.467483  7910 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:46.509151  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.494809  4038 raft_consensus.cc:2376] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13. Re-sending same reply.
I20260709 13:17:46.512274  8478 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:46.512892  8478 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:46.513975  8478 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.517210  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.517915  4113 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:46.518086  3969 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:46.512275  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.519804  4042 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:46.519203  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.523350  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.493075  8703 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:46.523026  4116 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 7.
I20260709 13:17:46.499363  8356 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:46.531956  8751 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.502964  8609 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:46.540804  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70442.7us
I20260709 13:17:46.543103  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.551201  8750 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.464850  8586 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.555209  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.529182  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.554072  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.554991  8750 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.557875  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:46.558163  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:46.558540  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.559019  8750 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.559315  8441 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:46.560341  8441 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:46.560667  8441 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:46.561527  8441 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.562320  8642 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:46.562804  8441 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:46.564981  4040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2509) took 1883 ms (client timeout 2031 ms). Trace:
W20260709 13:17:46.565380  4040 rpcz_store.cc:269] 0709 13:17:44.682177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:44.682415 (+   238us) service_pool.cc:224] Handling call
0709 13:17:46.553482 (+1871067us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b540041d054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:46.564911 (+ 11429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3554623360}
I20260709 13:17:46.566121  4679 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.558847  8736 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:46.599715  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.602977  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.509246  8510 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.548422  8356 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:17:46.608862  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85379.3us
I20260709 13:17:46.607928  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:46.607347  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.613683  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:46.613404  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.616906  4113 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:46.614301  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71277.6us
I20260709 13:17:46.613422  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.614964  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.617772  4040 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:46.618418  4121 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:46.623000  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.625484  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.619571  7910 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.555091  8749 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:46.613376  8705 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.002s
I20260709 13:17:46.604813  8750 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.626119  4043 raft_consensus.cc:2376] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11. Re-sending same reply.
I20260709 13:17:46.613137  8586 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:46.632540  4042 raft_consensus.cc:2376] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10. Re-sending same reply.
I20260709 13:17:46.635200  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.634595  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.635394  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.636940  8579 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:46.637516  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.644886  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.639856  8610 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.644156  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:46.645226  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.650105  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 182142us
I20260709 13:17:46.652151  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.653081  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.653435  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:46.654449  8743 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:46.655395  8743 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:46.655596  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:46.655905  8433 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:46.656333  8433 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:46.656629  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.657238  3965 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:46.657348  8433 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.658653  3965 pending_rounds.cc:85] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 10
I20260709 13:17:46.658962  3965 pending_rounds.cc:107] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:17:46.658743  8433 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:46.659708  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.661284  3972 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 13:17:46.648398  4038 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:46.648653  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.649017  4115 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:46.659255  3965 raft_consensus.cc:2889] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:46.674415  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:46.675684  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45606.1us
W20260709 13:17:46.695613  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 65947.5us
I20260709 13:17:46.696691  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.697782  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.699743  4039 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:46.675464  8691 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:46.608961  8641 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:46.701259  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:46.702520  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46999us
I20260709 13:17:46.705183  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.710346  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.711002  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:46.712371  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.714419  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.712118  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.648119  7936 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:17:46.702749  7910 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.761209  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:46.756570  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.633860  8705 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.704124  8691 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:46.761277  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 50004.4us
I20260709 13:17:46.766189  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.774089  3938 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:46.774462  3938 leader_election.cc:403] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:17:46.769017  8510 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:46.770458  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.675881  8750 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.772372  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.773316  4115 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:46.779860  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.780460  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.802655  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.804240  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:46.804940  4675 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:46.807173  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.808204  4112 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:46.811151  3972 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:46.782991  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.779682  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.780049  4040 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.813892  4045 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:46.817708  4114 raft_consensus.cc:2410] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:46.776021  8691 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:46.814230  4118 raft_consensus.cc:2376] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12. Re-sending same reply.
I20260709 13:17:46.823953  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.819650  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.825317  3971 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:46.824606  4118 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:46.827450  4118 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:46.828513  4118 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:46.686509  8749 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:46.833052  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 122704us
I20260709 13:17:46.833825  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:46.760735  8753 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:46.836374  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.838140  8757 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:46.840932  4043 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:17:46.845307  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.846077  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:46.849220  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 92288.2us
I20260709 13:17:46.845659  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:46.853118  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:46.854988  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:46.830266  8520 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.866914  4120 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:46.697880  8703 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.868337  3970 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:46.870024  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:46.875463  4117 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:46.803105  8609 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.843197  8753 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:46.884302  4047 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
W20260709 13:17:46.884927  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.886718  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:46.889271  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.888011  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:46.903951  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:46.909202  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53873.5us
I20260709 13:17:46.888321  8753 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:46.898066  8703 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:46.914992  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:46.880060  8520 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:46.912211  3866 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 12, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:17:46.961678  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58634.2us
W20260709 13:17:46.951073  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:46.951447  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63549.1us
I20260709 13:17:46.907925  7936 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.965101  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.959681  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:46.897478  8756 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:46.918440  8610 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:46.972728  3969 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:46.972922  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:46.981861  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66110.7us
I20260709 13:17:46.982492  3970 raft_consensus.cc:2410] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:46.949230  8754 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:46.987396  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:46.959201  8641 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:46.951960  8759 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:47.001385  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:46.994773  8623 consensus_meta.cc:287] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
W20260709 13:17:47.017120  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:46.996111  8642 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:47.006301  3866 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:47.023442  4040 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:47.005865  8520 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:47.010370  8747 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
W20260709 13:17:47.024552  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 250604us
I20260709 13:17:46.998345  8759 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:47.027031  4045 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:47.025590  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.027999  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.026368  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49022.9us
I20260709 13:17:46.972430  7936 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.001389  8705 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:47.034659  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.029917  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.031560  3969 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:47.036562  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:47.012603  8771 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:47.038885  4040 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:47.031019  8752 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 13:17:47.040819  3970 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.022172  8610 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:47.042630  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:47.006585  8757 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:47.030285  8750 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.029237  8759 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:17:47.044440  8523 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.001s
I20260709 13:17:47.037768  8360 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.052589  3866 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 7 to 12, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:47.020727  8754 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.070842  8741 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:47.076890  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.080963  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.092640  8755 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260709 13:17:47.093192  8747 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:17:47.062337  8610 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.016206  8756 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.040153  8771 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.121806  4045 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:47.123540  8764 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.161s	user 0.000s	sys 0.005s
I20260709 13:17:47.062067  8609 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.127743  8610 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.125959  4045 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:47.114238  3866 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 10 to 11, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 11 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.021595  8623 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:47.145777  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.039611  8520 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
W20260709 13:17:47.165665  8355 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.728s	user 0.015s	sys 0.001s
I20260709 13:17:47.128830  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:47.199178  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.199887  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.098752  8360 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.058948  8749 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.100533  8750 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.205232  8770 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:47.216627  4044 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:47.217442  8751 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:47.218046  8751 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.133805  8771 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.226068  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:47.205571  3866 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 8 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.234972  3866 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 12, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.237264  8751 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:47.248317  3970 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
W20260709 13:17:47.242821  8661 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.002s
W20260709 13:17:47.245800  8441 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.683s	user 0.008s	sys 0.009s
I20260709 13:17:47.206921  8360 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.214654  8757 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.236021  8691 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:47.261718  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.292798  3965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.005s
W20260709 13:17:47.267047  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 207618us
W20260709 13:17:47.275322  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 146627us
I20260709 13:17:47.293648  4042 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:47.114756  3971 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:17:47.277767  8754 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.277181  3866 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:17:47.266845  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 147119us
I20260709 13:17:47.279770  8642 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:47.282732  8756 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.284447  7936 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.284957  8661 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:47.285440  8762 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 13:17:47.194931  8355 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.323644  8355 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.312459  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:47.303999  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 105589us
I20260709 13:17:47.276490  4675 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
W20260709 13:17:47.290484  3968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.003s
W20260709 13:17:47.339851  3968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.003s
I20260709 13:17:47.341531  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:47.342198  3971 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.343683  8759 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.339996  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:47.346838  4046 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
W20260709 13:17:47.293174  3965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.005s	sys 0.005s
I20260709 13:17:47.297209  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:47.229914  8750 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.303323  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:47.304416  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:47.311389  8433 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.652s	user 0.015s	sys 0.010s
I20260709 13:17:47.353602  3969 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:47.311993  8441 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.298766  8642 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.314035  8661 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.315483  4676 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:47.315773  8773 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:47.317087  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:47.330520  4119 consensus_meta.cc:287] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.002s
I20260709 13:17:47.365881  4119 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:47.333177  4038 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:47.329783  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.329035  8495 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:47.335150  8613 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.942s	user 0.009s	sys 0.016s
W20260709 13:17:47.327822  8650 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.819s	user 0.011s	sys 0.000s
W20260709 13:17:47.336254  7910 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.018s
W20260709 13:17:47.336510  8356 consensus_meta.cc:287] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.019s
I20260709 13:17:47.369717  8355 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:47.373647  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 56660us
I20260709 13:17:47.375061  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.375982  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:47.377099  8782 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.377585  8782 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.377930  8782 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.370925  8757 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:47.345139  3963 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:47.348317  3972 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:47.353425  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 52709.4us
I20260709 13:17:47.310568  3866 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 4 to 6, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 6 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:47.357052  8759 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:47.386009  3856 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:47.371265  8613 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:47.388983  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.390308  3866 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:47.357321  8642 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:47.391772  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62068.7us
I20260709 13:17:47.370823  8356 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.394762  3866 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:17:47.395946  8495 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:17:47.396844  8686 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.898s	user 0.004s	sys 0.009s
I20260709 13:17:47.397289  8686 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.397543  8642 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:47.400527  4116 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:47.380719  8757 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:47.401248  8757 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:47.401592  8356 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.396747  3866 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 6 to 11, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 11 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.402679  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:47.401275  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:47.297787  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 380401us
I20260709 13:17:47.356177  8441 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.367990  7936 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:17:47.403954  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.407444  3972 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:47.408002  8356 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:47.409549  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 358) took 1113 ms. Trace:
I20260709 13:17:47.409710  8609 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:47.410372  8703 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.410748  8703 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.411144  8703 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.412731  8441 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.409986  4676 rpcz_store.cc:276] 0709 13:17:46.296115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.318094 (+ 21979us) service_pool.cc:224] Handling call
0709 13:17:47.409250 (+1091156us) spinlock_profiling.cc:243] Waited 877 ms on lock 0x7b54007959d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:47.409444 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2017601408}
I20260709 13:17:47.401330  8613 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:47.415470  8613 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:47.415824  8613 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.409739  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.417248  7936 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:47.417668  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.418097  7936 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.418483  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:47.418998  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.419384  8355 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:47.405468  8757 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.420946  8741 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:47.421329  8741 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.421643  8741 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.395772  8433 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:47.424960  8586 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.410682  4683 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:47.430546  3971 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:17:47.403388  8759 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:17:47.433995  8441 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:47.434767  8633 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.972s	user 0.014s	sys 0.001s
I20260709 13:17:47.435372  8686 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:47.435775  8686 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:47.436118  8686 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.419039  7936 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.439036  3866 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 8 to 10, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 10 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:47.439594  8782 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.434772  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.441505  3866 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 10 to 14, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:17:47.443005  3866 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 10 to 13, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:17:47.444168  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.444448  8355 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:47.444832  8756 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:47.445403  8749 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:47.434463  8759 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:47.446302  8754 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:47.449481  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.453964  8441 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:47.454855  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:47.455497  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.456046  3969 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 13:17:47.371414  8650 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:47.503645  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54383us
I20260709 13:17:47.505425  8650 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.505990  8520 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.505651  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:47.457140  8613 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.507964  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.457479  3972 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:47.457571  4041 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:47.461416  8771 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.462001  8782 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.463979  8750 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.444058  8757 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.467422  8360 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.432834  8753 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.469928  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.470959  3938 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.473707  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:47.475976  8756 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:47.478230  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70522.1us
W20260709 13:17:47.479465  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.534366  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.480013  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:47.480283  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:47.480545  4679 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:47.481022  8776 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:47.483074  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:47.483094  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.484594  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:47.431051  8609 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.487498  8691 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:47.488906  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:47.489233  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:47.491794  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.478127  8633 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:17:47.493848  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2551) took 1022 ms. Trace:
W20260709 13:17:47.525650  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70885.8us
I20260709 13:17:47.528420  8742 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.528402  8642 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:47.477288  4121 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
W20260709 13:17:47.553894  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.534782  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 64985.2us
I20260709 13:17:47.533378  8495 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.536473  8756 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.537616  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:47.526834  8751 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:47.544500  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:47.526575  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:47.557826  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66105us
I20260709 13:17:47.558516  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:47.542209  3963 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:47.550349  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.546057  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:47.546162  4046 rpcz_store.cc:276] 0709 13:17:46.471656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.491096 (+ 19440us) service_pool.cc:224] Handling call
0709 13:17:47.493676 (+1002580us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b540002b2d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:47.493787 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325017856}
W20260709 13:17:47.553666  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 82802.9us
I20260709 13:17:47.478166  8759 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:47.536646  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53658.5us
I20260709 13:17:47.542521  8750 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.541229  8355 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:47.540508  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:47.562333  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.570214  3972 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.535673  8610 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:17:47.560103  8782 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.591099  8650 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:47.544572  7910 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:17:47.591874  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.593052  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.577250  8355 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.613204  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.576963  8609 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.594396  8780 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:47.594238  8610 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:47.592489  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:47.571261  8587 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:47.599468  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:47.599345  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.635519  4120 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:47.602501  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:47.606467  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 123445us
I20260709 13:17:47.590711  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2547) took 1132 ms. Trace:
I20260709 13:17:47.612500  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.637485  4113 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:47.614945  8757 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:47.616101  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:17:47.622968  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.560914  8495 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.629387  4117 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:47.641070  8751 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.641283  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.642019  4117 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:47.642087  8751 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.629709  3969 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:47.596490  8742 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:47.649303  8742 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.649775  8742 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.633474  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:47.643918  4117 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:47.624728  8790 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:17:47.653632  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 66195.8us
I20260709 13:17:47.657616  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:47.655830  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 54408.3us
I20260709 13:17:47.659951  3972 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
W20260709 13:17:47.661347  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 102748us
I20260709 13:17:47.601406  8650 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:47.664407  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:47.667367  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.636905  4041 rpcz_store.cc:276] 0709 13:17:46.458574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.459575 (+  1001us) service_pool.cc:224] Handling call
0709 13:17:47.590533 (+1130958us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b540028c154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:47.590645 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2292705664}
I20260709 13:17:47.627888  8623 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:47.672917  4045 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:47.632975  8613 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.627866  8703 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.676527  3966 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.690136  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:47.693976  4120 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:47.714458  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:47.715204  4038 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:47.712641  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:47.711503  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:47.712361  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:47.700399  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.693830  4121 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:17:47.678036  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.716288  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:47.717177  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:47.722033  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:47.722590  4046 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:47.665680  8587 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:47.625612  8686 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.672879  8753 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:47.721575  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 165397us
I20260709 13:17:47.725522  3969 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:47.726025  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:47.740116  4042 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:47.726699  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:47.694113  8784 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:17:47.661934  8780 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:47.669082  8650 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.755492  4039 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:47.634513  8741 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.745530  8609 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:47.753023  8661 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:47.715031  8520 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:47.718446  8441 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:47.730379  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 52422.7us
I20260709 13:17:47.742985  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.637683  8759 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.694137  8586 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:17:47.753463  8623 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.773106  4040 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:47.752275  8495 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.789201  8736 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:47.765820  8520 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:47.765271  8441 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:47.809765  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66797.4us
W20260709 13:17:47.810426  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.814205  3966 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
W20260709 13:17:47.809118  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49479.6us
I20260709 13:17:47.785223  8661 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:47.788841  8691 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.820129  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:47.826277  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 168714us
W20260709 13:17:47.826866  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72675us
I20260709 13:17:47.785023  8695 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:47.816431  8759 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.832098  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:47.827096  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:47.761454  8355 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.798249  8623 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.829422  8795 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.842137  8749 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:47.842644  8749 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:47.843549  8749 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.848599  8441 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.850035  8441 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.832643  8691 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.862804  8703 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.840446  8795 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:47.863662  8795 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:47.864192  8360 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.865070  8771 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.867441  8736 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:47.867848  8736 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:47.839953  8751 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:47.872179  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 52138.7us
W20260709 13:17:47.879498  8794 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:17:47.873566  8736 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.880661  8736 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:47.881743  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2572) took 1229 ms. Trace:
I20260709 13:17:47.882123  3965 rpcz_store.cc:276] 0709 13:17:46.652402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.658065 (+  5663us) service_pool.cc:224] Handling call
0709 13:17:46.658408 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:47.391821 (+733413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.391858 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:47.393980 (+  2122us) log.cc:844] Serialized 52 byte log entry
0709 13:17:47.538060 (+144080us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:47.538089 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.538132 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:47.881481 (+343349us) raft_consensus.cc:1685] finished
0709 13:17:47.881505 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:47.881673 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126772,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":73,"thread_start_us":649658,"threads_started":2,"wal-append.queue_time_us":198593}
I20260709 13:17:47.892436  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:47.895764  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 68740.8us
W20260709 13:17:47.873549  8793 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 13:17:47.827700  8780 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.900704  8586 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:47.836622  8587 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:47.837155  8520 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.914757  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.870755  8809 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:47.917219  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:47.890379  8686 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:47.918951  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:47.895500  8773 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:47.925472  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.928872  4113 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:47.932873  8800 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:47.933333  8800 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:47.933679  8800 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:47.948627  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.910943  8751 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:47.950531  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 159878us
W20260709 13:17:47.950661  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 118634us
I20260709 13:17:47.948801  4118 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:47.958048  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:47.958688  4121 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.969607  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:47.928742  8773 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:47.925946  8741 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.975384  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:47.959360  8686 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:47.897341  8661 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:47.978585  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59720.7us
I20260709 13:17:47.922721  8586 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:47.979729  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:47.926726  8703 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:17:47.964962  8809 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:47.983295  8803 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:47.982089  8686 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:47.985765  8742 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:47.982610  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:47.987407  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:47.972892  8691 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:47.976531  8495 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:47.996505  4121 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:47.997298  8804 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:47.998322  8773 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.003124  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.006834  8633 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:48.007817  8741 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:48.008071  8360 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:48.009370  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.009805  8360 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:48.010267  8586 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.012976  4115 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:17:47.989347  8809 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.015640  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.017083  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.018785  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:48.014830  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.026384  3969 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [13.6-13.6]
I20260709 13:17:48.029757  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.030607  3969 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
W20260709 13:17:48.033901  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57865.1us
I20260709 13:17:47.989284  8803 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.034847  4043 raft_consensus.cc:2368] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:47.993963  8686 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:48.008574  8802 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
I20260709 13:17:48.037213  4120 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:17:47.960353  8751 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.046053  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:48.047444  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.038388  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:48.043691  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.045761  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:48.041992  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.010243  8360 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.070802  4116 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:48.071593  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.072609  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.073273  3965 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:48.070426  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.076704  4039 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:48.089095  8495 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:48.001909  8804 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:48.057147  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:48.090772  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:48.091339  4047 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.022811  8691 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:48.038570  7936 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:47.981542  8784 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:48.035918  8741 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:48.039335  8623 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.036530  8809 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.042778  8782 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:48.043054  8803 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:17:48.113041  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55960.3us
I20260709 13:17:48.121402  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.113960  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:48.125342  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.094550  8810 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:48.129783  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.130312  3965 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:17:48.093832  8804 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.123716  8741 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:48.127030  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.139369  4120 raft_consensus.cc:606] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:48.138285  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 103761us
W20260709 13:17:48.140281  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80879.2us
I20260709 13:17:48.072324  8756 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.143189  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.102062  8757 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:48.144085  3963 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:48.124969  7910 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:48.148088  4012 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:48.126847  8623 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.145399  8810 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.171277  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.177423  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.099290  8650 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.178627  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.179246  3965 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.179801  8650 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.137549  8771 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:48.180426  8757 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:48.181010  8757 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:48.181882  8757 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.182842  8808 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:48.183446  8808 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.186185  4038 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:48.187711  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:48.142797  8433 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:17:48.192169  8813 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:17:48.192060  8623 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:48.193043  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:48.193293  8810 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:48.193569  8650 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:48.192066  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.215240  8750 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:48.197193  8807 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.356s	user 0.007s	sys 0.000s
I20260709 13:17:48.216123  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.216748  3967 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:48.197719  8795 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.198637  8756 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.125989  8691 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:17:48.143688  8782 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:48.173642  7910 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.220265  8782 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.221025  7910 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.216032  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.213061  4047 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:17:48.192004  8788 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:17:48.172597  8633 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:48.257513  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.190810  8495 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:17:48.268059  4038 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:48.199781  8433 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:48.260787  8822 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:17:48.258265  8825 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:48.278563  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54790.1us
I20260709 13:17:48.281183  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:48.180543  8771 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.342649  4112 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:17:48.295668  3965 raft_consensus.cc:2410] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:17:48.227758  8650 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:48.342551  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46154.5us
I20260709 13:17:48.370699  4112 raft_consensus.cc:614] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:48.370817  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.371073  3963 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:17:48.367570  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 329218us
I20260709 13:17:48.372695  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.373355  3968 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.277061  8756 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:48.279085  8810 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:48.378696  3970 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:48.387774  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:48.390118  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.391470  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:48.394690  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:48.395720  4120 raft_consensus.cc:2410] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:17:48.402598  4112 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:48.372208  8623 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:48.403879  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:48.343532  8742 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.408392  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:48.412626  4119 raft_consensus.cc:2368] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
I20260709 13:17:48.409447  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:48.411895  4114 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:48.279551  8633 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.410606  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:48.418219  4121 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:48.411530  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:48.409968  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 193988us
I20260709 13:17:48.419135  4118 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.297263  8825 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:48.421949  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:48.427959  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.404369  8756 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:48.426035  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:48.411056  8623 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:48.426848  8736 consensus_meta.cc:287] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.004s
W20260709 13:17:48.421504  8441 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.571s	user 0.008s	sys 0.011s
I20260709 13:17:48.454109  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.456633  4118 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:48.420907  8355 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:48.468116  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.483439  3967 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:48.477169  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:48.468384  8609 consensus_meta.cc:287] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.703s	user 0.009s	sys 0.010s
I20260709 13:17:48.458685  8798 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:48.488288  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103909us
I20260709 13:17:48.457190  8751 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:48.417443  8433 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.475931  8782 raft_consensus.cc:2764] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:48.493757  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:48.487001  8800 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.003s
I20260709 13:17:48.487085  8356 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.505878  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:48.523938  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 104594us
I20260709 13:17:48.493556  8355 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:48.526847  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 62733.5us
I20260709 13:17:48.527909  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:48.481488  8650 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:48.529872  8831 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:17:48.532259  8843 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:48.532892  8843 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:48.533265  7910 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.533834  8843 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.529081  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.535624  7910 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:48.543677  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89608.4us
I20260709 13:17:48.546710  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:48.578872  8650 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.580053  8650 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:48.580492  8650 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:48.580958  8650 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:48.610738  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64148.7us
I20260709 13:17:48.614957  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:48.632040  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 94718.8us
I20260709 13:17:48.634317  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.589227  8756 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.524670  8835 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.504698  8800 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.667490  4113 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:48.667865  8800 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:48.505362  8623 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.503221  8686 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.669010  8623 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:48.644151  8824 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 13:17:48.670126  8686 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:48.646667  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.654852  8650 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.672106  8842 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:48.672835  8650 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.646553  8633 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:48.641077  8828 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:17:48.630504  8771 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:48.663475  8804 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.657579  8741 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.669030  8757 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:48.678227  8841 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:17:48.678586  8757 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.679654  8741 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.657514  8587 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:48.638511  8798 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:48.643539  8826 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:48.630985  8356 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:48.682230  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.685015  4042 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:48.643321  8806 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.749s	user 0.000s	sys 0.010s
I20260709 13:17:48.685736  8833 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:17:48.686571  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.687948  8782 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:48.689368  8782 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:48.690177  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2703) took 1073 ms. Trace:
I20260709 13:17:48.681643  8804 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.689687  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.691545  4118 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:17:48.657475  8837 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:17:48.693082  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.693576  8842 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:48.682231  8587 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.640250  8579 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:17:48.696971  8757 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:48.697381  8356 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:48.675853  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.700012  8771 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:17:48.700650  8771 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:48.696323  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:48.690578  4117 rpcz_store.cc:276] 0709 13:17:47.616605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.670486 (+ 53881us) service_pool.cc:224] Handling call
0709 13:17:47.713042 (+ 42556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:47.739073 (+ 26031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:47.739103 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:47.753265 (+ 14162us) log.cc:844] Serialized 26 byte log entry
0709 13:17:47.829668 (+ 76403us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:47.829706 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:47.829774 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:48.635525 (+805751us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:48.689841 (+ 54316us) raft_consensus.cc:1685] finished
0709 13:17:48.689867 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:48.690098 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69095,"raft.queue_time_us":52134,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4287,"spinlock_wait_cycles":4493184,"thread_start_us":70258,"threads_started":1,"wal-append.queue_time_us":125728}
I20260709 13:17:48.636174  8751 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:17:48.681496  7936 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.560s	user 0.017s	sys 0.000s
I20260709 13:17:48.697476  8579 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:48.708607  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:48.704479  3968 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:17:48.660431  8360 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.001s
I20260709 13:17:48.705818  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:48.708720  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 179712us
I20260709 13:17:48.707386  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:48.712090  4112 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:48.710186  4119 raft_consensus.cc:2376] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13. Re-sending same reply.
I20260709 13:17:48.700547  8587 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.697674  8355 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:48.720994  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.721743  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.689772  8782 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:48.686911  8833 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:17:48.702620  8841 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:48.698516  8356 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:48.726270  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.705678  8757 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:48.729355  8841 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:48.737331  8841 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:48.710800  7936 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:48.715431  8360 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.742481  8360 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:48.739912  4115 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:48.709693  8579 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:48.729648  3963 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:48.729691  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.729436  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.748580  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.748068  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:17:48.755069  3965 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.755268  4115 raft_consensus.cc:606] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.755879  4115 raft_consensus.cc:614] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:17:48.705300  8798 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:48.764662  3968 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:17:48.727860  8809 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
I20260709 13:17:48.726234  8800 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:48.773325  3965 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:48.728204  8782 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:48.728718  8833 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:17:48.766119  8829 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.064s	user 0.003s	sys 0.000s
I20260709 13:17:48.777594  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:48.767756  8803 consensus_meta.cc:287] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.622s	user 0.010s	sys 0.000s
I20260709 13:17:48.783865  8773 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:48.786074  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2698) took 1183 ms. Trace:
I20260709 13:17:48.812951  4116 rpcz_store.cc:276] 0709 13:17:47.602118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.655989 (+ 53871us) service_pool.cc:224] Handling call
0709 13:17:47.691267 (+ 35278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.090346 (+399079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:48.785744 (+695398us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54002abcd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:48.785956 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872304000}
W20260709 13:17:48.805343  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.817107  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:48.806437  3970 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:48.800431  8356 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.809660  8433 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:17:48.823276  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45779.5us
I20260709 13:17:48.824940  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:48.825878  4038 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:48.827169  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.833346  4045 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:48.828943  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:48.835227  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:48.837363  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:48.781021  8826 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.781164  8800 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:48.832598  8845 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:17:48.836462  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:17:48.825599  8741 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:48.841768  4040 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:48.842396  4046 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:48.843804  8826 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.824265  8633 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:48.854087  8586 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:48.854485  8586 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:48.855229  8586 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.774937  8809 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.856740  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:17:48.857606  8809 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:48.858911  8800 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.846309  7910 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:48.862260  7910 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:48.863106  7910 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.864127  8795 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:48.866250  4038 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:48.867491  8356 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:48.867967  8703 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:48.870661  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.873853  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:48.875643  8686 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:48.831043  8833 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.877106  8686 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:48.877990  8686 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:48.878316  8686 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:48.872416  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:48.879709  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 186783us
I20260709 13:17:48.839108  8650 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:48.835554  8610 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:48.899453  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:48.900144  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:48.904284  4038 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:48.920492  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.845299  8360 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:48.851259  8691 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:48.927042  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.824331  8803 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.868510  8703 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.930938  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:48.936849  4046 raft_consensus.cc:2410] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:17:48.934715  4047 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:48.891597  8810 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:48.962679  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:48.958912  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3090) took 1286 ms. Trace:
I20260709 13:17:48.963656  4043 rpcz_store.cc:276] 0709 13:17:47.672076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.672818 (+   742us) service_pool.cc:224] Handling call
0709 13:17:48.958707 (+1285889us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540035d4d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:48.958855 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698224512}
I20260709 13:17:48.920050  8795 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:48.965919  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.966789  3965 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:48.969851  4041 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:48.882376  8741 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.974154  4086 leader_election.cc:400] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:48.974512  4086 leader_election.cc:403] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:17:48.976003  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:48.976127  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.924142  8650 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:48.977309  4047 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:48.938699  8360 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:48.997390  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.024693  4046 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:48.879554  8579 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:48.957296  8784 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56100 (request call id 0) took 2361 ms. Trace:
I20260709 13:17:48.941045  8855 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:49.019449  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:48.879149  8686 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:48.976163  8795 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:49.038837  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 62919.5us
I20260709 13:17:49.040001  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.012806  8800 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13.
I20260709 13:17:48.939898  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.012437  8798 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:48.977975  8695 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:17:48.965719  8841 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.024176  8691 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.054625  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.055343  3965 raft_consensus.cc:2368] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
I20260709 13:17:49.035414  8855 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:49.039597  8749 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:17:49.047653  8843 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.095422  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.029738  8587 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:17:49.059625  8855 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.102128  8800 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.121198  8800 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.102936  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.103350  4676 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:17:49.122165  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.029701  8784 rpcz_store.cc:276] 0709 13:17:46.563953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:46.564121 (+   168us) service_pool.cc:224] Handling call
0709 13:17:46.705835 (+141714us) log.cc:844] Serialized 501 byte log entry
0709 13:17:47.087545 (+381710us) spinlock_profiling.cc:243] Waited 2.03 ms on lock 0x7b18004266a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:47.418975 (+331430us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b54007aaba0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c1dbe 00007fed763cc930 00007fed763cc8d8 00007fed763cc858 00007fed763cc813 00007fed763cba9c 00007fed7c2b7626 00007fed7c2b1dd8 00007fed764087cb 00007fed7640b2c0
0709 13:17:48.925394 (+1506419us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20004,"raft.queue_time_us":229618,"raft.run_cpu_time_us":1781,"raft.run_wall_time_us":99510,"spinlock_wait_cycles":102125696,"thread_start_us":282429,"threads_started":2,"wal-append.queue_time_us":259036,"wal-append.run_cpu_time_us":5780,"wal-append.run_wall_time_us":1452363}
I20260709 13:17:49.122916  4043 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:49.123878  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:49.125087  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:49.125952  8795 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.126515  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.128186  8800 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.109318  8756 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.125626  4044 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.121690  4041 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:17:49.103591  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:49.136904  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.105120  8826 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.105360  8841 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.100543  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.049994  8842 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.058425  8686 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.109148  8843 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.110663  8808 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:49.112258  8840 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.481s	user 0.001s	sys 0.000s
I20260709 13:17:49.113884  8703 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.114324  8520 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.115530  8691 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.095315  8749 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:49.120417  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.129019  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.188608  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.140163  3963 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:49.104529  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.190593  8830 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:49.190865  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 86396.9us
I20260709 13:17:49.191129  8844 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:49.158708  8579 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.108886  4012 leader_election.cc:400] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
I20260709 13:17:49.147262  3966 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:49.148857  4118 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.198329  4012 leader_election.cc:403] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:49.150032  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.150398  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.152326  4112 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.155790  8784 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:49.156143  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:49.148999  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.160109  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.180694  7910 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.205693  7910 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.107676  8633 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.182596  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.182574  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.182528  8803 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.143755  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:49.211689  4043 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:49.192212  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.212971  4043 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:17:49.213116  3972 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.213346  4043 pending_rounds.cc:85] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:17:49.213678  4043 pending_rounds.cc:107] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:17:49.188644  3965 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:49.192400  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.193202  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.193570  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.194209  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.191609  3970 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:17:49.201548  4112 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.053292  8810 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.203452  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.048497  8798 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.209146  4119 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:49.219198  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 81523.9us
W20260709 13:17:49.221293  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.213914  4043 raft_consensus.cc:2889] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.182950  8800 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:49.191874  8749 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:17:49.224491  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 115765us
I20260709 13:17:49.225085  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:49.194823  8842 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.229701  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.228652  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.231184  4039 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
W20260709 13:17:49.237335  8864 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:17:49.222522  8633 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.228783  8800 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.241906  8756 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.246766  4044 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:49.248147  8433 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.188798  8825 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.258360  4119 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:49.261234  4044 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.259611  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.267515  4041 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:49.267849  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:49.274088  8859 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:17:49.275390  7910 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:49.278455  8623 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.000s
W20260709 13:17:49.279449  8854 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:17:49.182824  8650 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.229545  8586 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:49.284837  8782 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.261122  8633 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.270951  3972 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:49.191617  8844 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.228953  8826 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
I20260709 13:17:49.286975  8855 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:49.269208  8851 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:17:49.230109  8847 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:17:49.204002  8830 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.268152  8495 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:49.186374  8360 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.290930  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:49.293529  4011 leader_election.cc:400] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15.
W20260709 13:17:49.293922  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63669.3us
I20260709 13:17:49.274231  8861 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.314993  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.265645  8756 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:49.270164  8825 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.270665  8741 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.310149  3966 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:49.295819  8803 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:49.295677  8703 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.318711  3969 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.318234  3857 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 237eb348003645f7abcc1c18bd324690 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:17:49.308638  7936 raft_consensus.cc:993] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
W20260709 13:17:49.322495  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 128979us
I20260709 13:17:49.326443  8855 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.327139  7936 raft_consensus.cc:1081] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:17:49.315246  8861 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.328455  8861 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.322577  8803 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:49.329233  8803 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.336452  8844 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.337395  8798 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:49.347709  8852 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.297s	user 0.002s	sys 0.000s
I20260709 13:17:49.348990  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.350651  8855 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.353104  8826 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.314637  8633 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:49.353566  8830 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.354038  8633 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.354255  8855 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.354764  8855 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.354950  8633 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.356942  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.356629  8855 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.358779  8873 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:49.360157  3937 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:49.322906  8756 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.367403  8759 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.373780  8759 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.363453  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.376607  8782 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.377341  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.377892  8756 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.378964  3968 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:17:49.381786  3967 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:17:49.342352  8803 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.362277  8742 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.353931  8861 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.373898  8826 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:49.354674  8830 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:17:49.386996  8742 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:49.408134  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48097.9us
I20260709 13:17:49.410342  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.391196  8826 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.412269  8742 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:49.458051  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 143146us
W20260709 13:17:49.457540  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 139415us
W20260709 13:17:49.460165  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49898.3us
I20260709 13:17:49.461025  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.463439  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.453039  8756 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:49.472121  4120 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:17:49.474136  4040 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:17:49.474773  4040 pending_rounds.cc:85] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 12
I20260709 13:17:49.475018  4040 pending_rounds.cc:107] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:17:49.475244  4040 raft_consensus.cc:2889] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.484594  4121 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:17:49.486215  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.486720  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.486836  4119 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.488247  4087 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.465399  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.492252  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.492821  8879 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.492967  4041 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:17:49.493609  4114 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:17:49.493927  8826 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.495875  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.498414  8878 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:49.498416  8795 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:49.500962  8808 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:49.473961  8782 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.505477  4116 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:49.506191  4119 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:49.515242  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3101) took 1478 ms. Trace:
I20260709 13:17:49.515532  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.509738  8879 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.518690  8861 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.509953  8855 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:49.515717  4042 rpcz_store.cc:276] 0709 13:17:48.036832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.036944 (+   112us) service_pool.cc:224] Handling call
0709 13:17:48.071121 (+ 34177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:48.685515 (+614394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.515009 (+829494us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400029ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:49.515181 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411277184}
I20260709 13:17:49.519555  8855 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:49.520037  8855 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.501679  8803 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.504487  8843 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.508826  8703 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:49.522907  8873 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:49.529145  8847 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.529707  8847 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.531958  8847 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.541985  8865 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:49.542447  8865 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.545519  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:49.546473  8863 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:17:49.550791  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.553112  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.543989  8865 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.557577  4011 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.559201  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:49.559638  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.559787  4115 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:49.560326  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.562140  4112 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:49.562376  4119 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.565305  8861 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:49.565851  8861 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.566690  8861 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.570962  8360 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.571766  8360 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.574507  8360 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.576059  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.511174  8579 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:49.578611  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:49.578723  4119 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:49.581910  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.582468  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.583057  3967 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:49.584335  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.585266  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.527680  8826 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:49.577117  8858 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:49.588915  3969 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:49.590404  3964 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:49.594907  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.595497  3970 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:49.578435  8823 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:17:49.596447  8823 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:49.590566  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.588685  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.577495  8650 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:49.592587  8686 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:49.588429  8825 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:17:49.577806  8803 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:49.599340  8749 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.600947  3968 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 7. Current term is 8. Ops: []
I20260709 13:17:49.577612  8843 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:49.601258  8686 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:49.601696  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:49.601872  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44613.8us
I20260709 13:17:49.602907  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.604054  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.604992  8782 raft_consensus.cc:2764] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:49.597388  8823 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.614986  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.598027  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.616140  3966 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:49.617130  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.605679  8782 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:49.620882  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.618809  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.611600  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:49.606758  8876 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:17:49.614673  8686 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:17:49.628130  8843 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:49.628347  8759 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.614506  8520 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:49.618571  8753 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:17:49.631265  8843 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.632112  8843 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.633221  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:49.634819  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.626550  8800 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.637709  8800 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:49.638334  8833 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.639294  8753 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:49.639675  8753 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:49.622941  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:49.640496  8753 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:49.624395  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.641682  8753 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.625551  3964 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.625093  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.638592  8520 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:49.631142  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.650906  3965 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
W20260709 13:17:49.650125  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71613.4us
I20260709 13:17:49.611703  4648 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:49.671998  8356 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:49.673264  8870 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:49.673653  8870 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.673972  8870 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:49.674086  4046 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:49.675311  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.650215  8823 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:17:49.679751  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.638221  8800 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:49.656509  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.633245  8843 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:49.664932  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.668102  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.671335  8798 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.663278  8873 raft_consensus.cc:2764] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:17:49.655525  8865 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.657321  8803 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:49.716710  8803 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.717128  8803 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.717370  3965 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 14 index: 6. (index mismatch)
I20260709 13:17:49.718230  8686 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:49.718948  8844 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:49.722378  8795 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:17:49.668176  8847 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.733096  8847 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.735057  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.735386  8847 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.735738  4046 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:49.736423  8356 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:49.736202  8520 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.736855  8356 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.737212  8356 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:49.679016  8650 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:49.739383  8650 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.679069  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:49.741340  8650 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.710141  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:49.745563  7936 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.746089  7936 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.748481  8879 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.748436  7936 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:49.688555  4043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:17:49.757580  4043 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:17:49.757967  4043 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:17:49.756561  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:49.762431  8749 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:49.765029  8879 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:49.767045  8879 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:49.761269  8800 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.769670  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:49.771206  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:49.696969  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71969.9us
I20260709 13:17:49.654289  8804 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:49.654716  8623 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:49.617034  8703 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:17:49.703820  3963 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:17:49.707635  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 96003.2us
I20260709 13:17:49.653889  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:49.710682  4086 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:17:49.783244  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72648.2us
I20260709 13:17:49.783620  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.712011  4041 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:49.774317  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.776093  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:49.776350  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.777055  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.786633  4119 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:49.778702  4040 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:49.779803  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.779908  8804 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.780493  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.780721  8623 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.793889  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.781265  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.781503  4039 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:17:49.788414  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:49.791126  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 137306us
I20260709 13:17:49.791589  4044 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:49.796025  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.795680  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:49.796842  4120 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:49.804800  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.806135  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.810755  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.812686  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.816375  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.817847  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.818473  3965 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:49.819187  4041 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:49.821105  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.825901  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:49.826161  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:49.828503  3966 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:49.827715  3970 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:17:49.829319  3970 pending_rounds.cc:85] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
W20260709 13:17:49.829135  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 56447.6us
I20260709 13:17:49.829934  3970 pending_rounds.cc:107] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:17:49.830657  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.830852  3970 raft_consensus.cc:2889] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:49.834461  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:49.834666  4042 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:49.799748  8879 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.804298  8686 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:49.846769  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.850767  4116 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:49.848086  4113 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:49.848692  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.805678  8756 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:49.864230  4113 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:49.827286  8703 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:49.857739  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.873665  4115 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:49.875612  4043 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.831079  8736 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:49.820329  8623 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.887166  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:49.888375  4112 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:49.841131  8825 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:49.831424  8844 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:49.879410  4040 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:17:49.906512  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:49.816859  7936 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:17:49.804170  8759 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:17:49.908960  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.916859  4040 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:49.847344  8879 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:49.824571  8753 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:49.911438  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.948756  4046 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:17:49.847122  8691 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:49.913194  3963 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:49.916082  4114 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:49.911448  4043 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.860499  8858 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:49.843029  8855 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.915576  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:49.858332  8810 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:49.945962  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.954706  4040 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:49.955017  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:49.835023  8780 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:17:49.883996  8736 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.951530  4121 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:17:49.961148  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:49.962463  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 134467us
I20260709 13:17:49.968991  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:49.911852  8844 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:49.847826  8763 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
W20260709 13:17:49.971827  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 136741us
I20260709 13:17:49.915547  8703 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.948186  8879 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.982834  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:49.983960  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:49.985320  3969 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:49.950539  8825 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.967934  8736 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:49.954844  8842 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:49.999286  4114 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:49.972640  8844 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:49.937143  8870 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:49.973417  8858 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:49.951916  8742 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:49.955706  8355 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.043s
W20260709 13:17:50.023295  8887 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:17:50.026243  8355 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.026751  8355 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.027067  8355 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.003504  8800 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:49.968379  8810 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.030575  8810 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.007649  8610 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.038112  8804 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:49.999980  8835 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.039012  8835 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.041294  8835 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.098582  4117 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:50.106839  8520 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.107371  8520 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:50.111547  8495 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:50.112001  8495 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:50.112857  8495 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.118544  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.108208  8520 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.128489  8520 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:50.136746  8650 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.138038  8650 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.141295  8650 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.149681  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.150823  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.151381  4114 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:50.152311  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:50.154788  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 472523us
I20260709 13:17:50.155231  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.156049  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:50.158363  4114 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:50.159227  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.160166  4112 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:50.156378  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:50.167014  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:50.168576  8586 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:50.169015  8586 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.169332  8586 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:50.171756  4044 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:50.168445  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.173714  4041 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:17:50.174935  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.175252  8633 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:50.177121  4042 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:17:50.178085  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.178771  4047 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:50.180297  8495 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:50.181181  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.183521  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:50.184792  8623 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:50.184921  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:50.186586  8624 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:50.187384  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.188184  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:50.189072  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.190203  4042 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 8: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:50.188258  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:50.196712  4038 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:50.200945  8624 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.201169  8623 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.051735  8795 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.226580  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:50.231606  8855 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.235494  8825 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:50.245903  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55956.7us
I20260709 13:17:50.042599  8842 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:50.301573  3968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.025s
W20260709 13:17:50.302691  3968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.000s	sys 0.025s
I20260709 13:17:50.239909  8795 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.238534  4679 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:50.308729  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:50.201352  8586 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.287413  7936 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:50.287899  8803 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.570s	user 0.010s	sys 0.000s
I20260709 13:17:50.299830  8798 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.332283  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:50.333329  4039 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:50.220239  8623 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.320259  8795 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.214481  8703 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.320557  8749 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:50.321964  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 338052us
I20260709 13:17:50.221132  8624 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:50.373576  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 390800us
I20260709 13:17:50.377739  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:50.381086  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:50.376940  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.324312  8650 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:17:50.378882  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.391405  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.395929  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.398658  3969 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:50.399134  3971 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:50.399561  3971 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:50.338879  8803 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:50.401171  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.371404  8686 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:50.402089  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:50.381763  8810 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:17:50.339618  7936 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.410411  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:50.340715  8798 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.369268  8855 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:17:50.393277  8873 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:50.368728  8830 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:17:50.390219  8841 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:50.399936  8356 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.662s	user 0.012s	sys 0.000s
I20260709 13:17:50.411051  3963 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.372989  8749 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.422115  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.426365  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:50.430022  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:50.421151  3971 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.334033  8858 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.395479  8759 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:17:50.433848  3971 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:50.414204  8808 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:50.432097  8878 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.444562  8878 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.445968  8798 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:50.446514  8798 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:50.446720  8878 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.447108  8798 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:50.449115  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:50.454438  8900 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:17:50.439616  8897 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.455873  8897 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:50.456269  8897 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.461050  8586 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.467995  3971 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:17:50.468474  3971 pending_rounds.cc:85] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 7
I20260709 13:17:50.469537  3971 pending_rounds.cc:107] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:17:50.441488  3963 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:50.425454  8873 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:50.408035  8756 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:17:50.469787  3971 raft_consensus.cc:2889] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:50.414047  8610 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:17:50.434154  8742 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:50.425625  8753 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:17:50.508113  3971 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:17:50.508713  3965 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:50.507365  3966 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:50.502282  8433 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:50.442535  8841 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:50.510845  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 106223us
I20260709 13:17:50.525295  3963 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:17:50.506642  8894 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:17:50.543382  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:50.546357  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:50.439829  8782 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:17:50.507568  8873 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.547343  8848 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:17:50.557643  8902 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:17:50.550203  8756 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:17:50.509037  7936 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:50.432548  8356 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.507340  8686 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.472244  8360 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:17:50.618501  8803 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:50.614519  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:50.593143  8847 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:50.614353  8749 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:50.585348  7936 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.724295  7936 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.726593  7936 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:50.584671  8624 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:50.595002  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 179844us
I20260709 13:17:50.615955  8841 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.729583  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.730237  3969 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:50.723858  8847 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:50.583457  8736 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.571s	user 0.006s	sys 0.003s
I20260709 13:17:50.731699  8736 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.731920  8847 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.634054  8691 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:50.613134  8870 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:50.617158  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:50.586892  8897 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:50.670984  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:50.750782  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:17:50.723023  8800 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
W20260709 13:17:50.694643  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 148350us
I20260709 13:17:50.756326  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:50.527814  8909 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:50.620141  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.611665  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:50.653952  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 224005us
I20260709 13:17:50.756927  8903 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:50.764183  8903 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:50.696372  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46330.7us
W20260709 13:17:50.748373  8495 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.558s	user 0.009s	sys 0.000s
I20260709 13:17:50.697482  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.701798  4118 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:50.472368  8808 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.700630  8923 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:50.687242  8520 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.001s
W20260709 13:17:50.707194  8916 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260709 13:17:50.620237  8623 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:50.716204  8879 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.714s	user 0.002s	sys 0.005s
I20260709 13:17:50.722610  4113 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:50.575112  8898 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:17:50.729355  8921 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:50.798141  4044 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11. Ops: []
W20260709 13:17:50.695654  8355 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.668s	user 0.004s	sys 0.008s
I20260709 13:17:50.768283  8800 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:50.739571  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:50.737041  3963 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:17:50.698753  8844 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:17:50.750131  4112 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:50.637786  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:50.698444  8843 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.758390  4121 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.758396  4119 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:50.792362  8855 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:50.675913  8873 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.770290  8356 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:50.771275  8897 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:50.772640  8803 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:50.764549  8903 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.777465  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:50.721884  8842 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:50.781198  4043 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:50.751931  7936 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:50.748191  8691 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:50.796849  4117 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:50.796868  8782 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:17:50.738266  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:50.782313  8825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.015s	sys 0.012s
I20260709 13:17:50.853503  3969 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
W20260709 13:17:50.853521  8825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.015s	sys 0.012s
I20260709 13:17:50.853157  7936 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.826134  3970 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:50.799540  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.857162  7936 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:50.861079  4041 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:50.861527  4117 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
W20260709 13:17:50.862599  8920 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:17:50.863570  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3138) took 1015 ms. Trace:
I20260709 13:17:50.863889  4040 rpcz_store.cc:276] 0709 13:17:49.847814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.956218 (+108404us) service_pool.cc:224] Handling call
0709 13:17:49.956480 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.287693 (+331213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:50.287728 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:50.288284 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:17:50.471509 (+183225us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:17:50.471545 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:50.471621 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.863335 (+391714us) raft_consensus.cc:1685] finished
0709 13:17:50.863359 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.863486 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5205,"raft.queue_time_us":11424,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6880,"thread_start_us":459843,"threads_started":2,"wal-append.queue_time_us":434760}
I20260709 13:17:50.865690  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3057) took 1091 ms. Trace:
I20260709 13:17:50.766389  8909 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:50.760587  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:50.838833  4119 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:17:50.867744  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:50.827070  8703 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:50.798763  8433 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:50.799026  8921 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:50.871609  3970 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:50.796427  8795 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:50.876748  4121 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:50.866021  3964 rpcz_store.cc:276] 0709 13:17:49.773810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.774052 (+   242us) service_pool.cc:224] Handling call
0709 13:17:49.774385 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:49.774727 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:49.774753 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:49.789654 (+ 14901us) log.cc:844] Serialized 26 byte log entry
0709 13:17:49.974157 (+184503us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:49.975213 (+  1056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:49.975440 (+   227us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:50.865482 (+890042us) raft_consensus.cc:1685] finished
0709 13:17:50.865513 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:50.865635 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7483,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":14269,"thread_start_us":106392,"threads_started":1,"wal-append.queue_time_us":404650}
I20260709 13:17:50.882161  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:50.898351  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.030735  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 270212us
I20260709 13:17:51.029464  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.033108  4680 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:50.829203  8844 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.035851  4121 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:51.036801  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.037614  4675 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 13:17:51.030073  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 155077us
I20260709 13:17:51.039417  4648 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:50.881459  8703 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.835850  8355 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.838773  8843 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:50.881860  8433 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:50.799564  8879 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.059752  4119 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:51.045181  4114 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:51.046062  8356 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.046485  7936 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.062705  7936 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.037451  8650 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:51.043541  8623 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.037281  8886 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:17:51.062317  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:51.106405  4113 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:17:51.108067  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:50.849934  8803 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:51.111178  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 48956.2us
I20260709 13:17:51.111356  4115 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:51.110864  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71542.3us
I20260709 13:17:51.028973  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.146312  4047 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:17:51.129666  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.147146  4042 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:51.148006  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.148536  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:51.138092  4039 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:51.110266  8922 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.049903  8736 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.145658  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:51.044788  8355 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.044627  8703 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.153649  4677 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
W20260709 13:17:51.115864  8861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.334s	user 0.014s	sys 0.005s
I20260709 13:17:51.157069  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:50.884042  8804 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.228s
I20260709 13:17:51.055495  8928 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:51.056093  8911 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.160992  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:51.174086  4113 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:51.104718  8633 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:51.102851  8520 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.251005  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.315879  4042 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:51.145102  8906 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:51.145236  8579 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:51.144876  8897 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.325454  7936 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.327605  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:51.179988  8861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.014s	sys 0.005s
I20260709 13:17:51.107033  8356 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.349587  7936 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.228672  8736 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:51.354267  7936 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.276170  8928 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:51.107414  8623 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.341320  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:51.338091  8906 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:51.347117  8932 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:17:51.366602  4042 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.274207  8703 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:17:51.158237  8921 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.173317  8922 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.352173  8579 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 10 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:51.392967  7936 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.394421  7936 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:51.336796  8633 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.340998  8520 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.407176  4042 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:51.371465  8901 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:51.323004  8911 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.372246  8906 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.396270  7936 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.379272  8861 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:51.347071  8897 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.144546  8909 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.412506  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.366707  8928 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:51.398289  8873 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.368032  8736 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.424342  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:51.414618  8929 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.568s	user 0.001s	sys 0.000s
I20260709 13:17:51.427834  4042 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
W20260709 13:17:51.433797  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 385330us
I20260709 13:17:51.434305  4042 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:51.416682  8808 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.435580  4042 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:51.440167  4042 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:17:51.433022  4038 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:51.450999  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:51.454787  4112 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.627s	user 0.009s	sys 0.000s
I20260709 13:17:51.455173  4112 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:51.439286  8921 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.457979  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:51.454025  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.460713  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:51.441309  8795 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.427843  8861 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.468212  8763 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:17:51.477548  8623 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.486840  8911 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.452805  8844 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.479383  8736 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.453694  8843 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.479701  8803 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.454687  8650 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:51.488747  8650 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.480672  8897 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.449990  8909 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.420523  8901 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.479260  8922 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:51.471000  8826 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.006s	sys 0.014s
W20260709 13:17:51.521194  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57999.8us
I20260709 13:17:51.528111  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.477696  8879 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:51.518450  8826 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.006s	sys 0.014s
I20260709 13:17:51.468457  8870 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:17:51.534317  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 392507us
I20260709 13:17:51.511469  8808 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:17:51.540275  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.515265  8844 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.452385  8579 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.521194  8623 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:17:51.517375  8941 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:51.531924  8843 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.545951  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.547497  8355 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:51.548151  8922 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.547748  8753 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:51.548630  8922 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.549458  8753 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:51.549729  8736 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.550246  8736 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.550472  8753 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:51.554829  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 94198.8us
I20260709 13:17:51.555577  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:51.544580  8795 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:51.562628  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:51.565562  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.545531  8356 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.544004  8938 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:51.575387  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:51.577092  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:51.578016  3968 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:51.586213  4047 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.586845  3968 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:51.589128  8834 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:51.589779  8922 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.589152  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 367) took 1351 ms. Trace:
I20260709 13:17:51.591532  4677 rpcz_store.cc:276] 0709 13:17:50.228656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.232830 (+  4174us) service_pool.cc:224] Handling call
0709 13:17:50.233172 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.179036 (+945864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.579640 (+400604us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54009fe2d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:51.579815 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116438784}
I20260709 13:17:51.560927  8520 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:51.562120  8927 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:17:51.544881  8808 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.596894  8355 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:51.601100  8953 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:17:51.600883  8934 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:17:51.600879  8355 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:51.602053  8933 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:17:51.602545  8433 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.565250  8795 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.606401  8355 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.608929  8942 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.562453  8623 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:51.610814  8861 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.545249  8941 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.613334  8949 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:17:51.543987  8844 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:51.604331  8952 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:17:51.618924  3968 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.589742  8834 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.616602  8901 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:51.640515  8936 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:17:51.642356  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:51.647600  8847 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.647980  8433 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.630473  8795 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.654778  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.631201  8633 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.656396  3968 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:51.617200  8938 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.669533  4047 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:51.672216  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.673843  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.673972  8938 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.675129  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.675833  4039 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:51.678064  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.679320  8949 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.680938  8623 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.681880  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.682022  8844 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.683349  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.684015  4121 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:51.676541  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:51.686529  4039 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:51.687577  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.688153  4047 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:51.691344  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:51.691733  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.634506  8942 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.694574  8808 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.693038  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.694802  8941 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.696913  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.697813  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.698065  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.698653  4045 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:51.699445  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.699822  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.699966  4045 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:51.700372  4121 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:51.701212  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.703799  4121 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:17:51.704955  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:51.706073  4045 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.710379  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.712018  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.712643  3968 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:51.713203  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3069) took 1342 ms. Trace:
I20260709 13:17:51.714882  8906 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.717056  8906 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.718575  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2741) took 1868 ms. Trace:
I20260709 13:17:51.718938  4115 rpcz_store.cc:276] 0709 13:17:49.850236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.875598 (+ 25362us) service_pool.cc:224] Handling call
0709 13:17:49.875883 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.139694 (+1263811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.718354 (+578660us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400096354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:51.718515 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2840851712}
W20260709 13:17:51.719962  8903 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.846s	user 0.005s	sys 0.004s
I20260709 13:17:51.713464  3968 rpcz_store.cc:276] 0709 13:17:50.370658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.371124 (+   466us) service_pool.cc:224] Handling call
0709 13:17:50.373668 (+  2544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.577900 (+1204232us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003d11a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c3dc0 00007fed7644e1c0 00007fed7644f231 00007fed7644bd8f 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c
0709 13:17:51.712976 (+135076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.713152 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385186048}
I20260709 13:17:51.720182  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:51.703759  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.703532  8753 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:51.725872  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:51.720825  8915 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.157s	user 0.029s	sys 0.050s
I20260709 13:17:51.734323  4045 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:51.735016  4039 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:51.711182  8912 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:51.737439  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:51.732448  8841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.011s	sys 0.030s
I20260709 13:17:51.730543  8844 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:51.732327  8847 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:51.720376  8903 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.743218  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.737159  8912 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:51.753830  8912 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.756067  8903 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.739799  8844 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.757086  4116 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:51.759150  8942 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:51.738551  8841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.007s	user 0.011s	sys 0.030s
I20260709 13:17:51.740639  8847 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:51.777294  8691 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.778569  8691 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:51.779254  8912 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.777969  8847 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.785928  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2578) took 1613 ms. Trace:
I20260709 13:17:51.786315  4044 rpcz_store.cc:276] 0709 13:17:50.172826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.176152 (+  3326us) service_pool.cc:224] Handling call
0709 13:17:50.176396 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.798572 (+622176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.785677 (+987105us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b540041d054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:51.785867 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1429349248}
I20260709 13:17:51.786947  8912 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:51.770228  8919 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.002s	user 0.008s	sys 0.010s
I20260709 13:17:51.757153  8844 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:51.771606  8928 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.796851  8847 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:51.805795  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 1.02831e+06us
I20260709 13:17:51.777052  8949 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:51.766214  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:51.772390  8795 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.801386  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3078) took 1063 ms. Trace:
I20260709 13:17:51.801921  8928 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.802183  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 697) took 1022 ms. Trace:
W20260709 13:17:51.803011  8907 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 1.247s	user 0.000s	sys 0.013s
I20260709 13:17:51.817898  4112 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:51.804345  8855 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:51.805094  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.807168  4121 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:51.807262  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.813150  3966 rpcz_store.cc:276] 0709 13:17:50.737683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.771927 (+ 34244us) service_pool.cc:224] Handling call
0709 13:17:50.772230 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.772431 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:50.798810 (+ 26379us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.801038 (+1002228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.801095 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:51.801145 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.801209 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.801326 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1010858,"prepare.queue_time_us":26947,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":1003565,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80}
I20260709 13:17:51.815752  3967 rpcz_store.cc:276] 0709 13:17:50.779463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.830252 (+ 50789us) service_pool.cc:224] Handling call
0709 13:17:50.837936 (+  7684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.838132 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:17:50.838356 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.801871 (+963515us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:51.801925 (+    54us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:17:51.801969 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.802033 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.802131 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":963249,"prepare.queue_time_us":3027,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":964251,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46}
I20260709 13:17:51.813200  8912 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:51.822937  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:51.847131  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.844085  8844 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.851039  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.851733  8844 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.852051  8782 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.853353  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:51.849983  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.854710  8782 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:51.855187  8795 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.857648  8842 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.823896  8923 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:51.858335  8842 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.859083  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:51.859651  3968 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:17:51.860338  8842 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.862995  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.863883  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:51.860265  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.865492  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:51.844653  8756 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:51.866346  3970 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:17:51.869072  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.864517  3964 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:51.868702  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.869874  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:51.871272  3964 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:51.871436  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:51.823560  8909 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:51.871744  3964 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:51.872591  3967 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:17:51.868618  8756 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.877163  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.857733  8912 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.877974  4678 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:51.878525  8756 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.879669  8912 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.858446  8923 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.883018  8834 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.885334  8923 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.873525  3968 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:17:51.873176  3964 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.853878  8847 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:51.889292  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:51.891630  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:51.892202  3969 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:51.866801  8842 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.889441  3964 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:51.888877  8971 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:51.903961  3938 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.906121  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:51.907254  3970 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:51.907478  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:51.907737  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:51.908125  3969 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.903179  8909 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:51.909548  8909 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:51.910466  3967 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:17:51.911624  8909 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:51.912122  8841 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.913386  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:51.919232  3970 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:51.890136  8749 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.903348  8921 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:17:51.932032  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2743) took 1776 ms (client timeout 1728 ms). Trace:
W20260709 13:17:51.937321  4117 rpcz_store.cc:269] 0709 13:17:50.148636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.226312 (+ 77676us) service_pool.cc:224] Handling call
0709 13:17:51.924713 (+1698401us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:51.924858 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309636992}
I20260709 13:17:51.931408  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.921522  8971 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:17:51.938526  4680 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:17:51.940043  3968 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:51.921447  8909 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:51.941498  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2580) took 1765 ms. Trace:
I20260709 13:17:51.877080  8855 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.945207  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:51.949940  4041 rpcz_store.cc:276] 0709 13:17:50.175733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.180018 (+  4285us) service_pool.cc:224] Handling call
0709 13:17:50.180277 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:50.861487 (+681210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.941256 (+1079769us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b5400112954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:51.941441 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565211392}
I20260709 13:17:51.945777  3968 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:51.951640  3968 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.952558  3968 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:51.902514  8842 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.954218  4117 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:17:51.955953  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:51.954169  3970 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:51.958698  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3072) took 1222 ms. Trace:
I20260709 13:17:51.922819  8841 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.966204  8842 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.966442  8841 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.924235  8749 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.969089  8749 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.932956  8756 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:51.970099  3972 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
W20260709 13:17:51.969480  8947 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.358s	user 0.003s	sys 0.000s
W20260709 13:17:51.955982  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 86181.7us
I20260709 13:17:51.972117  3969 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:51.972365  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:51.974340  4120 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:51.959235  3971 rpcz_store.cc:276] 0709 13:17:50.736004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.736129 (+   125us) service_pool.cc:224] Handling call
0709 13:17:50.753647 (+ 17518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:50.754034 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:17:50.781133 (+ 27099us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.795695 (+1014562us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b18001059a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed7a32058f 00007fed7335f571 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd
0709 13:17:51.893288 (+ 97593us) log.cc:844] Serialized 14 byte log entry
0709 13:17:51.902413 (+  9125us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:51.902830 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:17:51.902962 (+   132us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:51.902988 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.903040 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:51.958442 (+ 55402us) raft_consensus.cc:1685] finished
0709 13:17:51.958468 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:51.958633 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1016592,"prepare.queue_time_us":119287,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":1304,"raft.queue_time_us":975568,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":29155,"spinlock_wait_cycles":27149952,"thread_start_us":97244,"threads_started":2,"wal-append.queue_time_us":360333}
I20260709 13:17:51.979118  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:51.974390  8896 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.243s	user 0.023s	sys 0.036s
W20260709 13:17:51.991497  8896 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.260s	user 0.024s	sys 0.037s
I20260709 13:17:51.982923  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:51.985960  8879 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:51.974161  8756 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.994793  8841 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:51.995327  8841 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:51.996392  8756 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:51.986207  8974 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:51.989235  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2544) took 2206 ms (client timeout 1531 ms). Trace:
W20260709 13:17:51.998142  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2582) took 1811 ms (client timeout 2057 ms). Trace:
I20260709 13:17:51.990015  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2751) took 1794 ms. Trace:
I20260709 13:17:51.956199  8971 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:17:51.998436  4118 rpcz_store.cc:269] 0709 13:17:49.782977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:49.783404 (+   427us) service_pool.cc:224] Handling call
0709 13:17:51.989017 (+2205613us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540026acd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:51.989144 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109834112}
I20260709 13:17:51.999485  8971 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.001857  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:52.003073  4114 rpcz_store.cc:276] 0709 13:17:50.195889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.196035 (+   146us) service_pool.cc:224] Handling call
0709 13:17:50.196322 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.061085 (+864763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:51.989800 (+928715us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54001b1f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:51.989959 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949263744}
I20260709 13:17:51.998709  4113 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:17:51.976225  8782 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.013000  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:52.013604  4683 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:52.014022  4683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 377) took 1135 ms. Trace:
I20260709 13:17:52.014282  4683 rpcz_store.cc:276] 0709 13:17:50.878283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.878511 (+   228us) service_pool.cc:224] Handling call
0709 13:17:52.012849 (+1134338us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:17:52.013972 (+  1123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6766464}
W20260709 13:17:52.021205  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 444170us
I20260709 13:17:52.022281  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:51.993664  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:51.996179  8841 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:51.983314  3968 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:17:52.025965  3968 pending_rounds.cc:85] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:52.026207  3968 pending_rounds.cc:107] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:17:52.026417  3968 raft_consensus.cc:2889] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:52.006632  4043 rpcz_store.cc:269] 0709 13:17:50.186608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.187160 (+   552us) service_pool.cc:224] Handling call
0709 13:17:51.997982 (+1810822us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54000b8e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:51.998085 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1340602240}
I20260709 13:17:52.008196  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:51.994428  8879 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:52.008948  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:52.010478  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:52.010947  8909 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:17:52.025123  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:52.028568  8587 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.038129  8782 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.038272  8587 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.031213  8780 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:52.032829  8954 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:52.028558  8843 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.033311  4678 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.034514  8879 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:52.037233  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43665.6us
I20260709 13:17:52.037302  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:52.039166  8773 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.047986  8587 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:52.049098  8945 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.440s	user 0.002s	sys 0.000s
W20260709 13:17:52.049561  4012 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.728s (SENT) [suppressed 42 similar messages]
I20260709 13:17:52.050639  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.051791  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.052889  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.054647  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.055189  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.055295  4113 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:52.054018  4118 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:52.064527  4118 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:52.068193  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.071929  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.077281  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.077754  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.078327  4043 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.079473  8360 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:52.079962  8847 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:52.080168  8844 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:52.080844  8847 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:52.081220  8847 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:52.082041  8847 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.083015  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.041416  8780 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.086007  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.086416  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.087718  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.088544  4042 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:52.089980  4040 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.090525  4044 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:52.091787  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 68301.4us
I20260709 13:17:52.079872  8360 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.100660  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.102797  4043 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:17:52.109965  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.063604  8938 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:52.111909  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:52.076607  8941 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:52.114125  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.076448  8623 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.083174  8847 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.115087  4117 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:52.115952  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.085685  8971 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.040478  8953 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:17:52.114178  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.084390  8909 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:52.089643  8879 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:52.122661  4044 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:17:52.112859  8923 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.131845  4040 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:52.135337  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.137470  4042 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:52.139475  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:52.111721  8360 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:52.166038  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51952.6us
I20260709 13:17:52.166481  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:52.165398  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.168349  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.168860  4042 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.153877  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.158082  4121 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:17:52.172158  4115 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:52.158842  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:52.159057  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64288.9us
I20260709 13:17:52.159443  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.173079  4113 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:52.173219  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.174012  4117 raft_consensus.cc:2368] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:52.089529  8780 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.165026  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.118896  8842 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.118466  8974 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.175011  4040 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:52.176409  3937 leader_election.cc:400] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:52.162147  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.176729  3937 leader_election.cc:403] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:17:52.166234  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.157912  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2765) took 1324 ms. Trace:
I20260709 13:17:52.178133  4043 raft_consensus.cc:2368] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:52.179193  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.177498  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.181744  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.182137  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.182790  7936 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:52.183156  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.183332  7936 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:52.142060  8855 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:52.177953  4119 rpcz_store.cc:276] 0709 13:17:50.833526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.867516 (+ 33990us) service_pool.cc:224] Handling call
0709 13:17:52.157650 (+1290134us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003a70d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:52.157836 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439871232}
W20260709 13:17:52.186570  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.181226  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.189679  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:52.179144  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.187105  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.192580  8969 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.193123  8969 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.193523  8959 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:17:52.195477  8969 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:52.196513  8979 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:17:52.180008  8795 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:17:52.184739  8971 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.192073  4117 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:17:52.208976  8433 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:52.209851  8360 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.164481  8909 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.119830  8938 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:52.212735  8757 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:17:52.214162  8909 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.192847  8970 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.215065  8855 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.215189  8970 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.216291  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:52.140985  8954 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:52.217129  8855 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.177210  8782 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:52.217458  8954 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.218065  8782 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:52.221560  3965 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:52.223304  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.134521  8941 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:52.226984  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43886us
I20260709 13:17:52.238390  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.186592  7936 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:52.187547  3937 leader_election.cc:400] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:52.241469  3937 leader_election.cc:403] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:52.242034  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54626.9us
I20260709 13:17:52.236217  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:52.143888  8623 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.262667  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.266971  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.268651  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.269156  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:52.273967  4113 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:52.268713  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.275535  8855 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:52.276873  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.274231  4114 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:17:52.278609  8855 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.285411  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.286345  8757 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.286767  3937 leader_election.cc:400] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:52.287106  8971 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.287663  8971 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.185287  8756 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.190946  8749 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:52.334292  4040 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:52.166038  8825 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 13:17:52.332046  4038 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:52.318787  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48568.6us
W20260709 13:17:52.338421  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51791.6us
I20260709 13:17:52.339150  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:52.341377  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78802.6us
I20260709 13:17:52.342118  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.345553  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.347085  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.347811  3964 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:52.348694  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.350584  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:52.353291  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.351235  3965 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:52.358512  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.188711  8942 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.359898  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.360600  3964 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:52.362286  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.363157  3964 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:52.364537  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.366768  7936 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.367179  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.180241  8923 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.239646  8959 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.364938  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.392710  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.272950  8909 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:17:52.386531  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 337005us
I20260709 13:17:52.387686  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.234675  8795 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:52.186118  8842 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.393821  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.563934  4047 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.383898  4038 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:52.290987  8753 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:52.263608  8433 raft_consensus.cc:2764] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:17:52.503157  3968 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:52.336894  8780 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.367379  8650 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 13:17:52.510306  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.522131  8757 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.261739  8579 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:17:52.189697  8974 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.576503  8974 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.360388  8969 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.563918  8742 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.577800  8969 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.578389  8969 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.579130  8842 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.579701  8842 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:52.580312  8969 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.580132  8842 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.522562  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.521430  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.363350  8756 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.584075  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:52.581094  3969 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:52.292940  8495 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.514484  8970 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.366705  8949 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:52.272159  8912 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:52.556072  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.558708  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3165) took 1005 ms. Trace:
I20260709 13:17:52.520864  8951 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:52.597538  4039 rpcz_store.cc:276] 0709 13:17:51.552894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.736322 (+183428us) service_pool.cc:224] Handling call
0709 13:17:51.742220 (+  5898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.078673 (+336453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.078704 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.079243 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:17:52.166949 (+ 87706us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:52.166988 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.167053 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.558468 (+391415us) raft_consensus.cc:1685] finished
0709 13:17:52.558500 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.558647 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":376099,"raft.queue_time_us":362841,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6739,"thread_start_us":87412,"threads_started":1,"wal-append.queue_time_us":256022}
I20260709 13:17:52.603483  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:52.556981  8956 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:17:52.511073  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.520421  8923 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.513980  8941 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:52.572600  8977 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:17:52.577105  8971 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.389642  8942 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.556394  8826 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:52.289587  8782 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.625057  8842 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:52.625741  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:52.623741  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.549120  4678 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:52.626174  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.577054  8974 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.613114  4047 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:17:52.580883  8841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.002s	sys 0.017s
I20260709 13:17:52.569540  8855 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.615662  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.621225  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.602648  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.640712  4047 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:52.641065  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.641686  3963 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.577877  8742 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.623674  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2560) took 2311 ms. Trace:
I20260709 13:17:52.603261  8951 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.607626  8946 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.626519  3968 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:52.642768  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:52.633694  8841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.003s	sys 0.019s
I20260709 13:17:52.644946  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:52.644426  4120 rpcz_store.cc:276] 0709 13:17:50.307590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.308682 (+  1092us) service_pool.cc:224] Handling call
0709 13:17:50.309024 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.974767 (+1665743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.618880 (+644113us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54001b1a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:52.619055 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3829402368}
I20260709 13:17:52.594924  8757 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:52.699463  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 54601.1us
I20260709 13:17:52.700223  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:52.700917  8906 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:52.702926  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.703652  3971 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:52.635105  8834 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:17:52.707599  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 403874us
I20260709 13:17:52.638335  8928 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.642131  8763 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:52.696136  8951 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:52.719671  3963 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:17:52.641820  8896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.012s	sys 0.018s
I20260709 13:17:52.701462  8906 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.707919  8959 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:52.710673  8944 raft_consensus.cc:2764] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:52.745414  3968 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:17:52.733199  8896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.012s	sys 0.019s
I20260709 13:17:52.747982  3971 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:17:52.752640  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45441us
W20260709 13:17:52.733321  8879 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:17:52.763346  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.719324  8834 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:52.728006  8841 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.768144  3971 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:52.704945  8946 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.769768  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.773550  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.730095  8984 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:17:52.769006  8844 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:52.776721  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:52.830530  3938 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:52.779450  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:52.832406  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53028.9us
I20260709 13:17:52.738497  8953 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:17:52.779868  8756 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.779703  8757 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.755477  8623 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.780562  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.781988  8847 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:52.782183  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.782487  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.782745  8944 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:52.782908  8861 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:52.783653  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.785422  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.869475  3966 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:52.788046  4040 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:17:52.789373  8988 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:17:52.791428  4043 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:52.871841  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:52.793630  8873 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:52.796483  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:52.796872  8841 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.800699  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.803337  4042 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:52.805001  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.741734  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:52.753017  8906 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:52.704594  8795 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.779299  8834 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.833613  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.719635  8928 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.835216  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:52.834877  3938 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:52.840055  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:52.869050  3972 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:52.917336  3971 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:52.873421  4043 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 8.
I20260709 13:17:52.919689  4043 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:17:52.876524  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:52.836194  8633 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:52.880023  3967 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:52.831297  8855 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 13:17:52.895676  8749 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.533s	user 0.000s	sys 0.008s
I20260709 13:17:52.952374  8749 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:52.953091  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:52.953300  3965 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:17:52.953722  8928 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:52.836748  8433 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:17:52.954299  8928 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:17:52.954770  8989 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:17:52.956004  8495 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:52.948311  8773 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:52.961400  8773 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.963670  8773 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.955863  3963 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:17:52.964426  3963 pending_rounds.cc:85] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 9
I20260709 13:17:52.964655  3963 pending_rounds.cc:107] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:17:52.964905  3963 raft_consensus.cc:2889] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:52.965080  8994 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:17:52.965606  8994 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:52.966001  8994 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:17:52.967347  8855 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:52.967808  8855 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:52.969410  8855 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:52.971673  8855 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:52.975744  8946 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.976456  8946 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:52.904250  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3170) took 1226 ms. Trace:
I20260709 13:17:52.836340  8996 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:52.922334  3971 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:52.992257  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:52.921258  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 86447.7us
I20260709 13:17:52.923134  3972 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:52.872174  8953 consensus_queue.cc:1243] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:52.875790  8949 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:52.877197  8873 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:52.872044  8780 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:52.949401  8906 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:52.951628  8633 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:52.834755  8844 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:52.875717  8959 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:52.980469  8841 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:52.908368  8942 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:52.983928  4045 rpcz_store.cc:276] 0709 13:17:51.678052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.738510 (+ 60458us) service_pool.cc:224] Handling call
0709 13:17:51.738799 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.084032 (+345233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.084079 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:52.084723 (+   644us) log.cc:844] Serialized 52 byte log entry
0709 13:17:52.550628 (+465905us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:52.550674 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:52.550755 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:52.903927 (+353172us) raft_consensus.cc:1685] finished
0709 13:17:52.903954 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:52.904166 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":333028,"raft.queue_time_us":348207,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17305,"thread_start_us":430064,"threads_started":1,"wal-append.queue_time_us":512911}
I20260709 13:17:52.877846  8753 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:53.001812  3968 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:53.006395  3972 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:53.019650  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:53.020450  3972 raft_consensus.cc:2410] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:17:53.010293  3971 pending_rounds.cc:85] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:17:53.021005  3971 pending_rounds.cc:107] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:17:53.021268  3971 raft_consensus.cc:2889] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:53.015362  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 286211us
I20260709 13:17:53.013688  8742 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:53.027691  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:53.028258  8844 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.011368  8633 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.031973  8753 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.037094  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:53.037999  8773 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:17:53.038367  8773 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.038789  8773 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:53.014681  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:53.044531  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 293203us
I20260709 13:17:53.054522  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:53.055127  4045 raft_consensus.cc:2376] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10. Re-sending same reply.
I20260709 13:17:53.065644  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:53.067298  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:53.071952  8841 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.072566  8841 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.074728  8841 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:53.094830  3937 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.015s	sys 0.005s
W20260709 13:17:53.095196  3937 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.015s	sys 0.005s
W20260709 13:17:53.095733  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 750198us
I20260709 13:17:53.093865  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:53.095957  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.024211  8912 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:53.016003  8959 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.104157  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 492) took 1622 ms. Trace:
I20260709 13:17:53.104537  4112 rpcz_store.cc:276] 0709 13:17:51.482265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.743873 (+261608us) service_pool.cc:224] Handling call
0709 13:17:51.760934 (+ 17061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:51.818276 (+ 57342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.103919 (+1285643us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b5400080554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:53.104096 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130585984}
I20260709 13:17:53.099628  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:53.098570  8433 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:53.121722  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 324009us
W20260709 13:17:53.124487  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 354765us
I20260709 13:17:53.128468  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.126987  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.119270  4011 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:53.134307  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 299133us
I20260709 13:17:53.103112  8944 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:53.141764  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 340180us
I20260709 13:17:53.105652  8742 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:53.138482  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:53.123075  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.135478  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:53.049121  8873 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.144284  7936 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.148147  7910 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.152138  7910 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:53.118461  8937 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.153589  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:53.147639  7936 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.147619  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.146574  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:53.124780  8433 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.164803  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.166302  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:53.158041  4012 connection.cc:256] RPC call timeout handler was delayed by -1.0873537659999784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260709 13:17:53.122253  8951 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.168941  8951 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.169341  8847 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:53.169858  8847 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:53.170281  8847 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:53.170095  8951 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:53.172272  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:53.173053  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.173399  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:53.174285  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.174664  8951 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.172978  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.177544  9018 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.162024  8999 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:53.178172  9018 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:53.179169  8999 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:53.179472  9018 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.173403  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:53.174861  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2761) took 2473 ms (client timeout 1551 ms). Trace:
W20260709 13:17:53.181653  4116 rpcz_store.cc:269] 0709 13:17:50.701640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:50.799290 (+ 97650us) service_pool.cc:224] Handling call
0709 13:17:53.174662 (+2375372us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400003054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:53.174792 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069273472}
I20260709 13:17:53.181084  4045 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:53.167371  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:53.185288  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.180826  7910 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:53.191094  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 44579.9us
I20260709 13:17:53.191927  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.109191  8949 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.190981  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:53.199393  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.200290  7936 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.156273  8861 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.158284  9015 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.161922  8650 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:53.207320  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.177213  8951 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:53.180056  8999 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.152127  8782 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:17:53.223031  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.223932  4045 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:53.212014  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.181105  8433 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.207742  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.193293  8873 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.240419  4045 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:53.241218  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.163208  8841 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:17:53.244222  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.244794  7936 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.244850  4045 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
W20260709 13:17:53.244397  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90920.4us
I20260709 13:17:53.246789  4045 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:17:53.247207  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.248055  4045 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:17:53.256515  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.217702  8937 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.258533  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.261770  7936 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:53.262480  7936 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:53.262982  7936 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.217204  8650 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.264876  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:53.276304  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:53.259824  8974 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.277431  8974 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.279547  8974 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:53.169970  8912 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:53.286790  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 94094.6us
I20260709 13:17:53.262387  8971 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.240110  8844 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:17:53.291113  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.268217  8650 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:53.297480  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 104815us
W20260709 13:17:53.301546  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.306944  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.281890  9015 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:17:53.303326  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 118372us
I20260709 13:17:53.283330  8921 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.294420  8971 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.318624  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.317036  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.317123  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:53.321310  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:53.325331  7910 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:53.325827  7910 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.326117  7910 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.291294  8861 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:17:53.333601  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.333240  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.335006  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.333832  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:53.319553  8909 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.001s
I20260709 13:17:53.346227  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.309854  9017 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.299402  8953 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:17:53.309836  9010 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.336696  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.349100  7936 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.336985  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.337234  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:53.342286  9005 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:17:53.343492  8633 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.309870  9013 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.335608  4114 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:53.327678  8825 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:17:53.324353  8971 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.353834  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.309999  9015 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.350569  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:17:53.309954  9012 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:53.356406  9014 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:17:53.357561  9009 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:17:53.389968  4038 raft_consensus.cc:2368] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:53.358741  8800 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:53.390434  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.363498  4114 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:17:53.354044  9010 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:53.392786  9003 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:17:53.393345  8633 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:53.394743  9027 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:17:53.395063  8736 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:53.395917  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3185) took 1290 ms. Trace:
I20260709 13:17:53.396322  4039 rpcz_store.cc:276] 0709 13:17:52.105108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.645638 (+540530us) service_pool.cc:224] Handling call
0709 13:17:52.645958 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.698332 (+ 52374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.698362 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:52.769607 (+ 71245us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.098494 (+328887us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:53.098534 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.098599 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.395693 (+297094us) raft_consensus.cc:1685] finished
0709 13:17:53.395714 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.395858 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63726,"raft.queue_time_us":52736,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":3087,"thread_start_us":328031,"threads_started":1,"wal-append.queue_time_us":431110}
I20260709 13:17:53.397059  8773 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.399132  8773 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.366855  7936 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.369220  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.346527  9000 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:53.310266  8984 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:17:53.374033  4118 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:53.376245  4117 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:53.331964  9030 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:53.380525  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:53.354565  8909 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:17:53.391093  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:53.428407  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.414619  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.389564  8742 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:17:53.359771  9017 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.384142  9015 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.400568  9010 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.383605  9012 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.429061  4113 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:53.435375  3970 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:53.427222  4120 raft_consensus.cc:2376] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17. Re-sending same reply.
I20260709 13:17:53.408928  9014 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:53.458215  7910 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.447854  8433 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.451798  8994 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.385712  8624 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:17:53.461755  8944 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.462287  8944 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.464227  8938 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:53.465164  8835 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:53.465668  8835 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:17:53.469051  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 135979us
W20260709 13:17:53.447732  9025 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:17:53.469198  7910 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.472293  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.472921  4120 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:53.474325  4039 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:17:53.477324  3972 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.438038  9012 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:53.466665  9017 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:53.528070  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49441.2us
I20260709 13:17:53.466636  8835 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.576665  4120 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:17:53.637133  8949 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:53.640992  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:53.641942  8949 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.642504  8949 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.642180  9012 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.642903  8949 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.642140  3972 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:53.643493  4116 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:53.649801  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:53.650701  4047 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:53.652043  4120 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:53.654656  8835 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:53.645001  8847 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.649731  8804 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:53.651433  8951 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.651225  8971 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.677120  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:53.644240  9014 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.698081  4114 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.700013  4047 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:17:53.700197  7910 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:53.701071  7910 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.708691  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:53.711932  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:53.713331  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.713598  4113 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:53.707993  9036 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:17:53.714702  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:17:53.716511  4118 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
W20260709 13:17:53.742623  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:53.743983  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.711220  9030 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.715481  8942 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.786899  7910 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:53.717593  8825 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:53.822086  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.715574  8861 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:53.827378  7910 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:53.706137  8804 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.713567  8938 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:17:53.828380  7910 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.832255  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.795512  8942 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:53.839421  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 124781us
I20260709 13:17:53.817622  8433 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:53.827100  8825 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.826344  9012 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:53.834714  8624 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:53.855852  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.856957  4120 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
W20260709 13:17:53.841152  8873 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.000s
I20260709 13:17:53.860381  4114 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:53.850660  8951 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.863660  4114 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:53.839489  8994 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:53.853942  8825 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:53.864328  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 399) took 2479 ms. Trace:
I20260709 13:17:53.866549  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.843828  8942 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.864938  9036 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:53.869149  8981 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.787s	user 0.001s	sys 0.005s
W20260709 13:17:53.869410  8937 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:17:53.870302  8847 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.850827  9046 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:17:53.822187  9030 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.859220  8624 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:53.871508  4046 rpcz_store.cc:276] 0709 13:17:51.380323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.702987 (+322664us) service_pool.cc:224] Handling call
0709 13:17:51.775096 (+ 72109us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:17:51.775374 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.099837 (+324463us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:52.099867 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:53.356507 (+1256640us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4800280bd8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:17:53.462022 (+105515us) spinlock_profiling.cc:243] Waited 6.6 ms on lock 0x7b2c000a5238. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:17:53.462407 (+   385us) log.cc:844] Serialized 26 byte log entry
0709 13:17:53.647133 (+184726us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:53.647173 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.647274 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.859046 (+211772us) raft_consensus.cc:1685] finished
0709 13:17:53.859067 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.859194 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338788,"raft.queue_time_us":334215,"raft.run_cpu_time_us":8711,"raft.run_wall_time_us":1243039,"spinlock_wait_cycles":26084864,"thread_start_us":184103,"threads_started":1,"wal-append.queue_time_us":248695}
W20260709 13:17:53.867501  9041 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 13:17:53.878691  8650 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.567s	user 0.004s	sys 0.008s
I20260709 13:17:53.878710  8624 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:53.875367  8937 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:53.883344  4120 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:17:53.877473  8944 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.864799  8433 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:17:53.884887  4114 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:53.897428  4120 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:53.903936  8937 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:53.904359  8937 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:53.905201  8937 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.892915  8971 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:53.890472  9030 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:53.913818  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 716) took 1141 ms. Trace:
I20260709 13:17:53.916949  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2590) took 1820 ms. Trace:
I20260709 13:17:53.918872  4042 rpcz_store.cc:276] 0709 13:17:52.097284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.219539 (+122255us) service_pool.cc:224] Handling call
0709 13:17:52.803165 (+583626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:52.879800 (+ 76635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.916703 (+1036903us) spinlock_profiling.cc:243] Waited 583 ms on lock 0x7b54000f0d50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:53.916892 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1341463296}
I20260709 13:17:53.918761  3969 rpcz_store.cc:276] 0709 13:17:52.772075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.879204 (+107129us) service_pool.cc:224] Handling call
0709 13:17:52.879496 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.001150 (+121654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:53.001185 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:53.001229 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:53.001261 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.913607 (+912346us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54001ca554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:53.913652 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.913769 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279342464}
I20260709 13:17:53.875033  9036 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.920964  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:53.922192  4678 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:53.919503  9039 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.924314  9039 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.884344  8650 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:53.928424  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:53.929447  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.929625  4047 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:53.912815  8937 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:53.932152  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:53.932473  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.932783  4046 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:53.934350  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:53.936949  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:53.888954  9010 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.938259  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.943213  8360 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.943648  8949 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.931365  8957 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.948108  4046 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:53.932510  9055 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:53.952589  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.941368  9046 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:53.940948  9043 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:17:53.972231  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3174) took 1895 ms. Trace:
I20260709 13:17:53.972916  8870 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:53.973313  8870 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:53.974021  8949 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:53.976754  8825 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.977953  4038 raft_consensus.cc:2368] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:17:53.984151  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3092) took 1638 ms. Trace:
I20260709 13:17:53.984704  3965 rpcz_store.cc:276] 0709 13:17:52.346050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.358255 (+ 12205us) service_pool.cc:224] Handling call
0709 13:17:53.983965 (+1625710us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54002599d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:53.984077 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1366182272}
I20260709 13:17:53.957599  8360 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:53.972718  4041 rpcz_store.cc:276] 0709 13:17:52.077082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.077850 (+   768us) service_pool.cc:224] Handling call
0709 13:17:52.078155 (+   305us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.560810 (+482655us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:52.582751 (+ 21941us) log.cc:844] Serialized 14 byte log entry
0709 13:17:53.017611 (+434860us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:53.026798 (+  9187us) log.cc:844] Serialized 52 byte log entry
0709 13:17:53.041757 (+ 14959us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:53.041800 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:53.971783 (+929983us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400020dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:53.971842 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:53.971897 (+    55us) raft_consensus.cc:1685] finished
0709 13:17:53.971991 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:53.972162 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208237,"prepare.queue_time_us":29177,"prepare.run_wall_time_us":42,"raft.queue_time_us":173922,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":28009,"spinlock_wait_cycles":654922368,"thread_start_us":381756,"threads_started":1,"wal-append.queue_time_us":499727}
I20260709 13:17:53.960345  9046 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:53.993211  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:53.991176  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:53.951223  9015 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.995440  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:53.994710  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:53.957218  9055 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:53.954371  8957 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:53.996445  9046 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.016430  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:53.974189  8870 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.015828  4114 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:17:54.017159  9058 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:17:53.998535  8943 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:53.996022  8949 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:54.022804  4045 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:53.992786  8795 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:54.018324  9057 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:54.000494  8938 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:54.029784  4047 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:17:54.001930  8360 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:54.015923  8825 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.042264  8957 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.043068  9039 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.037153  8944 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.048276  8360 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.055141  4086 leader_election.cc:400] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:17:54.055469  4086 leader_election.cc:403] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:54.037926  9057 consensus_queue.cc:1243] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:54.030237  8949 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.054451  9010 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.060793  4679 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:54.089263  9055 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.076716  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:54.091965  8579 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:54.092828  9045 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:54.093484  9015 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.094666  8756 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:54.095072  8756 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:54.095839  8756 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.102840  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3099) took 1595 ms. Trace:
I20260709 13:17:54.103266  3970 rpcz_store.cc:276] 0709 13:17:52.507194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.522275 (+ 15081us) service_pool.cc:224] Handling call
0709 13:17:54.102658 (+1580383us) spinlock_profiling.cc:243] Waited 843 ms on lock 0x7b5400307854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:54.102774 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1939061120}
I20260709 13:17:54.110942  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:54.111943  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:54.112794  8959 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.113175  9008 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:17:54.113734  9008 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:54.116190  9008 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:54.077950  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75450.9us
I20260709 13:17:54.079846  8949 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:54.083717  8942 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.068603  8999 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:17:54.096303  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.036366  8795 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.122383  3869 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:54.125787  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71345.3us
I20260709 13:17:54.067781  8650 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.145358  4038 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 11. Current term is 13. Ops: []
I20260709 13:17:54.110961  8804 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:54.153864  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.154614  4112 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:54.143635  8756 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.180305  9046 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.181697  9006 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.182159  8942 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:54.185595  8870 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.147611  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:54.196219  9032 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.838s	user 0.000s	sys 0.003s
I20260709 13:17:54.201920  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:54.222147  4045 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:54.203133  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:54.206085  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:54.212715  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 493) took 2729 ms. Trace:
I20260709 13:17:54.214903  9036 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.225167  4119 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:54.228412  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:54.224107  4121 rpcz_store.cc:276] 0709 13:17:51.483674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:51.857236 (+373562us) service_pool.cc:224] Handling call
0709 13:17:52.157807 (+300571us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:52.172115 (+ 14308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.212506 (+2040391us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54003a70d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:54.212645 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690304256}
I20260709 13:17:54.256122  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:54.252437  8773 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:54.261993  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:54.228334  8624 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.270097  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:54.271132  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:54.278108  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:54.279201  9046 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:54.264546  8773 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.280102  8773 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.286854  4045 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:54.289414  9066 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.289742  4045 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:54.292181  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:54.290026  9066 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:54.291008  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.293129  4045 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:54.301855  8495 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:54.302251  8495 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:54.302886  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 169568us
I20260709 13:17:54.303278  8495 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.300119  4039 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:54.305327  8773 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.306828  9057 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:17:54.319501  9057 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:54.319744  8773 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.320113  8433 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:54.320504  8433 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.321333  8433 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.321698  8624 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.308339  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.322440  4042 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:54.306593  4040 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:17:54.329682  4038 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:54.317519  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.315275  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.308713  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.334357  8938 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.335464  8938 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.337055  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:54.337801  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.343631  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.344735  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:54.317396  9054 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:17:54.221603  9006 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.295022  8999 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:17:54.362142  4047 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:54.346021  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.304737  8495 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.297923  8879 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.346736  4041 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:54.357916  8433 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.307015  8834 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:17:54.373027  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.369240  9066 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:54.357239  9063 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:54.385159  8946 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.385679  8946 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.385896  8736 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:54.387200  8736 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.376271  8879 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.387804  8946 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.388085  8736 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.389422  8879 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.385317  9063 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.391444  9006 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.359300  4679 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.376572  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:54.383909  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.386606  4043 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:54.375181  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.392726  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 406) took 1588 ms. Trace:
I20260709 13:17:54.398703  4114 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.399089  4040 rpcz_store.cc:276] 0709 13:17:52.803930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.898709 (+ 94779us) service_pool.cc:224] Handling call
0709 13:17:52.993005 (+ 94296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:54.333384 (+1340379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.392485 (+ 59101us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003dc054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:54.392668 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020256000}
I20260709 13:17:54.394317  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:54.400645  4041 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:17:54.405172  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.405752  4120 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:54.423341  4121 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:54.401212  8736 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:54.406734  9066 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:54.440526  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:54.441226  4041 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:54.408154  8834 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:54.407382  8943 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:54.445463  4114 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:54.450726  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.439648  9066 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:54.443997  9063 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.447453  8999 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:17:54.462774  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:54.463567  8949 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:17:54.465682  8896 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:54.466241  9068 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:17:54.453855  9070 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:17:54.469723  4041 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:17:54.474396  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.472121  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:54.506893  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.511071  4680 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.511106  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:54.497334  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:54.513413  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.474262  8896 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.519254  8896 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.519469  9082 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:54.449666  8834 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.452190  8798 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:17:54.525553  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.526980  4114 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:17:54.453976  8951 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:17:54.451295  8943 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.517480  8870 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:54.461721  8912 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:17:54.468442  8928 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:17:54.553958  8943 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:54.555315  9079 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:17:54.461273  9069 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:17:54.567437  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2584) took 1229 ms. Trace:
I20260709 13:17:54.567739  4119 rpcz_store.cc:276] 0709 13:17:53.338236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.338354 (+   118us) service_pool.cc:224] Handling call
0709 13:17:53.338610 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.225594 (+886984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.567248 (+341654us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400002654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:54.567388 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2038322560}
I20260709 13:17:54.565624  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 504) took 1249 ms. Trace:
I20260709 13:17:54.568796  4116 rpcz_store.cc:276] 0709 13:17:53.316730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.316881 (+   151us) service_pool.cc:224] Handling call
0709 13:17:54.565403 (+1248522us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b5400080f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:54.565559 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":743651584}
I20260709 13:17:54.572289  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:54.576531  9080 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:17:54.576869  4045 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:17:54.577256  4045 pending_rounds.cc:85] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 6
I20260709 13:17:54.577476  4045 pending_rounds.cc:107] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:17:54.577719  4045 raft_consensus.cc:2889] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.549302  9063 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:54.578768  9063 consensus_queue.cc:1243] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:54.579257  9063 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:54.579581  9063 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.580394  9063 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.585332  9063 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.593568  8834 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.606165  4120 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:54.607400  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:54.609110  4115 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:54.609951  4120 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.6-14.6]
I20260709 13:17:54.612121  4112 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:17:54.613183  4115 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 13:17:54.612798  4120 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:54.622943  8795 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:54.624569  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:54.625428  4678 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:54.626462  4087 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:54.627555  8795 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.635589  9059 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:54.636049  9059 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.636958  9059 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.638026  9059 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.642949  9001 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:54.643356  9001 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:54.644110  9001 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.645594  9077 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:17:54.669121  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.653877  9063 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.659634  9077 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.669178  9001 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.684891  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:54.692166  8841 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.692780  8841 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.694736  8841 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.695677  8906 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:54.696074  8906 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:54.696873  8906 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.698066  8906 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:54.714395  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:54.673122  9063 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.740249  9010 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:54.712594  9008 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:54.743773  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.723486  8994 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.705300  4679 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:54.723186  8971 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:54.728345  8993 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.727180  8842 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.746182  9008 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:54.752976  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:54.772034  8623 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:54.729166  8879 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:54.772514  8623 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:54.773108  8879 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:54.773773  8623 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.6, Last appended by leader: 6, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.774124  8879 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.775012  8623 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:54.764930  4680 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 8. Current term is 9. Ops: []
W20260709 13:17:54.777029  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.777858  4039 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:54.779012  4039 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:54.780148  4039 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:54.732811  8970 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:54.781243  8970 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.783423  8970 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:54.771946  9008 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:54.788082  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.741323  8756 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:54.780920  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.729369  8896 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.790752  8842 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.753997  9077 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:54.792066  9086 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.103s	user 0.002s	sys 0.001s
W20260709 13:17:54.793959  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.741567  8923 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:54.795092  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2680) took 1777 ms. Trace:
I20260709 13:17:54.741703  9083 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:17:54.753829  8998 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.763859  8994 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.796526  8847 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:54.787874  8971 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.797252  8999 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:17:54.797154  9070 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:17:54.798305  9087 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:17:54.755684  9010 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.803434  4039 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:17:54.808449  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.805464  3968 rpcz_store.cc:276] 0709 13:17:53.017717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.018903 (+  1186us) service_pool.cc:224] Handling call
0709 13:17:53.030392 (+ 11489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:53.030584 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:53.194011 (+163427us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.794609 (+1600598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.794669 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:54.794714 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:54.794902 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:54.795027 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1176764,"prepare.queue_time_us":138914,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"thread_start_us":586449,"threads_started":3,"wal-append.queue_time_us":550230}
I20260709 13:17:54.809545  9077 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:54.801864  8756 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.856305  3869 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 9 to 11, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 11 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:54.866449  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 1.58133e+06us
I20260709 13:17:54.867888  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:54.795231  8993 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.832680  8938 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.872109  8757 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:54.808866  8923 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.903451  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:54.915382  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:54.922420  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.931304  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:54.933033  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.935947  3965 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:54.937199  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:54.941501  3963 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:54.942139  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:54.942852  3970 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:54.823503  8998 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.953619  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:54.954319  3963 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:54.956918  3968 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:17:54.957275  3968 pending_rounds.cc:85] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:17:54.957494  3968 pending_rounds.cc:107] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:17:54.957705  3968 raft_consensus.cc:2889] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:54.887317  8855 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:17:54.916910  9030 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.917197  8974 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:54.910351  9096 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:54.979020  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:54.978319  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.243999  3970 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
W20260709 13:17:55.244583  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:54.880791  9012 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:17:55.056348  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.070484  7910 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:55.137230  9080 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:17:54.894675  8938 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:54.954182  9093 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:55.233855  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 366042us
I20260709 13:17:55.276495  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:54.950196  8798 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:54.912302  8757 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:54.941812  9063 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.247944  8996 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.252360  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.228720  8873 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:55.255071  8756 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.248023  8970 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:55.256330  8842 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.260385  3965 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
W20260709 13:17:55.256788  8906 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.002s
I20260709 13:17:55.238982  8974 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.261823  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.265164  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.268558  8971 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.273543  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.227882  3963 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
W20260709 13:17:55.248237  9101 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.419s	user 0.000s	sys 0.001s
I20260709 13:17:55.286904  8909 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.280969  3970 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:55.281762  3937 leader_election.cc:400] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:55.306048  3937 leader_election.cc:403] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.287415  4039 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:17:55.295655  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.296105  8844 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:55.297066  8951 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:17:55.301695  3968 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:55.278790  8855 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:55.311691  3965 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.293520  9098 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.319248  8994 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.329582  4113 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:55.312326  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.313210  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:55.055246  9030 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:55.334204  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108196us
I20260709 13:17:55.290597  8970 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:55.283035  8798 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.280282  8921 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:17:55.333078  4116 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:55.335271  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.342033  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:55.342291  4118 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:17:55.319360  8844 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:55.322954  8842 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:55.289942  8873 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.339047  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.355075  3970 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
W20260709 13:17:55.339542  3935 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items [suppressed 14 similar messages]
I20260709 13:17:55.321228  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.346642  4121 raft_consensus.cc:2368] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:55.348062  3965 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:55.321050  8951 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:55.349221  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.353263  4118 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:55.262324  9096 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.326808  8971 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
W20260709 13:17:55.368533  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.359380  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.372328  3968 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.340351  8855 consensus_queue.cc:1243] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:55.340193  8970 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:55.280478  9093 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.378273  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.382987  3963 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:55.380626  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.343145  9069 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:55.348896  8896 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.347353  8994 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.391928  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:55.357755  8909 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.357918  8782 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.334052  9098 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.388480  8855 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:55.350471  9070 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:17:55.418565  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.419492  4118 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:55.422125  3968 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:55.396888  8974 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.390342  9109 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:55.356185  3935 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2713)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2709)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2707)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2710)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3134)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3138)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2704)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2706)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3129)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2708)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2690)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3133)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3135)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2694)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3124)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3127)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2689)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2691)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2692)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2696)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2697)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 722)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3130)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3131)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3132)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3136)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3141)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3143)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3144)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2711)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2712)
I20260709 13:17:55.411454  8896 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:55.441219  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.442094  4118 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:55.442735  8841 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:55.443346  8841 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.397061  9069 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.395182  9097 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
W20260709 13:17:55.431810  9091 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:17:55.421162  8855 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.455849  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.431277  9109 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:55.408874  8994 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.414769  8909 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.415000  8782 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.445533  8998 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.470693  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.470081  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.471429  4038 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:55.472486  8873 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.405166  8844 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.451023  8896 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:55.473489  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.474151  4038 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:17:55.427649  8951 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.476842  8951 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.476745  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:55.477631  9103 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:17:55.478010  4038 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
W20260709 13:17:55.478986  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.479785  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:55.481220  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.482002  4038 raft_consensus.cc:2410] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:17:55.482127  8909 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.483256  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.483510  9030 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.484705  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.485572  8994 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.486022  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:55.488528  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.489343  4041 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:55.490548  9069 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:55.491171  8795 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.863s	user 0.006s	sys 0.004s
I20260709 13:17:55.491631  8795 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:55.492326  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.465027  9109 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:55.493801  9059 consensus_meta.cc:287] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.001s
I20260709 13:17:55.494376  4038 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:55.495177  8757 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.495839  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.499171  8782 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:55.499455  8623 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.000s
I20260709 13:17:55.500684  8855 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.500478  8896 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.502808  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.504022  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.504580  3971 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:55.488564  9093 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.505825  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.506606  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.507537  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.508442  3971 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:17:55.509205  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.509825  3972 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:55.509980  3971 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:55.510737  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.510879  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.511286  3972 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:17:55.503149  9008 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.719s	user 0.007s	sys 0.001s
I20260709 13:17:55.511520  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:55.512151  9008 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.513135  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3194) took 1585 ms. Trace:
I20260709 13:17:55.477114  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.514223  8798 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:55.509105  8844 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:55.515204  9096 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.515746  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.516347  3968 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:55.517073  8749 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:55.517163  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.517516  8749 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:55.518764  8756 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:55.519146  8756 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:55.519882  8756 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.520258  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.467844  8938 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.514438  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3226) took 1076 ms. Trace:
I20260709 13:17:55.514590  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.513505  4680 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:55.512540  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:55.512178  4679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 399) took 1234 ms (client timeout 1560 ms). Trace:
I20260709 13:17:55.518317  9066 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.521458  4044 rpcz_store.cc:276] 0709 13:17:54.438449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.438878 (+   429us) service_pool.cc:224] Handling call
0709 13:17:54.439175 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.537268 (+ 98093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:54.537301 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:54.537346 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:54.537378 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.512650 (+975272us) spinlock_profiling.cc:243] Waited 97.9 ms on lock 0x7b540035d9d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:55.512694 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.514383 (+  1689us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225115904}
W20260709 13:17:55.538381  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 157863us
I20260709 13:17:55.522500  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.523303  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2675) took 2652 ms. Trace:
I20260709 13:17:55.526295  4677 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:17:55.529619  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.530176  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.530398  4121 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
W20260709 13:17:55.530966  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.566300  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:55.569859  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.570444  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.531342  8921 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:17:55.548581  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.555272  8842 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:55.521104  9008 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:55.533103  9001 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.845s	user 0.006s	sys 0.005s
I20260709 13:17:55.533010  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:55.518308  8749 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.535651  4116 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:17:55.534304  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.515743  9096 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:55.533547  4679 rpcz_store.cc:269] 0709 13:17:54.277531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.277838 (+   307us) service_pool.cc:224] Handling call
0709 13:17:55.512018 (+1234180us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54008da254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:55.512122 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185083136}
I20260709 13:17:55.513506  4042 rpcz_store.cc:276] 0709 13:17:53.927887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:53.929151 (+  1264us) service_pool.cc:224] Handling call
0709 13:17:55.512968 (+1583817us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54000b8e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:55.513081 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":901189760}
I20260709 13:17:55.565402  3965 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:17:55.561293  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3215) took 1392 ms. Trace:
I20260709 13:17:55.566607  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.582715  3966 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:55.582310  4045 rpcz_store.cc:276] 0709 13:17:54.168738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.302564 (+133826us) service_pool.cc:224] Handling call
0709 13:17:54.305684 (+  3120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:54.578104 (+272420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.561030 (+982926us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540028c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:55.561227 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622771968}
I20260709 13:17:55.582715  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.575630  8938 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.584725  3965 raft_consensus.cc:2376] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18. Re-sending same reply.
I20260709 13:17:55.585125  8938 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.585608  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.586156  3965 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:55.586961  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:55.575987  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.587980  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.576486  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.590200  3971 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:55.565272  3967 rpcz_store.cc:276] 0709 13:17:52.911133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:52.923893 (+ 12760us) service_pool.cc:224] Handling call
0709 13:17:52.924208 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:52.966005 (+ 41797us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:53.137036 (+171031us) log.cc:844] Serialized 14 byte log entry
0709 13:17:54.679762 (+1542726us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:54.680409 (+   647us) log.cc:844] Serialized 52 byte log entry
0709 13:17:54.860717 (+180308us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:54.966611 (+105894us) log.cc:844] Serialized 14 byte log entry
0709 13:17:55.247439 (+280828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:55.247538 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:55.523085 (+275547us) raft_consensus.cc:1685] finished
0709 13:17:55.523104 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:55.523236 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1884614,"prepare.queue_time_us":629795,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":5886,"raft.queue_time_us":1724682,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":6611,"thread_start_us":518087,"threads_started":4,"wal-append.queue_time_us":499013,"wal-append.run_cpu_time_us":1413,"wal-append.run_wall_time_us":1079132}
I20260709 13:17:55.579452  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:55.536845  8756 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:55.591089  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.591694  3971 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:55.569218  3972 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:55.587476  3965 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:17:55.584394  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.594103  3965 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:17:55.591588  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.595183  3967 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:17:55.574636  9016 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.575075  9084 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.574316  8921 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:55.610647  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.611227  3965 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:55.607899  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:55.608063  3967 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:17:55.614184  3967 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:55.615491  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:55.620712  3971 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:55.600137  8623 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.623744  3968 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:55.614632  4678 raft_consensus.cc:2410] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:17:55.595382  9030 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:55.616245  9063 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.624423  3972 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [14.8-16.9]
W20260709 13:17:55.626420  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:55.575242  9077 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 13:17:55.651557  9030 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.652170  8938 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.610160  8749 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.625208  8650 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.624399  3966 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:17:55.644054  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 66628.3us
I20260709 13:17:55.625811  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:55.587493  8970 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.610615  9016 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.669275  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.649427  3968 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:55.652316  3972 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:17:55.589601  9096 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:55.622025  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.670682  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.672219  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.673559  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.679914  4119 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:55.705171  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.706139  4114 raft_consensus.cc:2410] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:17:55.710237  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 92653.4us
I20260709 13:17:55.642647  8623 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.714282  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.715015  3966 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:55.697666  8938 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:55.667222  9063 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:55.680019  8842 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:55.697863  9118 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.681479  8971 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.679693  9084 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:17:55.655823  9120 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.730803  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.732950  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.734333  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.727200  9117 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:55.737437  8855 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.742045  9109 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.744231  8623 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.745436  8970 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.746387  3972 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:55.680255  8921 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.751807  9016 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.723413  9059 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:17:55.750130  9063 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.763953  9030 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.752342  8757 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:55.733860  9118 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.728262  8842 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.738284  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.734519  9098 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.758754  8938 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:55.773638  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.779870  9109 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:55.780355  9117 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:55.781409  8855 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:55.771445  8757 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:55.782485  8757 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.784961  3963 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:17:55.795066  3937 leader_election.cc:400] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
I20260709 13:17:55.795704  3937 leader_election.cc:403] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:17:55.798955  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.783492  8921 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:55.800310  9118 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:17:55.824167  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.833557  3972 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:17:55.833997  3972 pending_rounds.cc:85] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 10
I20260709 13:17:55.834213  3972 pending_rounds.cc:107] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:17:55.834460  3972 raft_consensus.cc:2889] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:17:55.842525  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72482.6us
I20260709 13:17:55.843297  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:55.842200  8749 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 10. Current term is 11.
W20260709 13:17:55.854012  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 59254.7us
I20260709 13:17:55.855918  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:55.857514  9129 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:55.858137  9129 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.860405  9129 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.835646  9118 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.845703  9109 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:55.875810  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.877502  4117 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:55.850914  9030 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:55.853006  9059 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:55.879047  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.884738  4114 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:55.878873  9016 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:55.885658  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.886161  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.868034  8749 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.882761  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.887539  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:55.863528  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:55.886740  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.894068  4117 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:55.895603  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:55.898617  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.899245  4042 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:55.900005  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.898021  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.880453  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.889142  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.900352  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.900835  3964 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:55.901648  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:55.903167  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.903318  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.904374  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.903353  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.866287  8623 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:55.909384  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.757665  9120 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.905690  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.917083  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:55.917879  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.892663  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.917906  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.906179  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.906874  4047 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:17:55.907172  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.907452  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.908720  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:55.908931  4114 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:55.910527  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.924857  4038 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:55.911365  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.893249  7910 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:55.912714  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.913715  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.913856  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:55.913725  4045 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:17:55.867643  8756 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:55.915302  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:55.944216  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.868322  9118 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.898892  9130 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.943009  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.947381  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.956687  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.884060  9109 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.944713  8870 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:55.885982  9030 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.946264  8923 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.950165  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.974990  3967 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:17:55.975914  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.952935  8749 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:55.977528  9096 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.978060  9120 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.945844  4044 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:17:55.979597  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:55.881436  9077 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:17:55.947710  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:55.981281  9133 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:55.948235  4115 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:55.953810  8847 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:55.982005  8847 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:55.944211  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:55.983415  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.984530  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.985185  8749 raft_consensus.cc:2764] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:17:55.985836  8749 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.937683  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:55.904466  9059 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:55.986294  9096 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:55.987367  9059 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.988737  9118 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.986832  8757 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.948611  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:55.944487  8861 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:55.883908  8938 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:55.905203  8855 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:55.993635  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:55.996928  7910 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:55.899053  9016 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:55.982385  8847 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:55.998145  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:56.019797  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82209.6us
I20260709 13:17:56.009255  4118 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:17:55.991226  8842 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:56.015522  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.020539  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:56.020965  7936 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:56.026185  9016 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:56.026980  8763 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:17:56.027406  8763 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:56.026314  7936 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:56.028385  7936 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:56.030068  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:56.027314  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:55.998426  8841 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.033851  9010 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.034137  8896 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:55.992648  8870 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.008241  9131 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:17:56.035108  9131 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:56.027772  9068 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:56.018698  8855 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:56.036325  9131 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:56.034639  8896 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:56.037477  8896 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.037726  8855 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.037726  9131 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.040113  9131 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:56.040963  4040 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:56.032969  9109 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:55.959316  8756 consensus_queue.cc:1243] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:17:56.035511  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:55.931921  8623 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.042438  9109 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:56.042883  9109 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.043241  9109 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.043648  8870 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.044176  8623 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:55.959429  9130 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.036664  9068 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:56.046654  9130 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.996656  8861 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.047513  8861 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.048400  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:56.046856  9068 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.059116  7936 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.027817  8763 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.035380  8993 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.021313  9129 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:56.067210  4117 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:17:56.067178  9129 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.069779  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:56.070300  4117 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.005007  9077 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:56.061431  9119 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:56.064193  8757 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.066330  8360 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.071933  9084 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:56.087728  8360 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.082409  7936 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.079203  9077 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.085618  9119 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:56.092346  9084 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.093453  9077 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.113620  9066 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.117643  9133 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.118206  9133 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:56.122001  9098 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:17:56.122794  9098 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:56.126731  9030 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.102480  9119 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:56.105468  9129 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.138254  9084 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:56.139026  9098 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.140386  9098 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:56.170643  9133 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.182670  9133 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:55.985836  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:56.411351  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 425437us
I20260709 13:17:56.411626  8996 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:55.996179  3964 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:17:56.417150  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:56.417989  3964 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:56.419000  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:56.420184  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:55.976691  3967 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:17:56.218761  3966 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:55.938174  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:56.002123  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:56.227873  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:56.230522  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:56.235549  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.239051  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3240) took 1436 ms. Trace:
I20260709 13:17:56.244282  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 720) took 1011 ms. Trace:
W20260709 13:17:56.247028  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.249807  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:56.250211  4038 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:17:56.256333  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 183957us
W20260709 13:17:56.257519  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:56.258370  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 193008us
I20260709 13:17:56.263266  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:56.265192  3965 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:17:56.266614  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:56.266746  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:56.270455  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:56.271366  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:56.224180  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:56.286042  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 340728us
I20260709 13:17:56.287986  3869 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 10 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:56.291175  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:56.292654  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:17:56.167587  9077 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:56.460843  8941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.020s	sys 0.061s
W20260709 13:17:56.461445  8941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.021s	sys 0.061s
I20260709 13:17:56.462093  9077 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.177395  9109 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.467787  9109 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.178404  9119 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.359401  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:56.481639  9119 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.483502  4680 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:56.369642  8360 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.372990  9017 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:56.378545  4046 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:56.379415  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:17:56.384891  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.389154  9130 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.390640  8896 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.376394  4040 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:17:56.396059  8861 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:56.404119  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.384733  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:56.384258  4117 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:17:56.440487  3964 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:56.411615  8763 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:56.454556  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.455809  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:56.457494  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:56.458979  4112 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:17:56.469298  4085 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:56.474016  3869 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 12 to 13, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 13 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:17:56.476728  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.477775  4043 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.478609  3971 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:17:56.461503  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46937.1us
I20260709 13:17:56.475524  4121 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 8.
I20260709 13:17:56.487993  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3136) took 1228 ms. Trace:
I20260709 13:17:56.496326  3968 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:56.495388  3965 rpcz_store.cc:276] 0709 13:17:55.256558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.231965 (+975407us) service_pool.cc:224] Handling call
0709 13:17:56.232471 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.452874 (+220403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.484570 (+ 31696us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:56.503103  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.451707  3963 rpcz_store.cc:276] 0709 13:17:55.233070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.520003 (+286933us) service_pool.cc:224] Handling call
0709 13:17:56.243443 (+723440us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001caa54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:56.244023 (+   580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606836608}
I20260709 13:17:56.451411  4039 rpcz_store.cc:276] 0709 13:17:54.802110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:54.896296 (+ 94186us) service_pool.cc:224] Handling call
0709 13:17:54.896592 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:55.309037 (+412445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.238343 (+929306us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540028cb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:56.238759 (+   416us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897979648}
I20260709 13:17:56.501917  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3137) took 1242 ms. Trace:
I20260709 13:17:56.501170  3972 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:56.508563  3971 rpcz_store.cc:276] 0709 13:17:55.256809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.477684 (+1220875us) service_pool.cc:224] Handling call
0709 13:17:56.478221 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.494910 (+ 16689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.498854 (+  3944us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.513434  4044 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:17:56.514423  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.520112  4041 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:56.538889  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.523981  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:56.528640  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59667.5us
I20260709 13:17:56.542788  4047 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:56.534739  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:56.546139  8360 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:17:56.548398  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:56.550756  8763 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.553100  4679 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.554464  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:56.554670  9084 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:56.555286  3963 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:56.555572  9084 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:56.557186  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2709) took 1257 ms. Trace:
I20260709 13:17:56.557636  3970 rpcz_store.cc:276] 0709 13:17:55.281753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.001835 (+720082us) service_pool.cc:224] Handling call
0709 13:17:56.531495 (+529660us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:56.558643  9063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.014s	sys 0.014s
W20260709 13:17:56.559100  9063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.014s	sys 0.014s
I20260709 13:17:56.559424  3970 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:17:56.560119  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3144) took 1301 ms. Trace:
I20260709 13:17:56.560436  3970 rpcz_store.cc:276] 0709 13:17:55.258483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.558447 (+1299964us) service_pool.cc:224] Handling call
0709 13:17:56.558963 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.559835 (+   872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.560049 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.569049  9030 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.569839  9030 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.570652  3964 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:17:56.571013  3964 pending_rounds.cc:85] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:17:56.571282  3964 pending_rounds.cc:107] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:17:56.571612  3964 raft_consensus.cc:2889] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.530815  9130 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.575726  9130 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.521780  9109 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:56.544267  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3130) took 1285 ms. Trace:
I20260709 13:17:56.572494  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3145) took 1313 ms. Trace:
I20260709 13:17:56.572397  9030 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:56.576797  9109 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:56.583323  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.581246  3964 rpcz_store.cc:276] 0709 13:17:55.258702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.569847 (+1311145us) service_pool.cc:224] Handling call
0709 13:17:56.570269 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.572222 (+  1953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.572416 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.577641  3966 rpcz_store.cc:276] 0709 13:17:55.255039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.717223 (+462184us) service_pool.cc:224] Handling call
0709 13:17:55.717494 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.429197 (+711703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.525320 (+ 96123us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540044c0d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:56.540585 (+ 15265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150485760}
I20260709 13:17:56.581802  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3139) took 1310 ms. Trace:
W20260709 13:17:56.593218  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 74427.6us
I20260709 13:17:56.588534  3968 rpcz_store.cc:276] 0709 13:17:55.257325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.529948 (+1272623us) service_pool.cc:224] Handling call
0709 13:17:56.536532 (+  6584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.544645 (+  8113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.544673 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.544718 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:56.567163 (+ 22445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.567236 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.567347 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.550803  3969 raft_consensus.cc:2376] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15. Re-sending same reply.
I20260709 13:17:56.609071  3970 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:17:56.609571  3970 pending_rounds.cc:85] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 9
I20260709 13:17:56.609689  8861 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:56.614910  3970 pending_rounds.cc:107] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:17:56.615262  3970 raft_consensus.cc:2889] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:56.587011  8996 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:56.609171  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:56.625542  4113 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:17:56.603178  8896 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.563390  9017 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.643479  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:56.644256  4680 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:56.649734  8928 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:56.650480  8928 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:56.651810  8928 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.647652  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3146) took 1388 ms. Trace:
I20260709 13:17:56.656191  3970 rpcz_store.cc:276] 0709 13:17:55.258931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.591217 (+1332286us) service_pool.cc:224] Handling call
0709 13:17:56.608636 (+ 17419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.644964 (+ 36328us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.647595 (+  2631us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:17:56.666807  8847 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.007s
I20260709 13:17:56.667357  8847 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.668725  4115 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:56.663303  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:56.638679  8861 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:56.634002  8996 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.689661  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:56.696671  9011 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.697445  9011 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.699860  9011 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:56.701079  3964 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:17:56.701723  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2720) took 1228 ms. Trace:
I20260709 13:17:56.702040  3964 rpcz_store.cc:276] 0709 13:17:55.473300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.700220 (+1226920us) service_pool.cc:224] Handling call
0709 13:17:56.700660 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.701480 (+   820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.701668 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.703961  4680 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:17:56.705785  4043 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:56.690896  7936 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.696491  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3143) took 1436 ms. Trace:
I20260709 13:17:56.712852  3972 rpcz_store.cc:276] 0709 13:17:55.258219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.685120 (+1426901us) service_pool.cc:224] Handling call
0709 13:17:56.685531 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.691023 (+  5492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.691053 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.691118 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:56.694710 (+  3592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.694793 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.694987 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.714696  3972 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:17:56.686466  8896 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.682253  9130 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:56.707823  3965 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:17:56.710297  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3147) took 1451 ms. Trace:
I20260709 13:17:56.727631  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:56.729916  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3141) took 1467 ms. Trace:
I20260709 13:17:56.730389  3965 rpcz_store.cc:276] 0709 13:17:55.257769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.658104 (+1400335us) service_pool.cc:224] Handling call
0709 13:17:56.681556 (+ 23452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.724204 (+ 42648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.725515 (+  1311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.729758  4680 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:56.739027  3970 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:56.726452  3969 rpcz_store.cc:276] 0709 13:17:55.259153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.646843 (+1387690us) service_pool.cc:224] Handling call
0709 13:17:56.669383 (+ 22540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.706871 (+ 37488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.706899 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.706940 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:56.706979 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.707034 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.710242 (+  3208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.743000  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:56.756953  4120 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:17:56.709704  9030 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:17:56.771698  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49213.8us
I20260709 13:17:56.707118  8861 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.725790  9011 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.766168  7936 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.774130  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2718) took 1306 ms. Trace:
W20260709 13:17:56.775528  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 166579us
I20260709 13:17:56.779789  4047 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:17:56.772619  3968 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.749147  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:56.820266  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:56.822088  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2711) took 1533 ms. Trace:
I20260709 13:17:56.822525  3968 rpcz_store.cc:276] 0709 13:17:55.288467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.691632 (+1403165us) service_pool.cc:224] Handling call
0709 13:17:56.754531 (+ 62899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.821796 (+ 67265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.822022 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.823495  3966 rpcz_store.cc:276] 0709 13:17:55.467227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.695328 (+1228101us) service_pool.cc:224] Handling call
0709 13:17:56.727653 (+ 32325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.766579 (+ 38926us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.766608 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.773868 (+  7260us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:56.773911 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.773968 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.774071 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.828467  4117 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:56.826999  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:56.757251  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2712) took 1454 ms. Trace:
I20260709 13:17:56.833801  3970 rpcz_store.cc:276] 0709 13:17:55.302376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.657011 (+1354635us) service_pool.cc:224] Handling call
0709 13:17:56.722732 (+ 65721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.747184 (+ 24452us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.757045 (+  9861us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.928857  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:56.773654  9030 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:56.829126  8847 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.944470  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 725) took 1177 ms. Trace:
I20260709 13:17:56.946002  4119 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:56.935756  4039 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:56.945499  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 116241us
I20260709 13:17:56.950510  3968 rpcz_store.cc:276] 0709 13:17:55.766770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.932900 (+1166130us) service_pool.cc:224] Handling call
0709 13:17:56.943642 (+ 10742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.944042 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.944071 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.944165 (+    94us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:56.944206 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.944267 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.944394 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.776419  8896 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.959844  4121 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:56.957679  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:56.953318  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 131979us
I20260709 13:17:56.954443  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 723) took 1188 ms. Trace:
I20260709 13:17:56.831485  9098 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:56.937999  9030 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:56.962248  3972 rpcz_store.cc:276] 0709 13:17:55.766236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.722637 (+956401us) service_pool.cc:224] Handling call
0709 13:17:56.787201 (+ 64564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.949367 (+162166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.949397 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.949530 (+   133us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:17:56.949593 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.949707 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.954358 (+  4651us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.927165  9011 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:56.980967  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 724) took 1214 ms. Trace:
W20260709 13:17:56.972007  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 352695us
I20260709 13:17:56.970752  4118 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
W20260709 13:17:56.990100  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.927886  9130 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:56.997457  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:56.988785  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2599) took 1500 ms. Trace:
I20260709 13:17:56.996053  3965 rpcz_store.cc:276] 0709 13:17:55.766507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.770810 (+1004303us) service_pool.cc:224] Handling call
0709 13:17:56.937884 (+167074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.980629 (+ 42745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.980657 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:56.980699 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:56.980729 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.980807 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:56.980913 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:56.999914  4113 rpcz_store.cc:276] 0709 13:17:55.476253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.476864 (+   611us) service_pool.cc:224] Handling call
0709 13:17:56.959709 (+1482845us) spinlock_profiling.cc:243] Waited 970 ms on lock 0x7b54001446d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:56.976179 (+ 16470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2231997696}
I20260709 13:17:56.969394  9109 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.016185  4120 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.014698  9135 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.017707  3869 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.019568  3869 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:57.021611  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58566.2us
I20260709 13:17:57.023098  3967 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:57.023801  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 729) took 1237 ms. Trace:
I20260709 13:17:57.024103  3967 rpcz_store.cc:276] 0709 13:17:55.786075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.964711 (+1178636us) service_pool.cc:224] Handling call
0709 13:17:57.022776 (+ 58065us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.023533 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.023746 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.026098  8996 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:57.029793  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46971.8us
I20260709 13:17:57.032920  9066 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:57.036671  7936 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:56.974763  9098 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:57.050202  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:56.977932  9137 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.320s
I20260709 13:17:57.042232  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:57.052785  3869 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 11 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 12 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:17:57.070399  4041 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.000s
I20260709 13:17:57.033460  9066 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.071578  4041 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:17:57.073542  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 240089us
I20260709 13:17:57.045130  9017 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.082525  3968 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260709 13:17:57.087229  3963 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.531s	user 0.011s	sys 0.000s
I20260709 13:17:57.087575  3963 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
I20260709 13:17:57.071867  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 394) took 1033 ms. Trace:
I20260709 13:17:57.091363  4679 rpcz_store.cc:276] 0709 13:17:56.026457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.026620 (+   163us) service_pool.cc:224] Handling call
0709 13:17:56.026960 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.553688 (+526728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.006807 (+453119us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400600ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:57.054196 (+ 47389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105477376}
I20260709 13:17:57.092015  3971 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 11. Current term is 12. Ops: []
I20260709 13:17:57.071935  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:17:57.093233  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70866.9us
I20260709 13:17:57.082994  3968 pending_rounds.cc:85] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
W20260709 13:17:57.096974  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61585.1us
I20260709 13:17:57.099334  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3158) took 1262 ms. Trace:
I20260709 13:17:57.099695  3967 rpcz_store.cc:276] 0709 13:17:55.836649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.041219 (+1204570us) service_pool.cc:224] Handling call
0709 13:17:57.081709 (+ 40490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.094917 (+ 13208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.094945 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.099090 (+  4145us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:57.099129 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.099185 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.099281 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.076176  8855 raft_consensus.cc:2764] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:17:57.101899  3968 pending_rounds.cc:107] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:17:57.103653  3968 raft_consensus.cc:2889] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:57.017643  9135 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:57.105265  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 174333us
W20260709 13:17:57.104954  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 82811.9us
I20260709 13:17:57.111523  8941 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:57.114215  9144 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
I20260709 13:17:57.114444  8941 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.114836  8941 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.115386  9066 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:17:57.115986  9145 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:17:57.111583  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2854) took 1023 ms. Trace:
I20260709 13:17:57.116755  3869 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.117787  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 730) took 1304 ms. Trace:
I20260709 13:17:57.110090  8360 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:57.124634  3972 rpcz_store.cc:276] 0709 13:17:55.813286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.030404 (+1217118us) service_pool.cc:224] Handling call
0709 13:17:57.082541 (+ 52137us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.110273 (+ 27732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.110306 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:57.117547 (+  7241us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:57.117588 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.117642 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.117737 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.121549  8861 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.128465  8360 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:57.136852  9152 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:17:57.137642  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 185581us
I20260709 13:17:57.136881  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2613) took 1131 ms. Trace:
W20260709 13:17:57.141227  3866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 239) took 25485 ms (client timeout 15000 ms). Trace:
I20260709 13:17:57.141358  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:57.142558  9068 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:17:57.142364  3869 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 7 to 14, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 14 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:17:57.117933  4114 rpcz_store.cc:276] 0709 13:17:56.001296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.002251 (+   955us) service_pool.cc:224] Handling call
0709 13:17:56.002559 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.024185 (+ 21626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.024218 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.055066 (+ 30848us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.538488 (+483422us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:56.542530 (+  4042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.557000 (+ 14470us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.024483 (+467483us) raft_consensus.cc:1685] finished
0709 13:17:57.024505 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.024684 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21219,"raft.queue_time_us":22868,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":408577,"threads_started":1,"wal-append.queue_time_us":759027}
W20260709 13:17:57.143985  9153 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:17:57.144312  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75117.1us
I20260709 13:17:57.139321  8360 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.142767  4118 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:57.143807  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:57.149626  4113 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:57.140369  4116 rpcz_store.cc:276] 0709 13:17:55.997458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:55.998342 (+   884us) service_pool.cc:224] Handling call
0709 13:17:55.998658 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.021594 (+ 22936us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:17:56.061205 (+ 39611us) log.cc:844] Serialized 14 byte log entry
0709 13:17:56.502506 (+441301us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.591851 (+ 89345us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.606294 (+ 14443us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:56.606331 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.621786 (+ 15455us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.117534 (+495748us) raft_consensus.cc:1685] finished
0709 13:17:57.117553 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.128373 (+ 10820us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30609,"prepare.queue_time_us":47301,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":62133,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":3169,"thread_start_us":180640,"threads_started":1,"wal-append.queue_time_us":881538}
W20260709 13:17:57.137079  9141 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:17:57.160905  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.162756  3963 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:17:57.162942  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.157727  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:57.145701  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3151) took 1573 ms. Trace:
I20260709 13:17:57.165143  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 733) took 1213 ms. Trace:
I20260709 13:17:57.165532  3963 rpcz_store.cc:276] 0709 13:17:55.951889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.101264 (+1149375us) service_pool.cc:224] Handling call
0709 13:17:57.123866 (+ 22602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.164858 (+ 40992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.165080 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:17:57.166396  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:17:57.169636  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.170046  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.163774  3964 rpcz_store.cc:276] 0709 13:17:55.572381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.702824 (+1130443us) service_pool.cc:224] Handling call
0709 13:17:56.703209 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:56.703646 (+   437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:56.703681 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:56.704172 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:17:56.827943 (+123771us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:56.828371 (+   428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:56.828939 (+   568us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:57.145406 (+316467us) raft_consensus.cc:1685] finished
0709 13:17:57.145434 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:57.145627 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":323096,"spinlock_wait_cycles":10880768,"thread_start_us":121936,"threads_started":1,"wal-append.queue_time_us":311354}
I20260709 13:17:57.173995  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:57.144449  9137 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:57.159204  8896 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:57.159706  9158 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:57.193063  9137 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.193444  9158 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.142419  9156 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.194469  9156 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.195569  9158 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.195055  4112 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:57.192622  9068 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:17:57.201588  4116 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
W20260709 13:17:57.141673  3866 rpcz_store.cc:269] 0709 13:17:31.611738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:31.614438 (+  2700us) service_pool.cc:224] Handling call
0709 13:17:57.093404 (+25478966us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:47.651918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:47.835112 (+183194us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:47.838746 (+  3634us) write_op.cc:435] Acquired schema lock
0709 13:17:47.839998 (+  1252us) tablet.cc:662] Decoding operations
0709 13:17:47.882962 (+ 42964us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:47.897943 (+ 14981us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:47.904965 (+  7022us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:17:47.960881 (+ 55916us) tablet.cc:701] Row locks acquired
0709 13:17:47.960939 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:17:47.973213 (+ 12274us) write_op.cc:270] Start()
0709 13:17:47.990782 (+ 17569us) write_op.cc:276] Timestamp: P: 1783603067961027 usec, L: 0
0709 13:17:47.999846 (+  9064us) op_driver.cc:348] REPLICATION: starting
0709 13:17:48.089327 (+ 89481us) log.cc:844] Serialized 5964 byte log entry
0709 13:17:49.114565 (+1025238us) op_driver.cc:464] REPLICATION: finished
0709 13:17:49.253094 (+138529us) write_op.cc:301] APPLY: starting
0709 13:17:49.253188 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:49.373205 (+120017us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644932a 00007fed763cef14 00007fed763ceec3 00007fed763cee38 00007fed763cedf3 00007fed763ce0dc 00007fed763f7e16 00007fed763dfcbb 00007fed763ca39d 00007fed763cdd75
0709 13:17:49.378787 (+  5582us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:49.378829 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:49.886481 (+507652us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:50.018865 (+132384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:17:50.018941 (+    76us) write_op.cc:312] APPLY: finished
0709 13:17:50.022921 (+  3980us) log.cc:844] Serialized 139 byte log entry
0709 13:17:50.416490 (+393569us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:50.439187 (+ 22697us) write_op.cc:454] Released schema lock
0709 13:17:50.472463 (+ 33276us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:50.550787 (+ 78324us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:50.552673 (+  1886us) write_op.cc:454] Released schema lock
0709 13:17:51.802410 (+1249737us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
Metrics: {"mutex_wait_us":296372,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":138222,"apply.run_cpu_time_us":91225,"apply.run_wall_time_us":1264915,"cfile_cache_hit":62,"cfile_cache_hit_bytes":67037,"num_ops":15,"prepare.queue_time_us":105307,"prepare.run_cpu_time_us":20624,"prepare.run_wall_time_us":792485,"raft.queue_time_us":173362,"raft.run_cpu_time_us":42561,"raft.run_wall_time_us":324275,"replication_time_us":1058737,"spinlock_wait_cycles":23661568,"thread_start_us":862777,"threads_started":5,"wal-append.queue_time_us":1141706,"wal-append.run_cpu_time_us":40500,"wal-append.run_wall_time_us":3594866}]]}
I20260709 13:17:57.196218  9158 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:17:57.201574  9156 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.214643  8861 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:57.215574  8861 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:17:57.215886  8861 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:57.217072  7910 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:17:57.218588  8844 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:57.220302  8844 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:57.221529  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:57.203279  9146 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:17:57.222966  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:57.221104  9043 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:17:57.226486  4039 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:17:57.195525  9137 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:57.233070  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67067.5us
I20260709 13:17:57.229460  7910 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:17:57.199219  9066 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:17:57.224435  9156 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:57.230880  9119 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.002s
I20260709 13:17:57.230297  9011 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:57.255264  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:57.263667  9059 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:57.264140  4649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 2.164s (SENT) [suppressed 8 similar messages]
I20260709 13:17:57.222224  8896 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:17:57.255777  9098 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.230918  9109 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:17:57.224295  8861 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.236938  9017 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:57.231889  8763 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:17:57.311556  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 170308us
I20260709 13:17:57.311476  8360 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.313406  9167 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:57.262676  9119 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.016s	sys 0.002s
W20260709 13:17:57.321019  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 209467us
W20260709 13:17:57.322103  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65199.3us
W20260709 13:17:57.322062  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103763us
I20260709 13:17:57.265053  9130 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.231223  8847 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:17:57.256747  8941 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:57.332656  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 119171us
I20260709 13:17:57.314137  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:57.317055  9059 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:57.333876  4118 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:17:57.327070  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:57.295164  9159 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:57.320133  8763 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:57.320406  9017 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.265456  9137 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:17:57.338619  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2855) took 1313 ms. Trace:
I20260709 13:17:57.337211  9167 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.339762  9166 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:17:57.295418  9066 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:17:57.321096  9030 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.339419  4115 rpcz_store.cc:276] 0709 13:17:56.025080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.028881 (+  3801us) service_pool.cc:224] Handling call
0709 13:17:56.029143 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:56.681343 (+652200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.332997 (+651654us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540034e254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:57.338558 (+  5561us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470083456}
I20260709 13:17:57.336447  9059 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.266901  9156 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.345520  9157 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.347108  9109 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:17:57.347136  9159 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.350355  9109 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:57.350816  9030 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.342543  8861 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.351572  9109 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.354856  4120 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:57.357450  9163 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:57.358670  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:57.361330  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:57.338614  9017 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:57.368570  9164 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:57.370935  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 106829us
I20260709 13:17:57.374670  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:57.375527  9166 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:57.376554  9166 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.377143  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:57.374648  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47608.1us
W20260709 13:17:57.385006  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46203.9us
I20260709 13:17:57.350373  9167 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.369107  9164 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:57.395689  9174 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:57.389503  9109 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:17:57.409571  8360 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.368554  9172 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:17:57.350867  9159 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.397758  9164 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:57.370260  9157 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.408347  9084 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:17:57.440307  9170 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:57.445152  9170 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.445569  9170 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.440557  8941 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.457037  9172 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:17:57.458822  9172 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.459260  9172 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.461270  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:57.461901  3963 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:57.465214  9149 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:17:57.466924  9157 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.441335  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:57.470955  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.472873  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:57.461205  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.441823  9133 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:57.476231  3967 raft_consensus.cc:2368] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:17:57.478528  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:57.479439  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:57.480154  4039 raft_consensus.cc:2368] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
W20260709 13:17:57.467203  9143 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.496s	user 0.000s	sys 0.001s
I20260709 13:17:57.483194  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:57.485232  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:57.485960  4043 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:57.486474  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:57.487053  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:57.487596  4677 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.490041  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:57.496155  8847 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:57.497067  8847 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.499167  8847 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.496212  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:57.489883  8896 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.495276  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.415836  8763 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.502741  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.503801  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:57.520364  4677 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
W20260709 13:17:57.506536  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 129508us
I20260709 13:17:57.521090  3963 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:57.522245  3967 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:57.502226  9135 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.496273  9178 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:17:57.528304  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:57.503049  8763 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.533244  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.533922  3963 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:57.538451  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.523620  9176 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:57.542902  3967 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:17:57.532841  9157 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:57.547755  8844 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:57.548151  8847 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.548384  8360 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.548703  9164 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.549438  8844 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.551642  8844 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:57.551570  9164 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.548961  8360 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.544389  9159 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.554277  8360 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:57.555725  4085 leader_election.cc:400] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:17:57.556826  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:57.551685  9156 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.557050  9159 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:57.558322  9177 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:57.558184  9159 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.559219  9182 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:17:57.560190  9159 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.560325  9182 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:57.557334  9157 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:57.560994  8847 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.561368  9157 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.542044  9178 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:57.560674  9182 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:57.605891  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:57.620604  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.627084  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:57.540431  8861 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:57.634302  3963 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:57.542394  9176 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:57.638211  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 149745us
W20260709 13:17:57.638751  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82034.2us
I20260709 13:17:57.639518  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:57.642346  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3142) took 2384 ms. Trace:
I20260709 13:17:57.643271  3971 rpcz_store.cc:276] 0709 13:17:55.257996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.664878 (+1406882us) service_pool.cc:224] Handling call
0709 13:17:57.088018 (+423140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.092458 (+  4440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.642129 (+549671us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54003976d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:57.642279 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972115840}
I20260709 13:17:57.643217  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 728) took 1872 ms. Trace:
I20260709 13:17:57.645844  3968 rpcz_store.cc:276] 0709 13:17:55.770325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:56.954534 (+1184209us) service_pool.cc:224] Handling call
0709 13:17:57.001158 (+ 46624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:57.133520 (+132362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.642977 (+509457us) spinlock_profiling.cc:243] Waited 73.9 ms on lock 0x7b54001caa54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:57.643157 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170025344}
I20260709 13:17:57.539189  9017 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.640575  8861 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:57.635906  9172 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.685940  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:57.682147  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:57.688160  3967 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:57.686612  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.689230  3970 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:17:57.690222  4041 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:57.688756  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:57.691684  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.691910  3966 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.693140  9170 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.695214  9170 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.685086  9157 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:57.695785  9183 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.695952  9157 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.696378  9183 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.697036  9043 raft_consensus.cc:2764] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:17:57.697335  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54983.1us
I20260709 13:17:57.698114  9157 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.648067  9109 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:57.699445  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.698604  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:57.679214  9133 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:57.676748  9084 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:57.759702  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:17:57.762270  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 80735.4us
W20260709 13:17:57.762558  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64111.6us
I20260709 13:17:57.704536  3966 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:17:57.728451  3963 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
W20260709 13:17:57.777055  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.777551  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:57.821022  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51089.7us
I20260709 13:17:57.821018  3970 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:57.823104  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.824280  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.824915  3963 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:57.825876  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.826355  9043 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:57.827005  9043 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.829633  9043 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:57.830257  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:17:57.830598  3970 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:57.831790  3970 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:57.826984  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:57.850598  9155 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.619s	user 0.000s	sys 0.004s
W20260709 13:17:57.851739  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 234194us
I20260709 13:17:57.839839  3968 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:17:57.852509  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 218328us
I20260709 13:17:57.698560  9183 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.722564  9109 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:57.705816  8847 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:57.707070  9017 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.859951  3963 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:17:57.771375  8360 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:17:57.917101  9186 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.230s	user 0.000s	sys 0.009s
I20260709 13:17:57.831879  9170 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.705147  9178 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.916421  9185 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.923980  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:57.857856  9109 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:57.699095  9182 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.761834  9133 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:57.917030  8360 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:57.941138  9185 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.943331  3966 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:17:57.946272  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:57.700681  8861 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:57.852242  9157 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 13:17:57.930990  9066 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.944219  9133 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:57.945854  8360 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:57.956115  9159 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:57.957130  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:17:57.960861  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:57.931329  9170 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.860736  9176 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:57.980302  9196 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:17:57.979091  8896 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:57.982026  8896 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:57.982893  8896 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:57.984978  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 66916.5us
I20260709 13:17:57.985311  9159 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.987524  9159 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:57.979285  9066 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:57.970307  9157 consensus_queue.cc:1243] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:17:57.992501  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:57.990674  9059 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.620s	user 0.001s	sys 0.009s
W20260709 13:17:58.018594  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 63895.2us
I20260709 13:17:58.046752  9157 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.047317  9157 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.009768  9059 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.053572  3967 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:58.005003  9200 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:17:58.081929  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.044939  9066 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.051198  9177 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:17:58.081842  9198 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:17:58.080485  9159 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:58.096220  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 106410us
I20260709 13:17:58.097199  4086 leader_election.cc:400] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:17:58.097609  4086 leader_election.cc:403] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:17:58.097273  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:58.081388  9200 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:17:58.109619  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 137833us
I20260709 13:17:58.111168  9066 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.116672  9133 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.101529  9200 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:58.111610  9017 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.138602  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.124893  9133 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.112495  9159 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.125686  9156 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.119210  9157 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:58.151898  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54731.8us
I20260709 13:17:58.141163  9017 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:58.142482  9185 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:58.157351  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43799.4us
I20260709 13:17:58.153147  9206 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.156284  9017 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:58.166397  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.166494  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.161855  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:58.162786  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.155961  9170 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.147616  9156 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.181362  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.181557  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.198323  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.198983  4040 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:58.200387  9059 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.202847  9209 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.203387  9209 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.222319  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:58.223837  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:58.223325  3968 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:17:58.233534  4045 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:17:58.235088  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.236629  4043 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.236482  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.246007  9156 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.247403  9209 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.255738  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.255323  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.277664  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.278563  4044 raft_consensus.cc:2410] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:17:58.280575  4044 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:58.288029  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.224900  9030 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.230247  9159 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.247903  9109 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.293519  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.295928  4114 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:17:58.301412  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.302165  4113 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:58.273283  9216 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.304852  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.306315  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.305902  4116 raft_consensus.cc:2376] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15. Re-sending same reply.
W20260709 13:17:58.307394  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 145665us
I20260709 13:17:58.291848  9209 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:17:58.314704  8847 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:58.320600  8847 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.320996  8847 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:17:58.325030  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 108101us
I20260709 13:17:58.325940  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.326313  4043 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:58.328333  9109 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.329888  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.249603  9200 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.336946  9083 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.307443  8360 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.324898  9066 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:17:58.346696  4038 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:58.316470  8896 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:17:58.316056  9084 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:17:58.391157  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:58.389917  9066 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.394531  9066 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:17:58.394928  9066 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:58.395181  8360 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.404387  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.405158  4039 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:17:58.405834  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.407214  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:58.405369  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:17:58.408999  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:58.409440  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.407481  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.411010  9176 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.412402  9030 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.412925  9030 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.413439  8861 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:58.414321  9185 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:58.415452  9130 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:58.415799  9130 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:58.418866  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:17:58.419516  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:17:58.412935  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:58.426352  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77352.2us
I20260709 13:17:58.337772  9083 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.343096  9209 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.348589  8844 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 13:17:58.431861  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:58.436025  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.439157  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.441423  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.440928  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.445267  4112 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:58.428082  9109 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:17:58.449009  4115 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:17:58.431376  9183 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:17:58.451488  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.455991  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:58.456243  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.457067  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:58.465075  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 124585us
I20260709 13:17:58.465978  8870 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:17:58.440551  9137 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.467170  9137 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:58.468182  9137 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.472173  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.478641  9209 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.479334  9059 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:58.480006  9059 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.481673  9083 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.482436  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.486801  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.465946  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:58.501401  4114 raft_consensus.cc:2368] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:58.502385  4112 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:58.503345  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 173558us
I20260709 13:17:58.504654  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.505961  4046 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:58.448431  8844 consensus_queue.cc:1243] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:17:58.452273  9030 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.507331  9059 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.452749  9109 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.504494  9172 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:17:58.500208  9226 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:17:58.504222  9215 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:17:58.510026  9191 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:17:58.517264  9017 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.523677  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.516719  8847 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.526834  9109 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.527275  9172 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:58.530186  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.603777  9172 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.550086  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.605392  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.605904  4043 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:17:58.606663  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.607604  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:17:58.529739  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63904.7us
I20260709 13:17:58.610972  4043 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:58.611794  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:58.613798  9202 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:58.614403  9202 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:58.615579  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:58.562992  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.532043  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.537536  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.541706  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.542625  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.542663  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.617153  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.543955  3970 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:17:58.547744  9130 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.548537  9182 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.596107  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3160) took 1138 ms. Trace:
I20260709 13:17:58.596699  8855 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:17:58.530972  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:58.596017  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 270131us
I20260709 13:17:58.547698  3965 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:17:58.599061  9017 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.599792  9179 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:58.531168  8844 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:17:58.600121  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3181) took 1054 ms. Trace:
I20260709 13:17:58.558142  9135 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:17:58.601032  4044 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:58.549309  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.550213  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.549218  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:58.552814  9211 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.206s	user 0.005s	sys 0.000s
I20260709 13:17:58.553557  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.636993  4683 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:17:58.631806  3966 rpcz_store.cc:276] 0709 13:17:57.545437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.949995 (+404558us) service_pool.cc:224] Handling call
0709 13:17:57.955431 (+  5436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.966469 (+ 11038us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:17:58.246684 (+280215us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18003ae4c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:17:58.285828 (+ 39144us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.596444 (+310616us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.596999 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.597161 (+   162us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:58.597374 (+   213us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.599654 (+  2280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.599736 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.599905 (+   169us) raft_consensus.cc:1685] finished
0709 13:17:58.599928 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.600060 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261859,"prepare.queue_time_us":179791,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":97,"raft.queue_time_us":269037,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":1362,"spinlock_wait_cycles":4832640,"thread_start_us":84451,"threads_started":2,"wal-append.queue_time_us":108904}
I20260709 13:17:58.638211  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.639014  9183 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.639418  9183 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.639802  9183 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.641327  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.641899  4115 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.518883  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.553918  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.647972  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.648252  9237 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:17:58.648290  4113 raft_consensus.cc:2368] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:58.648903  9237 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.556123  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.650091  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.649928  9237 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.649179  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.651186  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.651785  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.652905  8844 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.627398  9202 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.653898  8844 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.650204  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.655860  9209 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.528966  9200 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.656364  9209 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.594864  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3178) took 1050 ms. Trace:
I20260709 13:17:58.653123  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.550949  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.609031  9109 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.658398  4038 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:58.657482  3963 rpcz_store.cc:276] 0709 13:17:57.544614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.861398 (+316784us) service_pool.cc:224] Handling call
0709 13:17:57.916582 (+ 55184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.916994 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.917034 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.917532 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.098325 (+180793us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:58.290741 (+192416us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.594528 (+303787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.594615 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.594659 (+    44us) raft_consensus.cc:1685] finished
0709 13:17:58.594670 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.594793 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317807,"prepare.queue_time_us":51001,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":305545,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":8083,"thread_start_us":331275,"threads_started":2,"wal-append.queue_time_us":202590}
I20260709 13:17:58.657064  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3183) took 1111 ms. Trace:
I20260709 13:17:58.653160  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.659920  3967 rpcz_store.cc:276] 0709 13:17:57.545991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.079441 (+533450us) service_pool.cc:224] Handling call
0709 13:17:58.079784 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.114746 (+ 34962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.114781 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.117124 (+  2343us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.155757 (+ 38633us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.165954 (+ 10197us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.166133 (+   179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.166201 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.656853 (+490652us) raft_consensus.cc:1685] finished
0709 13:17:58.656875 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.656998 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25052,"prepare.queue_time_us":10021,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":23599,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":6084,"thread_start_us":63010,"threads_started":2,"wal-append.queue_time_us":105863}
I20260709 13:17:58.661360  4039 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:17:58.661768  9209 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.652557  4119 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:17:58.609639  4046 raft_consensus.cc:2368] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:58.652237  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.549968  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.657107  4045 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:58.618840  4043 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:58.628865  4041 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 9.
I20260709 13:17:58.629114  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:17:58.629590  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 199978us
I20260709 13:17:58.659715  4038 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:17:58.666522  4038 pending_rounds.cc:85] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 8
I20260709 13:17:58.666298  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.594825  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3187) took 1047 ms. Trace:
I20260709 13:17:58.621896  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:58.618635  9192 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.010s	sys 0.010s
I20260709 13:17:58.635032  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.635100  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.670404  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.644270  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.644972  4120 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:17:58.646003  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115123us
I20260709 13:17:58.671092  4677 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:17:58.672147  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:58.673454  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.618302  9059 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:17:58.678056  9059 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:58.678478  9059 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:17:58.678817  9236 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:58.679222  9236 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.679721  9209 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:58.680122  9209 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.680473  9209 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.670083  8847 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.679972  9236 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.682329  9236 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.684438  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.667320  3971 rpcz_store.cc:276] 0709 13:17:57.547209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.233662 (+686453us) service_pool.cc:224] Handling call
0709 13:17:58.233928 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.234288 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:58.234687 (+   399us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.555326 (+320639us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18004aaee0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:17:58.594427 (+ 39101us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.594488 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.594542 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.594611 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.594757 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14447,"prepare.queue_time_us":14722,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":2849,"raft.queue_time_us":308702,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":6672128,"thread_start_us":51295,"threads_started":1,"wal-append.queue_time_us":102036}
W20260709 13:17:58.685473  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 63665.7us
I20260709 13:17:58.672907  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.687048  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.684918  4116 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
W20260709 13:17:58.689428  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.652421  9183 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.517992  9066 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:58.548856  9222 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.095s	user 0.000s	sys 0.004s
I20260709 13:17:58.696398  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3184) took 1150 ms. Trace:
I20260709 13:17:58.696753  3972 rpcz_store.cc:276] 0709 13:17:57.546259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.191301 (+645042us) service_pool.cc:224] Handling call
0709 13:17:58.191621 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.191945 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.191973 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.192456 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.303570 (+111114us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:58.303612 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.303680 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.696204 (+392524us) raft_consensus.cc:1685] finished
0709 13:17:58.696224 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.696342 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2575,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":122,"thread_start_us":110761,"threads_started":1,"wal-append.queue_time_us":165519}
I20260709 13:17:58.666855  4038 pending_rounds.cc:107] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:17:58.631223  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.699507  4038 raft_consensus.cc:2889] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:58.670063  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3186) took 1123 ms. Trace:
I20260709 13:17:58.673830  4117 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:58.690470  9135 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.700986  9135 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.701473  3967 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:17:58.674045  4115 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:58.703616  4115 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:17:58.700342  9221 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:17:58.704993  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:17:58.700068  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68924.4us
I20260709 13:17:58.705981  9030 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.706589  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:58.707289  9230 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:17:58.700075  3968 rpcz_store.cc:276] 0709 13:17:57.546777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.228091 (+681314us) service_pool.cc:224] Handling call
0709 13:17:58.272070 (+ 43979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.273762 (+  1692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.273796 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.302983 (+ 29187us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.507037 (+204054us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:17:58.511460 (+  4423us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.599134 (+ 87674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.599218 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.669866 (+ 70648us) raft_consensus.cc:1685] finished
0709 13:17:58.669886 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.670007 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":380663,"prepare.queue_time_us":4425,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":105705,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":7957,"thread_start_us":163935,"threads_started":1,"wal-append.queue_time_us":305943}
W20260709 13:17:58.708426  9232 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
I20260709 13:17:58.709167  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:58.711136  9212 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:17:58.712437  4118 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:17:58.713007  9098 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:58.712570  9221 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:58.713402  9098 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:17:58.700343  9164 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:17:58.708453  3966 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 8. Current term is 9. Ops: []
I20260709 13:17:58.714294  9172 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.714322  9098 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.716858  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:58.717810  9212 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.719343  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.719949  9221 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.720099  9212 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:58.692602  9188 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.967s	user 0.011s	sys 0.004s
I20260709 13:17:58.722193  4680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 407) took 1250 ms. Trace:
I20260709 13:17:58.722461  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:58.722543  4680 rpcz_store.cc:276] 0709 13:17:57.471751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.471875 (+   124us) service_pool.cc:224] Handling call
0709 13:17:57.472205 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:57.472601 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:57.472630 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:57.473109 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:17:57.601679 (+128570us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:17:57.601724 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:57.601801 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:58.639479 (+1037678us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:17:58.721897 (+ 82418us) raft_consensus.cc:1685] finished
0709 13:17:58.721918 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.722117 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1339,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6126,"spinlock_wait_cycles":3402112,"thread_start_us":127652,"threads_started":1,"wal-append.queue_time_us":212283}
I20260709 13:17:58.724838  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.725452  4120 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:58.726009  9185 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:17:58.727093  9212 raft_consensus.cc:2764] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:58.728646  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.715693  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:17:58.729939  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57152us
I20260709 13:17:58.730520  9212 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.730929  9212 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.731309  9212 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:58.711064  9135 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.730185  9220 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.738999  9220 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:58.738924  9212 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.677045  9083 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:17:58.672057  9192 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.010s	sys 0.010s
I20260709 13:17:58.677505  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:58.689731  4116 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 13:17:58.690002  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.691406  8360 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:58.677529  8896 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:17:58.747340  9083 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:17:58.740803  9183 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:58.748137  8896 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:17:58.748728  8896 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.744246  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:58.749681  8896 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.750866  8896 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:17:58.751262  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.691884  9084 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:17:58.691815  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:58.752080  9084 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.752465  9084 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.692893  4112 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:58.631858  9179 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:58.753536  9083 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:17:58.754067  9179 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.754561  9083 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:58.754918  9083 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.755360  9179 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:58.756441  8855 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:58.695149  9066 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.694658  9177 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:58.739787  9221 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:17:58.757577  9221 consensus_queue.cc:1243] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:17:58.726493  9185 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:58.741286  9043 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:58.717012  9098 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:58.742146  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 55694.7us
I20260709 13:17:58.776034  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:58.628469  3964 rpcz_store.cc:276] 0709 13:17:57.457522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.188476 (+730954us) service_pool.cc:224] Handling call
0709 13:17:58.188815 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.189090 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:17:58.229356 (+ 40266us) log.cc:844] Serialized 14 byte log entry
0709 13:17:58.595786 (+366430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:17:58.595838 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:17:58.595894 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.595953 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:58.596058 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185280,"prepare.queue_time_us":41967,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":170766,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"thread_start_us":122910,"threads_started":1,"wal-append.queue_time_us":286127}
I20260709 13:17:58.742982  9220 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.743873  9209 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.779409  4038 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:58.711197  9130 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.755859  9083 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.780854  9209 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:58.781225  9083 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:58.781841  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:58.782451  4680 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:17:58.783491  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74430.5us
I20260709 13:17:58.768599  9043 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.784838  9043 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.699645  3963 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:17:58.786309  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.787213  4047 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:58.788232  9135 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:17:58.747584  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57601.8us
W20260709 13:17:58.791914  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.792081  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.761838  4121 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:17:58.757270  9177 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:17:58.763001  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.759290  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:58.767627  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.794253  4045 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.778810  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:17:58.780383  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.784987  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:17:58.795374  4038 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:17:58.796991  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45803us
I20260709 13:17:58.797745  4046 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
W20260709 13:17:58.761813  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.758263  9221 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:58.798426  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.810523  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.818077  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:58.825083  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.818763  4038 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:17:58.792687  9164 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:17:58.799077  8847 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:17:58.841018  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.805985  9221 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:58.892436  4680 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:17:58.777472  9059 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.818398  9217 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:58.818555  9216 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.859104  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:17:58.864821  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.808919  9200 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:17:58.811280  9183 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:58.831233  9220 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:17:58.913259  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75040us
I20260709 13:17:58.892561  8360 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:17:58.919170  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 134277us
I20260709 13:17:58.854537  9109 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:17:58.917110  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.918679  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.918844  4040 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:17:58.887337  9172 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:58.858141  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:58.923722  4683 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:58.895431  9191 raft_consensus.cc:2764] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:17:58.860500  9043 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:58.949669  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:58.908078  8847 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.909332  9017 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:58.913630  9178 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:17:58.955765  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:58.918287  9156 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:17:58.978992  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 61959.7us
W20260709 13:17:58.979508  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60914.7us
I20260709 13:17:58.981892  4039 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:17:58.838020  9066 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:17:58.983901  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:58.985625  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:17:58.999279  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.005259  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55343.6us
I20260709 13:17:58.986948  9183 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:59.007258  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:59.007995  9130 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:17:59.008433  9130 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:59.008555  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 740) took 1390 ms. Trace:
I20260709 13:17:59.008867  9130 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:17:58.914067  9217 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:58.986388  9178 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.014102  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:58.957304  9109 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.013206  9178 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.021329  9202 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:17:59.021617  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:59.022195  9202 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:17:59.022940  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:59.023207  9202 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:17:59.023523  8861 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:59.023967  8861 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:59.014452  3969 rpcz_store.cc:276] 0709 13:17:57.618228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.437486 (+819258us) service_pool.cc:224] Handling call
0709 13:17:58.451258 (+ 13772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.597619 (+146361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.597654 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.598198 (+   544us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.762350 (+164152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:17:58.762638 (+   288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.763648 (+  1010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.008343 (+244695us) raft_consensus.cc:1685] finished
0709 13:17:59.008366 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.008497 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":141016,"raft.queue_time_us":142336,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"thread_start_us":163711,"threads_started":1,"wal-append.queue_time_us":388781}
W20260709 13:17:58.992830  8870 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.014s	sys 0.044s
I20260709 13:17:58.988015  9156 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:58.991854  9137 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:17:58.912930  9216 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.016882  9172 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:17:59.045886  8861 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:59.037395  8870 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.014s	sys 0.044s
I20260709 13:17:59.025691  9109 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.033193  9176 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:59.055758  4039 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:17:59.035969  9137 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:17:59.058293  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 151943us
I20260709 13:17:58.993024  9017 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:59.035770  9156 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:17:59.057147  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.035328  9183 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:17:59.078167  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.085613  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.086382  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 250360us
I20260709 13:17:59.056336  8861 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:17:59.054391  9172 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:59.050309  8870 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:17:59.136279  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:59.020160  9180 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:17:59.024605  8847 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:59.085405  9227 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:17:59.077489  9137 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:17:59.136458  4683 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:17:59.103237  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 189264us
I20260709 13:17:59.093523  9202 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:17:59.145642  9083 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:17:59.151517  9130 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.036654  9221 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.154424  4045 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
W20260709 13:17:59.157583  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 134680us
I20260709 13:17:59.132942  9212 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:59.162475  3937 leader_election.cc:400] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:17:59.165896  3937 leader_election.cc:403] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:17:59.095670  8360 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
W20260709 13:17:59.158725  9182 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.529s	user 0.002s	sys 0.008s
I20260709 13:17:59.161350  9066 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:17:59.176940  9066 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:59.177330  9169 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:17:59.178361  9244 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:17:59.174391  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.180708  9178 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.181658  9017 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:59.161980  9084 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.173542  9059 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:59.184090  9084 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:59.177863  9169 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.186360  9169 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:17:59.177850  9066 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.189672  4118 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:17:59.189656  4042 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:17:59.159067  9202 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:59.182762  9177 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.192333  4113 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:17:59.182653  9178 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:59.285225  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.161854  9030 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:17:59.293589  9217 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:59.294025  4683 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:17:59.159922  9176 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 13:17:59.295521  9172 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:59.297037  9245 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:17:59.298738  9185 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:59.311445  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.567250  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.567886  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.325117  9084 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:17:59.327868  9247 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 13:17:59.329761  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3302) took 1010 ms. Trace:
I20260709 13:17:59.154918  9250 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.142s
W20260709 13:17:59.351369  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.217890  9254 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:17:59.362425  9251 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.227s	user 0.002s	sys 0.000s
I20260709 13:17:59.361807  8870 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:17:59.360394  9179 consensus_meta.cc:287] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.000s
I20260709 13:17:59.356814  9221 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:17:59.387087  8855 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
W20260709 13:17:59.394905  9236 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.712s	user 0.006s	sys 0.003s
I20260709 13:17:59.397207  9130 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:17:59.376292  9164 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:59.348680  9255 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
W20260709 13:17:59.356076  9249 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:17:59.361719  9216 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:59.577343  4679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.054s	sys 0.138s
W20260709 13:17:59.368777  9098 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.000s
I20260709 13:17:59.349488  9137 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:17:59.460371  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.472354  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.472956  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.473857  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.475323  4120 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:17:59.478689  9109 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:59.487022  9156 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.525389  4683 pending_rounds.cc:85] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 11
W20260709 13:17:59.526259  9220 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.009s	sys 0.004s
W20260709 13:17:59.530768  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 383501us
W20260709 13:17:59.536991  4011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.000s	sys 0.013s
W20260709 13:17:59.537346  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 374993us
W20260709 13:17:59.540191  9237 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.001s	sys 0.012s
I20260709 13:17:59.569159  4040 rpcz_store.cc:276] 0709 13:17:58.319855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.658111 (+338256us) service_pool.cc:224] Handling call
0709 13:17:58.658358 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:58.956852 (+298494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.329438 (+372586us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54001121d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:59.329689 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598635392}
W20260709 13:17:59.533603  9159 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.009s
I20260709 13:17:59.566007  9176 consensus_queue.cc:1243] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:17:59.610705  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.568869  9084 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:17:59.582314  4013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.023s
I20260709 13:17:59.354768  8847 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:17:59.635483  4649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.021s	sys 0.025s
I20260709 13:17:59.636245  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.576665  9267 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.612622  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:17:59.840201  4649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.021s	sys 0.037s
I20260709 13:17:59.687381  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2878) took 1135 ms. Trace:
I20260709 13:17:59.638737  4114 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:17:59.660313  4119 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:17:59.609474  9178 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.192s
W20260709 13:17:59.636802  4679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.054s	sys 0.138s
I20260709 13:17:59.690236  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:59.608374  8855 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:17:59.669368  4116 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:17:59.685962  9137 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:59.840996  4011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.000s	sys 0.021s
I20260709 13:17:59.841614  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:17:59.740365  9264 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:17:59.858120  9178 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:17:59.859867  4678 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:59.861698  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:17:59.635885  9164 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.876008  9178 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:59.691090  9177 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:17:59.856563  9237 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.003s	sys 0.020s
I20260709 13:17:59.841053  4117 rpcz_store.cc:276] 0709 13:17:58.551968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.701012 (+149044us) service_pool.cc:224] Handling call
0709 13:17:58.701299 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:17:58.701652 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:58.701681 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:17:58.702143 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:17:58.947636 (+245493us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:17:58.947682 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:58.947759 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.687160 (+739401us) raft_consensus.cc:1685] finished
0709 13:17:59.687181 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.687311 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1088,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":222766,"threads_started":1,"wal-append.queue_time_us":315712}
I20260709 13:17:59.690483  9255 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:59.857333  4683 pending_rounds.cc:107] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:17:59.886808  4683 raft_consensus.cc:2889] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:59.578246  9183 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:17:59.867516  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2877) took 1315 ms. Trace:
I20260709 13:17:59.749853  9017 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:17:59.872161  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 752) took 1063 ms. Trace:
W20260709 13:17:59.869828  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 845525us
I20260709 13:17:59.875101  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:17:59.662501  9252 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:17:59.857220  9220 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.009s	sys 0.014s
I20260709 13:17:59.753027  9263 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:17:59.668936  9109 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:17:59.877907  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.846570  9179 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:17:59.633728  9185 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:17:59.840798  9159 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.003s	sys 0.018s
I20260709 13:17:59.638337  9259 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:59.864580  9258 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:59.856807  3937 leader_election.cc:400] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:17:59.908711  3937 leader_election.cc:403] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:17:59.909243  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52873.8us
I20260709 13:17:59.895681  3963 rpcz_store.cc:276] 0709 13:17:58.802175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.809215 (+  7040us) service_pool.cc:224] Handling call
0709 13:17:58.839352 (+ 30137us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:17:59.132718 (+293366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:17:59.133870 (+  1152us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:17:59.141561 (+  7691us) log.cc:844] Serialized 52 byte log entry
0709 13:17:59.581098 (+439537us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:17:59.581141 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.855641 (+274500us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b54003976d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:59.855708 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:17:59.855758 (+    50us) raft_consensus.cc:1685] finished
0709 13:17:59.856009 (+   251us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:17:59.865988 (+  9979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2929,"raft.queue_time_us":249589,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":23116,"spinlock_wait_cycles":161968000,"thread_start_us":487316,"threads_started":2,"wal-append.queue_time_us":554130}
W20260709 13:17:59.856798  4013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.013s	sys 0.033s
W20260709 13:17:59.912034  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 896549us
I20260709 13:17:59.912916  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:17:59.913667  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.911935  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.915218  4115 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:17:59.879667  9236 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:17:59.895776  4112 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:17:59.898129  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.916462  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:59.887681  4114 rpcz_store.cc:276] 0709 13:17:58.551667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.677253 (+125586us) service_pool.cc:224] Handling call
0709 13:17:59.865044 (+1187791us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b540004cc54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:17:59.867252 (+  2208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047034624}
I20260709 13:17:59.918056  4113 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:17:59.864864  8861 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:17:59.919716  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.919013  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.921089  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.922001  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.922925  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.681454  9202 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.925290  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.929946  4047 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:59.923237  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:59.911703  4676 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:59.932145  4039 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:59.927457  4044 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:17:59.933746  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.934561  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:59.924285  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.934970  4046 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:17:59.894176  9017 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:17:59.906510  9220 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:59.906327  9263 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:17:59.865211  9267 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.955034  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.956430  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:17:59.916142  9258 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.957625  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.967111  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.919276  8855 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:17:59.919066  9236 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:17:59.970088  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:17:59.988593  4039 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 9: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:17:59.970341  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:59.989387  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:17:59.990088  4682 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:17:59.990198  9216 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:17:59.992619  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:59.993584  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:17:59.996975  4682 raft_consensus.cc:1217] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[11.10-15.12]   Dedup: 11.10->[13.11-15.12]
I20260709 13:17:59.997467  4682 pending_rounds.cc:85] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 10
I20260709 13:17:59.997689  4682 pending_rounds.cc:107] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:17:59.971660  4112 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:17:59.915706  9259 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.004730  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:17:59.979499  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2888) took 1376 ms. Trace:
I20260709 13:18:00.009109  4115 rpcz_store.cc:276] 0709 13:17:58.603289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.705259 (+101970us) service_pool.cc:224] Handling call
0709 13:17:58.705521 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.915631 (+1210110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:17:59.979272 (+ 63641us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001b2954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:17:59.979442 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2781535616}
I20260709 13:17:59.968248  9130 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:17:59.967710  9109 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:17:59.985327  3869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 96) took 12561 ms (client timeout 15000 ms). Trace:
I20260709 13:17:59.893580  9084 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:17:59.933187  9172 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:17:59.986654  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.997484  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:17:59.999646  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:17:59.965444  9237 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:00.032588  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 188228us
W20260709 13:18:00.033456  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:17:59.973003  9236 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:00.057049  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:00.057686  4121 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:00.007638  4119 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:17:59.998395  4682 raft_consensus.cc:2889] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:17:59.910207  9252 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.016073  4043 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:00.021939  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:17:59.935491  8861 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:00.079874  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47289.9us
I20260709 13:18:00.005198  9216 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:17:59.916831  9255 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.096745  4038 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:18:00.055939  9262 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:17:59.958472  9178 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.019258  8844 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:18:00.100649  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 236437us
W20260709 13:18:00.096001  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 118865us
I20260709 13:18:00.082866  9109 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:00.021114  9250 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:18:00.086205  9237 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:00.097978  9273 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:18:00.107458  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.098527  9084 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.083616  9172 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.099836  9262 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:00.118109  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98843.8us
W20260709 13:18:00.115634  9221 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.006s
I20260709 13:18:00.135406  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.137475  4117 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 19 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 13:18:00.021353  3869 rpcz_store.cc:269] 0709 13:17:47.398313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:47.419436 (+ 21123us) service_pool.cc:224] Handling call
0709 13:17:59.953540 (+12534104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:17:57.356933 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:17:57.357622 (+   689us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:17:57.357672 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:17:57.357690 (+    18us) tablet.cc:662] Decoding operations
0709 13:17:57.358692 (+  1002us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:17:57.358776 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 13:17:57.358802 (+    26us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:17:57.359579 (+   777us) tablet.cc:701] Row locks acquired
0709 13:17:57.359624 (+    45us) write_op.cc:260] PREPARE: finished
0709 13:17:57.359780 (+   156us) write_op.cc:270] Start()
0709 13:17:57.359925 (+   145us) write_op.cc:276] Timestamp: P: 1783603077359717 usec, L: 0
0709 13:17:57.359960 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:17:57.360633 (+   673us) log.cc:844] Serialized 3727 byte log entry
0709 13:17:57.692525 (+331892us) op_driver.cc:464] REPLICATION: finished
0709 13:17:58.337739 (+645214us) spinlock_profiling.cc:243] Waited 6.27 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed733420ac 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed79e82ef0
0709 13:17:58.612693 (+274954us) write_op.cc:301] APPLY: starting
0709 13:17:58.612846 (+   153us) tablet.cc:1367] starting BulkCheckPresence
0709 13:17:58.660679 (+ 47833us) tablet.cc:1370] finished BulkCheckPresence
0709 13:17:58.660720 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:17:58.732198 (+ 71478us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180037aec0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:58.780422 (+ 48224us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b180037aec0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed79e82ef0 00007fed79e83489 00007fed79e8571a
0709 13:17:59.049982 (+269560us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:17:59.080051 (+ 30069us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b180037aec0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f557 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:17:59.163090 (+ 83039us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:17:59.174711 (+ 11621us) write_op.cc:312] APPLY: finished
0709 13:17:59.317550 (+142839us) log.cc:844] Serialized 89 byte log entry
0709 13:17:59.612340 (+294790us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:59.637008 (+ 24668us) write_op.cc:454] Released schema lock
0709 13:17:59.691366 (+ 54358us) write_op.cc:341] FINISH: Updating metrics
0709 13:17:59.691921 (+   555us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:17:59.691954 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3363532,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":919872,"apply.run_cpu_time_us":25358,"apply.run_wall_time_us":1079201,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41873,"num_ops":9,"prepare.queue_time_us":150220,"prepare.run_cpu_time_us":41697,"prepare.run_wall_time_us":132692,"raft.queue_time_us":141053,"raft.run_cpu_time_us":24158,"raft.run_wall_time_us":1088369,"replication_time_us":332408,"spinlock_wait_cycles":166429568,"thread_start_us":1528779,"threads_started":5,"wal-append.queue_time_us":492785,"wal-append.run_cpu_time_us":33308,"wal-append.run_wall_time_us":1108004}]]}
I20260709 13:18:00.114619  9164 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.121485  4676 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:18:00.121273  9156 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.083410  9017 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.126866  9178 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:00.230671  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.241254  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.128448  9262 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.135311  8847 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.087056  9263 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.253674  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 403) took 1416 ms. Trace:
I20260709 13:18:00.262917  4677 rpcz_store.cc:276] 0709 13:17:58.824665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.824820 (+   155us) service_pool.cc:224] Handling call
0709 13:18:00.232152 (+1407332us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54009fe2d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:00.240489 (+  8337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876976000}
W20260709 13:18:00.268893  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.130018  9183 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:18:00.247871  9200 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:00.279469  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 156459us
I20260709 13:18:00.109324  9220 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:00.287982  9276 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:18:00.288273  8861 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.291057  9172 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.297389  9255 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.285416  9237 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:00.316499  9277 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:18:00.298453  9109 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.298739  9263 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:00.337090  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 198859us
I20260709 13:18:00.352157  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:00.352751  9172 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:00.364984  9183 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:00.367393  9258 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.368667  9267 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:00.384516  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 362634us
I20260709 13:18:00.385815  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:00.369310  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.374697  9236 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:00.375384  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.377178  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 276958us
I20260709 13:18:00.405025  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:00.407331  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:00.408557  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.407979  4044 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:18:00.407155  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:00.414623  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.414830  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:00.416394  4044 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:00.440344  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:00.421087  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.418857  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.547380  3963 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.420121  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.545454  3964 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:00.450037  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:00.472595  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:00.449044  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:00.446630  4046 raft_consensus.cc:2376] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15. Re-sending same reply.
I20260709 13:18:00.560343  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.561707  4116 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:00.441399  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.565007  3965 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.565959  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.566660  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.567169  3966 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:00.568638  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 182884us
I20260709 13:18:00.569406  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.573886  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.573830  3971 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:00.412321  9288 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.577042  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.577550  9268 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.578017  9098 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.577087  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.601578  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.602676  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:00.578703  9236 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:00.604915  9098 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:00.605638  9098 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:00.605962  9098 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:00.606304  9098 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.604636  9268 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:00.609401  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.610062  3970 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:00.610864  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.611399  3970 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:00.612076  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.580482  8861 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:00.612939  8861 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:00.613876  8861 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.615087  8861 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:00.615676  9185 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.704s	user 0.005s	sys 0.001s
W20260709 13:18:00.612946  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45014.4us
I20260709 13:18:00.560847  9156 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.618677  9156 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.619891  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:00.581073  9266 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:00.581755  3857 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 237eb348003645f7abcc1c18bd324690 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 6 but the committed config has opid_index of 8
I20260709 13:18:00.441100  9255 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.584579  9254 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:00.585543  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.597712  3969 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:00.599996  9248 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:00.417483  9259 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:00.411962  9216 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:00.622174  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.622668  4042 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:00.623323  3963 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:00.625034  3966 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:00.612695  3970 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:00.627709  3964 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:00.403121  9212 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:00.417744  9164 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:00.584136  9200 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:00.440733  9258 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:00.417601  9183 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:00.629988  3965 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
W20260709 13:18:00.629081  3857 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 47505.8us
I20260709 13:18:00.630870  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.449713  8870 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:00.632274  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 159776us
I20260709 13:18:00.668121  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.668823  3970 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:18:00.669699  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.670751  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.671404  3970 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:00.660344  4010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.016s	sys 0.059s
W20260709 13:18:00.620906  9083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.008s	sys 0.039s
I20260709 13:18:00.674381  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.628456  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 414) took 1643 ms. Trace:
I20260709 13:18:00.631366  9266 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:00.667023  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.048s
W20260709 13:18:00.673270  4010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.016s	sys 0.059s
I20260709 13:18:00.632949  9248 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:00.703694  3972 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:00.809558  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:00.810501  9172 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:00.810909  9172 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:00.811260  9172 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:00.705384  4045 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:18:00.703569  9083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.009s	sys 0.039s
I20260709 13:18:00.813764  9295 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.707332  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.814815  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:00.815279  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.809922  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.819355  3972 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.707830  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.658579  9185 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:00.799752  9291 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.801097  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.801355  9216 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:00.802862  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.707978  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.004s	sys 0.049s
I20260709 13:18:00.803287  9220 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:00.704171  9258 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:00.803508  9250 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.658151  9255 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.667565  9200 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.805188  9294 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:00.717170  9156 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:00.720847  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98736.8us
I20260709 13:18:00.805364  9178 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:00.663414  9179 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:00.806113  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 203493us
I20260709 13:18:00.661881  9135 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:18:00.708448  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:00.806571  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.716473  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.823490  3969 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:00.825189  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:00.825562  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.779335  9286 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:00.667476  9164 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.677250  8870 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:00.835949  4677 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:00.834852  9313 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:00.816735  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
W20260709 13:18:00.803265  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.835810  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 708873us
I20260709 13:18:00.850508  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:00.841430  9294 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:00.848309  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.853302  4085 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:00.865899  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.834343  3870 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 10 to 13, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:00.854684  3971 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:00.838492  9305 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:00.850493  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:00.848133  8855 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.849s	user 0.008s	sys 0.002s
I20260709 13:18:00.864867  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.854003  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:00.710335  9262 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.855304  9178 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:00.853963  9267 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:00.866572  3970 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:00.838927  9220 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.909349  3937 leader_election.cc:400] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
W20260709 13:18:00.911417  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.907912  3870 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 9 to 11, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 11 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:00.926532  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.868135  9294 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:00.845198  9258 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.856839  9179 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:00.939052  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.950284  3971 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:00.939750  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:00.847546  9216 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.869692  9156 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:00.908296  9137 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:00.951242  3970 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:00.917847  8855 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
W20260709 13:18:00.942471  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89259.1us
I20260709 13:18:00.913915  9254 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:00.850615  9183 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.933270  9237 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:00.965471  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 102243us
W20260709 13:18:00.936448  9303 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:18:00.980732  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:00.981366  3970 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:00.952709  9255 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:00.973414  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 64208us
I20260709 13:18:00.955075  3870 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 14 to 15, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 15 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:00.979637  3963 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:00.956261  9156 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:00.969214  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.941701  9267 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.986536  9237 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:00.913290  9202 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
W20260709 13:18:00.989683  9302 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:18:00.914247  9098 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:00.993155  3972 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:01.019964  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:01.027865  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.028613  3972 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:01.029188  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 60068.7us
I20260709 13:18:01.029974  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:01.007261  9156 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:18:01.033622  9312 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:01.034327  9098 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:01.034569  9307 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:01.035466  9308 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:01.036562  9220 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:00.704972  4679 rpcz_store.cc:276] 0709 13:17:58.985280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:58.988658 (+  3378us) service_pool.cc:224] Handling call
0709 13:17:59.012589 (+ 23931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:17:59.012823 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:17:59.878612 (+865789us) log.cc:844] Serialized 14 byte log entry
0709 13:18:00.411307 (+532695us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:00.418096 (+  6789us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:00.459367 (+ 41271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:00.568241 (+108874us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:00.621075 (+ 52834us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":625699,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":97577,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":13747,"thread_start_us":1333137,"threads_started":3,"wal-append.queue_time_us":404224}
I20260709 13:18:01.038452  9209 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:00.975910  9137 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.006745  9300 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:01.050057  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.050415  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.064038  4044 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
W20260709 13:18:01.064361  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 74898.2us
W20260709 13:18:01.063868  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 209915us
I20260709 13:18:01.073073  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:01.076531  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46654.9us
I20260709 13:18:01.077421  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.080754  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.081064  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:01.050820  3972 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:01.051059  3970 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:01.039574  9212 raft_consensus.cc:2764] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:01.089900  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.090512  3970 raft_consensus.cc:2376] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13. Re-sending same reply.
I20260709 13:18:01.051355  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:01.051887  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.051777  9301 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.120s
I20260709 13:18:01.052502  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:01.053751  9315 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:18:01.060055  3963 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:01.092506  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.093047  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:00.629781  9288 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.052624  9262 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.105702  4114 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:01.098318  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.104128  4041 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:01.105274  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:00.814311  9295 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.025650  9254 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:18:00.835407  9291 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.113334  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.061908  9209 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:01.073341  9259 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.120745  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.085155  9237 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:01.054567  8855 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:18:01.091410  9268 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:01.120054  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:00.840727  9250 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.114511  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:00.868273  9313 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.214498  4117 raft_consensus.cc:606] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:01.214931  4117 raft_consensus.cc:614] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:00.802132  9266 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.115381  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:00.805241  9248 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.113310  9323 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.107718  9098 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.118790  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.238474  3970 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.131533  9237 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:01.180966  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 107984us
I20260709 13:18:01.243854  3870 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 8 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 12 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:01.107059  9304 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:01.193565  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.211988  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 233598us
W20260709 13:18:01.218652  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103354us
I20260709 13:18:01.134389  4680 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.119834  9209 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:01.119385  9300 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.254761  4115 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:18:01.184638  9202 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:01.287665  3971 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:01.289084  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.253350  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.243304  3969 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:01.299364  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.300168  3969 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:01.233242  9164 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.305349  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2631) took 1387 ms. Trace:
I20260709 13:18:01.305759  4116 rpcz_store.cc:276] 0709 13:17:59.917779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.918759 (+   980us) service_pool.cc:224] Handling call
0709 13:18:01.305140 (+1386381us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b540026bbd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:01.305278 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225429248}
I20260709 13:18:01.307269  4116 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:01.235800  9200 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:01.309711  8861 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.694s	user 0.005s	sys 0.007s
I20260709 13:18:01.264911  9320 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.311074  9320 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.313488  9320 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.313956  9295 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.267776  9288 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.270678  9250 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.271903  4115 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:01.316959  4120 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:01.317351  9313 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.318197  4119 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 14. Ops: []
I20260709 13:18:01.273036  9300 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.274163  9325 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:01.275216  9267 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.275765  9304 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.276677  9137 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.233486  9212 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:01.278637  9252 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.246042  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:01.252151  4086 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.240322  9178 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.309947  9200 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.258719  9309 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:01.265882  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.131966  9259 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:01.331378  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78124.7us
I20260709 13:18:01.323204  4047 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:01.328116  3971 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
W20260709 13:18:01.333984  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.370761  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.249964  9237 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:01.335008  3970 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:01.371989  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.338991  9318 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.339656  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.361557  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.380646  3969 raft_consensus.cc:2410] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 13:18:01.361614  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 109730us
I20260709 13:18:01.282709  9202 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.338918  9164 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:01.365823  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 245200us
I20260709 13:18:01.388516  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.243582  9172 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.389267  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.389948  3972 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:01.373108  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.360684  9325 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:01.250982  9098 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:01.382923  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 136955us
I20260709 13:18:01.381429  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.233891  9323 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.389214  3970 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:01.366631  3870 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:01.369764  9250 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:01.403119  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.404383  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:01.394026  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.220151  9268 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.411165  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.397455  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:01.414083  4011 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:01.414790  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:01.397666  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.372237  9178 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:01.376489  8855 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:01.312665  9291 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.447078  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:01.423075  9212 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:01.424808  9268 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.391417  9202 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.441602  3968 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:01.440546  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:01.465498  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51510.2us
I20260709 13:18:01.462953  4046 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.466496  4044 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:01.443744  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:01.467799  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.462411  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.464612  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.447345  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:01.430918  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.468829  3970 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
W20260709 13:18:01.467931  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.470803  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.471362  3969 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.388082  9309 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:01.470147  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.474345  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:01.470829  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.475291  4041 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:01.475713  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.477906  4038 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:01.428483  9263 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.065s	user 0.005s	sys 0.004s
I20260709 13:18:01.478783  4044 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:01.487346  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.480572  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:01.488826  3970 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.489425  9178 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.489961  9178 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.492034  9178 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.492486  9178 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.431088  9329 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:01.497213  3970 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:01.556043  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.556725  3970 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:01.557626  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.558246  3970 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:01.559145  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.559736  3970 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:01.464975  9200 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:01.432413  9254 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:01.463392  9313 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:01.561908  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2732) took 1110 ms. Trace:
I20260709 13:18:01.562428  9162 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:01.562371  3972 rpcz_store.cc:276] 0709 13:18:00.451228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.098080 (+646852us) service_pool.cc:224] Handling call
0709 13:18:01.561757 (+463677us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400277254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:01.561857 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":648497408}
I20260709 13:18:01.496093  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.563886  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.504107  9178 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.564548  3972 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.565901  3963 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:01.566105  9178 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.566521  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2736) took 1114 ms. Trace:
I20260709 13:18:01.566866  3963 rpcz_store.cc:276] 0709 13:18:00.452152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.565469 (+1113317us) service_pool.cc:224] Handling call
0709 13:18:01.565734 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.566299 (+   565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.566472 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.383737  9318 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.570025  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3206) took 1150 ms. Trace:
I20260709 13:18:01.570382  3968 rpcz_store.cc:276] 0709 13:18:00.419809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.419912 (+   103us) service_pool.cc:224] Handling call
0709 13:18:01.569848 (+1149936us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54001f90d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:01.569949 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034663296}
I20260709 13:18:01.571587  9338 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:01.571754  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 190427us
I20260709 13:18:01.571998  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 773) took 1001 ms. Trace:
I20260709 13:18:01.572388  3968 rpcz_store.cc:276] 0709 13:18:00.570911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.571248 (+1000337us) service_pool.cc:224] Handling call
0709 13:18:01.571530 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.571713 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.571735 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.571772 (+    37us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:01.571809 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.571858 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.571949 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.574186  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 774) took 1003 ms. Trace:
I20260709 13:18:01.574525  3968 rpcz_store.cc:276] 0709 13:18:00.571195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.573484 (+1002289us) service_pool.cc:224] Handling call
0709 13:18:01.573745 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.573907 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.573932 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.573971 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:01.574001 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.574051 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.574138 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.571956  3972 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:01.576956  9263 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:01.578536  8360 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.578892  9248 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:01.579036  8360 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.581562  8870 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.582267  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3323) took 1666 ms. Trace:
I20260709 13:18:01.582849  9017 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.582942  8360 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.584589  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:01.585130  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.585520  4114 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:01.585748  4120 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:01.585963  9323 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.586570  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:01.586750  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.587373  4114 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:01.587865  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.589041  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.589223  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.589920  4113 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:01.579977  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:01.591100  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:01.504829  4041 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:01.429337  9325 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.519296  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:01.525331  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.612991  3964 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:01.527611  8847 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.532863  9179 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.535761  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.535630  9216 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.546283  9172 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.547201  9309 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.475878  8861 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:01.465385  9212 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.550382  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.624819  3967 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:01.625837  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.626462  3967 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:01.552795  8855 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:01.563802  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.471230  9267 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:01.505921  3870 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 10 to 11, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 11 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.598116  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.560601  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.603893  9313 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.611231  9259 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:01.617558  9303 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:18:01.644783  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.604314  9254 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.604628  9030 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.497289  9268 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:01.583024  9221 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.606245  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.609081  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:01.580664  9328 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.609881  9098 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.610250  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.610879  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.448206  9334 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:01.582649  4045 rpcz_store.cc:276] 0709 13:17:59.916101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.916210 (+   109us) service_pool.cc:224] Handling call
0709 13:18:01.582063 (+1665853us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540028b754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:01.582184 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1812209408}
I20260709 13:18:01.634440  8855 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:01.615113  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:01.707937  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 92914.2us
I20260709 13:18:01.647746  9338 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:01.708781  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:01.612784  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93559.4us
I20260709 13:18:01.617914  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2735) took 1166 ms. Trace:
I20260709 13:18:01.710240  3964 rpcz_store.cc:276] 0709 13:18:00.451933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.525042 (+1073109us) service_pool.cc:224] Handling call
0709 13:18:01.617855 (+ 92813us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.629822  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:01.631301  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.636410  3970 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:01.715732  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.716439  3970 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:01.639720  3969 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:01.717337  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3211) took 1136 ms. Trace:
I20260709 13:18:01.717694  3969 rpcz_store.cc:276] 0709 13:18:00.580672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.415805 (+835133us) service_pool.cc:224] Handling call
0709 13:18:01.717276 (+301471us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:01.718668  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:01.540617  9294 consensus_meta.cc:287] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.588s	user 0.003s	sys 0.003s
I20260709 13:18:01.721675  9294 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.723242  4675 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:18:01.724334  9294 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.604112  4119 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:01.642426  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:01.642339  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51310.7us
I20260709 13:18:01.731781  3967 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:01.643575  4046 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:01.645183  3870 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:01.646561  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48535.6us
I20260709 13:18:01.732297  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:01.503683  9164 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.735601  9164 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.620821  9329 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:01.617659  8847 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:01.736753  9329 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:01.737865  9164 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.737712  9329 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.633886  9212 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:01.634131  8861 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.742635  8861 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.649448  8763 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.745059  8847 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.747748  8847 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.648456  9313 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.750504  9313 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.653671  9268 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.751236  9268 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:01.660449  9300 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.661294  9304 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.652822  9109 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:01.753480  9109 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.755788  9109 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.662532  4120 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:18:01.757647  4120 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:18:01.663317  9328 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.760183  9328 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:01.614989  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.704716  4118 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:01.706100  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.570429  9318 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.763139  9305 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:01.763592  9304 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:01.769218  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.769972  4119 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:01.728386  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.771023  4041 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:01.773662  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:01.774958  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:01.775399  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.729529  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.781219  4043 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:01.783998  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.734220  3870 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:01.784061  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.730036  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:01.793565  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80906.7us
I20260709 13:18:01.794446  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.795362  9313 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.796960  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.798063  9098 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.798748  9098 raft_consensus.cc:2764] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:18:01.801343  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.653266  9311 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.709713  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:01.809183  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 99556.6us
I20260709 13:18:01.805073  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:01.810470  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:01.811389  4084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.007s	sys 0.016s
I20260709 13:18:01.653050  9263 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:01.812894  4084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.007s	sys 0.016s
I20260709 13:18:01.708458  8855 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:01.707355  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.826784  9137 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.854548  9137 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.829674  8763 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.665124  9030 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.806340  9172 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.803426  9338 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:01.832217  9268 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.856482  9338 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.858340  9137 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.808501  9331 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:01.856455  9172 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.825481  9263 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:01.861482  9172 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.833365  9212 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.862609  9263 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:01.821027  9330 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:01.840098  9202 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.863675  9330 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.864123  9330 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.848618  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.802575  9334 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:01.850159  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.809273  9267 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:01.865899  9267 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.865567  9334 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.850353  9178 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.816555  9311 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.816232  9300 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:01.866932  9300 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.867620  9300 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:01.868402  9311 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:01.855062  4042 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:01.866328  9267 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.856056  4676 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:01.863577  9212 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:01.877480  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:01.878052  4042 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:01.879045  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 146894us
W20260709 13:18:01.879588  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63284.1us
I20260709 13:18:01.880201  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:01.877791  3972 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:01.859440  9331 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:01.825169  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.872713  4046 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:01.882181  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.884872  4042 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:01.669194  9221 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:01.888919  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:01.884469  4118 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:01.892027  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:01.892753  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.893252  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 775) took 1319 ms. Trace:
I20260709 13:18:01.668821  9254 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:01.940856  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59506.3us
I20260709 13:18:01.817873  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:01.939141  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:01.941002  4041 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:01.936058  3968 rpcz_store.cc:276] 0709 13:18:00.573757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.575479 (+1001722us) service_pool.cc:224] Handling call
0709 13:18:01.575749 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.739563 (+163814us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.739595 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:01.739636 (+    41us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:01.739668 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.893025 (+153357us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b54003976d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:01.893072 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:01.893197 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":376276736}
I20260709 13:18:01.934643  4675 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 386) took 1124 ms. Trace:
I20260709 13:18:01.943156  4675 rpcz_store.cc:276] 0709 13:18:00.810263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.812453 (+  2190us) service_pool.cc:224] Handling call
0709 13:18:00.812800 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.723652 (+910852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.893798 (+170146us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b54005c0154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:01.934580 (+ 40782us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2092858240}
I20260709 13:18:01.859015  9313 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:01.941640  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:01.946542  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.836651  9250 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:01.947329  4039 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 13:18:01.889546  9331 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:01.872069  9179 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 13:18:01.950443  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:01.948941  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 131134us
I20260709 13:18:01.949442  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.976444  4116 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:01.873190  9323 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:18:01.896340  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 85934.7us
I20260709 13:18:01.892221  9288 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:01.974463  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.984920  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:01.942176  9177 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:01.866631  9178 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:01.977268  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:01.977377  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.890009  9320 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:01.944476  9156 consensus_meta.cc:287] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.882s	user 0.010s	sys 0.001s
I20260709 13:18:01.972322  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.956146  9318 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.980219  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:02.001072  3964 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:01.944706  9200 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.985303  3969 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
W20260709 13:18:01.991923  9209 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.001s
I20260709 13:18:01.986735  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:01.948288  9185 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.987787  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:01.985349  9109 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:02.012095  3967 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:01.979888  4041 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:01.976601  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:01.987543  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:01.951994  9098 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:01.955966  9263 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:01.952919  9324 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:01.996497  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3215) took 1414 ms. Trace:
I20260709 13:18:02.022861  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:02.023339  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46826.5us
I20260709 13:18:02.023314  3972 rpcz_store.cc:276] 0709 13:18:00.581847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.578285 (+996438us) service_pool.cc:224] Handling call
0709 13:18:01.583637 (+  5352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.881011 (+297374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.996237 (+115226us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540044bbd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:01.996435 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676087552}
I20260709 13:18:01.998769  9266 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:01.999665  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.005560  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:02.022866  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 223335us
I20260709 13:18:01.978595  9304 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:01.890755  9137 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:18:02.031452  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:01.979805  9179 consensus_queue.cc:1243] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 13.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:18:01.990839  9250 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.017973  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.057857  4046 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:01.952690  9212 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:18:01.994647  9295 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:02.016213  9109 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.062211  9267 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.028684  9252 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:01.979701  4047 raft_consensus.cc:2955] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 6 to 8, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:02.021479  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.022019  9183 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:01.994304  9320 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:01.978164  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:02.083791  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 105706us
I20260709 13:18:02.084316  9298 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.084558  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:02.027848  4042 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:02.022889  9185 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.004400  9177 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:02.029083  3969 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:18:02.089088  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3217) took 1506 ms. Trace:
I20260709 13:18:02.089443  3969 rpcz_store.cc:276] 0709 13:18:00.582367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.023950 (+1441583us) service_pool.cc:224] Handling call
0709 13:18:02.028852 (+  4902us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.088682 (+ 59830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.089030 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.009004  9288 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:02.028434  4116 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:02.019052  9263 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.010538  9318 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.034484  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.028802  9324 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.035135  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.082062  9323 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:02.037966  9178 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.004001  9156 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.041960  9098 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.054332  9202 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:02.076198  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54801.2us
I20260709 13:18:02.133956  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.076197  3964 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:02.135221  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.135835  3964 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:18:02.136613  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.137173  3964 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:02.138016  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.013882  9200 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.044857  9344 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.080968  4046 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.064670  9267 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.015686  9209 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.065266  9109 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.144531  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:02.145700  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.146853  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.090583  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.070173  9295 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:02.116250  9164 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:02.137223  9017 consensus_meta.cc:287] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:18:02.103220  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.037758  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.114372  4041 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:02.079288  9183 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.117735  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.066262  9250 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.086241  9212 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:02.086680  9320 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.138804  3967 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.114742  9263 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.149363  4042 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:02.151456  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.163084  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.097580  9252 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:02.110898  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:02.164921  3966 raft_consensus.cc:1813] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.119114  9323 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:02.238034  9323 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:02.183085  4039 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:02.241065  9319 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.241948  4039 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:02.241632  9319 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:02.245484  9348 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:18:02.247378  9346 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:18:02.247924  9030 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:02.250017  9200 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.251390  9185 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:02.257575  9248 consensus_meta.cc:287] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.678s	user 0.010s	sys 0.003s
I20260709 13:18:02.258292  4118 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:18:02.258597  9318 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:02.260035  9209 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:02.261536  9288 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.181103  9202 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:02.272706  3964 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:18:02.185520  4045 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:02.188828  4121 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:02.201735  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.208285  9345 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:18:02.227605  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76226.8us
I20260709 13:18:02.229936  3966 raft_consensus.cc:2368] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10.
I20260709 13:18:02.234618  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2911) took 1140 ms. Trace:
I20260709 13:18:02.236050  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.236555  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:02.279178  3969 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.141319  9098 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.189301  9258 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.186224  9183 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:02.286144  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.265866  9156 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:02.237637  9295 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.129201  9268 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.174774  4046 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:02.162565  9221 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:02.280860  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:02.280256  4038 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:02.291975  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:02.292934  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.278679  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:02.237488  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.282778  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:02.278426  4112 rpcz_store.cc:276] 0709 13:18:01.093706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.093834 (+   128us) service_pool.cc:224] Handling call
0709 13:18:01.094131 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.124908 (+ 30777us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:01.520607 (+395699us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18000b7160. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:18:01.673065 (+152458us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.071565 (+398500us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.083804 (+ 12239us) log.cc:844] Serialized 26 byte log entry
0709 13:18:02.084007 (+   203us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:02.084068 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.085099 (+  1031us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.234320 (+149221us) raft_consensus.cc:1685] finished
0709 13:18:02.234433 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.234560 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51701,"prepare.queue_time_us":133630,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":125204,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":20521,"spinlock_wait_cycles":8805632,"thread_start_us":404521,"threads_started":2,"wal-append.queue_time_us":357687}
I20260709 13:18:02.234722  9252 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.161793  9344 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.316794  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.321343  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:02.272593  9325 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.329425  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.270748  9164 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:02.288221  9349 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:18:02.328624  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:18:02.331385  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:02.368467  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:02.306154  9347 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.181s	user 0.001s	sys 0.001s
W20260709 13:18:02.306337  9342 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.254s	user 0.001s	sys 0.000s
W20260709 13:18:02.305501  9350 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 13:18:02.298230  9357 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.092s	user 0.003s	sys 0.000s
I20260709 13:18:02.285260  9319 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:02.320978  9352 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:18:02.303341  9212 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:02.367420  9185 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:02.375604  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44422.7us
I20260709 13:18:02.375761  4046 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:02.281148  8855 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.399354  3971 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:02.300973  9318 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:02.306694  9221 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:02.378113  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.330397  9267 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:02.313834  9324 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.373675  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.411288  3969 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:18:02.291240  9202 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:02.381218  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:02.395959  9185 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.279654  9209 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:18:02.320003  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:02.380846  9200 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:02.450290  9200 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.450743  9200 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.454115  9313 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:02.454586  9313 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:02.455389  9313 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.457834  8855 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.458894  9200 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.460054  9320 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.434417  9185 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.387194  9098 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.485417  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.389899  9250 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:02.348832  9030 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:02.377460  3972 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:02.396207  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:02.504522  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 108391us
I20260709 13:18:02.505597  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3210) took 1935 ms. Trace:
I20260709 13:18:02.275470  9017 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:02.393345  9330 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.003s
I20260709 13:18:02.404011  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:02.404618  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:02.403957  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 125384us
I20260709 13:18:02.411082  9267 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:02.411358  9309 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:18:02.415903  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3218) took 1833 ms. Trace:
I20260709 13:18:02.505977  3963 rpcz_store.cc:276] 0709 13:18:00.570264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.567678 (+997414us) service_pool.cc:224] Handling call
0709 13:18:01.567965 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.568304 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:01.568332 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.596876 (+ 28544us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.882040 (+285164us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:01.882087 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.882148 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.505390 (+623242us) raft_consensus.cc:1685] finished
0709 13:18:02.505410 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.505540 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"thread_start_us":273245,"threads_started":1,"wal-append.queue_time_us":449450}
I20260709 13:18:02.510977  3969 rpcz_store.cc:276] 0709 13:18:00.582593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.415080 (+1832487us) service_pool.cc:224] Handling call
0709 13:18:02.415423 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.415597 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.415623 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.415662 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:02.415690 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.415740 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.415850 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.294245  9254 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:02.419050  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:02.419317  4043 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:02.286327  9177 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.420429  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.421657  9317 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:18:02.516317  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:02.516912  3963 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:02.423629  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.423417  9305 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 8 to 13, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:02.404832  9319 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:18:02.425561  9237 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.039s	user 0.011s	sys 0.000s
I20260709 13:18:02.427456  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 776) took 1842 ms. Trace:
W20260709 13:18:02.428819  3971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2771) took 1620 ms (client timeout 2145 ms). Trace:
W20260709 13:18:02.525260  3971 rpcz_store.cc:269] 0709 13:18:00.808542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.471183 (+662641us) service_pool.cc:224] Handling call
0709 13:18:02.428614 (+957431us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b5400407ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:02.428729 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1919945600}
I20260709 13:18:02.526649  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.527284  3971 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:02.427392  9304 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:02.528173  9304 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.395596  9212 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.287783  9258 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:02.385841  9338 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:18:02.548347  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:02.549717  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.550743  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:02.551663  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.464071  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2907) took 1372 ms. Trace:
I20260709 13:18:02.401589  9318 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.555961  9318 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:02.407873  9221 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.561043  9221 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.416903  9202 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.475492  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:02.473817  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2680) took 1013 ms. Trace:
I20260709 13:18:02.565294  4040 rpcz_store.cc:276] 0709 13:18:01.460705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.460924 (+   219us) service_pool.cc:224] Handling call
0709 13:18:01.474370 (+ 13446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.474710 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:01.474742 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.498108 (+ 23366us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.664335 (+166227us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:01.664375 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:01.664440 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.467647 (+803207us) raft_consensus.cc:1685] finished
0709 13:18:02.473550 (+  5903us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.473740 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":95129,"raft.queue_time_us":485,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16342,"thread_start_us":159209,"threads_started":1,"wal-append.queue_time_us":476420}
I20260709 13:18:02.567358  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.483621  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 777) took 1897 ms. Trace:
I20260709 13:18:02.456635  9313 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:02.400600  9263 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.512784  4046 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:18:02.570881  3963 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:02.367928  9325 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.514778  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.572469  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.573619  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.510423  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.575026  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:02.575227  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70016.9us
I20260709 13:18:02.575635  3969 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:02.576471  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:02.525046  3970 rpcz_store.cc:276] 0709 13:18:00.584934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.426587 (+1841653us) service_pool.cc:224] Handling call
0709 13:18:02.426929 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.427122 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.427147 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.427190 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:02.427223 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.427274 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.427393 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.576947  9017 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:02.536177  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.467154  9109 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:02.517566  9300 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.649s	user 0.004s	sys 0.008s
I20260709 13:18:02.578311  4116 raft_consensus.cc:2368] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:02.578074  9300 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.525045  9237 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.553715  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:02.579458  4047 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:02.516842  9267 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.552295  4121 rpcz_store.cc:276] 0709 13:18:01.091809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.106841 (+ 15032us) service_pool.cc:224] Handling call
0709 13:18:01.133660 (+ 26819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.273890 (+1140230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.463793 (+189903us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002ab7d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:02.464002 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2426103168}
I20260709 13:18:02.518662  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:02.581360  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 62792us
I20260709 13:18:02.581754  4121 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:02.578217  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:02.580154  4115 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:02.580451  4041 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:02.582998  4112 raft_consensus.cc:606] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:02.585340  4112 raft_consensus.cc:614] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:02.587707  9341 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.588183  9341 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:02.588546  9341 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.598532  9328 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:02.599138  9328 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:02.583105  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:02.599987  9328 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.601387  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:02.602207  9030 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.602891  9030 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:02.604203  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3216) took 2022 ms. Trace:
I20260709 13:18:02.604619  3967 rpcz_store.cc:276] 0709 13:18:00.582093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.019052 (+1436959us) service_pool.cc:224] Handling call
0709 13:18:02.138618 (+119566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.210062 (+ 71444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.604008 (+393946us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540044c0d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:02.604142 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246805376}
I20260709 13:18:02.605542  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3213) took 2024 ms. Trace:
I20260709 13:18:02.580128  9300 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.604178  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.608073  9300 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:02.608541  9300 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:02.609849  9300 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.577739  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:02.568990  3968 rpcz_store.cc:276] 0709 13:18:00.585874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.482623 (+1896749us) service_pool.cc:224] Handling call
0709 13:18:02.483038 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.483248 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.483275 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.483323 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:02.483358 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.483421 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.483546 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.513202  9266 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.617465  9344 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:02.605878  3966 rpcz_store.cc:276] 0709 13:18:00.581326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.563557 (+982231us) service_pool.cc:224] Handling call
0709 13:18:02.605356 (+1041799us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54001caa54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:02.605478 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219570560}
I20260709 13:18:02.623366  4043 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:02.624177  3969 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 19. Ops: []
I20260709 13:18:02.624804  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2746) took 2036 ms. Trace:
W20260709 13:18:02.621976  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 518804us
I20260709 13:18:02.625104  3969 rpcz_store.cc:276] 0709 13:18:00.587928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.577329 (+1989401us) service_pool.cc:224] Handling call
0709 13:18:02.624012 (+ 46683us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.624560 (+   548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.624734 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17792}
I20260709 13:18:02.627647  3963 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 13:18:02.628592  3968 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:02.637917  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2762) took 1835 ms. Trace:
I20260709 13:18:02.638316  3968 rpcz_store.cc:276] 0709 13:18:00.802852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.620631 (+1817779us) service_pool.cc:224] Handling call
0709 13:18:02.628411 (+  7780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.637686 (+  9275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.637862 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.639437  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2766) took 1835 ms. Trace:
I20260709 13:18:02.632911  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.639796  3963 rpcz_store.cc:276] 0709 13:18:00.803859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.624590 (+1820731us) service_pool.cc:224] Handling call
0709 13:18:02.624890 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.639188 (+ 14298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.639384 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.643565  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2772) took 1834 ms. Trace:
I20260709 13:18:02.643993  3969 rpcz_store.cc:276] 0709 13:18:00.808839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.636706 (+1827867us) service_pool.cc:224] Handling call
0709 13:18:02.637007 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.643237 (+  6230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.643266 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.643310 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.643341 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.643402 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.643513 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5897}
I20260709 13:18:02.647086  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:02.623538  9331 consensus_meta.cc:287] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.000s
I20260709 13:18:02.515379  9330 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.604835  9298 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:02.636047  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2770) took 1827 ms. Trace:
I20260709 13:18:02.662624  3966 rpcz_store.cc:276] 0709 13:18:00.808260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.626848 (+1818588us) service_pool.cc:224] Handling call
0709 13:18:02.635517 (+  8669us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.635705 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.635740 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.635783 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:02.635815 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.635869 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.635985 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.649623  9313 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:18:02.657208  9212 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:02.664216  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 250614us
I20260709 13:18:02.668495  3971 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:02.673620  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3220) took 1850 ms. Trace:
I20260709 13:18:02.671214  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:02.673986  3971 rpcz_store.cc:276] 0709 13:18:00.822842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.642690 (+1819848us) service_pool.cc:224] Handling call
0709 13:18:02.668275 (+ 25585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.673342 (+  5067us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.673563 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.580228  9183 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.671325  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.672045  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:02.681787  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 541) took 1031 ms. Trace:
I20260709 13:18:02.674471  4040 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:02.636615  9344 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:02.682174  4115 rpcz_store.cc:276] 0709 13:18:01.649942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.650608 (+   666us) service_pool.cc:224] Handling call
0709 13:18:01.658600 (+  7992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.583672 (+925072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.681565 (+ 97893us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:02.681724 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118868224}
I20260709 13:18:02.682099  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.554675  9338 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.661950  9295 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:02.693861  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:02.695869  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48876.2us
I20260709 13:18:02.699625  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 778) took 1589 ms. Trace:
I20260709 13:18:02.700088  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:02.700064  3966 rpcz_store.cc:276] 0709 13:18:01.110573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.671960 (+1561387us) service_pool.cc:224] Handling call
0709 13:18:02.698679 (+ 26719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.699121 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.699156 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.699215 (+    59us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:02.699249 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.699321 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.699556 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.703290  9017 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:02.703492  3971 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:02.704124  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3222) took 1311 ms. Trace:
I20260709 13:18:02.704602  9030 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:02.704423  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.706552  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.707572  9185 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.663688  8855 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:02.708195  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.669760  9298 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.708742  9266 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:02.709193  9030 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:02.704422  3971 rpcz_store.cc:276] 0709 13:18:01.393199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.702843 (+1309644us) service_pool.cc:224] Handling call
0709 13:18:02.703171 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.703892 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.704072 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.709932  9017 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.710177  9330 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.712061  9338 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:02.721520  9323 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.722680  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:02.664683  9331 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.690815  9344 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:02.680886  9268 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:02.664613  9200 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.726643  4038 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:02.727120  9258 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.690105  9164 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:02.814845  9164 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:02.815826  9164 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.817118  9164 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.704289  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:02.729621  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:02.818607  4047 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
W20260709 13:18:02.787061  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 94031.4us
W20260709 13:18:02.789106  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 303773us
I20260709 13:18:02.701537  9212 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.700843  9254 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:02.726070  9183 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:02.791390  9266 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:02.812402  3971 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:02.798363  9017 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:02.786104  9295 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:02.819862  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:02.790258  9030 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:02.822136  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.811508  9258 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:02.797344  9098 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:02.830238  4044 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:02.830245  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3225) took 1431 ms. Trace:
I20260709 13:18:02.834545  4041 raft_consensus.cc:2368] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:18:02.844408  3971 rpcz_store.cc:276] 0709 13:18:01.398580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.790542 (+1391962us) service_pool.cc:224] Handling call
0709 13:18:02.812227 (+ 21685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.826451 (+ 14224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.830174 (+  3723us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.839820  9030 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:02.829631  9266 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:02.793143  8855 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.869885  4119 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 5
I20260709 13:18:02.870280  4119 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 13:18:02.870534  4119 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:02.873555  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3337) took 1001 ms. Trace:
I20260709 13:18:02.873984  4043 rpcz_store.cc:276] 0709 13:18:01.872371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.873052 (+   681us) service_pool.cc:224] Handling call
0709 13:18:02.873333 (+1000281us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540002b7d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:02.873470 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112570752}
W20260709 13:18:02.876703  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3229) took 1458 ms (client timeout 1697 ms). Trace:
W20260709 13:18:02.877298  3965 rpcz_store.cc:269] 0709 13:18:01.418099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.535466 (+117367us) service_pool.cc:224] Handling call
0709 13:18:02.876492 (+1341026us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400408dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:02.876637 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2891567488}
I20260709 13:18:02.878197  9374 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:02.880549  9390 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:02.814208  9268 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.893008  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:02.894804  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:02.895939  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:02.885679  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3226) took 1483 ms. Trace:
I20260709 13:18:02.896922  3971 rpcz_store.cc:276] 0709 13:18:01.402497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.845936 (+1443439us) service_pool.cc:224] Handling call
0709 13:18:02.885136 (+ 39200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.885350 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.885387 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.885433 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:02.885469 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.885520 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.885620 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.886816  3972 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:02.898952  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2756) took 2178 ms. Trace:
I20260709 13:18:02.899287  3972 rpcz_store.cc:276] 0709 13:18:00.720344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.593373 (+1873029us) service_pool.cc:224] Handling call
0709 13:18:02.886435 (+293062us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:02.886637 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.898659 (+ 12022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.898893 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70492544}
I20260709 13:18:02.883428  9375 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:02.840624  9258 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:02.900676  3972 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:02.926853  3937 leader_election.cc:400] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:18:02.928592  3937 leader_election.cc:403] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:02.829906  9254 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.850109  9098 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:02.828882  9212 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:02.930815  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 779) took 1369 ms. Trace:
I20260709 13:18:02.934912  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3228) took 1517 ms. Trace:
I20260709 13:18:02.941748  3971 rpcz_store.cc:276] 0709 13:18:01.417795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.897963 (+1480168us) service_pool.cc:224] Handling call
0709 13:18:02.934418 (+ 36455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.934606 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.934631 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.934671 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:02.934701 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.934752 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.934854 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.940326  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:02.941407  3972 rpcz_store.cc:276] 0709 13:18:01.561757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.900147 (+1338390us) service_pool.cc:224] Handling call
0709 13:18:02.900498 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.928009 (+ 27511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.930731 (+  2722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.944166  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3235) took 1364 ms. Trace:
I20260709 13:18:02.944516  3972 rpcz_store.cc:276] 0709 13:18:01.579719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.943404 (+1363685us) service_pool.cc:224] Handling call
0709 13:18:02.943685 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.943860 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.943883 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.943934 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:02.943978 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.944025 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.944116 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.945900  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3236) took 1366 ms. Trace:
I20260709 13:18:02.946126  3972 rpcz_store.cc:276] 0709 13:18:01.579960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.945332 (+1365372us) service_pool.cc:224] Handling call
0709 13:18:02.945537 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.945652 (+   115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.945668 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.945695 (+    27us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:02.945722 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.945767 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.945858 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:02.940299  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 232152us
I20260709 13:18:02.948537  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:02.903649  9156 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.866362  9318 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.927416  9313 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:18:02.902180  9375 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:02.961737  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:02.962119  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3221) took 2139 ms. Trace:
W20260709 13:18:02.929353  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 247575us
I20260709 13:18:02.962574  3968 rpcz_store.cc:276] 0709 13:18:00.823093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.652161 (+1829068us) service_pool.cc:224] Handling call
0709 13:18:02.652614 (+   453us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.653059 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:02.890025 (+236966us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.960606 (+ 70581us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.960673 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:02.960724 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.960973 (+   249us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.962060 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":301640,"threads_started":2}
I20260709 13:18:02.925223  9329 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:02.930545  9258 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:02.974761  3971 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:02.966624  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:02.981698  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 84938us
I20260709 13:18:02.944626  9319 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:02.989223  3968 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:02.953461  9317 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:02.904364  9267 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.968331  9375 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:02.993645  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3234) took 1414 ms. Trace:
I20260709 13:18:02.951099  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 418) took 1768 ms. Trace:
I20260709 13:18:02.954828  9362 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.002801  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 543) took 1343 ms. Trace:
I20260709 13:18:02.994427  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2781) took 1397 ms. Trace:
I20260709 13:18:03.018910  3968 rpcz_store.cc:276] 0709 13:18:01.596726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.971454 (+1374728us) service_pool.cc:224] Handling call
0709 13:18:02.971828 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.994190 (+ 22362us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.994374 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.020005  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:02.964664  9324 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:03.008136  3971 rpcz_store.cc:276] 0709 13:18:01.579458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.942765 (+1363307us) service_pool.cc:224] Handling call
0709 13:18:02.974442 (+ 31677us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.993369 (+ 18927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.993589 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:02.969764  9183 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:02.993466  9329 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:03.014616  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48060.9us
I20260709 13:18:03.075495  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:03.076203  4680 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:03.016222  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 165820us
I20260709 13:18:02.954792  8763 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:18:02.992298  9305 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56100 (request call id 1) took 3135 ms. Trace:
I20260709 13:18:02.995342  9319 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.068222  4042 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:03.017503  4113 rpcz_store.cc:276] 0709 13:18:01.659720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.668538 (+  8818us) service_pool.cc:224] Handling call
0709 13:18:01.807269 (+138731us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:01.807492 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:01.822677 (+ 15185us) log.cc:844] Serialized 14 byte log entry
0709 13:18:02.640494 (+817817us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18002e0a80. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:18:03.002095 (+361601us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.002401 (+   306us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:03.002544 (+   143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.002618 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.002742 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28299,"prepare.queue_time_us":15099,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":91063,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":16277,"spinlock_wait_cycles":32426880,"thread_start_us":332612,"threads_started":2}
I20260709 13:18:03.001255  9317 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.003943  9248 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:02.965179  9295 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.089685  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:02.938623  9344 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:02.981786  9221 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.094983  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.112623  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:02.996315  9191 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:18:03.132200  4680 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:03.133548  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:03.137392  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:03.138001  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66136.2us
I20260709 13:18:03.138633  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:03.137960  9156 raft_consensus.cc:2764] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:18:03.140213  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.141068  9344 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:03.141410  9372 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:03.099398  9370 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:03.142097  9374 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:18:03.142575  9364 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 13:18:03.143468  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 162720us
I20260709 13:18:03.092236  9329 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.090293  9185 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:03.132558  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:03.107758  9288 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:18:03.137754  9363 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.290s	user 0.001s	sys 0.001s
W20260709 13:18:03.141952  9380 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:18:03.115713  9323 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:03.169231  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:03.217038  3971 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:18:03.171368  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 81817.9us
I20260709 13:18:03.218169  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:03.218709  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 86207.9us
I20260709 13:18:03.124087  9183 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:03.176206  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.166168  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:18:03.174034  9365 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
W20260709 13:18:03.225629  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49520.2us
I20260709 13:18:03.170199  9370 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.222517  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:03.097983  9098 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.182889  9382 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:03.189587  9341 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.002s
I20260709 13:18:03.232160  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:03.179999  9393 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:03.214534  9338 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.220569  9328 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:03.287781  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55683.3us
I20260709 13:18:03.215442  9294 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:03.291150  4085 leader_election.cc:400] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 9. Current term is 10.
I20260709 13:18:03.229566  9185 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.301625  9294 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.234483  9370 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.319900  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3224) took 1926 ms. Trace:
I20260709 13:18:03.320363  3966 rpcz_store.cc:276] 0709 13:18:01.393737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.789127 (+1395390us) service_pool.cc:224] Handling call
0709 13:18:02.805610 (+ 16483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.805816 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:02.961700 (+155884us) log.cc:844] Serialized 14 byte log entry
0709 13:18:03.319563 (+357863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.319616 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:03.319665 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.319727 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.319837 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31094,"prepare.queue_time_us":471956,"thread_start_us":466868,"threads_started":2}
I20260709 13:18:03.280594  9268 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.312207  3971 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:03.317800  4114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:03.327050  4114 raft_consensus.cc:606] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:03.327427  4114 raft_consensus.cc:614] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:03.328233  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:03.209574  9288 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.290052  9191 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:03.207665  9319 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:03.334412  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 200929us
I20260709 13:18:03.223670  9200 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:03.189321  9317 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.277679  9177 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:18:03.342993  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:03.350551  9392 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:18:03.234501  9384 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:18:03.324451  9382 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.363273  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.325455  9254 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.364073  3971 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
W20260709 13:18:03.365743  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 225589us
I20260709 13:18:03.331382  9338 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:03.367456  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.369405  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:03.369884  9378 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:18:03.371192  3966 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:03.336879  9388 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:03.303606  9328 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.365693  9317 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:03.379805  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.331056  9341 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.290501  9393 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.360870  9267 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.359338  9200 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:03.367322  9382 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.377995  9319 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.386361  3971 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:03.366747  9338 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:03.390434  9341 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.376410  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.394569  3966 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:03.395459  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.396025  3966 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:03.396642  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.397449  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.397850  3966 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:03.398396  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.398783  3966 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:03.399471  3966 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:03.399850  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3238) took 1374 ms. Trace:
I20260709 13:18:03.400058  3966 rpcz_store.cc:276] 0709 13:18:02.025132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.399167 (+1374035us) service_pool.cc:224] Handling call
0709 13:18:03.399364 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.399701 (+   337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.399816 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.401171  3966 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:03.402860  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3244) took 1368 ms. Trace:
I20260709 13:18:03.012043  4679 rpcz_store.cc:276] 0709 13:18:01.182452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.213272 (+ 30820us) service_pool.cc:224] Handling call
0709 13:18:01.277232 (+ 63960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:01.448077 (+170845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:01.465154 (+ 17077us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:01.641477 (+176323us) log.cc:844] Serialized 26 byte log entry
0709 13:18:01.949127 (+307650us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:01.952337 (+  3210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:02.889108 (+936771us) spinlock_profiling.cc:243] Waited 95.8 ms on lock 0x7b54009826d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:02.903440 (+ 14332us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:02.927082 (+ 23642us) raft_consensus.cc:1685] finished
0709 13:18:02.927110 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:02.942236 (+ 15126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265,"raft.queue_time_us":32018,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":14626,"spinlock_wait_cycles":220433280,"thread_start_us":233605,"threads_started":1,"wal-append.queue_time_us":345115}
I20260709 13:18:03.418416  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.413453  3966 rpcz_store.cc:276] 0709 13:18:02.034600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.400570 (+1365970us) service_pool.cc:224] Handling call
0709 13:18:03.400824 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.402494 (+  1670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.402790 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.420221  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:03.388664  9212 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:03.389396  9388 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.093235  9305 rpcz_store.cc:276] 0709 13:17:59.840875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.842193 (+  1318us) service_pool.cc:224] Handling call
0709 13:17:59.980877 (+138684us) log.cc:844] Serialized 501 byte log entry
0709 13:18:01.506237 (+1525360us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b1800495ac0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74718a20 00007fed74729a29 00007fed7472a13f 00007fed746ee2ab
0709 13:18:01.507471 (+  1234us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b4c001540c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74718a20 00007fed74729a29 00007fed7472a13f 00007fed746ee2ab 00007fed7471bf3c 00007fed7471c3fe 00007fed749a950b 00007fed763a8381 00007fed763a626b 00007fed763acd53 00007fed763accd9
0709 13:18:02.964360 (+1456889us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":59233,"mutex_wait_us":6570,"raft.queue_time_us":333159,"raft.run_cpu_time_us":10444,"raft.run_wall_time_us":1211527,"spinlock_wait_cycles":43737728,"thread_start_us":124397,"threads_started":1,"wal-append.queue_time_us":269225,"wal-append.run_cpu_time_us":1884,"wal-append.run_wall_time_us":1004131}
I20260709 13:18:03.402119  9403 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:03.580988  3966 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:03.581485  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3245) took 1518 ms. Trace:
I20260709 13:18:03.581704  3966 rpcz_store.cc:276] 0709 13:18:02.062694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.580347 (+1517653us) service_pool.cc:224] Handling call
0709 13:18:03.580649 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.581278 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.581441 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:03.578248  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 159890us
I20260709 13:18:03.379038  9183 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.578826  3971 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:03.589003  3971 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 9. Current term is 10. Ops: []
I20260709 13:18:03.589794  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 782) took 1345 ms. Trace:
I20260709 13:18:03.401786  9338 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:03.590189  3971 rpcz_store.cc:276] 0709 13:18:02.244938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.588496 (+1343558us) service_pool.cc:224] Handling call
0709 13:18:03.588817 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.589544 (+   727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.589736 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:03.593039  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 783) took 1347 ms. Trace:
W20260709 13:18:03.456647  9298 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.000s
I20260709 13:18:03.389209  9288 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.596202  3971 rpcz_store.cc:276] 0709 13:18:02.245277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.592192 (+1346915us) service_pool.cc:224] Handling call
0709 13:18:03.592514 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.592703 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.592729 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.592789 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:03.592822 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.592875 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.592972 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:03.452492  9368 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.148s	user 0.001s	sys 0.001s
W20260709 13:18:03.456928  9386 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:18:03.453464  9396 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:18:03.454372  9383 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
W20260709 13:18:03.456226  9304 consensus_meta.cc:287] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.928s	user 0.008s	sys 0.001s
W20260709 13:18:03.460134  9017 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.000s
I20260709 13:18:03.457885  8855 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:03.436429  9164 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.002s
I20260709 13:18:03.459702  9376 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:03.602605  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2653) took 1667 ms. Trace:
I20260709 13:18:03.605968  9399 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:03.606261  9404 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:03.609042  9393 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:03.609694  9401 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 13:18:03.367664  9374 consensus_queue.cc:1175] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e032f02b0aa450384dda978641ba666" responder_term: 17 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:03.593859  9405 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:03.611665  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 784) took 1301 ms. Trace:
I20260709 13:18:03.461218  9109 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.453018  9294 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:03.618182  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.583283  9403 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:03.625489  4116 rpcz_store.cc:276] 0709 13:18:01.934963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.237265 (+302302us) service_pool.cc:224] Handling call
0709 13:18:03.602392 (+1365127us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540004cc54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:03.602537 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589534080}
I20260709 13:18:03.436735  9381 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.180s
I20260709 13:18:03.454949  9329 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.639750  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2940) took 1392 ms. Trace:
W20260709 13:18:03.651037  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.650295  4115 rpcz_store.cc:276] 0709 13:18:02.247498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.702926 (+455428us) service_pool.cc:224] Handling call
0709 13:18:02.703324 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.904495 (+201171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.904532 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.905067 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.121066 (+215999us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:03.121102 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.121171 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.639501 (+518330us) raft_consensus.cc:1685] finished
0709 13:18:03.639525 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.639680 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178657,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":357633,"threads_started":2,"wal-append.queue_time_us":319352}
W20260709 13:18:03.651532  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.652093  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46318.4us
I20260709 13:18:03.628302  3857 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e7bedca9d544f8992960c04a55f9233 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:03.461280  9409 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.187s
I20260709 13:18:03.643157  3971 rpcz_store.cc:276] 0709 13:18:02.310533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.599409 (+1288876us) service_pool.cc:224] Handling call
0709 13:18:03.599729 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.599929 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.599960 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:03.600011 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:03.600050 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.600108 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.611604 (+ 11496us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:03.629069  9030 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.002s
I20260709 13:18:03.460988  9200 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.639103  9288 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.627314  9376 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.658484  3964 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:03.613579  9298 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.632302  9325 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.649902  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2932) took 1410 ms. Trace:
I20260709 13:18:03.674753  4121 rpcz_store.cc:276] 0709 13:18:02.239818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.584312 (+344494us) service_pool.cc:224] Handling call
0709 13:18:02.584723 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.586736 (+  2013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.586771 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:02.586822 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:02.586865 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.649649 (+1062784us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:03.649702 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.649843 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":233836,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5781,"spinlock_wait_cycles":3804544}
I20260709 13:18:03.636369  9177 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.627653  9410 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:03.668285  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2757) took 2866 ms. Trace:
I20260709 13:18:03.678994  3964 rpcz_store.cc:276] 0709 13:18:00.801529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.601711 (+1800182us) service_pool.cc:224] Handling call
0709 13:18:03.658070 (+1056359us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:03.658296 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.668009 (+  9713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.668224 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51206912}
I20260709 13:18:03.644658  9320 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.624058  9017 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:03.672688  4085 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.697s (SENT) [suppressed 6 similar messages]
I20260709 13:18:03.623873  9304 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:03.660573  9375 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.597s	user 0.006s	sys 0.004s
I20260709 13:18:03.688176  3970 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 13:18:03.700601  3970 pending_rounds.cc:85] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 5
I20260709 13:18:03.701016  3970 pending_rounds.cc:107] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 13:18:03.701395  3970 raft_consensus.cc:2889] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.702071  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2752) took 3040 ms. Trace:
I20260709 13:18:03.702437  3970 rpcz_store.cc:276] 0709 13:18:00.661844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.577366 (+1915522us) service_pool.cc:224] Handling call
0709 13:18:03.687630 (+1110264us) spinlock_profiling.cc:243] Waited 43.7 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed73327a5b 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:03.687827 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.701854 (+ 14027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.702021 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100612608}
W20260709 13:18:03.705668  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.706113  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.709916  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.710202  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.711118  4112 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:03.713945  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.660930  9393 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:18:03.662947  9109 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:03.715674  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.664052  9030 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.716310  4121 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:03.717593  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.720086  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.720443  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.721237  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.722229  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.722798  4116 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.724279  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.725919  9304 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.707723  9375 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.728243  9375 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:03.726040  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.698453  9328 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:03.734493  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:03.737542  9397 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:03.718570  9403 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.739182  9403 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:03.740070  9258 consensus_meta.cc:287] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.736s	user 0.011s	sys 0.000s
I20260709 13:18:03.740473  9258 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:03.741487  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2652) took 1806 ms (client timeout 2047 ms). Trace:
W20260709 13:18:03.741870  4120 rpcz_store.cc:269] 0709 13:18:01.934683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.137054 (+202371us) service_pool.cc:224] Handling call
0709 13:18:03.741302 (+1604248us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540034d854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:03.741430 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667805440}
I20260709 13:18:03.742522  9258 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.709649  9331 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.747618  4119 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:03.747969  9017 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.747848  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.748632  4121 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:03.749279  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3357) took 1431 ms. Trace:
W20260709 13:18:03.749441  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96689.9us
I20260709 13:18:03.749670  4038 rpcz_store.cc:276] 0709 13:18:02.317923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.319924 (+  2001us) service_pool.cc:224] Handling call
0709 13:18:02.373349 (+ 53425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.810307 (+436958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.749042 (+938735us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54003dbb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:03.749223 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":811843968}
I20260709 13:18:03.751628  3967 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:03.752192  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2759) took 2950 ms. Trace:
I20260709 13:18:03.752481  3967 rpcz_store.cc:276] 0709 13:18:00.802101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.605615 (+1803514us) service_pool.cc:224] Handling call
0709 13:18:03.748653 (+1143038us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:03.751333 (+  2680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.751978 (+   645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.752142 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42012032}
I20260709 13:18:03.687295  9177 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.757138  4041 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:03.758270  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.759171  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.759058  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:03.761070  4119 raft_consensus.cc:606] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:03.761394  4119 raft_consensus.cc:614] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:03.761413  9344 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.001s
I20260709 13:18:03.664814  9388 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.744282  4679 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:03.764824  4047 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:03.769337  4121 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:03.775058  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.775573  4121 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16.
I20260709 13:18:03.776669  4112 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 8 to 13, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:03.779105  4113 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:03.781430  4119 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:03.782678  9250 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:03.783089  9250 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.783910  9250 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.789177  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e32744704d014399851a0661c8929ded"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:03.798332  4680 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:03.799156  4680 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:03.799808  4120 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
W20260709 13:18:03.782887  9362 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.000s
I20260709 13:18:03.782953  4038 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:18:03.801873  4038 pending_rounds.cc:85] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 9
I20260709 13:18:03.802232  4038 pending_rounds.cc:107] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:18:03.802527  4038 raft_consensus.cc:2889] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:03.770187  9393 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:03.799944  4680 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.804314  4121 raft_consensus.cc:606] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.804734  4121 raft_consensus.cc:614] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:03.806152  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:03.806385  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:03.815591  4680 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:03.802366  9362 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:18:03.832727  4680 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:03.818141  9393 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:03.841830  9393 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:03.832273  9329 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.858559  9309 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:03.866806  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 780) took 2273 ms. Trace:
I20260709 13:18:03.851591  9344 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:18:03.884816  3972 rpcz_store.cc:276] 0709 13:18:01.593202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.946637 (+1353435us) service_pool.cc:224] Handling call
0709 13:18:02.946851 (+   214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:02.989954 (+ 43103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:02.989985 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:02.990456 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.143195 (+152739us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:03.143244 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.866151 (+722907us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54003985d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:03.866231 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.866309 (+    78us) raft_consensus.cc:1685] finished
0709 13:18:03.866325 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.866700 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4386,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7792,"spinlock_wait_cycles":57448192,"thread_start_us":68201,"threads_started":1,"wal-append.queue_time_us":621014}
I20260709 13:18:03.890583  9318 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.894341  4116 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:03.896482  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:03.896878  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3247) took 1790 ms. Trace:
I20260709 13:18:03.897226  3966 rpcz_store.cc:276] 0709 13:18:02.106805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.582231 (+1475426us) service_pool.cc:224] Handling call
0709 13:18:03.588288 (+  6057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.588513 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.588536 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.600452 (+ 11916us) log.cc:844] Serialized 26 byte log entry
0709 13:18:03.669724 (+ 69272us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:03.669758 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.669820 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:03.726165 (+ 56345us) raft_consensus.cc:1685] finished
0709 13:18:03.726185 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:03.880572 (+154387us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b54001edf50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:03.896810 (+ 16238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13331712,"thread_start_us":68924,"threads_started":1,"wal-append.queue_time_us":119629}
W20260709 13:18:03.870090  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3361) took 1550 ms (client timeout 1924 ms). Trace:
I20260709 13:18:03.870965  4112 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:03.873421  9414 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:18:03.838949  9382 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:03.877580  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:03.878264  9263 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.878858  9298 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.879453  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3333) took 2026 ms. Trace:
I20260709 13:18:03.879670  9030 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:03.880744  9177 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:03.898836  4042 rpcz_store.cc:269] 0709 13:18:02.319435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.346773 (+ 27338us) service_pool.cc:224] Handling call
0709 13:18:03.869937 (+1523164us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b540028c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:03.870033 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604157824}
I20260709 13:18:03.908915  3968 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
W20260709 13:18:03.894480  9266 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.993s	user 0.010s	sys 0.001s
I20260709 13:18:03.913302  4047 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:03.916066  3937 leader_election.cc:400] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:03.916407  3937 leader_election.cc:403] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:03.917695  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.917822  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.910655  4044 rpcz_store.cc:276] 0709 13:18:01.853008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:01.853132 (+   124us) service_pool.cc:224] Handling call
0709 13:18:01.853484 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:02.843798 (+990314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:03.879227 (+1035429us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b540035d4d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:03.879393 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2245829504}
I20260709 13:18:03.884739  9309 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.919045  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.919672  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.922214  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.922433  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.922546  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.928580  4044 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:03.928994  4041 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.929606  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:03.929876  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.930552  4044 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.914685  9344 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:03.936527  9250 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.937537  9309 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.922124  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.938836  4046 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:03.939275  4115 raft_consensus.cc:2368] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:03.939735  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.926877  9404 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:03.942023  9404 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:03.942930  9404 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.943645  9382 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:03.944128  9404 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:03.922169  4038 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:03.945595  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.946177  4038 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:03.947131  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.948208  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.918450  4042 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:03.949221  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.949365  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.949975  4042 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:18:03.950274  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.950735  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:03.951078  4112 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:03.927595  9398 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:18:03.927872  9362 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.955895  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.914870  9390 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:18:03.957337  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.958379  3965 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:03.960038  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.960616  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 8.
I20260709 13:18:03.961535  4041 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:03.955314  9398 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:03.962769  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:03.963335  4042 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:03.925536  9338 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.948698  4038 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:03.918735  9329 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:03.954775  4046 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
W20260709 13:18:03.969900  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:03.956430  9370 consensus_meta.cc:287] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.000s
I20260709 13:18:03.968210  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:03.965720  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:03.996140  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:03.919201  9319 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:18:03.919164  9266 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:03.999261  4041 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:03.957240  9395 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.957446  9324 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:03.999928  4046 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:18:03.957792  9309 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:03.958760  9164 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:04.052376  4047 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.013249  4012 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16.
I20260709 13:18:04.061470  4112 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:04.068471  4012 leader_election.cc:403] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:18:04.068917  4112 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:18:04.064932  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99280.5us
I20260709 13:18:04.069940  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:03.959000  9362 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.074694  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:04.097326  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:04.100193  4039 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:04.101676  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 88587.2us
I20260709 13:18:04.107949  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:04.067667  8855 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.117846  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:04.112188  9331 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:04.000255  9098 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:04.060673  9017 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:04.115456  4041 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:03.996639  9329 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.066844  9164 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:04.000707  9370 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.100284  9212 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.138897  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.109110  9403 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16.
I20260709 13:18:04.070240  9324 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.120115  8855 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:04.151888  4114 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:04.139571  9164 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.155200  4117 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:18:04.155546  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47679.5us
I20260709 13:18:03.965912  9398 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.170022  9177 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:04.150347  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:04.123004  9325 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:18:04.186730  4044 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:04.187299  4038 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:04.153718  8855 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:04.158226  9317 consensus_meta.cc:287] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.006s
W20260709 13:18:04.194397  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.156606  9212 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.152159  9334 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:18:04.150830  9419 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:04.185145  9177 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:04.142844  9098 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:04.228063  4120 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:04.182919  9382 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:18:04.204541  9367 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:18:04.235206  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 161500us
W20260709 13:18:04.290280  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.211278  9212 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.240263  9338 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:04.245415  9366 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:04.316649  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:04.329244  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.308434  9366 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:04.301249  9098 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.334677  4040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 451) took 1354 ms (client timeout 1755 ms). Trace:
I20260709 13:18:04.344522  4038 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:18:04.344609  4040 rpcz_store.cc:269] 0709 13:18:02.979987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.328900 (+1348913us) service_pool.cc:224] Handling call
0709 13:18:04.334596 (+  5696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16256}
I20260709 13:18:04.348961  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.350894  4040 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:04.360594  9370 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:04.297045  9177 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.335247  9329 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.342428  9266 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.349591  9435 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:04.348474  9366 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.354648  9362 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:04.388890  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 272618us
I20260709 13:18:04.393859  9177 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.350690  9098 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.396246  4040 raft_consensus.cc:2955] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 8 to 13, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:04.410950  3963 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:04.401829  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.412106  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.412916  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:04.413782  3966 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:04.414199  9098 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.414803  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.414592  9366 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.415370  3966 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.416260  9376 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.417698  9376 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:04.419462  9437 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:18:04.423187  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:04.405668  4038 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.408344  3971 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:04.415084  9221 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:04.427399  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.428072  3971 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.400414  9435 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.431181  9435 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.431486  9367 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:04.432107  3964 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:04.409693  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.380336  9324 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.388554  9329 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.444936  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.445632  3972 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.441183  9367 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:04.449254  9431 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.001s	sys 0.001s
W20260709 13:18:04.449321  9429 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.087s	user 0.000s	sys 0.002s
I20260709 13:18:04.458097  3966 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:04.473565  3972 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
W20260709 13:18:04.484866  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.497133  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.462808  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2935) took 2222 ms. Trace:
I20260709 13:18:04.497997  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.500581  3966 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:04.463397  9250 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.526s	user 0.005s	sys 0.005s
I20260709 13:18:04.507755  4112 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
W20260709 13:18:04.510262  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2796) took 1531 ms (client timeout 1516 ms). Trace:
W20260709 13:18:04.510669  3968 rpcz_store.cc:269] 0709 13:18:02.979245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.019705 (+ 40460us) service_pool.cc:224] Handling call
0709 13:18:04.510090 (+1490385us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b5400407ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:04.510196 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903608192}
I20260709 13:18:04.511332  3971 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:04.511932  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.521577  3968 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.482226  9098 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:04.496368  9162 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:18:04.457384  9440 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.457234  9435 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:04.521183  9250 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.449888  9329 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.477866  9367 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.541808  9435 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.549403  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:04.550034  9435 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.550141  4047 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:04.471767  9164 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.529713  9237 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.530385  3966 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:04.557282  3963 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:04.558398  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.512773  9212 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.497742  4118 rpcz_store.cc:276] 0709 13:18:02.240504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.602719 (+362215us) service_pool.cc:224] Handling call
0709 13:18:02.603050 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.872279 (+1269229us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b1800473d40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76444bfb 00007fed7644f64b
0709 13:18:03.872407 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:03.872430 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:03.900235 (+ 27805us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.197481 (+297246us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:04.197525 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.197599 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.462344 (+264745us) raft_consensus.cc:1685] finished
0709 13:18:04.462373 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.462719 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15558,"raft.queue_time_us":247424,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":22963,"spinlock_wait_cycles":32110976,"thread_start_us":548252,"threads_started":2,"wal-append.queue_time_us":425164}
I20260709 13:18:04.565842  4047 raft_consensus.cc:2410] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:18:04.551455  9395 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:04.565788  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:04.560549  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 269870us
I20260709 13:18:04.569362  3971 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:04.566596  3963 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:04.566648  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.538476  9098 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.541101  3968 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:04.571321  3970 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 17 because replica has last-logged OpId of term: 14 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 13:18:04.558748  9362 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.559428  9435 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.573486  3966 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:04.544215  9250 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.577306  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.580013  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.541518  9440 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.581005  9435 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.582582  9440 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.582980  9435 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.584980  9367 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:04.585227  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.578734  9436 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.585932  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.587085  3971 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.567260  9212 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.594408  9398 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:04.606494  9212 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.598227  9098 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.600950  3972 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:04.609867  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.579690  9362 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.610904  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.611106  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.611492  3972 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:04.611670  3964 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:04.611833  9362 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.600996  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:04.602841  8855 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.585917  3970 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.605850  9329 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.606359  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3227) took 3197 ms. Trace:
I20260709 13:18:04.615593  3971 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:18:04.616612  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.629436  3965 rpcz_store.cc:276] 0709 13:18:01.408738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:02.878113 (+1469375us) service_pool.cc:224] Handling call
0709 13:18:02.878472 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:03.958797 (+1080325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.606133 (+647336us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001563d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:04.606305 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2483094912}
I20260709 13:18:04.635954  3972 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:04.638247  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.638947  3972 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:04.638852  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.608651  9212 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.641987  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:04.640030  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.646482  3970 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:18:04.647444  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.649065  3968 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.649402  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.647933  3969 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:04.648159  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:04.629320  9221 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:04.654527  3964 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:04.637470  9367 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.637099  9164 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.656404  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.659895  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.687789  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:04.698298  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.695432  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.699371  4118 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:04.672876  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.701664  3969 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:04.701727  4121 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:04.703262  3966 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:04.661625  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.704051  3970 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:18:04.697371  4116 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:04.705138  3970 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
W20260709 13:18:04.705363  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.616605  9436 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.711617  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.713968  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.649945  9329 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:04.691627  3972 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:04.667088  3968 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:04.709299  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.661692  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.709934  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.720296  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:04.719086  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.729990  4115 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:04.714608  4117 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:04.721616  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:04.706156  9450 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:04.654551  9212 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.731916  3965 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:04.733243  4113 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:04.734522  3968 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:04.713230  9367 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.738090  9367 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.732609  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.739403  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:04.740293  9212 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:04.740777  3966 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:04.740576  3968 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:18:04.724584  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.710832  3970 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:04.731612  4112 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:04.642904  9442 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:18:04.742165  3966 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:04.746606  3970 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:04.751101  9446 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:04.753665  9309 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.001s
I20260709 13:18:04.754127  9436 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.754712  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:04.755566  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:04.755973  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:04.656404  9362 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.091s
I20260709 13:18:04.696825  9221 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.729475  9329 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.758927  3970 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:18:04.760102  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.764837  3970 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:04.768569  3970 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:04.724913  9407 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:04.775844  3970 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:04.754671  9406 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.779284  3965 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:04.759537  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:04.757112  9446 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:04.783095  3970 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:04.794032  9427 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.499s	user 0.001s	sys 0.003s
I20260709 13:18:04.773212  9329 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:04.773948  9440 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:04.823963  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 97594.8us
I20260709 13:18:04.780150  9435 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.801847  9436 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:04.803231  9446 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.834486  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:04.837496  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.830948  9407 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:04.838070  3971 raft_consensus.cc:1813] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:04.830353  9250 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:04.838297  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:04.839242  3971 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 10: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:04.835166  9435 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.827692  9162 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:18:04.815490  4676 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:04.781127  9406 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.834465  9436 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:04.815076  9454 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:18:04.830152  9440 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.840013  9407 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:04.839213  8855 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.785698  9444 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:04.861989  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:04.856009  9221 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:04.865787  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:04.870476  3965 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:04.871800  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 140327us
I20260709 13:18:04.872795  9454 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:04.865345  3971 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
W20260709 13:18:04.879624  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45231.3us
I20260709 13:18:04.862660  9435 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.882216  3938 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:04.879570  4121 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:04.868940  9436 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.887307  9436 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.868058  9407 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:04.889454  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:04.894062  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 43894.5us
I20260709 13:18:04.867383  9440 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:04.891027  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.897325  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.898226  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.903318  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:04.904532  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.905376  4112 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:04.880434  9221 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:04.907742  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:04.889928  9407 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:04.896529  8855 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:04.892449  9393 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:04.891258  9406 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:04.906518  9250 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:04.913065  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 84251.3us
W20260709 13:18:04.913820  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 151470us
I20260709 13:18:04.890026  9366 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:18:04.880254  4676 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:04.915580  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:04.924190  9406 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:04.911367  9237 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:18:04.919183  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 749622us
I20260709 13:18:04.909452  9376 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:04.920943  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:04.909051  9309 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:04.921689  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.924602  9406 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.929193  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:04.912678  8855 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:04.931669  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:04.910342  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.921237  9331 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:04.918841  9030 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:04.925155  9183 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:18:04.928212  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.927376  9250 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:04.933285  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:04.934656  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 530760us
I20260709 13:18:04.925366  9440 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.931752  9406 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:04.921731  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:04.936554  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.951701  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:04.954761  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:04.955569  4120 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:18:04.947965  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3390) took 1048 ms. Trace:
I20260709 13:18:04.935535  9164 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:04.965858  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.966395  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.966658  4047 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:04.967115  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.958837  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.959223  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:04.968695  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.960305  4114 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:04.960990  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.969235  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.930675  9435 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:04.933488  8855 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:04.971005  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:04.933315  9376 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:04.972813  4113 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:04.961205  4046 rpcz_store.cc:276] 0709 13:18:03.899537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.062974 (+163437us) service_pool.cc:224] Handling call
0709 13:18:04.063348 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.063771 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:04.333643 (+269872us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.935574 (+601931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:04.936065 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 13:18:04.936219 (+   154us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:04.936251 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:04.936315 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:04.947670 (+ 11355us) raft_consensus.cc:1685] finished
0709 13:18:04.947694 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:04.947884 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":439124,"prepare.queue_time_us":94663,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":380760,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7869,"thread_start_us":431182,"threads_started":2,"wal-append.queue_time_us":239714}
I20260709 13:18:04.970824  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.979730  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.948545  9453 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:04.944973  9221 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:04.975350  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:05.007766  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48643.9us
I20260709 13:18:05.008020  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:05.008620  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.009622  4038 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:04.978104  9237 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:04.968367  9212 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:04.935477  9331 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:04.935369  9452 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.020376  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.021041  4038 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:04.980861  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:04.937844  9300 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:18:04.981515  9453 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:04.960745  9403 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:18:04.962595  9440 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.998530  9295 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:04.999174  9376 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:04.981438  9200 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.001060  9395 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:04.978541  9266 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:18:05.004837  9324 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:05.005100  9258 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:04.981680  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:04.979820  9366 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:05.012874  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.022878  4042 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:04.974201  9362 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:05.021329  9317 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:05.030166  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.026726  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.011638  9237 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.019433  9393 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:05.013691  9212 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:05.070204  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 88592.4us
I20260709 13:18:05.025799  9309 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 13:18:05.082803  9435 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.021001  9419 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:18:05.034989  4679 raft_consensus.cc:1813] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Handling vote request from an unknown peer 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.019626  9367 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:05.084007  9469 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:04.981598  9185 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:18:05.023013  9370 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:18:05.037408  9395 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.023169  9404 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:18:05.093318  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:05.127403  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:05.010867  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.032791  9250 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.139954  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.102824  3972 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:05.097683  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 78166.9us
I20260709 13:18:05.092132  9237 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.087713  9362 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:05.106848  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.089370  4038 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:05.038399  9200 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.094982  9212 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.038601  9295 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:05.131306  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 120526us
I20260709 13:18:05.135754  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.137126  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.158499  4047 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:05.158007  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.136498  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.139359  4043 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.103404  9435 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.140542  9395 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.150552  4042 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:05.167258  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.158133  4039 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:05.157961  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.165675  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.126046  9030 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.169229  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.170855  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.171476  4039 raft_consensus.cc:2376] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16. Re-sending same reply.
I20260709 13:18:05.143059  9164 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.143496  9452 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.175657  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.148986  9362 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.180984  4041 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.149191  9098 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.190802  3967 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:05.099056  9331 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.183982  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.165548  9435 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.162606  4679 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:18:05.092018  9453 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.188735  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.199246  4042 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:18:05.156935  9221 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.198072  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.200095  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.200559  4040 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:05.201419  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:05.202013  4042 raft_consensus.cc:606] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.202389  4042 raft_consensus.cc:614] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:05.203706  9185 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:18:05.204233  9185 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.205243  8855 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.205176  9185 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.207183  9367 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.208083  9367 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.212711  9185 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.149475  9475 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:18:05.182483  9266 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:05.220889  3963 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.223675  4041 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:05.224619  9476 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:18:05.226378  9164 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.230739  9164 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.225545  9370 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:18:05.234385  9475 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:05.234769  9475 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.235669  9475 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:05.236804  9468 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:18:05.236941  9309 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:05.237432  9309 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.238261  9309 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.239625  9309 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.197027  9098 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.240877  9030 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.243153  9098 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.217417  9419 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:05.244127  9419 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.238781  4044 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.250483  4044 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:18:05.251372  4044 pending_rounds.cc:85] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:18:05.251775  4044 pending_rounds.cc:107] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:18:05.252250  4044 raft_consensus.cc:2889] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:05.229087  9444 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56100 (request call id 3) took 5305 ms. Trace:
I20260709 13:18:05.228919  9329 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.276082  9449 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:05.276515  9449 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:05.245524  9419 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.277362  9449 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.277839  9098 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:05.278198  9476 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:05.244154  9200 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.278614  9476 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.279227  9419 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.279574  9476 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.280722  9476 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.281998  9164 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:05.282641  3969 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:05.219445  9477 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.219650  9474 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.289732  4042 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:18:05.277670  9329 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.250286  9331 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:05.324549  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 170496us
I20260709 13:18:05.313822  9366 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.314451  9393 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.225095  9470 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.278581  9449 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:05.339882  9221 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.315208  9474 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.284937  9440 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.326550  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:05.341231  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.255851  9446 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:05.368942  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 184263us
W20260709 13:18:05.372488  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46039.8us
I20260709 13:18:05.378485  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.278366  9098 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:05.426673  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48261.3us
I20260709 13:18:05.430786  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.431859  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.426148  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.433056  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:05.436827  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.437038  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.439719  9258 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:05.275983  9444 rpcz_store.cc:276] 0709 13:17:59.919930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:59.920074 (+   144us) service_pool.cc:224] Handling call
0709 13:18:01.089617 (+1169543us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b580082a0d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763a80aa 00007fed7642a447 00007fed7644770a 00007fed7644876a 00007fed7644791b 00007fed7645303c 00007fed764526b3 00007fed7644a9fa 00007fed7b4124c9 00007fed7498ec54
0709 13:18:01.332824 (+243207us) log.cc:844] Serialized 501 byte log entry
0709 13:18:02.186631 (+853807us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b54006809a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c5142 00007fed763a5eaa 00007fed763acd53 00007fed763accd9 00007fed763acc69 00007fed763acc31 00007fed763abdfd 000000000038f354 000000000038f199 00007fed7335f475
0709 13:18:05.224275 (+3037644us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10272,"raft.queue_time_us":14806,"raft.run_cpu_time_us":13638,"raft.run_wall_time_us":933433,"spinlock_wait_cycles":54338432,"thread_start_us":225299,"threads_started":1,"wal-append.queue_time_us":447276,"wal-append.run_cpu_time_us":1851,"wal-append.run_wall_time_us":1050411}
I20260709 13:18:05.317610  9477 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.450363  9474 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.470355  3971 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.460170  9185 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:05.471194  9185 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.471529  9185 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:05.470398  9474 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.475816  9477 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:05.477619  9451 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.727s	user 0.002s	sys 0.002s
I20260709 13:18:05.456705  9367 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:05.478468  9367 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.478807  9367 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.478929  9098 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:05.466243  9479 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:18:05.428953  9440 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:05.455590  9237 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.439441  9490 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:18:05.457290  9481 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:05.432755  9376 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:05.484125  9376 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.484841  9237 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.485037  9446 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.486213  9376 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.425694  9489 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:05.429183  9329 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.451361  9366 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.432502  9452 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.453204  9393 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.458642  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.459506  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:05.459802  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.368319  9406 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:05.487903  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.490795  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53888.2us
I20260709 13:18:05.499617  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:05.497696  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.497467  3966 raft_consensus.cc:2376] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15. Re-sending same reply.
I20260709 13:18:05.501637  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:05.502496  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.502843  3857 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b68b34d0f4bd480da49284d88135af8b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:18:05.501613  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.505653  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.494517  9481 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:05.515038  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.515570  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:05.518054  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.487584  9212 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.522682  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:05.510208  9489 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.524562  9435 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.525226  8855 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:05.511077  9266 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:05.528170  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.533659  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.535780  4114 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:05.537601  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.538432  4114 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:18:05.539450  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.543309  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:05.546276  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.517648  9436 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:05.554203  4114 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:05.567090  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:05.567718  4113 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.568982  4114 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:05.570009  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.571954  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.573393  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.522989  9483 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:05.530347  9452 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.660915  9452 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:05.661381  9452 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.665020  9436 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:05.665611  9436 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.667222  9453 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.667652  9436 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.567945  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:05.669139  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101278us
I20260709 13:18:05.669996  9250 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.670388  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:05.671358  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.575332  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.671499  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.671878  4042 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:05.627947  9484 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.417s	user 0.000s	sys 0.002s
I20260709 13:18:05.674754  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.676028  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.677703  9475 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.688328  9449 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.689118  9449 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.692195  9449 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.691277  9473 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.694504  9473 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.695279  9473 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.695914  9452 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.698011  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:05.698697  4676 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 10.
I20260709 13:18:05.699167  9458 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:05.699579  9458 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:05.702337  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:05.702967  4679 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.704687  9469 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:05.705134  9469 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.691321  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:05.706205  9404 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:05.699708  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:05.706733  9404 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:05.553237  9237 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:05.707113  9404 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.577240  9435 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.554821  9098 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:05.708164  9098 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.708563  9098 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.648350  9362 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.709045  4675 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:05.711009  9362 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.711361  3938 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:05.558413  8855 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:18:05.713114  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:05.713708  4675 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
W20260709 13:18:05.609072  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.623411  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.556109  9477 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:05.714830  9477 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:05.714977  9473 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.715258  9477 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.719043  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:05.720577  9403 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:05.721101  9177 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.721243  9470 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:05.706182  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3256) took 1135 ms. Trace:
I20260709 13:18:05.721701  9470 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.721901  3969 rpcz_store.cc:276] 0709 13:18:04.570427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.702598 (+132171us) service_pool.cc:224] Handling call
0709 13:18:04.702891 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.283155 (+580264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.705951 (+422796us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540044cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:05.706126 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332868864}
I20260709 13:18:05.722539  9470 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.723517  9470 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.707506  9237 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.726104  9237 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:05.694648  9472 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.495s	user 0.000s	sys 0.005s
I20260709 13:18:05.600874  9266 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:05.525498  9489 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.721457  9403 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:05.730041  9403 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.632544  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:05.566982  9384 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:18:05.726368  9177 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.731739  9237 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:05.634203  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.567018  9370 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:05.597803  9295 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:05.576933  9483 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.734619  9483 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:05.631004  9455 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.787s	user 0.000s	sys 0.003s
W20260709 13:18:05.577708  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.636678  9446 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:05.637076  4120 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:18:05.740393  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:05.638396  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:05.741566  3967 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.742285  4679 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:05.743564  3938 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:05.744462  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:05.745097  9362 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:05.745844  9362 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:05.746740  9362 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.746889  9098 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.639952  4115 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:05.605104  9406 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.642591  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:05.642916  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.754896  4117 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 6.
W20260709 13:18:05.630046  9471 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.464s	user 0.001s	sys 0.000s
I20260709 13:18:05.644393  9476 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.756699  9476 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.758857  9476 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.644820  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.617908  9395 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.761426  9395 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.611784  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.651932  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.762754  4116 raft_consensus.cc:1813] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.763314  4116 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:18:05.654467  9300 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:05.763671  9098 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.764310  9300 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:05.764693  9300 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:05.765561  9300 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.766693  9300 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.654809  9490 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:05.769055  9490 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.771252  9490 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.655937  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3267) took 1081 ms. Trace:
I20260709 13:18:05.656211  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.656750  9419 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:05.772979  3972 rpcz_store.cc:276] 0709 13:18:04.574119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.739284 (+165165us) service_pool.cc:224] Handling call
0709 13:18:05.102660 (+363376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.140811 (+ 38151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:05.655720 (+514909us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54001c9b50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:05.655871 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835010944}
I20260709 13:18:05.639331  9474 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:05.774379  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:05.775058  3972 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:05.775935  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:05.776468  3972 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:05.660137  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:05.777381  9266 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:05.670501  9250 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:05.777817  9266 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:05.778484  9435 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:05.778611  9250 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.705910  9469 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.707602  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:05.713822  8855 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:05.781426  4680 raft_consensus.cc:2368] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13.
I20260709 13:18:05.781715  8855 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.782141  8855 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:05.782850  4013 leader_election.cc:400] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13.
I20260709 13:18:05.783164  4013 leader_election.cc:403] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:05.783782  9483 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.599874  9185 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.774730  9474 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.786676  9185 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.601256  9341 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:05.788632  9341 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:05.789069  9341 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.780946  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.789623  9367 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:05.790211  9435 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:05.777051  3963 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:05.708268  4087 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:05.731200  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:05.732038  9177 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:05.605831  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.774307  3967 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:18:05.800480  9185 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.800940  9185 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:05.801299  9185 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.781328  9469 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:05.730849  9403 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.635025  9212 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:05.750715  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.806152  4038 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:05.751029  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:05.751444  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:05.631127  4113 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:05.808434  4118 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:05.788226  9474 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:05.796418  9367 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:05.814155  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 208399us
I20260709 13:18:05.747356  9458 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:05.854269  4120 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:05.815212  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.816828  4042 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:05.858044  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:05.865104  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:05.871214  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 215058us
W20260709 13:18:05.872080  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 163891us
I20260709 13:18:05.874148  4120 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:05.872545  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:05.877676  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:05.871618  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 93889.7us
I20260709 13:18:05.901779  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.901782  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.910367  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.902882  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.911713  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:05.925019  4038 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:05.903119  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:05.853132  9403 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:05.926280  3972 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:18:05.932255  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59778.8us
I20260709 13:18:05.931344  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.933899  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:05.936167  9258 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:05.936705  9419 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:18:05.937115  9419 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:05.937480  9419 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:05.856339  9295 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13.
I20260709 13:18:05.933069  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:05.936208  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:05.948417  3967 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:05.950714  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:05.951516  4118 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:05.865967  9384 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:05.865974  9395 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:05.866326  9237 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:05.864817  9212 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:05.927402  9475 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:05.915068  9309 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:05.929659  9458 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:05.955317  4118 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:05.915514  9200 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:05.958544  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:05.874606  9480 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:18:05.856485  9329 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:05.971000  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 69300.9us
I20260709 13:18:05.942418  9476 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:05.986480  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:05.987429  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:05.977033  9367 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:05.996289  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.926819  9221 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:05.988262  9309 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:05.914920  9331 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:18:05.978860  3967 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:18:06.014663  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:05.990569  4115 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 13:18:06.018319  3971 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.067s	sys 0.139s
I20260709 13:18:05.965099  9237 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:06.025733  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:06.032397  3971 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.067s	sys 0.140s
I20260709 13:18:06.033170  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:05.915392  9017 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:18:06.035115  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:06.037922  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:06.039028  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:06.046842  4038 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:05.968847  9477 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:06.056116  3968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.020s
W20260709 13:18:06.060015  3968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.008s	sys 0.020s
I20260709 13:18:06.020741  9367 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:05.962908  9384 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:06.074846  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.036491  9395 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:06.028820  9329 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:06.047111  9212 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:06.055008  9435 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:06.037467  9309 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.046921  9476 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:06.037793  9200 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:18:06.076905  9367 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:06.123080  9393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.026s
I20260709 13:18:06.138938  9483 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.137542  9435 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:06.141067  9452 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.149492  3867 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.183178  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:06.168876  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:06.154701  9200 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:06.127429  9237 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:06.195500  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 277878us
W20260709 13:18:06.155797  9393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.004s	sys 0.026s
I20260709 13:18:06.157652  9017 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:06.162153  9480 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:06.187287  9366 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.197016  9324 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.006s	sys 0.021s
W20260709 13:18:06.217537  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48765.8us
W20260709 13:18:06.219323  9453 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
W20260709 13:18:06.246104  9495 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:18:06.247783  3870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 233) took 32497 ms (client timeout 15000 ms). Trace:
I20260709 13:18:06.249152  3867 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 13 to 15, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 15 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.251505  3867 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 10 to 16, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.224016  9237 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:06.261354  9498 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:18:06.261725  3867 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 7 to 15, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 15 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:06.265246  9341 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.257745  9295 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.265923  9475 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:06.223126  9017 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:06.221794  9452 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:06.233836  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.237480  9384 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.239264  9177 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:06.269134  9017 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.270628  9177 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.228394  9480 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:06.274377  9341 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:06.248214  3870 rpcz_store.cc:269] 0709 13:17:33.750482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:33.750657 (+   175us) service_pool.cc:224] Handling call
0709 13:17:34.469456 (+718799us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:18:06.247678 (+31778222us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:02.063602 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:02.191298 (+127696us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:02.210964 (+ 19666us) write_op.cc:435] Acquired schema lock
0709 13:18:02.225138 (+ 14174us) tablet.cc:662] Decoding operations
0709 13:18:02.553375 (+328237us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:02.572614 (+ 19239us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:02.572642 (+    28us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:02.573440 (+   798us) tablet.cc:701] Row locks acquired
0709 13:18:02.573455 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:02.573636 (+   181us) write_op.cc:270] Start()
0709 13:18:02.573754 (+   118us) write_op.cc:276] Timestamp: P: 1783603082573562 usec, L: 0
0709 13:18:02.573770 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:18:02.574470 (+   700us) log.cc:844] Serialized 3258 byte log entry
0709 13:18:03.389295 (+814825us) op_driver.cc:464] REPLICATION: finished
0709 13:18:03.717903 (+328608us) write_op.cc:301] APPLY: starting
0709 13:18:03.729808 (+ 11905us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:03.735730 (+  5922us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:03.735822 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:04.157120 (+421298us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:04.209090 (+ 51970us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:18:04.223707 (+ 14617us) write_op.cc:312] APPLY: finished
0709 13:18:04.293242 (+ 69535us) log.cc:844] Serialized 81 byte log entry
0709 13:18:04.599364 (+306122us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed733420ac 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b
0709 13:18:04.778930 (+179566us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.813655 (+ 34725us) write_op.cc:454] Released schema lock
0709 13:18:04.815233 (+  1578us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:04.834724 (+ 19491us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:04.836338 (+  1614us) write_op.cc:454] Released schema lock
0709 13:18:05.630515 (+794177us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
Metrics: {"mutex_wait_us":31554,"reported_tablets":53,"spinlock_wait_cycles":5545344,"child_traces":[["op",{"apply.queue_time_us":305053,"apply.run_cpu_time_us":32203,"apply.run_wall_time_us":1117677,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37679,"num_ops":8,"prepare.queue_time_us":271089,"prepare.run_cpu_time_us":15663,"prepare.run_wall_time_us":864755,"raft.queue_time_us":474106,"raft.run_cpu_time_us":36454,"raft.run_wall_time_us":286042,"replication_time_us":802279,"spinlock_wait_cycles":71692800,"thread_start_us":1279113,"threads_started":5,"wal-append.queue_time_us":835187,"wal-append.run_cpu_time_us":23460,"wal-append.run_wall_time_us":1086651}]]}
I20260709 13:18:06.263657  3867 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 6 to 8, term changed from 7 to 9, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New cstate: current_term: 9 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:06.231647  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.242666  9331 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:06.267232  9185 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.268190  9452 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:06.266753  9295 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.241158  9496 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.242304  9490 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:06.219040  9200 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:06.252285  9266 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.283473  3867 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 9 to 15, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:06.280182  9331 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:06.229743  9324 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.006s	sys 0.021s
I20260709 13:18:06.290493  3867 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:18:06.320389  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.326728  9370 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.330035  9452 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.218549  9476 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:06.333611  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.335259  4680 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:06.327997  3867 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:06.260254  8855 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:06.303563  9404 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.008s
I20260709 13:18:06.284637  9098 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:06.376502  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.328923  9470 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.605s	user 0.011s	sys 0.001s
I20260709 13:18:06.280454  9366 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.287830  9490 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:06.380810  9404 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:06.381647  9370 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:06.382105  9370 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:06.382889  9404 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.383611  4120 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:06.385867  9098 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:06.387081  9329 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.337908  9258 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:06.387579  9329 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.388157  9258 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.389575  9329 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.390803  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:06.392611  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 434122us
I20260709 13:18:06.394507  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:06.395481  9370 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.396247  9404 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:06.401820  9404 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:06.401648  9309 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.402892  9404 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.406358  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:06.406966  4680 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:06.268021  9435 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:06.397935  9295 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.398664  3969 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:06.399700  8855 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.400533  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:06.415982  4038 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:18:06.409233  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 433266us
I20260709 13:18:06.424415  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.425256  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.426760  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.427250  4114 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.428396  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.428973  4118 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:06.429241  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.430502  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:06.431155  4121 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:06.432020  4038 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
W20260709 13:18:06.412637  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 425003us
I20260709 13:18:06.403797  9309 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:06.337360  9477 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.433527  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:06.456190  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:06.435566  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:06.437536  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:06.456498  4120 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:06.439131  4680 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:18:06.303851  9419 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:06.340484  9212 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.076s
I20260709 13:18:06.291179  9496 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.449056  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.467553  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:06.451951  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.468245  4680 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:06.452672  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.397797  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:06.457700  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:06.458318  3938 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:06.400622  9098 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:06.458333  3963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.024s	sys 0.035s
W20260709 13:18:06.493932  3963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.024s	sys 0.035s
I20260709 13:18:06.301625  9480 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.462664  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.460039  9395 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:06.464408  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.464939  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:06.465237  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:06.446568  4649 leader_election.cc:336] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.674s (SENT)
I20260709 13:18:06.523665  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:06.524632  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78117.8us
W20260709 13:18:06.525331  4649 leader_election.cc:336] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.755s (SENT)
I20260709 13:18:06.526407  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:06.466851  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 427864us
W20260709 13:18:06.472736  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.448251  9489 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.444932  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:06.483732  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:06.491202  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 93473.7us
I20260709 13:18:06.530421  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:06.423483  9329 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.529166  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:06.472394  9477 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:06.530779  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:06.548930  4121 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.416090  9331 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.542186  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:06.533962  4113 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
W20260709 13:18:06.809607  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.793476  3964 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.005s	sys 0.010s
W20260709 13:18:06.810541  3964 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.006s	sys 0.011s
W20260709 13:18:06.813210  4112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.019s	sys 0.010s
W20260709 13:18:06.813696  4112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.019s	sys 0.010s
W20260709 13:18:06.794265  3966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.008s	sys 0.011s
W20260709 13:18:06.814800  3966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.008s	sys 0.012s
W20260709 13:18:06.597576  3971 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.016s	sys 0.014s
W20260709 13:18:06.805830  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.817162  3971 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.016s	sys 0.014s
W20260709 13:18:06.818148  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:06.806838  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 264537us
I20260709 13:18:06.656196  4121 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:06.518926  4680 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:06.722458  9376 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:06.828960  9376 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:06.831259  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.553308  4679 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
W20260709 13:18:06.832453  9017 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.018s	sys 0.014s
I20260709 13:18:06.490864  9030 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:06.702963  9177 raft_consensus.cc:2764] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:06.416726  9200 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.493055  9295 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.833632  9376 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.702193  9212 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:06.525533  9384 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:06.749711  9419 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.706617  9403 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:18:06.561596  9477 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:06.613588  9474 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.018s
I20260709 13:18:06.721717  9393 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:06.491307  9470 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:06.750941  9517 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.825215  4116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.006s	sys 0.021s
I20260709 13:18:06.473483  9490 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:06.693051  9488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.041s
W20260709 13:18:06.546782  9458 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 13:18:06.528072  9098 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:06.535878  9453 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:06.564270  9492 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.662652  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.748987  9525 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:06.724694  9509 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.219s	user 0.000s	sys 0.000s
I20260709 13:18:06.615509  9185 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:06.724118  9504 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:18:06.981595  9331 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:06.984457  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.986207  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:06.832933  9017 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.018s	sys 0.014s
I20260709 13:18:06.725620  9520 raft_consensus.cc:2764] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:18:06.707409  9513 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.004166  9513 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.005255  8855 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.005896  8855 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.006703  9513 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.545903  9489 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.008239  8855 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:06.754458  9505 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:18:07.008435  4118 consensus_meta.cc:287] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.010s
W20260709 13:18:06.758075  9507 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:18:07.011476  9540 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.012560  9540 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.014122  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3377) took 3117 ms. Trace:
I20260709 13:18:06.761116  9496 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.015285  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2976) took 1142 ms. Trace:
I20260709 13:18:06.747505  9521 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:18:06.762915  9469 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.960s	user 0.011s	sys 0.000s
W20260709 13:18:06.554107  9300 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.787s	user 0.014s	sys 0.000s
I20260709 13:18:06.554266  9395 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:18:06.844056  4116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.006s	sys 0.021s
W20260709 13:18:06.675110  9221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.005s	sys 0.026s
I20260709 13:18:07.015954  9496 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:07.018855  9221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.006s	sys 0.026s
W20260709 13:18:07.018162  9536 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:18:06.837447  9212 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.015745  4112 rpcz_store.cc:276] 0709 13:18:05.872848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.873442 (+   594us) service_pool.cc:224] Handling call
0709 13:18:05.941136 (+ 67694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.941517 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.941545 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.942064 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.814345 (+872281us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:06.814428 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.814553 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.013215 (+198662us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:07.014917 (+  1702us) raft_consensus.cc:1685] finished
0709 13:18:07.014942 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.015165 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1084,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5440,"spinlock_wait_cycles":85537664,"thread_start_us":871650,"threads_started":1,"wal-append.queue_time_us":1032320}
I20260709 13:18:07.011370  4118 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:06.839448  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:06.846223  9488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.000s	sys 0.041s
I20260709 13:18:07.019176  9496 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:06.840421  9474 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.006s	sys 0.018s
I20260709 13:18:07.023519  9212 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:06.843366  9517 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.842073  9477 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.025164  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.026602  9517 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:07.026495  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:06.708351  9266 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:06.847965  9098 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.840411  9436 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:06.842305  9393 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:06.835037  9295 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.554612  9329 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.744246  9366 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:06.833915  9030 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:06.838088  9384 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:06.856717  9492 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:06.955283  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:06.955705  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:06.957000  9403 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.958475  3867 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.007s	sys 0.020s
W20260709 13:18:06.959843  9324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.032s
W20260709 13:18:06.960163  9473 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.025s	sys 0.049s
I20260709 13:18:06.967700  9525 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:06.968277  9362 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:06.968950  9516 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:06.969727  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 439213us
W20260709 13:18:06.970834  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 513055us
I20260709 13:18:06.970949  9370 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:06.972352  9490 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:06.978317  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3301) took 1284 ms. Trace:
W20260709 13:18:06.979091  9531 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.213s	user 0.005s	sys 0.000s
I20260709 13:18:06.994473  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3281) took 2348 ms. Trace:
I20260709 13:18:07.018214  9395 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:06.841486  9470 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.009436  9489 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:06.847136  9458 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.032027  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:07.008168  4114 consensus_meta.cc:287] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.580s	user 0.014s	sys 0.006s
I20260709 13:18:07.014568  4045 rpcz_store.cc:276] 0709 13:18:03.896273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.901252 (+  4979us) service_pool.cc:224] Handling call
0709 13:18:03.923462 (+ 22210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:03.951863 (+ 28401us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:03.962891 (+ 11028us) log.cc:844] Serialized 14 byte log entry
0709 13:18:04.743096 (+780205us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b180045d9c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:04.928913 (+185817us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.682047 (+753134us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b2c000a5238. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:05.682420 (+   373us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.149630 (+467210us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:06.149675 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.149751 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.013567 (+863816us) raft_consensus.cc:1685] finished
0709 13:18:07.013614 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.013909 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":908819,"prepare.queue_time_us":13033,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1918,"raft.queue_time_us":728276,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":11324,"spinlock_wait_cycles":15573248,"thread_start_us":742661,"threads_started":2,"wal-append.queue_time_us":1288179,"wal-append.run_cpu_time_us":2060,"wal-append.run_wall_time_us":1050667}
I20260709 13:18:07.058714  9295 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.059556  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.085661  4676 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:18:07.065752  3867 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.008s	sys 0.020s
I20260709 13:18:07.080574  9470 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.088150  9329 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.060165  9030 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.040807  9212 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.089512  9212 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.090332  9300 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:07.060931  9341 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.090943  9300 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:07.079578  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:07.092036  9341 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:07.053457  9393 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.093619  9212 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.028329  9540 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:07.080003  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 240844us
I20260709 13:18:07.095069  9395 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.095602  9341 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.079694  9436 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.069916  3963 rpcz_store.cc:276] 0709 13:18:05.694157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.793834 (+ 99677us) service_pool.cc:224] Handling call
0709 13:18:05.794070 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:05.794244 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:06.494325 (+700081us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.977418 (+483093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:06.977548 (+   130us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:06.977692 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.977818 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.978052 (+   234us) inbound_call.cc:177] Queueing success response
0709 13:18:07.010890 (+ 32838us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18003c6ca0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:07.021830 (+ 10940us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18003c6ca0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
Metrics: {"mutex_wait_us":1397,"prepare.queue_time_us":351521,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":22595,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":140,"spinlock_wait_cycles":40238720,"thread_start_us":1150134,"threads_started":2,"wal-append.queue_time_us":482040}
I20260709 13:18:07.080379  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:07.099231  4114 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:07.099746  9406 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:07.072433  9525 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.101032  9406 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:07.101437  9406 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:07.102695  9406 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.080741  9403 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.081700  9362 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:07.071553  9324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.012s	sys 0.033s
I20260709 13:18:07.085192  9478 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:18:07.072037  3964 rpcz_store.cc:276] 0709 13:18:04.646226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:04.759318 (+113092us) service_pool.cc:224] Handling call
0709 13:18:04.777294 (+ 17976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:04.823904 (+ 46610us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:05.678595 (+854691us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b18002d3340. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf
0709 13:18:05.678738 (+   143us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.178706 (+499968us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b18002d3340. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:18:06.811354 (+632648us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.811712 (+   358us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.812753 (+  1041us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.812947 (+   194us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:06.813031 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.813187 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:06.992271 (+179084us) raft_consensus.cc:1685] finished
0709 13:18:06.992292 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:06.994371 (+  2079us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43779,"prepare.queue_time_us":161746,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":190360,"raft.run_cpu_time_us":802,"raft.run_wall_time_us":17303,"spinlock_wait_cycles":29299712,"thread_start_us":1119573,"threads_started":3,"wal-append.queue_time_us":754153}
I20260709 13:18:07.105072  9540 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:07.083540  9458 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.106782  9030 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.061034  9098 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.107988  9030 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.108891  9362 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.109567  9458 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.110113  9030 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.089061  9516 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.111435  9403 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.082917  9384 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.100252  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:07.072677  9473 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.026s	sys 0.050s
I20260709 13:18:07.112538  9516 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.113013  9362 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.114324  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.114871  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.115093  4680 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.115504  4675 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
W20260709 13:18:07.107355  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 612277us
I20260709 13:18:07.117213  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:07.117522  9540 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.107208  9406 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.114724  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.120965  3963 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:07.121134  9362 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:07.120668  3964 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:07.121960  9492 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.118042  9540 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.107170  9496 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.119415  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:07.127215  9496 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.127769  9496 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:07.120841  4676 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.129031  9496 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.135854  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.136965  3963 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:07.139361  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.140448  3963 raft_consensus.cc:2410] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 15 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 6.
I20260709 13:18:07.141423  9540 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.142596  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.143232  3965 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:07.143787  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.145143  9540 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.092267  9300 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.150975  3968 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
W20260709 13:18:07.151629  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 581793us
I20260709 13:18:07.153894  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.157220  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:07.162428  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 83101.4us
I20260709 13:18:07.162669  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.173739  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3297) took 1667 ms. Trace:
W20260709 13:18:07.180073  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.234225  3965 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 13:18:07.237533  9490 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:07.241865  3970 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:18:07.244115  9436 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:07.245200  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 125939us
W20260709 13:18:07.246028  9534 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.244s	user 0.001s	sys 0.002s
W20260709 13:18:07.245911  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50676.8us
I20260709 13:18:07.110136  9098 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.254118  9490 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:07.256259  9367 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.110s	user 0.010s	sys 0.010s
I20260709 13:18:07.222450  9473 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:07.267542  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.263543  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:07.245705  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77437.6us
I20260709 13:18:07.267939  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.172051  9470 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:07.256731  9237 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.995s	user 0.008s	sys 0.008s
I20260709 13:18:07.263543  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.275944  3938 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:07.265830  9492 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.293859  3972 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:07.245811  9478 consensus_queue.cc:1243] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:18:07.312008  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.174165  3966 rpcz_store.cc:276] 0709 13:18:05.506799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.507589 (+   790us) service_pool.cc:224] Handling call
0709 13:18:05.507953 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.517690 (+  9737us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:05.878952 (+361262us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.816141 (+937189us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.962532 (+146391us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b180034bd00. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db
0709 13:18:06.964042 (+  1510us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:06.968153 (+  4111us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.970291 (+  2138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:06.974688 (+  4397us) log.cc:844] Serialized 26 byte log entry
0709 13:18:06.974917 (+   229us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:06.974962 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:06.975094 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.153405 (+178311us) raft_consensus.cc:1685] finished
0709 13:18:07.153426 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.173659 (+ 20233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12821,"prepare.queue_time_us":623197,"prepare.run_cpu_time_us":161,"prepare.run_wall_time_us":5624,"raft.queue_time_us":310264,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":23322,"spinlock_wait_cycles":375654016,"thread_start_us":1340080,"threads_started":3,"wal-append.queue_time_us":850112}
I20260709 13:18:07.293138  9470 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.293311  9473 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:07.319495  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 60060.8us
I20260709 13:18:07.293033  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.276939  9324 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.325315  9324 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.321107  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:07.330986  3967 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:07.333011  9541 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.333715  9541 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.335500  9543 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.336195  9543 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.338541  9543 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.341092  4117 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
W20260709 13:18:07.349696  9546 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 13:18:07.350193  9324 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.295460  9496 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.352960  9458 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.320956  9470 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.357401  9300 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:07.361182  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 90331.1us
I20260709 13:18:07.368271  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 2986) took 1405 ms. Trace:
I20260709 13:18:07.381268  9458 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.382557  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.383407  3968 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:07.383445  9551 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.383885  9458 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.384353  9551 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.385021  3972 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:07.385936  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:07.385958  3966 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:07.387385  3965 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:07.323822  9473 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.404155  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.372336  4679 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:07.387858  9098 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.371615  9496 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.409998  9324 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.387118  9490 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.378820  4116 rpcz_store.cc:276] 0709 13:18:05.962546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.962695 (+   149us) service_pool.cc:224] Handling call
0709 13:18:05.963024 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:05.967022 (+  3998us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:05.967056 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:05.967541 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:18:07.018259 (+1050718us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:07.018352 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.018435 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.367864 (+349429us) raft_consensus.cc:1685] finished
0709 13:18:07.367888 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.368186 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3587,"raft.queue_time_us":5114,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":21353,"thread_start_us":1050187,"threads_started":1,"wal-append.queue_time_us":1397355}
I20260709 13:18:07.416193  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.418701  3964 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.398203  9492 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.302551  9367 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.414204  9098 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:07.392238  9525 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.427625  9098 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.429235  9525 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:07.430423  9512 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:07.431348  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 133297us
I20260709 13:18:07.431090  9512 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.432951  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.433537  9512 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.434357  9525 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:07.436146  9525 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:07.436940  9200 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:07.437628  9200 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.441110  9200 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.445010  9544 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:07.445689  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.446465  3966 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.431159  4118 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:07.436265  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.450248  9367 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:07.454154  9300 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.454757  9300 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.444912  9393 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.457396  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:07.459290  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.461549  4113 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:18:07.461953  4113 pending_rounds.cc:85] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 9
I20260709 13:18:07.462200  4113 pending_rounds.cc:107] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:18:07.450562  4120 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.463012  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.463199  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.463622  4045 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:18:07.463937  4046 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:07.464102  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.464983  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.465531  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3295) took 2004 ms. Trace:
I20260709 13:18:07.465857  4042 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 21 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 13:18:07.445851  9366 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.468324  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.468611  9366 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.418542  9458 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.470263  9512 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.468909  9516 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.459374  9393 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:07.434459  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.471817  9516 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.472817  4112 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:07.471438  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.456789  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:07.465888  3971 rpcz_store.cc:276] 0709 13:18:05.461173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:05.471232 (+ 10059us) service_pool.cc:224] Handling call
0709 13:18:05.471591 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:06.032997 (+561406us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:06.817892 (+784895us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.979927 (+162035us) log.cc:844] Serialized 14 byte log entry
0709 13:18:06.980299 (+   372us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:07.042147 (+ 61848us) log.cc:844] Serialized 52 byte log entry
0709 13:18:07.046307 (+  4160us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:07.063456 (+ 17149us) log.cc:844] Serialized 14 byte log entry
0709 13:18:07.063673 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:07.073827 (+ 10154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:07.239048 (+165221us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18002d32e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:07.348901 (+109853us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:07.465282 (+116381us) raft_consensus.cc:1685] finished
0709 13:18:07.465312 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:07.465472 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15037,"prepare.queue_time_us":205818,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":2006,"raft.queue_time_us":39718,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":12186,"spinlock_wait_cycles":83163264,"thread_start_us":1438781,"threads_started":3,"wal-append.queue_time_us":180437}
I20260709 13:18:07.476078  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.476438  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.477078  4675 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:07.477488  9458 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.471180  9512 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.462491  4113 raft_consensus.cc:2889] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:07.450102  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.469920  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.479323  9300 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.479750  9492 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.481187  9366 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.482383  9516 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.482589  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.514881  3965 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:07.483569  3967 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
W20260709 13:18:07.484162  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47824.1us
I20260709 13:18:07.484689  9404 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:07.453671  9185 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.518375  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.450736  9324 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.518770  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:07.519040  4043 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:07.520277  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.497932  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.521580  3972 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:07.521865  9183 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:07.520532  9324 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.521971  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.522804  9317 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:07.523347  9317 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:07.518668  9185 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.500052  9541 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.501420  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.502472  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.502702  4120 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:07.503181  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.503365  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.542461  4112 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.505324  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 2992) took 1052 ms. Trace:
I20260709 13:18:07.488633  9295 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.510766  3964 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:07.471442  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.524717  9317 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:07.547930  9558 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:07.548921  9317 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.550072  4116 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:07.551258  4119 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:07.516863  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.516975  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.517429  9404 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.517777  9512 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.521075  4039 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:07.499203  3970 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:07.557751  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.526340  3966 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:07.440435  9470 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.516515  3971 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:07.510092  9458 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.543609  4117 rpcz_store.cc:276] 0709 13:18:06.452804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:06.462378 (+  9574us) service_pool.cc:224] Handling call
0709 13:18:07.505083 (+1042705us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b54002ea754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:07.505226 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1835995392}
I20260709 13:18:07.496064  9551 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.554438  4114 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:07.525223  4044 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 8.
I20260709 13:18:07.525748  9183 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:07.566708  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:07.572614  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.540688  9540 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.581426  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:07.581717  9520 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.584834  9551 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.585434  9551 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.587436  9551 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.588660  9183 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.591439  9183 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.581545  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.595609  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.594008  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.597011  4046 raft_consensus.cc:2368] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
I20260709 13:18:07.577126  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.595826  3938 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:07.587620  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:07.608130  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.611541  3966 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:07.613404  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.615012  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.618609  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.619247  3964 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:07.620534  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.621568  3968 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:07.625090  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.582185  9520 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.601249  9490 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:07.570147  9295 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.631791  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:07.637084  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.645759  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:07.651475  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.617856  9478 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.623209  9545 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:07.658231  3970 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:07.614576  9540 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.660498  4040 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:07.677141  4041 raft_consensus.cc:2368] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13.
W20260709 13:18:07.677234  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100132us
I20260709 13:18:07.670272  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.683423  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.654706  9551 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.687521  9478 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.684126  4045 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:07.687397  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.690208  3972 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.691391  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.691726  3965 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:07.687700  9551 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.660857  9545 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.695530  9540 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.695904  9545 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:07.696557  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.696096  9496 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.698904  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:07.701059  9525 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:07.702241  9367 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:07.702768  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.703534  4120 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.703941  9393 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:18:07.704854  9544 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.705277  9544 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:07.705673  9544 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.706947  9520 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.707067  9478 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:07.707664  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.712038  4119 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:07.713047  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:07.713491  4114 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:07.713696  3967 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:07.695829  9551 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.715809  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.705874  9527 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:07.716949  9527 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:07.717588  3970 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:07.718335  9185 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.717939  9527 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.718955  3970 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:07.719673  9527 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.720932  9200 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:07.721802  9200 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.722121  9200 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:07.722457  9200 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.728091  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.729591  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.728727  4675 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:07.733857  4120 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:07.738410  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.696497  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:07.740427  4677 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.742233  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:07.742980  3969 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:07.744369  9098 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.745515  3970 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:07.746268  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.746472  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.747072  3970 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:07.748126  3970 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:07.748489  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:07.748947  9543 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:07.750618  9404 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:07.751363  9543 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:07.751768  9543 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.752099  9543 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.727666  9470 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.757293  9362 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:07.757890  9362 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.758546  3965 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:07.759924  9362 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.744397  3969 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:18:07.680783  9324 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:07.739049  4043 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:07.767901  3967 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:07.746505  9098 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.731660  9541 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:07.780814  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47219.4us
I20260709 13:18:07.695323  9490 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.794993  9473 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.795933  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.795060  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:07.796838  3968 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:07.797477  4038 raft_consensus.cc:2368] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 17. Current term is 18.
I20260709 13:18:07.797721  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.798882  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.799520  4120 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:07.800799  4677 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:07.797506  9473 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.801007  9185 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:07.803843  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:07.798789  9489 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:07.805337  9489 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.805702  9489 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:07.807608  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.809434  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.809903  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.810555  4117 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:07.811232  9185 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:07.811743  9185 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:07.811880  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.810688  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.780849  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:07.814875  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.819747  4114 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:07.817915  3972 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:07.813592  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.815176  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.816195  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.783560  3971 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:07.828204  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:07.835950  3964 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:07.836668  3970 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:07.841972  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.842700  4114 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:07.799474  3968 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 10.
I20260709 13:18:07.860146  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.781968  9516 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:07.861594  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:07.817658  9565 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:18:07.863574  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:07.867273  4677 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:07.867971  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.868675  4117 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:07.871004  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.780093  9324 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.833061  9404 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.891074  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:07.866947  4120 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:07.891770  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.892153  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.871754  3967 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:07.894101  4114 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:07.899019  4120 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:07.899601  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.903088  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.905848  3970 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:07.829254  4679 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:07.907449  9295 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.908214  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.865751  9237 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:18:07.909704  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.910341  4046 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:07.911257  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.911695  9324 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.911875  3968 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:07.812885  9541 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:07.913148  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:07.901566  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.903748  3971 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:07.915508  4119 raft_consensus.cc:2410] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:18:07.901940  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:07.828912  9458 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.890105  9366 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:07.917654  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:07.929157  3972 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:07.864629  9516 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:07.831768  9473 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:07.898375  9525 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:18:07.925376  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83495.3us
I20260709 13:18:07.925474  3938 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:07.925853  9098 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:07.930461  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.812706  9185 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:07.893600  9404 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.949787  3965 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:07.920536  9483 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:18:07.940938  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70026.3us
I20260709 13:18:07.894124  9367 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:07.928673  9366 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:07.954679  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:07.893931  9393 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:18:07.948863  9395 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:07.971334  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:07.974431  4677 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:07.956894  9404 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.957373  9483 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:07.981801  3970 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:07.980386  9483 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:07.960641  9098 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:07.971551  9317 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:07.965384  9366 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:07.996214  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:07.997961  4677 raft_consensus.cc:2368] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:18:07.990119  4043 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:18:07.994565  3967 pending_rounds.cc:85] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:18:07.978179  9436 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:18:07.996220  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:07.986032  3970 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:08.002256  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.002662  9541 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.005638  9458 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:07.992882  9490 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:07.999945  4114 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:07.999888  3967 pending_rounds.cc:107] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:18:08.076107  3967 raft_consensus.cc:2889] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:07.932976  9545 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.001000  4046 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:07.963349  9470 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:07.993135  9295 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:08.083840  9295 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:07.994086  9317 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.084848  9295 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.085682  9317 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.086870  9317 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:08.061204  9570 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:18:08.067078  9520 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:08.089249  9520 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.089632  9520 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.073448  9300 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:08.094725  9543 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.097640  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.097949  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.098492  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.099500  4044 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:08.099942  4039 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:08.100473  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.100831  4046 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:08.101248  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.101857  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.078713  3966 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 13: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:08.083169  9551 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.102694  9551 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.102035  4040 raft_consensus.cc:2410] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:08.104059  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.101687  9200 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.103140  9551 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.095181  9483 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.103065  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.104269  4041 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:08.105391  4046 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:08.076347  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:08.102568  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.109932  3970 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:08.111335  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.107887  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 358439us
I20260709 13:18:08.116977  4038 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:08.081249  4042 raft_consensus.cc:2955] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 4 to 8, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:08.078775  9490 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.131979  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.132390  4047 raft_consensus.cc:2368] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18.
I20260709 13:18:08.135000  4114 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.158712  4039 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:08.159397  4117 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:08.167109  9544 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.169080  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.169618  9545 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:08.169746  4121 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:08.175190  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.175838  4039 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.176630  4041 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:08.177139  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.177748  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.178089  9367 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:08.178465  9367 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.179385  9367 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.180145  9200 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.182863  4087 leader_election.cc:400] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:18:08.183498  4087 leader_election.cc:403] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.183802  4046 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:08.185182  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:08.183316  4039 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:08.186309  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.186528  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:08.187222  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.149796  9490 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.180392  9483 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:08.180346  9367 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.193136  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.194099  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:08.215423  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66384.5us
I20260709 13:18:08.189889  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.211205  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:08.256754  3970 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
W20260709 13:18:08.280879  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 69777.6us
I20260709 13:18:08.284484  4121 raft_consensus.cc:2368] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
W20260709 13:18:08.271113  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.159665  9540 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.196532  9525 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.292092  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.196451  9543 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:08.309275  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:08.311648  9551 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.188745  9404 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.316831  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.318006  9393 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:08.317755  9520 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.309162  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:08.320120  4679 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:08.258488  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:08.322909  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64523.2us
I20260709 13:18:08.298444  4114 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:08.288957  9496 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.190987  9490 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:08.326202  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:08.350574  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:08.351318  4677 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.352325  9496 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.354681  9496 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.335170  9492 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:08.355597  9492 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:08.356673  9492 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:08.357620  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.287540  9483 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:08.366958  9483 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:08.369163  9483 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.356567  9404 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:08.389063  9544 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:08.397145  9520 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.365527  9490 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:08.398207  9490 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.398550  9490 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.191701  9516 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.408154  9551 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.345007  9540 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:08.410584  9489 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.001s
I20260709 13:18:08.411070  9489 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.290568  9098 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.412271  4119 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:08.356781  9572 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.176s	user 0.003s	sys 0.003s
I20260709 13:18:08.418787  4043 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:18:08.426334  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 462534us
I20260709 13:18:08.410976  9540 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.459820  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:08.457376  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 486072us
W20260709 13:18:08.468523  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 122983us
I20260709 13:18:08.470832  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.472461  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.473042  4121 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.464174  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:08.475088  4011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.016s	sys 0.008s
W20260709 13:18:08.515678  4011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.016s	sys 0.008s
W20260709 13:18:08.516031  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 563899us
I20260709 13:18:08.516637  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.518504  4114 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:08.479103  4120 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:08.437791  9473 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:18:08.438737  9395 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:08.542361  4677 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:08.545207  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.546887  4116 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.547598  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:08.470430  9489 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:08.515128  9367 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:18:08.548578  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:08.551682  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 87584.8us
I20260709 13:18:08.547619  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.477550  9540 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.516805  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:08.552853  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:08.554111  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 84826.6us
W20260709 13:18:08.562458  9366 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:18:08.563102  9366 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.567672  9540 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.568976  4113 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:08.570253  9540 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.571307  4115 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:18:08.573299  9341 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:08.573720  9341 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:08.574551  9341 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.573567  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.575712  9341 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.583837  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.586675  4116 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:08.590072  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.544606  9496 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.600493  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.601092  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.601763  4116 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.598702  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:08.579228  4679 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:08.580428  9551 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:08.595202  9540 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:08.611603  4115 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
W20260709 13:18:08.613528  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.614334  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:08.614686  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 287581us
I20260709 13:18:08.599586  9436 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:08.607227  9300 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:08.624238  4112 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:08.625566  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.627404  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:08.614509  9295 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.024s	sys 0.038s
W20260709 13:18:08.631376  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 307495us
I20260709 13:18:08.605228  9489 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:18:08.615810  9540 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.603436  9490 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:08.639350  9295 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.024s	sys 0.038s
I20260709 13:18:08.647229  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.636564  4116 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:08.639068  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:08.650274  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:08.642130  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 125425us
I20260709 13:18:08.652839  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.656819  4038 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:08.644308  9540 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:08.643828  9478 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.668057  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:08.683806  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57585.9us
I20260709 13:18:08.684337  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.685106  4039 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:08.685632  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.685961  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.672891  9587 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:08.686896  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:08.683187  4042 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:08.688154  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.640136  9366 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:08.640929  9551 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.672358  9317 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.672879  9545 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.703186  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.643445  9496 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.673219  9583 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:08.672960  4112 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:08.703912  4042 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:08.673365  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.706403  4043 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:08.690677  4040 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:08.654431  9436 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:08.711162  4116 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:08.698031  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.683065  9525 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:18:08.708935  4086 leader_election.cc:400] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18.
I20260709 13:18:08.726233  4086 leader_election.cc:403] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.673395  9595 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:08.686597  4115 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:08.628523  9395 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.695803  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:08.728205  4045 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:08.731911  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:08.733238  9541 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:08.733727  9404 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18.
I20260709 13:18:08.734174  9527 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:08.734817  9525 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:08.736920  9496 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.673097  9549 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.132s
W20260709 13:18:08.740052  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87740.7us
I20260709 13:18:08.739602  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.750146  4116 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:18:08.700131  9544 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.690897  9473 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:08.742606  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46919.1us
I20260709 13:18:08.744575  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.748723  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.747767  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:08.743041  9541 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:08.667459  9367 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:18:08.757643  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.759871  4116 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:08.738149  9595 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.762598  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:08.756000  9592 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:18:08.707906  9478 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:18:08.777549  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:08.769146  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:08.750083  9525 consensus_queue.cc:1243] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 17.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:08.779474  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.779559  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.781215  4040 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:08.712148  9317 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.728574  9436 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.756426  9366 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:08.752345  9551 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.752539  9489 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:08.783037  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.789423  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.798846  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.798926  4116 raft_consensus.cc:2393] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 12: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:08.743640  9545 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.796437  4118 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:08.805862  4679 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:08.805476  9541 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.807222  4112 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:08.808303  9585 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:08.808707  9585 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:08.809213  9585 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:08.809726  9436 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:08.810407  9588 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:18:08.811393  9483 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:08.811882  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3333) took 1066 ms. Trace:
I20260709 13:18:08.807078  9185 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:18:08.813937  9586 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:08.814919  9185 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:08.766654  9591 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:08.813623  3964 rpcz_store.cc:276] 0709 13:18:07.745819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.916834 (+171015us) service_pool.cc:224] Handling call
0709 13:18:07.920878 (+  4044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:07.933436 (+ 12558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:07.933471 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:07.970586 (+ 37115us) log.cc:844] Serialized 26 byte log entry
0709 13:18:08.427126 (+456540us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:18:08.427166 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.427233 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:08.811490 (+384257us) raft_consensus.cc:1685] finished
0709 13:18:08.811513 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:08.811795 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7669,"raft.queue_time_us":10789,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":8589,"thread_start_us":419849,"threads_started":1,"wal-append.queue_time_us":620025}
I20260709 13:18:08.766386  9590 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:08.766083  9601 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:08.816437  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:08.817832  9544 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:08.788643  9366 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.818275  9544 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.819084  9366 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.819366  9544 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.820286  9366 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:08.779429  9492 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:08.774811  9527 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:08.821437  9404 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.821724  9527 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.775141  9520 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:18:08.822017  9404 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.822816  9185 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:08.822670  9527 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.824410  9527 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.815534  9483 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:08.823654  9185 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:08.801898  9367 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:08.779515  9583 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:08.766567  9584 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:18:08.802040  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:08.835860  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.770067  9595 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:08.837019  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.839954  4116 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.840809  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:08.841164  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72111.2us
I20260709 13:18:08.845152  4121 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:08.797796  9300 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:08.764489  9295 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:18:08.849112  4040 raft_consensus.cc:2410] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:08.861529  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:08.816164  9478 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:08.821269  9492 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:08.865523  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.837448  9483 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:08.815596  9591 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:08.846364  9367 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.878938  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.886704  4045 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:08.860996  9185 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.800521  9551 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.867329  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:08.907220  4121 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:08.862036  9520 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:08.861675  9583 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:08.869091  9593 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:18:08.857440  9473 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:08.950466  9599 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:18:08.868515  9584 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:08.955624  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:08.963886  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:08.967217  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 106229us
I20260709 13:18:08.888343  9300 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:08.959373  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:08.955595  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:08.960424  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:08.961373  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:08.915679  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:08.965000  4040 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:08.866164  9478 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:08.956651  4116 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:08.919795  9295 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:08.920730  9543 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:08.900988  9545 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:08.912878  9490 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:08.964250  9406 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.076102  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 120595us
I20260709 13:18:08.900918  9483 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:08.947721  9520 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.081969  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:08.970314  9489 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.089717  4649 leader_election.cc:400] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
I20260709 13:18:09.090106  4649 leader_election.cc:403] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:08.900151  9367 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.067149  9185 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.065222  9300 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:09.094261  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.086124  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 245398us
I20260709 13:18:09.093932  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:09.092430  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:09.127290  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.125238  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53319.5us
I20260709 13:18:09.128371  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:09.078480  9544 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:08.968099  9473 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.082477  9601 raft_consensus.cc:2764] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:18:09.137454  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47851.1us
I20260709 13:18:09.138314  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:09.143487  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:09.148834  4112 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:09.088692  9549 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.084110  9545 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.086895  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:09.126998  9489 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:09.136435  9370 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.153323  9544 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.167873  9370 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.169936  9544 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:09.170090  9370 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.170562  4679 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.176542  9520 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.177759  9520 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.178272  9300 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.162545  4676 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:18:09.162737  9583 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.091387  9608 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.183588  4679 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:09.157264  9609 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
I20260709 13:18:09.086814  9543 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.086879  9406 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.189803  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:09.185549  4045 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:09.083278  9607 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:18:09.158401  9317 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:09.193953  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:09.192159  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.165998  9478 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.199468  9585 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.201088  9544 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.201807  9551 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.155498  9591 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.165467  9545 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.190394  9601 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:09.214116  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:09.191349  9584 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.190281  9612 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:09.211360  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 82606.7us
W20260709 13:18:09.222203  9613 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:18:09.223155  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.223600  9489 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.226146  9543 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.227306  9545 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.158809  9549 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:09.229754  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 91523.2us
I20260709 13:18:09.256523  4675 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:09.234154  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.219962  9544 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:09.242466  9612 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:09.242642  9615 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:09.197466  9496 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:09.244952  9492 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.246533  9406 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.247329  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.262421  3967 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 12.
W20260709 13:18:09.262609  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.211045  9317 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:09.228371  9200 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:18:09.247726  9341 consensus_meta.cc:287] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.005s
W20260709 13:18:09.268904  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 140593us
I20260709 13:18:09.269734  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.273633  4679 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:09.285454  9610 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:09.220752  9551 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:18:09.265174  9370 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:09.306278  4679 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:09.259663  9612 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:09.272622  9478 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:09.271240  9543 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:09.266471  9545 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:09.314747  9341 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:09.296150  9370 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.217218  9473 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.319835  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:09.320389  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.418s	user 0.028s	sys 0.026s
W20260709 13:18:09.325197  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.423s	user 0.028s	sys 0.026s
I20260709 13:18:09.271752  9317 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:09.325489  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 1.43206e+06us
I20260709 13:18:09.327705  4045 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:09.328231  4047 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:18:09.327935  4039 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:18:09.328691  4039 pending_rounds.cc:85] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 7
I20260709 13:18:09.328603  4047 pending_rounds.cc:85] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 7
I20260709 13:18:09.328873  9618 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:09.329422  4039 pending_rounds.cc:107] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:18:09.329906  4039 raft_consensus.cc:2889] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.329486  4047 pending_rounds.cc:107] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:09.330385  4047 raft_consensus.cc:2889] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.324527  9367 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:09.331141  9540 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.633s	user 0.003s	sys 0.008s
I20260709 13:18:09.331542  9540 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.337190  9544 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.337191  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.337492  4038 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:09.318717  9543 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:09.343358  4120 raft_consensus.cc:2368] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
I20260709 13:18:09.328649  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:09.323264  9341 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.320624  9525 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.353124  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:09.345520  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75876.9us
I20260709 13:18:09.342428  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:09.347664  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 86386us
I20260709 13:18:09.355401  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.356616  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.326879  9295 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.358307  4649 leader_election.cc:400] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
I20260709 13:18:09.373981  4649 leader_election.cc:403] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:09.337057  9584 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.351775  9543 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:09.318467  9595 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.365518  9618 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:18:09.366274  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:09.372534  9587 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.657s	user 0.013s	sys 0.000s
I20260709 13:18:09.354600  9341 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:09.323158  9545 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.369272  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.331146  9367 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.393590  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.370864  4044 pending_rounds.cc:85] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 8
I20260709 13:18:09.394428  4044 pending_rounds.cc:107] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:18:09.348059  9393 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:09.361356  4047 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:09.419417  4047 pending_rounds.cc:85] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 11
I20260709 13:18:09.419656  4047 pending_rounds.cc:107] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:09.419873  4047 raft_consensus.cc:2889] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:09.364603  9527 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.002s
I20260709 13:18:09.423558  4047 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:09.425146  9636 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.426908  3967 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:09.367290  9496 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:09.385295  4120 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:09.387506  4679 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:09.389732  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.358392  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:09.394768  4044 raft_consensus.cc:2889] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.413893  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.357409  9525 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.417663  9370 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.397336  9490 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:09.409317  9624 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17.
I20260709 13:18:09.389057  9587 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:18:09.412006  9621 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:09.428696  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72161.4us
I20260709 13:18:09.425733  9636 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.451390  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.434844  4038 raft_consensus.cc:2410] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:09.436954  3970 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:09.439731  4039 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:09.440536  3969 raft_consensus.cc:2368] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:18:09.391989  9489 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:18:09.443650  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.443815  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:09.444319  3972 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:09.384027  9295 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.447449  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:09.466557  3965 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:18:09.467020  3968 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.413901  9585 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.464252  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.419232  9629 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:09.466168  3963 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:09.467555  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.466741  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:09.468194  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95745.9us
W20260709 13:18:09.462085  4649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.992s (SENT) [suppressed 12 similar messages]
I20260709 13:18:09.472231  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.471232  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:09.474366  3965 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:09.469290  9621 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:09.475385  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.475787  3970 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:09.478086  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.478713  3972 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:09.481233  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:09.486126  3970 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:09.487205  4120 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:09.488250  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:09.466251  9549 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.473592  9629 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.476831  9615 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:09.508873  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.509491  3972 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:18:09.510104  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45947.7us
I20260709 13:18:09.510766  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.506599  3963 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:18:09.508126  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.511559  3969 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:09.512473  4120 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 13:18:09.509014  9629 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:09.514216  9584 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:09.514649  9584 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.514636  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.515246  9584 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:09.516106  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.509220  9615 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:09.517204  9615 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.517396  9473 raft_consensus.cc:2764] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:18:09.517733  9489 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:09.518095  9473 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:09.518492  9473 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.518797  9473 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:09.519007  9631 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:09.519435  9489 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:09.520087  9628 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:09.521459  9608 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:09.521346  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:09.522292  4677 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:09.522454  9628 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:09.523680  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:09.524212  4042 raft_consensus.cc:2410] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:09.526001  9584 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.529804  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:09.532752  9584 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.533712  9295 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:09.535497  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.554350  4120 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:09.555436  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.517138  9317 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:09.570647  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 108588us
W20260709 13:18:09.572178  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.556968  9622 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:09.505468  9585 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:09.609221  9200 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:09.612123  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 124571us
W20260709 13:18:09.612588  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 215127us
I20260709 13:18:09.557864  9367 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.589458  4120 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:09.529031  9628 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:09.585038  9185 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:09.568161  9629 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:09.594312  9639 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:18:09.583451  9612 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.597872  9586 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:18:09.632644  9645 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:09.634025  9647 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:18:09.585536  9584 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:18:09.634677  9629 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.563149  9295 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:09.634865  9549 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:18:09.645417  9612 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.585314  9631 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:18:09.656265  9631 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:09.656608  9631 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:09.614356  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59019.4us
I20260709 13:18:09.657191  9615 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.619444  9317 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:09.619652  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:09.659382  4114 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:09.659700  9615 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:09.620126  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.661388  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.661996  4120 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.620965  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.621644  9638 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:09.663849  9638 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:09.664196  9638 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.664518  9638 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.622905  9636 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.623267  9621 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.658171  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.667111  4011 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:09.564143  3968 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:09.667902  4044 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:09.601099  9525 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.658208  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.635578  3964 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:09.676011  9366 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.677028  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3023) took 1207 ms. Trace:
I20260709 13:18:09.676265  4120 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:09.679296  4085 leader_election.cc:400] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
W20260709 13:18:09.680066  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47030.1us
I20260709 13:18:09.681083  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:09.677443  4117 rpcz_store.cc:276] 0709 13:18:08.469832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.469980 (+   148us) service_pool.cc:224] Handling call
0709 13:18:08.470297 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.470506 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:08.523109 (+ 52603us) log.cc:844] Serialized 14 byte log entry
0709 13:18:09.625307 (+1102198us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b180037af80. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:18:09.675740 (+ 50433us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.675791 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:09.675835 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.676853 (+  1018us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.676971 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":52400,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":100,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":39260544,"thread_start_us":50196,"threads_started":1,"wal-append.queue_time_us":1152607}
I20260709 13:18:09.683816  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.636312  9367 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:18:09.685745  9367 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:09.686079  9367 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:09.686465  9341 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.686870  9367 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.687672  4045 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:09.688114  9367 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:09.651063  9586 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.689459  9543 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.689946  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:09.648672  9616 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.481s	user 0.000s	sys 0.001s
I20260709 13:18:09.696245  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.697604  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:09.700589  9200 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.702385  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.702929  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:09.703079  4044 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:09.646049  9404 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.680353  9295 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:09.707129  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:09.680536  9584 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:09.649477  9545 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:09.709800  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.718315  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:09.692152  9543 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.721897  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.722651  4044 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:09.705588  9525 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.718391  9185 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:09.725857  9525 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.726326  9185 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:09.727012  9185 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:09.727445  9185 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.727957  9525 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.657397  9631 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.729635  9631 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:09.730808  9636 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:09.731218  9636 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:09.732069  9636 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.720439  9527 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:18:09.652064  9645 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.732971  9655 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:09.737344  9655 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.737807  9341 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.738467  9200 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.739040  9341 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:09.742000  9655 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:09.741696  9586 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.743141  9586 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:09.709128  9295 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.745040  9295 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:09.692862  9628 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:09.746693  4117 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:18:09.747421  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.719645  9583 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:09.718418  9544 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:09.720389  9585 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.753727  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.748232  9622 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.757905  9645 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:09.761917  9633 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260709 13:18:09.760654  9473 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.766927  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.770913  9366 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:09.774348  9638 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.775180  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.776042  3965 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:09.777153  3968 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:09.786860  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.788111  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.788841  3969 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:09.791023  9473 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.791718  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:09.796885  9635 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
W20260709 13:18:09.798061  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:09.784286  9636 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.804620  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.753371  9583 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.820304  9585 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.823784  3968 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:18:09.825947  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 117935us
I20260709 13:18:09.810580  9583 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:09.829555  9636 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:09.833802  3968 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:09.834118  3968 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:09.839075  9655 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.840169  9622 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.834664  3968 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.847023  3968 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:09.845220  9605 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.039s	user 0.000s	sys 0.036s
I20260709 13:18:09.845939  4046 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:18:09.854235  4046 pending_rounds.cc:85] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 7
I20260709 13:18:09.854475  4046 pending_rounds.cc:107] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:18:09.854688  4046 raft_consensus.cc:2889] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.851037  9655 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.866609  3968 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:18:09.866972  3968 pending_rounds.cc:85] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 9
I20260709 13:18:09.867151  3968 pending_rounds.cc:107] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:18:09.867340  3968 raft_consensus.cc:2889] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:09.831420  9185 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.853081  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:09.868500  3972 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:09.878418  9185 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.881459  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3334) took 2135 ms. Trace:
I20260709 13:18:09.885170  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.888959  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.889730  4042 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:09.890113  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.891702  4039 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:09.893072  4039 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:18:09.889015  3971 rpcz_store.cc:276] 0709 13:18:07.746115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:07.980842 (+234727us) service_pool.cc:224] Handling call
0709 13:18:07.993452 (+ 12610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:08.434277 (+440825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:08.434311 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:08.452243 (+ 17932us) log.cc:844] Serialized 26 byte log entry
0709 13:18:08.741187 (+288944us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:08.741227 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:08.741303 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:09.844890 (+1103587us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b24001358d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed731e59c4 00007fed731e3acb 00007fed7339edc9 00007fed7339ea55 00007fed7339e09d 00007fed75fd010e 00007fed75fe788c 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221
0709 13:18:09.881160 (+ 36270us) raft_consensus.cc:1685] finished
0709 13:18:09.881181 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:09.881398 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107773,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":23085,"spinlock_wait_cycles":66393344,"thread_start_us":578603,"threads_started":2,"wal-append.queue_time_us":331231}
I20260709 13:18:09.891633  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.901618  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.900203  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.900446  9631 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.905942  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:09.904914  9628 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:09.910331  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3028) took 1389 ms. Trace:
I20260709 13:18:09.915042  9658 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.915483  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.915607  9658 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.911263  4113 rpcz_store.cc:276] 0709 13:18:08.521088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.521192 (+   104us) service_pool.cc:224] Handling call
0709 13:18:08.543911 (+ 22719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:08.569394 (+ 25483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:09.910149 (+1340755us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b540034e254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:09.910284 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57166720}
I20260709 13:18:09.897321  9295 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.919982  9628 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.935005  9200 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:18:09.934624  4113 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:18:09.909289  9662 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:09.915089  9655 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:09.927716  9586 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:09.938792  9628 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:09.909183  9631 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.949222  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:09.950554  4042 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:09.942067  9655 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:09.961108  9655 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:09.961566  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:09.964906  9586 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.960510  9658 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:09.986032  9295 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.990176  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.991338  9631 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:09.991492  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.956313  9662 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:09.992584  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:09.993860  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.993996  9662 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:09.994418  4038 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 13.
I20260709 13:18:09.995208  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.995832  4038 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:09.995751  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:09.996646  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:09.997030  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:09.997406  4038 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:09.989847  9586 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:09.998279  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:09.990293  9623 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:09.999210  9623 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:09.998869  4675 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:10.001008  4679 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:09.998530  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.006301  9662 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:10.007764  9545 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:10.009944  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.010701  3964 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:10.010928  3968 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:10.011492  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.012032  3964 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.012145  3968 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:10.012813  9607 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.013217  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.012843  4038 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 11: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:10.010180  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.009333  3971 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:10.009408  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.010474  9545 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.009227  4013 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:10.014853  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.015398  3972 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:09.997246  9638 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.021680  3969 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:10.016204  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:10.034340  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.021170  9612 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:18:10.021404  9237 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:10.014662  9601 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:10.036700  9367 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:10.043974  9367 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.044323  9367 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.045388  3971 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:10.047132  9545 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:10.049036  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.034437  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:10.050454  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.069895  3937 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14.
I20260709 13:18:10.070991  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.072136  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.075134  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.077047  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.000036  9623 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.080066  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.020078  9540 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.082361  4113 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 8. Current term is 9. Ops: []
I20260709 13:18:10.082861  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:10.048940  9543 raft_consensus.cc:2764] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:10.048794  9607 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:10.055634  9662 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:10.043586  9601 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.021323  9496 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:18:10.037623  9612 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:10.088083  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.088326  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.076732  9621 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.079191  9551 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:10.076589  9395 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.090873  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.079510  9636 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:10.091567  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.093323  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.093521  9662 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.038589  9237 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:10.081535  9370 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:10.094992  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.084219  9629 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.102268  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.088431  9623 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:10.103541  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.037690  9624 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:18:10.104867  3972 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:10.104677  3966 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.110132  9540 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:10.081681  9638 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:18:10.112196  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:10.099078  9612 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:10.096242  9601 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.118976  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.085593  9645 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:10.089753  9652 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.030488  3964 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:10.258715  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.259335  3964 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:10.124250  9662 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.091840  9436 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:10.125085  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:10.267045  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 142032us
I20260709 13:18:10.113617  9636 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.267333  9436 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.267616  9636 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:10.124787  9237 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:10.127979  9370 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:10.139106  9642 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.611s	user 0.004s	sys 0.000s
I20260709 13:18:10.150669  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.154072  9545 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:10.217029  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.249610  4038 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:10.262112  3964 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:18:10.262809  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.263475  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.153795  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.255254  9516 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:10.279953  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:10.276234  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.277732  4120 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:10.278658  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:10.272245  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 569) took 2083 ms (client timeout 1865 ms). Trace:
W20260709 13:18:10.281188  4118 rpcz_store.cc:269] 0709 13:18:08.188640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.193840 (+  5200us) service_pool.cc:224] Handling call
0709 13:18:10.272063 (+2078223us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b54003a7fd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:10.272179 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1196244736}
I20260709 13:18:10.289229  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.298061  3966 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:10.298779  9395 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.299233  9185 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:18:10.303989  9585 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:10.304414  9200 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:10.274437  9370 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:10.325379  9670 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 13:18:10.333503  9237 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.337879  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.352072  4038 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:18:10.272379  9540 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:10.358089  9540 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.360399  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3040) took 1036 ms. Trace:
I20260709 13:18:10.360812  4121 rpcz_store.cc:276] 0709 13:18:09.324282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.684715 (+360433us) service_pool.cc:224] Handling call
0709 13:18:09.693518 (+  8803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.736958 (+ 43440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.736990 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:09.737032 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:09.737061 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.360139 (+623078us) spinlock_profiling.cc:243] Waited 43.2 ms on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:10.360187 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:10.360339 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99459456}
I20260709 13:18:10.340476  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.362632  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.362783  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.363883  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.365063  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2718) took 1695 ms. Trace:
I20260709 13:18:10.365449  4115 rpcz_store.cc:276] 0709 13:18:08.670055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:08.798592 (+128537us) service_pool.cc:224] Handling call
0709 13:18:10.364852 (+1566260us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54003a89d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:10.364999 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105348992}
I20260709 13:18:10.363955  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.367640  4046 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:10.343238  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.301651  9645 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.368482  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.337193  9544 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:10.360417  9540 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:10.353044  9583 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260709 13:18:10.386184  4039 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:18:10.397300  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 108174us
I20260709 13:18:10.405684  4046 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:10.409822  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.409705  9658 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:10.411275  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:10.411938  9200 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:10.412365  9200 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:10.412506  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.412979  9185 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:10.413800  9185 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:10.411391  9658 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:10.414372  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.415398  9200 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.416782  9200 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.416637  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.420408  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.421233  9185 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:10.421958  9185 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:10.422946  9185 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:10.436935  4046 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:10.397672  9237 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.370100  9612 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.381701  9645 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.386844  9583 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.384064  9544 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.461593  9370 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.463124  9583 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.450309  9621 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:10.466305  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45979.1us
I20260709 13:18:10.473129  9621 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.473670  9621 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.475780  9621 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.464536  9662 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.478895  9662 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:10.480237  4044 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:10.480626  9655 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.482251  4039 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:10.479857  9367 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:10.477169  9680 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:18:10.482152  9544 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.488684  9655 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.461748  9645 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.492712  9367 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.463694  9370 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.498004  4040 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:10.498703  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3448) took 1158 ms. Trace:
I20260709 13:18:10.498996  4040 rpcz_store.cc:276] 0709 13:18:09.340708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.340898 (+   190us) service_pool.cc:224] Handling call
0709 13:18:10.497602 (+1156704us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:10.497830 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.498425 (+   595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.498612 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2504064}
I20260709 13:18:10.499652  9623 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:10.500630  9623 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.500727  9662 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:10.499805  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:10.502055  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:10.503376  4038 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:10.503947  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:10.500902  9492 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:18:10.517238  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.517879  4040 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:10.518841  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.519805  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:10.520268  4040 raft_consensus.cc:1813] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:10.510521  9652 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:10.522351  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:10.523178  9652 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:10.523545  9652 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:10.524060  9652 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.525688  9595 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.520696  4040 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:10.509219  9540 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:10.533267  9540 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:10.533658  9540 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:10.513520  9492 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:10.538568  9492 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.539746  9492 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:10.541628  9636 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.501324  9662 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:10.508015  9621 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:10.545838  9618 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.546886  9636 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.547657  9237 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.551059  9612 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.552943  9370 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.507742  9601 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.553966  4044 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:10.555760  4046 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:18:10.561703  4046 pending_rounds.cc:85] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:18:10.561930  4046 pending_rounds.cc:107] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:18:10.562077  4046 raft_consensus.cc:2889] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:10.558314  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.501161  9623 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.554601  9630 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:10.554382  9490 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:10.553804  9621 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:10.560988  9370 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.561118  9237 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.573047  9601 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.560863  9624 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:18:10.573844  9237 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:10.575663  3967 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:10.578140  9393 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:10.578547  9393 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:10.579071  4044 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:10.573750  9370 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:10.579442  9393 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.569861  9630 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:10.567375  9473 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:10.568917  9621 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:10.557694  9618 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.580678  9393 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:10.563490  9543 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:18:10.653473  9543 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:10.653852  9543 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:10.654443  9673 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.505s	user 0.003s	sys 0.000s
I20260709 13:18:10.654726  9543 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.629360  9630 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.643756  3965 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:10.657612  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.657753  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.643971  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.658524  3970 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:10.645452  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.569290  9490 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.625030  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.660218  3967 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:18:10.659291  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.659729  3968 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:10.661187  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.661409  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:10.664336  4677 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:18:10.669448  3971 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:10.670732  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 415) took 1133 ms. Trace:
I20260709 13:18:10.671109  4679 rpcz_store.cc:276] 0709 13:18:09.530087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.530348 (+   261us) service_pool.cc:224] Handling call
0709 13:18:09.568455 (+ 38107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.001423 (+432968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.663632 (+662209us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b5400600ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:10.663825 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":994313472}
I20260709 13:18:10.657188  9543 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:10.675709  9692 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:18:10.589596  9098 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:18:10.672147  9622 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:10.692970  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3466) took 1027 ms. Trace:
W20260709 13:18:10.697356  9684 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:18:10.699920  9490 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.650640  9473 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.704644  4042 rpcz_store.cc:276] 0709 13:18:09.665515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.890332 (+224817us) service_pool.cc:224] Handling call
0709 13:18:09.890631 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.951048 (+ 60417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.692685 (+741637us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b540041bc54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:10.692908 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137161088}
I20260709 13:18:10.711539  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.711822  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.712037  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.712791  4042 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:10.709064  3967 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:10.701844  9618 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:10.713996  3970 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:10.714040  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.714279  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:10.719884  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.722649  3968 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:10.723973  3968 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:18:10.724327  3968 pending_rounds.cc:85] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 10
I20260709 13:18:10.726804  3968 pending_rounds.cc:107] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:10.727171  3968 raft_consensus.cc:2889] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:10.729060  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.734133  9483 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:10.750219  9473 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.724908  9601 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:18:10.751032  9689 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:18:10.757383  3971 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:10.758517  3970 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 14. (term mismatch)
I20260709 13:18:10.769032  3970 pending_rounds.cc:85] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 13
I20260709 13:18:10.769302  3970 pending_rounds.cc:107] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 13.14
I20260709 13:18:10.769528  3970 raft_consensus.cc:2889] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:10.772332  3967 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:18:10.777616  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.778784  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.714886  9621 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.785728  9621 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:10.786715  9690 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:18:10.787842  9623 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.776216  9601 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:10.794906  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.795226  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.799813  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.795531  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:10.803375  3968 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:10.803879  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.807195  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:10.806814  4679 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:10.810540  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.810756  3938 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.815410  9601 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:10.796172  9489 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:18:10.801343  9237 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:18:10.815845  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3446) took 1485 ms. Trace:
I20260709 13:18:10.822237  4045 rpcz_store.cc:276] 0709 13:18:09.330168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.330294 (+   126us) service_pool.cc:224] Handling call
0709 13:18:09.353046 (+ 22752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:09.688066 (+335020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.815552 (+1127486us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54000b7554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:10.815749 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":769108864}
I20260709 13:18:10.801602  9490 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:10.805905  9393 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:10.806896  9367 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:10.830196  3966 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:10.834512  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:10.835284  3971 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:10.820616  9317 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:10.823673  9595 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:10.842931  3968 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
W20260709 13:18:10.866014  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 148644us
I20260709 13:18:10.869179  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:10.826036  9652 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.768148  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:10.885833  3967 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:10.886895  9652 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:10.857402  9370 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:18:10.889413  3965 raft_consensus.cc:2410] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:10.826541  9393 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:10.891607  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:10.895743  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.818661  9583 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:18:10.812011  9544 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:18:10.900967  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:10.911996  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:10.913756  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:10.859301  9317 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:10.903321  9393 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:10.868314  9540 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:10.923112  9489 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:10.911027  9545 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:10.939050  4045 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:10.919066  9317 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:10.961017  9490 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:10.936959  9489 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:10.967484  9707 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:10.937605  9618 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:18:10.985324  9545 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:10.989498  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 75832.7us
I20260709 13:18:11.004791  9704 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.005429  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.005709  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.006352  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.006613  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.007002  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.007663  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.004954  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.008077  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.008415  4114 raft_consensus.cc:2368] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:18:10.990270  4043 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:11.008875  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.009032  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.009179  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.009373  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.010371  4118 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.010548  9704 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.011190  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.010589  4119 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.012749  4119 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:11.007159  4117 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:18:11.014072  4117 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:11.014942  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.015590  4117 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.016258  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.020300  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.021066  4119 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 9: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.021787  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.022821  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.009792  4116 raft_consensus.cc:2393] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.022964  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.025058  9395 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:11.025398  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.025511  9621 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:11.026389  9621 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:11.026659  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.027354  9677 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:11.028043  4121 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.028316  3937 leader_election.cc:400] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:18:11.028714  3937 leader_election.cc:403] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:18:11.029377  9677 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 12. Current term is 13.
I20260709 13:18:11.025266  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.029548  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.030288  4116 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.031397  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.032253  9677 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:11.033126  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.033905  4116 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:11.035192  4116 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:11.012923  4118 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:11.047556  4118 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:11.030620  4121 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.037245  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:11.001667  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 157840us
I20260709 13:18:11.038766  4115 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
W20260709 13:18:11.050870  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.039515  4117 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.043298  4114 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:11.043028  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet 237eb348003645f7abcc1c18bd324690 with delete_type TABLET_DATA_TOMBSTONED (TS 0f3fa9d459de485e824f023c55580bc6 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:36870
I20260709 13:18:11.052220  4114 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:11.043134  9489 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.003221  9707 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:11.053097  9489 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:11.049203  9545 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.043491  4119 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:11.056089  9545 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.057070  3965 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:11.058765  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.059402  3966 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:11.061055  4116 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:18:11.061666  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.062959  3965 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 13:18:11.063457  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 224881us
I20260709 13:18:11.059291  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 97) took 7052 ms. Trace:
I20260709 13:18:11.073208  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.073479  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:11.073203  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.078130  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.080099  9370 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.080653  9370 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.082880  9370 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:11.083479  9370 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.083957  9370 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.086272  9708 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.086968  9708 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.089150  9544 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.089735  9544 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.106213  9708 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:11.092646  9544 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:11.110342  9370 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:11.110991  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46538us
I20260709 13:18:11.111883  4117 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:11.113252  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:11.113899  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3034) took 2148 ms. Trace:
I20260709 13:18:11.114271  4112 rpcz_store.cc:276] 0709 13:18:08.965125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.158104 (+192979us) service_pool.cc:224] Handling call
0709 13:18:09.159576 (+  1472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:09.182474 (+ 22898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:09.182504 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:10.433166 (+1250662us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b2c000875c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:10.439705 (+  6539us) log.cc:844] Serialized 26 byte log entry
0709 13:18:10.558165 (+118460us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:10.558201 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.113592 (+555391us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b54003a70d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:11.113649 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.113696 (+    47us) raft_consensus.cc:1685] finished
0709 13:18:11.113709 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.113841 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2627,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3106,"spinlock_wait_cycles":63347200,"thread_start_us":93362,"threads_started":1,"wal-append.queue_time_us":211133}
I20260709 13:18:11.116148  9636 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:11.116554  9636 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:11.117460  9636 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.118661  9636 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:11.114691  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:11.133800  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.122191  4118 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:11.059564  9707 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:11.148088  4679 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:18:11.148885  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70173us
I20260709 13:18:11.076143  9237 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.025681  9395 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.076464  9677 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:11.153321  4675 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:18:11.072384  9601 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.163390  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85334.7us
I20260709 13:18:11.153738  9716 tablet_replica.cc:333] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:18:11.123226  9621 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:11.165515  9621 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:11.068502  3867 rpcz_store.cc:276] 0709 13:18:03.936863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:03.937404 (+   541us) service_pool.cc:224] Handling call
0709 13:18:10.965804 (+7028400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:07.484509 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:07.485706 (+  1197us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:07.485770 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:18:07.485802 (+    32us) tablet.cc:662] Decoding operations
0709 13:18:07.487467 (+  1665us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:07.487564 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:07.487617 (+    53us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:07.488423 (+   806us) tablet.cc:701] Row locks acquired
0709 13:18:07.488486 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:18:07.512262 (+ 23776us) write_op.cc:270] Start()
0709 13:18:07.550033 (+ 37771us) write_op.cc:276] Timestamp: P: 1783603087508613 usec, L: 0
0709 13:18:07.550080 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:18:07.551169 (+  1089us) log.cc:844] Serialized 3277 byte log entry
0709 13:18:08.194953 (+643784us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:08.866375 (+671422us) op_driver.cc:464] REPLICATION: finished
0709 13:18:09.219195 (+352820us) write_op.cc:301] APPLY: starting
0709 13:18:09.242875 (+ 23680us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:09.248105 (+  5230us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:09.248150 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:09.418699 (+170549us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:09.419004 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:18:09.419076 (+    72us) write_op.cc:312] APPLY: finished
0709 13:18:09.420840 (+  1764us) log.cc:844] Serialized 81 byte log entry
0709 13:18:09.421060 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.421186 (+   126us) write_op.cc:454] Released schema lock
0709 13:18:09.421247 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:09.421703 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:09.421731 (+    28us) write_op.cc:454] Released schema lock
0709 13:18:09.983404 (+561673us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644932a 00007fed763cef14 00007fed763ceec3 00007fed763cee38 00007fed763cedf3 00007fed763ce0dc 00007fed763f7e16 00007fed763dfcbb 00007fed763ca39d 00007fed763cdd75
Metrics: {"mutex_wait_us":109061,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":294576,"apply.run_cpu_time_us":14225,"apply.run_wall_time_us":211120,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37679,"num_ops":8,"prepare.queue_time_us":1092300,"prepare.run_cpu_time_us":39067,"prepare.run_wall_time_us":407525,"raft.queue_time_us":360571,"raft.run_cpu_time_us":97108,"raft.run_wall_time_us":1203152,"replication_time_us":1287947,"spinlock_wait_cycles":67169536,"thread_start_us":1470385,"threads_started":4,"wal-append.queue_time_us":411863,"wal-append.run_cpu_time_us":51619,"wal-append.run_wall_time_us":2534128}]]}
I20260709 13:18:11.166379  9716 raft_consensus.cc:2243] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:11.164100  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.171232  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.171171  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:11.153422  9595 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:11.175810  4680 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
I20260709 13:18:11.077467  9545 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 13:18:11.151309  9705 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:11.157474  9540 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.184355  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:11.185088  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:11.173475  9716 raft_consensus.cc:2272] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:11.193544  4680 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:11.198442  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:11.158597  9393 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.153766  9237 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.175414  9704 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.170047  9601 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.196166  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:11.199801  9640 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:11.205279  9723 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:11.218152  9395 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:11.218930  9715 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:18:11.220073  9489 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:11.221060  4679 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:11.223126  9237 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:11.216321  9640 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:11.236205  9722 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:11.236689  9722 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.237188  9722 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.236117  9640 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:11.251896  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 137255us
I20260709 13:18:11.264721  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:11.192255  9490 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.278038  9707 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.266847  9624 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.273177  9716 ts_tablet_manager.cc:1916] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:11.224419  9723 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.214591  9724 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:11.305233  3970 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:11.287405  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 571) took 2018 ms. Trace:
I20260709 13:18:11.305819  4120 rpcz_store.cc:276] 0709 13:18:09.268534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.678624 (+410090us) service_pool.cc:224] Handling call
0709 13:18:10.272511 (+593887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.280743 (+  8232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.287182 (+1006439us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003a7fd0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:11.287339 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365026688}
I20260709 13:18:11.289938  3968 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:11.307386  9393 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:11.307694  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.308324  3968 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:11.309122  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.309657  3968 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:11.310431  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.310925  3968 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:11.291054  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.312245  3965 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:11.313274  9601 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.301451  9366 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:18:11.303958  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 127567us
I20260709 13:18:11.324337  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:11.244405  9370 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:18:11.306414  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:11.332613  3970 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:18:11.322276  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 169953us
I20260709 13:18:11.326624  9718 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:11.327674  9612 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:11.216180  9540 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
W20260709 13:18:11.340749  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 142382us
I20260709 13:18:11.342715  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:11.343374  4680 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:11.344556  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.305924  9707 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:11.332923  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:11.352051  4120 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:11.352437  4120 raft_consensus.cc:614] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:11.338066  9370 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.365067  9370 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:11.366802  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:11.332504  9724 raft_consensus.cc:2764] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:18:11.315282  9723 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:11.379805  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.381639  4013 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:11.381788  4042 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:18:11.382726  4042 pending_rounds.cc:85] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 9
I20260709 13:18:11.382994  4042 pending_rounds.cc:107] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:18:11.383219  4042 raft_consensus.cc:2889] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:11.383285  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:11.384110  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:11.384431  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:11.384776  4038 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:18:11.380059  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.386065  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3449) took 2033 ms (client timeout 2119 ms). Trace:
I20260709 13:18:11.385385  4040 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:11.386466  4043 rpcz_store.cc:269] 0709 13:18:09.341023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.341141 (+   118us) service_pool.cc:224] Handling call
0709 13:18:11.374270 (+2033129us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54002e9d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:11.374391 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3762944896}
I20260709 13:18:11.339180  9705 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:11.365188  9458 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:11.396978  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:11.398646  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.315076  9624 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.406648  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:11.414108  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:11.419818  4044 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:11.332075  9722 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:11.424836  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49517.9us
I20260709 13:18:11.389030  9541 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:11.424537  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.388144  9540 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:11.433616  9540 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.434835  4038 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:11.406558  9688 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.372402  9317 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.413578  9395 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:11.462942  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:11.463747  4038 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:11.438866  9622 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.440824  9726 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:11.407248  9458 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:11.424161  9628 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:11.464396  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77681.4us
I20260709 13:18:11.469626  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:11.464781  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 83186.4us
I20260709 13:18:11.441586  9200 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.451191  9655 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.439109  9586 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:11.449918  4045 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:11.468290  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2778) took 1443 ms. Trace:
I20260709 13:18:11.480993  4043 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:11.479202  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:11.638507  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154514us
W20260709 13:18:11.452237  9629 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.034s
W20260709 13:18:11.640651  9629 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.829s	user 0.012s	sys 0.035s
I20260709 13:18:11.639060  4039 rpcz_store.cc:276] 0709 13:18:10.024730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.561130 (+536400us) service_pool.cc:224] Handling call
0709 13:18:10.567102 (+  5972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.567250 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:10.662593 (+ 95343us) log.cc:844] Serialized 14 byte log entry
0709 13:18:10.771023 (+108430us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.374800 (+603777us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b18003b85a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:18:11.442167 (+ 67367us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.467413 (+ 25246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:11.467470 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:11.467516 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.467715 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:11.468202 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":678831,"prepare.queue_time_us":130563,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1778,"raft.queue_time_us":641971,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":29543,"spinlock_wait_cycles":18098304,"thread_start_us":249267,"threads_started":3,"wal-append.queue_time_us":170442}
W20260709 13:18:11.640216  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.646476  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.640544  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.468940  9726 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.497346  9470 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.170s
I20260709 13:18:11.649061  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:11.659219  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 180069us
I20260709 13:18:11.641733  9601 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:11.477031  9623 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.181s
I20260709 13:18:11.497503  9483 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
W20260709 13:18:11.658414  9636 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.001s
W20260709 13:18:11.669740  9720 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
I20260709 13:18:11.498905  9200 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.653138  9393 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.654735  9726 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.645296  9324 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:18:11.641847  9341 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:11.457525  9688 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.648216  9473 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:11.670540  9585 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.476971  9622 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.638063  9628 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.645696  9237 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:18:11.676174  9516 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:11.684816  9717 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:11.692612  9470 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:11.693158  9683 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:11.477301  9705 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.684656  9458 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.694459  9722 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:11.699494  9200 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.683436  9601 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:11.705379  9739 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:11.709201  9714 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:18:11.709676  9657 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:11.683240  9185 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:11.715096  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.773090  9470 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:11.721937  9645 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:11.725603  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.892577  4120 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:11.725812  9736 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:18:11.765626  9370 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.727167  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.728904  9733 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:18:11.729651  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:11.730705  4117 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:11.771016  9585 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:11.735215  9697 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.872s	user 0.001s	sys 0.000s
I20260709 13:18:11.738471  9652 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:18:11.739681  9728 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 13:18:11.740039  9730 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:11.740343  9300 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:11.913406  9730 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:11.744522  9742 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.303s	user 0.000s	sys 0.001s
I20260709 13:18:11.744977  9393 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.748291  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 440) took 1848 ms. Trace:
I20260709 13:18:11.918238  4677 rpcz_store.cc:276] 0709 13:18:09.899797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.899970 (+   173us) service_pool.cc:224] Handling call
0709 13:18:10.664036 (+764066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.664698 (+   662us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.748100 (+1083402us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b5400600ed0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:11.748229 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756376320}
I20260709 13:18:11.749064  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:11.730831  4116 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:11.919728  4676 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:11.729517  9698 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.778s	user 0.003s	sys 0.000s
I20260709 13:18:11.761595  4680 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:11.645116  9584 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:18:11.685148  9703 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:11.750398  9735 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:11.653944  9707 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:18:11.647374  9655 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.648048  9586 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.684581  9701 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.336s
I20260709 13:18:11.770586  9516 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:11.729615  9738 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.371s
W20260709 13:18:11.805327  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:11.934535  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:11.689579  9682 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.733111  9729 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:11.774590  9717 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.904825  9601 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.905414  9470 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:11.921907  4118 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:11.890618  9200 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:11.890604  9458 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:11.922608  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:11.894521  9624 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.921479  9703 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.929004  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2765) took 1972 ms. Trace:
I20260709 13:18:11.900207  9652 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:11.935092  4042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.048s
W20260709 13:18:12.005550  4042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.048s
I20260709 13:18:11.934623  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:12.006690  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 260548us
W20260709 13:18:12.007082  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72552.9us
I20260709 13:18:12.007925  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:11.935503  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:12.008793  3966 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:11.937002  4675 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:18:11.928633  9707 consensus_queue.cc:1243] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:11.947593  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.009974  4043 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:12.010950  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:11.949707  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:11.949852  3971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.007s	sys 0.019s
W20260709 13:18:12.011734  3971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.008s	sys 0.019s
I20260709 13:18:11.933944  9516 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:11.950917  3970 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.008s	sys 0.018s
I20260709 13:18:12.012392  4041 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:18:12.014942  3970 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.008s	sys 0.018s
I20260709 13:18:11.895318  9185 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:11.936115  9367 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:11.931970  9317 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:11.954921  4046 rpcz_store.cc:276] 0709 13:18:09.956990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.437861 (+480871us) service_pool.cc:224] Handling call
0709 13:18:10.554390 (+116529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:10.565212 (+ 10822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.928815 (+1363603us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000f0d50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:11.928947 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267282816}
I20260709 13:18:12.023028  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.023845  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:12.024104  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.025303  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.026337  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:11.901496  9645 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.028446  9645 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:11.926476  9733 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:18:12.002909  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:11.955883  4119 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:12.002135  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2875) took 1354 ms. Trace:
W20260709 13:18:11.920650  9723 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.534s	user 0.004s	sys 0.003s
I20260709 13:18:11.955300  9738 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:12.014719  9341 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:18:12.030203  4040 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:12.031478  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:12.001812  9631 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.035600  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.040050  3966 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:12.045090  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:12.034144  3969 rpcz_store.cc:276] 0709 13:18:10.647663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.666632 (+ 18969us) service_pool.cc:224] Handling call
0709 13:18:10.666938 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:10.681839 (+ 14901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.681871 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:10.689646 (+  7775us) log.cc:844] Serialized 52 byte log entry
0709 13:18:10.946420 (+256774us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:10.946466 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.946539 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:11.728794 (+782255us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:11.952844 (+224050us) raft_consensus.cc:1685] finished
0709 13:18:11.952865 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.002045 (+ 49180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6216,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6469,"spinlock_wait_cycles":3361024,"thread_start_us":217418,"threads_started":1,"wal-append.queue_time_us":198980}
I20260709 13:18:12.047734  9585 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:11.956096  9200 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.048668  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:12.050170  9185 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:12.050473  9541 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.000s
I20260709 13:18:12.018077  9300 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:12.028956  9645 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.054651  9726 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.020984  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:12.015261  9658 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.080221  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:12.080915  3969 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.056831  9628 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:12.065008  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 172729us
I20260709 13:18:12.062995  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:12.092733  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.093488  4040 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:12.033015  9470 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:11.941943  9682 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.042788  9324 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:12.095152  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:12.118328  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 97434us
I20260709 13:18:12.119127  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.112114  4043 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:12.119474  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:12.042402  9683 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:18:12.121796  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.069940  9738 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:12.059499  9723 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:12.128427  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.094033  9621 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.082413  9622 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.066157  9601 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:18:12.152127  4043 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:12.153687  4046 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:12.094995  9473 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:12.066849  9631 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.156944  4115 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.121845  9688 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.171331  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.172112  4038 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:12.124912  9751 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:12.144932  9585 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:12.148176  9628 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.116523  9645 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.115996  9658 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.242424  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:12.243615  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.247291  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.286702  4120 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
W20260709 13:18:12.248590  9754 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:12.129249  9324 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.170586  9300 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:18:12.174984  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:12.255419  9738 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.258509  9703 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.225724  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.278924  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:12.280576  9706 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 1.241s	user 0.005s	sys 0.000s
I20260709 13:18:12.156383  9707 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:12.280578  4675 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:18:12.328266  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.358107  9601 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:12.360312  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.356508  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:12.162163  9621 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.145563  9758 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:12.159005  9657 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.161s
I20260709 13:18:12.373665  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.279440  9586 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:12.360337  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 185442us
I20260709 13:18:12.175088  9483 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.187s
I20260709 13:18:12.386341  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.386515  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:12.387693  9752 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.235s	user 0.000s	sys 0.000s
W20260709 13:18:12.388701  9756 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:18:12.394120  9540 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.464149  3963 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:12.376416  9717 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.405985  9726 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.470680  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.472142  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:12.356003  9628 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.283437  9662 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.419932  9701 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.357890  9458 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:12.485880  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.423699  9716 ts_tablet_manager.cc:1929] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:18:12.425392  9324 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.427368  9631 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.429306  9645 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.358050  9585 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:12.173163  9473 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.462282  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.468595  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:12.440753  9622 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:12.500949  9708 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:12.503084  9726 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.411051  9341 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:18:12.511497  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.385157  9707 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.433605  9601 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.591542  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2761) took 1153 ms. Trace:
I20260709 13:18:12.489768  9584 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:12.476661  9367 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 13:18:12.480391  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:12.678272  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63635us
I20260709 13:18:12.592373  9716 log.cc:1199] T 237eb348003645f7abcc1c18bd324690 P 0f3fa9d459de485e824f023c55580bc6: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/wals/237eb348003645f7abcc1c18bd324690
I20260709 13:18:12.683123  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:12.677489  4113 rpcz_store.cc:276] 0709 13:18:11.438421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.438582 (+   161us) service_pool.cc:224] Handling call
0709 13:18:11.463581 (+ 24999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:11.638625 (+175044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:11.638657 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:11.639133 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:18:11.934456 (+295323us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:11.934498 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:11.934605 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.591324 (+656719us) raft_consensus.cc:1685] finished
0709 13:18:12.591347 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.591475 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15356,"raft.queue_time_us":15496,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":142139,"thread_start_us":264085,"threads_started":1,"wal-append.queue_time_us":426478}
I20260709 13:18:12.694180  4038 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 9.
W20260709 13:18:12.697173  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 216084us
I20260709 13:18:12.699220  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:12.690641  4044 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:12.594249  9708 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:12.590385  9585 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:12.679034  9516 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.001s
I20260709 13:18:12.703711  4118 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:18:12.508857  9458 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.569850  9631 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.131s
I20260709 13:18:12.555208  9324 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.159s
I20260709 13:18:12.501308  9701 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.714359  9367 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:12.739634  4044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:12.759250  4044 raft_consensus.cc:606] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:12.759629  4044 raft_consensus.cc:614] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:12.743619  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:12.724216  9683 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.062s	sys 0.094s
I20260709 13:18:12.675184  9726 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:12.746568  4677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.030s	sys 0.039s
I20260709 13:18:12.735577  9708 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.753258  9300 consensus_queue.cc:1243] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:12.694207  9584 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.739013  9758 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.761755  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 303089us
I20260709 13:18:12.729307  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:12.769966  4677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.030s	sys 0.039s
W20260709 13:18:12.752898  4039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.003s	sys 0.007s
I20260709 13:18:12.733271  9645 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:12.898871  4039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.004s	sys 0.007s
W20260709 13:18:12.770485  3969 consensus_meta.cc:287] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.689s	user 0.009s	sys 0.000s
I20260709 13:18:12.738579  9636 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.899916  9636 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.902025  9636 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.716691  9723 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:12.763106  9683 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.062s	sys 0.094s
I20260709 13:18:12.740502  9516 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:12.904821  4042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.023s	sys 0.027s
W20260709 13:18:12.905356  4042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.023s	sys 0.028s
I20260709 13:18:12.905936  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2793) took 1523 ms. Trace:
I20260709 13:18:12.906104  9516 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:12.778312  9765 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:18:12.785553  4044 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:12.906850  4042 rpcz_store.cc:276] 0709 13:18:11.382847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.395705 (+ 12858us) service_pool.cc:224] Handling call
0709 13:18:11.396017 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.396216 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:12.006101 (+609885us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.905631 (+899530us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.905681 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:12.905722 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.905782 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.905887 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17157,"prepare.queue_time_us":400920,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":97620,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":6352,"thread_start_us":1463166,"threads_started":3,"wal-append.queue_time_us":352732}
I20260709 13:18:12.908644  4044 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:18:12.909169  9366 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:12.909586  9366 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:12.794096  9726 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.910544  9366 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.906949  4040 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:12.911594  9366 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:12.913383  4044 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 13:18:12.795706  9767 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 13:18:12.914151  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3484) took 1434 ms. Trace:
W20260709 13:18:12.796386  9762 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:18:12.914534  4047 rpcz_store.cc:276] 0709 13:18:11.479353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.479489 (+   136us) service_pool.cc:224] Handling call
0709 13:18:11.645597 (+166108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.943394 (+297797us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:12.001609 (+ 58215us) log.cc:844] Serialized 14 byte log entry
0709 13:18:12.629364 (+627755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:12.629438 (+    74us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:12.629496 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.913927 (+284431us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b540035c5d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:12.913976 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.914095 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10311,"prepare.queue_time_us":82256,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":94288,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7596,"spinlock_wait_cycles":684279680,"thread_start_us":616885,"threads_started":2,"wal-append.queue_time_us":675392}
I20260709 13:18:12.805962  9716 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36870 (request call id 89) took 1771 ms. Trace:
I20260709 13:18:12.917080  9716 rpcz_store.cc:276] 0709 13:18:11.034350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.042752 (+  8402us) service_pool.cc:224] Handling call
0709 13:18:11.153325 (+110573us) ts_tablet_manager.cc:1151] Deleting tablet 237eb348003645f7abcc1c18bd324690
0709 13:18:11.153427 (+   102us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:12.046833 (+893406us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:12.423540 (+376707us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:12.805865 (+382325us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2239,"tablet-delete.queue_time_us":100971,"thread_start_us":29720,"threads_started":1}
I20260709 13:18:12.808517  9701 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.825909  9458 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.837213  9473 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:12.842592  9585 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.845522  9601 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.777823  9758 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.922062  9708 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.911245  9726 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:12.851770  9707 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:12.852406  9628 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.924182  9708 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.924571  4044 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:12.924975  9620 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:12.925482  9620 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.927824  9620 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:12.922127  9758 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.928331  9620 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.928746  9620 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.928110  3969 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
W20260709 13:18:12.865716  4676 consensus_meta.cc:287] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.945s	user 0.011s	sys 0.000s
I20260709 13:18:12.782338  9300 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.890969  9730 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:12.892203  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:12.892109  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3064) took 1167 ms. Trace:
W20260709 13:18:12.893885  9695 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.979s	user 0.012s	sys 0.017s
I20260709 13:18:12.928984  9683 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:12.941951  9683 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:12.795133  9584 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.942814  9730 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:12.943266  9730 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:12.943662  9730 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:12.943893  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.937181  9622 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:12.941571  4115 rpcz_store.cc:276] 0709 13:18:11.724304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.724851 (+   547us) service_pool.cc:224] Handling call
0709 13:18:11.725174 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.168091 (+442917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.891844 (+723753us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54001b2954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:12.892049 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":925536000}
I20260709 13:18:12.895385  9777 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:12.942281  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 50166.7us
I20260709 13:18:12.946260  9300 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.947947  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.949229  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3406) took 1228 ms. Trace:
I20260709 13:18:12.949772  3969 rpcz_store.cc:276] 0709 13:18:11.721184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.067011 (+345827us) service_pool.cc:224] Handling call
0709 13:18:12.949161 (+882150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:12.950290  4115 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:12.859179  9751 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.577s	user 0.001s	sys 0.007s
I20260709 13:18:12.949324  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.953079  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:12.955492  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.928951  9774 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:12.957297  9621 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:12.959263  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.946026  9777 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.972975  4117 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:12.973969  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.975741  9751 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:12.977807  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:12.978117  9769 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.424s	user 0.007s	sys 0.000s
I20260709 13:18:12.980995  9722 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:12.981402  9722 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:12.982247  9722 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:12.983431  9722 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:12.991106  4118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b759a28e523c491c941636a30d249939"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:12.991739  4118 raft_consensus.cc:606] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:12.992059  4118 raft_consensus.cc:614] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:12.993083  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:12.993654  4041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3464) took 3328 ms (client timeout 1969 ms). Trace:
I20260709 13:18:12.994318  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:12.995373  9696 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 2.077s	user 0.012s	sys 0.027s
I20260709 13:18:12.995720  4118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:12.996482  4118 raft_consensus.cc:606] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:12.996701  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2874) took 2349 ms. Trace:
I20260709 13:18:12.996879  4118 raft_consensus.cc:614] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:12.983347  4114 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:12.999264  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3060) took 1978 ms. Trace:
I20260709 13:18:12.997120  3972 rpcz_store.cc:276] 0709 13:18:10.647368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.650449 (+  3081us) service_pool.cc:224] Handling call
0709 13:18:10.665906 (+ 15457us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:10.666263 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:10.666291 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:10.674527 (+  8236us) log.cc:844] Serialized 52 byte log entry
0709 13:18:10.795992 (+121465us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:10.796034 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:10.796099 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:12.994734 (+2198635us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:12.996418 (+  1684us) raft_consensus.cc:1685] finished
0709 13:18:12.996442 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:12.996644 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2612,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":5052,"spinlock_wait_cycles":12416768,"thread_start_us":90229,"threads_started":1,"wal-append.queue_time_us":148258}
I20260709 13:18:12.999567  4114 rpcz_store.cc:276] 0709 13:18:11.021345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.058313 (+ 36968us) service_pool.cc:224] Handling call
0709 13:18:12.982816 (+1924503us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:12.983014 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.999040 (+ 16026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:12.999218 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4843392}
W20260709 13:18:12.906121  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 176896us
W20260709 13:18:12.994071  4041 rpcz_store.cc:269] 0709 13:18:09.664960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:09.680872 (+ 15912us) service_pool.cc:224] Handling call
0709 13:18:12.993427 (+3312555us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b540035cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:12.993555 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5339582720}
I20260709 13:18:13.005412  9688 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:13.005905  9688 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.007180  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.009483  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.010186  4114 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:13.010524  9640 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:13.010911  9640 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.011885  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:13.012517  4675 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:13.012555  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:13.012785  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:12.945645  9683 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.004726  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3405) took 1284 ms. Trace:
I20260709 13:18:13.036108  3969 rpcz_store.cc:276] 0709 13:18:11.720875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.003923 (+1283048us) service_pool.cc:224] Handling call
0709 13:18:13.004242 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.004438 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.004460 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.004500 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:13.004529 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.004579 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.004675 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.016369  9393 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:13.017198  9489 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:13.053956  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:13.054651  4677 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:13.056248  4013 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.034551  9640 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.059123  9640 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:13.008661  9688 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.069993  9682 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:13.072244  9760 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.712s	user 0.011s	sys 0.010s
I20260709 13:18:13.073547  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 443) took 1905 ms. Trace:
I20260709 13:18:13.073923  4679 rpcz_store.cc:276] 0709 13:18:11.168599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.168739 (+   140us) service_pool.cc:224] Handling call
0709 13:18:11.169035 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.221456 (+ 52421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.073293 (+1851837us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b5400600254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:13.073478 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108021632}
W20260709 13:18:13.075739  3963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3379) took 2398 ms (client timeout 2547 ms). Trace:
W20260709 13:18:13.076140  3963 rpcz_store.cc:269] 0709 13:18:10.676866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:10.690358 (+ 13492us) service_pool.cc:224] Handling call
0709 13:18:13.075539 (+2385181us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b54002c8654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:13.075652 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4028879232}
I20260709 13:18:13.077592  9721 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:13.077975  9721 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.078737  9721 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.079658  9721 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.082304  9370 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.000110  9774 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.087131  9774 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.053930  9489 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.088745  9489 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.089780  9489 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:13.097218  9786 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:18:13.098596  9658 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.105134  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3493) took 1150 ms. Trace:
I20260709 13:18:13.105818  9612 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:13.105551  4043 rpcz_store.cc:276] 0709 13:18:11.954405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.010715 (+ 56310us) service_pool.cc:224] Handling call
0709 13:18:13.104956 (+1094241us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400029ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:13.105066 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231317376}
W20260709 13:18:13.108461  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 52318.9us
I20260709 13:18:13.108660  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3401) took 1810 ms. Trace:
I20260709 13:18:13.111621  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3403) took 1774 ms. Trace:
I20260709 13:18:13.017859  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.018937  9200 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.019586  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.027916  9777 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.032205  9655 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.017198  9618 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:12.964232  4676 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:13.125342  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:13.125955  4679 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:13.013478  4680 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:13.038733  3969 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 8. (index mismatch)
W20260709 13:18:13.048782  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:12.931177  9620 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.112012  3964 rpcz_store.cc:276] 0709 13:18:11.337354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.380957 (+ 43603us) service_pool.cc:224] Handling call
0709 13:18:11.382922 (+  1965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.384170 (+  1248us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:11.422565 (+ 38395us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.111276 (+1688711us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.111341 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.111395 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.111456 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.111566 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1434167,"prepare.queue_time_us":99183,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"thread_start_us":254163,"threads_started":1,"wal-append.queue_time_us":372511,"wal-append.run_cpu_time_us":1502,"wal-append.run_wall_time_us":1112263}
I20260709 13:18:13.113258  4114 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:13.128660  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3408) took 1400 ms. Trace:
I20260709 13:18:13.129314  4114 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:18:13.112170  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.117046  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.118345  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.119093  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:13.121580  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 103805us
I20260709 13:18:13.109073  3967 rpcz_store.cc:276] 0709 13:18:11.298663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.367678 (+ 69015us) service_pool.cc:224] Handling call
0709 13:18:11.367935 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.368134 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:11.421585 (+ 53451us) log.cc:844] Serialized 14 byte log entry
0709 13:18:11.460667 (+ 39082us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.100328 (+1639661us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b18000d33c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:18:13.100484 (+   156us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.100546 (+    62us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:13.100591 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.100657 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.108599 (+  7942us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1637092,"prepare.queue_time_us":293600,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":69,"raft.queue_time_us":1652395,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":3927,"spinlock_wait_cycles":34155392,"thread_start_us":81788,"threads_started":2,"wal-append.queue_time_us":275194,"wal-append.run_cpu_time_us":1418,"wal-append.run_wall_time_us":1004394}
I20260709 13:18:13.134192  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.135306  4121 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:13.136859  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.137449  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:13.129024  3969 rpcz_store.cc:276] 0709 13:18:11.728361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.038047 (+1309686us) service_pool.cc:224] Handling call
0709 13:18:13.038381 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.128417 (+ 90036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.128610 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.142021  3963 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:13.098634  9300 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.142660  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3410) took 1248 ms. Trace:
I20260709 13:18:13.168442  3963 rpcz_store.cc:276] 0709 13:18:11.893868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.110521 (+1216653us) service_pool.cc:224] Handling call
0709 13:18:13.133393 (+ 22872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.142409 (+  9016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.142603 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.163084  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:13.164296  4013 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:13.166742  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.123880  9688 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:13.130806  9367 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:13.177726  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3399) took 1880 ms. Trace:
I20260709 13:18:13.072567  9730 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.188484  4679 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 10.
I20260709 13:18:13.189648  3970 rpcz_store.cc:276] 0709 13:18:11.296979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.333547 (+ 36568us) service_pool.cc:224] Handling call
0709 13:18:11.351705 (+ 18158us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.351915 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:12.015373 (+663458us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.177374 (+1162001us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.177429 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.177475 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.177537 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.177664 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":833185,"prepare.queue_time_us":107899,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"thread_start_us":992873,"threads_started":2,"wal-append.queue_time_us":344845}
I20260709 13:18:13.143571  9719 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.197510  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:13.168011  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet 237eb348003645f7abcc1c18bd324690 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
W20260709 13:18:13.204710  3856 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68341.9us
I20260709 13:18:13.169667  9655 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.201118  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3501) took 1174 ms. Trace:
I20260709 13:18:13.216928  4039 rpcz_store.cc:276] 0709 13:18:12.026433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.899828 (+873395us) service_pool.cc:224] Handling call
0709 13:18:12.900163 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:12.900339 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:12.900599 (+   260us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.200796 (+300197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.200856 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:13.200900 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.200960 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.201067 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63948,"prepare.queue_time_us":2120,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":65250,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":235464,"threads_started":1}
I20260709 13:18:13.201514  9620 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:13.162451  9098 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.183688  9595 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.206107  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:13.223157  4112 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.206739  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.168438  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 447) took 1388 ms. Trace:
I20260709 13:18:13.200246  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.177232  9541 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.129845  9544 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:18:13.178321  9688 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.197388  9777 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:18:13.228945  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.230700  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:13.229249  4114 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:13.253937  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.203321  9719 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.205255  9717 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:13.205717  9370 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:18:13.260277  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:13.249629  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.281651  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.251133  4112 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:13.255895  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.256898  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.224587  9395 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:13.260349  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.235116  9300 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.242208  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3397) took 1947 ms. Trace:
I20260709 13:18:13.236637  9540 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.270274  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.275776  9370 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.285853  3968 rpcz_store.cc:276] 0709 13:18:11.295151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.311415 (+ 16264us) service_pool.cc:224] Handling call
0709 13:18:11.311698 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.311881 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:11.429692 (+117811us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.241859 (+1812167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:13.241916 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:13.241965 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.242030 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.242152 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1723262,"prepare.queue_time_us":104191,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":859,"raft.queue_time_us":1642421,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":11130,"thread_start_us":264685,"threads_started":3,"wal-append.queue_time_us":271465,"wal-append.run_cpu_time_us":1021,"wal-append.run_wall_time_us":1003145}
I20260709 13:18:13.265072  9200 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:18:13.274677  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.223308  9655 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.267875  9630 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:18:13.254766  9777 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:13.325075  9777 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:13.325381  9782 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:18:13.325889  9796 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.326346  9185 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:13.326787  9185 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:13.300593  9366 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.327461  9366 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.327811  9366 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.225328  9620 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.260658  9483 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:13.261355  9719 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.229143  9595 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.342628  9595 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.343350  3969 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:13.237593  9751 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:13.374768  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:13.375399  9751 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:13.375779  9751 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:13.224594  9098 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.376605  9751 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.377827  9751 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.379783  9098 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.229586  4676 rpcz_store.cc:276] 0709 13:18:11.747593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.748728 (+  1135us) service_pool.cc:224] Handling call
0709 13:18:13.136277 (+1387549us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:13.278596  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.279053  3963 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:18:13.381245  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.381343  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.285154  4114 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:13.381868  3964 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:13.335234  9544 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:18:13.252543  9688 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.382843  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.383620  3964 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:13.384188  9662 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.384270  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.385324  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.385864  3964 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:13.386457  9620 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.288981  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.288733  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:13.389416  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 100727us
I20260709 13:18:13.390003  3967 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:13.390377  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.391177  3967 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:13.391839  9682 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.392256  9682 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.251960  9541 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:13.274487  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 1.81274e+06us
I20260709 13:18:13.287477  9300 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.292286  9540 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.297127  9395 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.297788  9655 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.268101  9717 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.306988  9492 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:13.311757  3968 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:13.313231  9804 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.314023  9652 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.315682  9470 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:13.321242  9370 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.328608  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.286748  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.369145  9730 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.292155  9658 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.292519  9543 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.326414  9796 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.336213  9722 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:18:13.332780  9545 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.327634  9185 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.335055  9794 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.320354  3868 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 15, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.357362  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.426899  9658 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.427520  4113 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:13.428506  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.381995  3963 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:13.382726  9774 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:13.453563  4112 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:13.401561  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:13.454836  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53377.4us
I20260709 13:18:13.429677  3969 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:13.427628  9658 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.386582  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.461040  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.461654  3964 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
W20260709 13:18:13.400504  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.392567  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.382862  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.465353  4116 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:13.466029  4121 raft_consensus.cc:606] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:13.466370  4121 raft_consensus.cc:614] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:13.462513  4680 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:13.467377  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.468250  4119 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:13.459826  4113 raft_consensus.cc:2410] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:13.462598  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.468842  4112 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:13.469323  3964 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:13.470248  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.470448  4112 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:13.347196  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:13.471282  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 124174us
I20260709 13:18:13.473057  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.474670  4114 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:13.474578  4039 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:13.393428  9791 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
W20260709 13:18:13.393224  9785 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:18:13.393009  9792 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:18:13.473949  9652 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:13.477967  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.392608  9682 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:13.405758  9799 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:18:13.474887  3868 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:13.479382  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:13.499432  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 153908us
I20260709 13:18:13.482429  4043 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:13.393124  9483 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:13.426469  9540 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:13.406543  9800 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:18:13.487735  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.518898  4038 raft_consensus.cc:2410] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:13.382865  9544 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:13.465075  9790 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
I20260709 13:18:13.494735  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.521765  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.426293  9688 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.505936  9483 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.497962  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.429404  9470 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:13.451766  9300 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.426335  9545 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.467594  9722 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:13.393227  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:13.479827  9777 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:13.499768  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 107265us
I20260709 13:18:13.550639  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.481096  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.502936  4043 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:18:13.551896  4040 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:13.552677  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.552924  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.506196  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.553596  4040 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:13.554193  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:13.554437  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.506394  9640 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:13.508842  4046 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:18:13.460376  9794 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.477423  9393 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:13.407398  9630 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:18:13.488965  9489 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:13.513398  3868 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 14, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:13.426718  9543 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.505652  9655 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:13.472874  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:13.519238  3937 connection.cc:256] RPC call timeout handler was delayed by -1.0085249280000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17010000000000003s for a response
I20260709 13:18:13.459571  9804 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.531332  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.532197  9683 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.614923  4038 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 9.
I20260709 13:18:13.452930  9774 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:13.478138  9719 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.525695  9492 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:13.537158  4676 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:13.522616  9544 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.604645  9620 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:13.539983  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.546372  9300 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.507682  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.554447  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:13.513594  9708 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.509362  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.634974  4044 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:13.565802  9717 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.569162  9470 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.560233  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.520820  9677 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:13.520656  9621 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.617331  9655 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:13.526234  9796 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.529958  9458 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:13.607770  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 135005us
I20260709 13:18:13.602608  9640 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.601455  9393 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.625574  9098 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.615980  4043 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:13.616129  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.616894  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.619170  9721 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:13.621220  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:13.605849  9799 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:18:13.621728  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.632254  9620 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:13.539058  9541 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.632966  4040 raft_consensus.cc:2368] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:18:13.632098  3964 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:13.530918  9483 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:13.641459  9612 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.646014  4046 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:13.648162  4120 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:13.648504  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.614030  9543 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.674278  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:13.647619  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 314756us
I20260709 13:18:13.616122  9366 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.652546  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.723155  4038 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:18:13.653244  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.724852  4118 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:13.655419  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.726573  4114 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:13.613917  9630 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.656155  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.646665  9798 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.653574  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:13.657481  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.652334  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:13.645335  3938 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.014s
I20260709 13:18:13.665338  3868 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 16, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.667208  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:13.644685  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:13.645751  9717 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.643573  9737 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:13.623657  9683 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.642906  9708 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.691370  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:13.675014  4120 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
W20260709 13:18:13.741636  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50459us
I20260709 13:18:13.673719  4117 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 11.
I20260709 13:18:13.650540  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.649873  9795 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.730716  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:13.656345  9393 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:13.648515  9621 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.665838  9620 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:13.736310  3938 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.005s	sys 0.014s
I20260709 13:18:13.738427  4044 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:13.721845  4046 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:13.631265  9774 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:13.763419  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 112967us
I20260709 13:18:13.744432  4038 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:18:13.764449  4038 pending_rounds.cc:85] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:18:13.658296  9492 raft_consensus.cc:2764] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:18:13.648706  9677 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.747773  4039 raft_consensus.cc:2410] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:13.671355  9544 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:13.739480  9799 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:18:13.749075  3868 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.659775  9098 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.764709  4038 pending_rounds.cc:107] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:13.784332  4038 raft_consensus.cc:2889] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:13.737213  9630 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.748134  9458 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:13.731716  9612 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.752575  9595 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.770987  4046 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:13.776964  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:13.745201  9618 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:13.794040  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:13.784565  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 233986us
I20260709 13:18:13.773309  9751 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:13.801404  3868 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 10 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:13.747696  9758 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:13.740402  9798 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.781913  9718 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:13.821676  4046 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:13.746556  9717 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:13.846419  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 69538.9us
I20260709 13:18:13.800647  9458 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:13.846271  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.797950  9544 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:13.748721  9737 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:13.755609  9795 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.800997  9688 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.847381  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:13.805117  9722 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.803712  9489 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.744412  9655 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.821137  9777 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.929620  3868 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.929626  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:13.943060  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 222602us
I20260709 13:18:13.951423  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:18:13.945257  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 209435us
W20260709 13:18:13.948416  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 101203us
I20260709 13:18:13.954278  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:13.955674  9300 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.929505  9458 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:13.958101  9808 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:18:13.862977  9595 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.959277  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3407) took 2237 ms. Trace:
I20260709 13:18:13.959633  3972 rpcz_store.cc:276] 0709 13:18:11.721410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.005390 (+1283980us) service_pool.cc:224] Handling call
0709 13:18:13.005733 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.206545 (+200812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.206575 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.207064 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.642158 (+435094us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:13.642198 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.642366 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:13.959070 (+316704us) raft_consensus.cc:1685] finished
0709 13:18:13.959091 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:13.959217 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211706,"raft.queue_time_us":213529,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":1615,"thread_start_us":434817,"threads_started":1,"wal-append.queue_time_us":571899}
I20260709 13:18:13.961361  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.961957  3972 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:13.962776  9601 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:13.963217  9601 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:13.963573  9601 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:13.957896  9520 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:13.968044  9520 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.968423  9520 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:13.970564  9595 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.973726  9683 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.974671  9545 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.977160  9682 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.978312  4042 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:13.979398  9630 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.980898  9795 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.960976  3868 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.927652  9794 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.951128  9804 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.982964  3868 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.985327  3868 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.986297  9682 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.988304  9612 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:13.978152  9640 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:13.940058  9618 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:13.992678  9618 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:13.993113  9618 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:13.993310  9489 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.879174  9751 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.981011  9719 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.001358  9722 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:14.003335  9662 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:18:14.003875  4045 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:14.000444  9618 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:14.015390  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52851.6us
I20260709 13:18:14.020685  4044 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:18:14.022554  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 68342.5us
I20260709 13:18:13.987324  3868 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 12, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:14.007453  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51800.2us
W20260709 13:18:14.008723  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.026705  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:14.009792  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:13.981011  9717 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:13.962785  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:13.977483  9737 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:14.000694  9520 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:13.996565  9751 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.045105  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.046705  3868 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 14, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:13.949091  9721 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:13.978221  9098 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:14.054178  9819 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.004s
I20260709 13:18:14.016595  9612 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.054118  9367 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:14.051669  9458 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.058539  3868 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 16, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:14.066164  9811 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 13:18:14.041501  9813 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:18:14.015352  9724 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:18:14.043109  9822 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.061s	user 0.002s	sys 0.000s
I20260709 13:18:14.015895  9623 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:14.068279  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52110.6us
W20260709 13:18:14.066905  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 414615us
I20260709 13:18:14.069099  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:14.122474  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53470.4us
I20260709 13:18:14.042383  9794 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:18:14.071853  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 99447.1us
I20260709 13:18:14.125301  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.042475  9804 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:14.079265  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:14.133086  4680 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.081873  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.083019  4682 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:18:14.083781  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 60111us
I20260709 13:18:14.085800  3868 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:14.074020  9658 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.000s
I20260709 13:18:14.046881  9719 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:18:14.083312  9367 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.093941  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3398) took 2797 ms. Trace:
W20260709 13:18:14.112905  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.080658  9612 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.091507  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:14.080569  9200 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:14.121291  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.129745  9718 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.151602  3965 rpcz_store.cc:276] 0709 13:18:11.296093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.312828 (+ 16735us) service_pool.cc:224] Handling call
0709 13:18:11.313089 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.313274 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:11.457367 (+144093us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.871671 (+2414304us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.093431 (+221760us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.093506 (+    75us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:14.093554 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.093627 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.093867 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1228273,"prepare.queue_time_us":580791,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2271,"raft.queue_time_us":1234912,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":21052,"thread_start_us":1542717,"threads_started":5,"wal-append.queue_time_us":633562,"wal-append.run_cpu_time_us":1765,"wal-append.run_wall_time_us":1265675}
W20260709 13:18:14.171088  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49881.3us
I20260709 13:18:14.171761  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.138404  3972 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:14.140542  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:14.110276  9723 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:14.074740  9751 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:18:14.049794  9777 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:18:14.143832  3868 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 15, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 15 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:14.144595  4677 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:14.174651  3965 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:14.147542  4086 leader_election.cc:400] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16.
I20260709 13:18:14.172343  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:14.150180  4680 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:14.114845  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3404) took 2745 ms. Trace:
I20260709 13:18:14.116218  9366 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.131546  9682 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:14.154914  9618 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.151563  9630 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.115809  9295 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:14.120249  9724 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:14.156059  9520 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.157019  9837 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:18:14.158895  4045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3510) took 2045 ms (client timeout 1919 ms). Trace:
I20260709 13:18:14.158567  9721 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.143481  9658 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:14.160887  9652 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.659s	user 0.010s	sys 0.001s
I20260709 13:18:14.161780  9601 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.122092  9708 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.229430  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:14.169298  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77865.9us
I20260709 13:18:14.234107  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.124253  9823 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:14.134071  9470 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.176515  3966 rpcz_store.cc:276] 0709 13:18:11.369565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.068870 (+699305us) service_pool.cc:224] Handling call
0709 13:18:12.075575 (+  6705us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:13.171703 (+1096128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.171738 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:13.191398 (+ 19660us) log.cc:844] Serialized 52 byte log entry
0709 13:18:13.324787 (+133389us) spinlock_profiling.cc:243] Waited 8.56 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:18:13.664083 (+339296us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:13.664158 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.664241 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.083811 (+419570us) raft_consensus.cc:1685] finished
0709 13:18:14.083833 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.114752 (+ 30919us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1060609,"raft.queue_time_us":1130521,"raft.run_cpu_time_us":1146,"raft.run_wall_time_us":108844,"spinlock_wait_cycles":19697408,"thread_start_us":429717,"threads_started":1,"wal-append.queue_time_us":592906}
I20260709 13:18:14.179150  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.178987  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.250453  4680 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.250939  4680 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 10: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:14.180559  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.251967  4679 raft_consensus.cc:1813] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.252447  4679 raft_consensus.cc:2393] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:14.181514  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.183882  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.253131  3965 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.143374  4676 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:14.263477  3868 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:14.184499  9682 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:14.227645  9751 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:14.144874  9804 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:14.126186  9623 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.191753  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.191205  9730 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:18:14.199777  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.308853  4119 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:14.182413  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.201164  9458 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.154860  9370 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:18:14.202451  9367 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.202993  9544 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:14.312361  9677 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.203549  9718 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:14.287472  9751 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.313292  9751 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.315425  9688 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.171093  9827 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:14.206357  9483 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.254216  9823 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.206573  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.317080  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2888) took 1005 ms. Trace:
I20260709 13:18:14.318248  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.300287  9804 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.317703  3967 rpcz_store.cc:276] 0709 13:18:13.311794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.391879 (+ 80085us) service_pool.cc:224] Handling call
0709 13:18:13.392142 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.393499 (+  1357us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:13.649328 (+255829us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.147201 (+497873us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.147651 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.147792 (+   141us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:14.147823 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.147907 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.316873 (+168966us) raft_consensus.cc:1685] finished
0709 13:18:14.316900 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.317016 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46121,"prepare.queue_time_us":535490,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2666,"raft.queue_time_us":40171,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12990,"spinlock_wait_cycles":26815232,"thread_start_us":650567,"threads_started":2,"wal-append.queue_time_us":534903}
I20260709 13:18:14.319939  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.320466  3967 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:14.211304  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.195506  9630 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.188984  9723 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.322628  4047 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:14.186832  9795 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:14.212803  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.214413  9798 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.214231  9683 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:14.212908  9777 consensus_queue.cc:1243] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:18:14.174599  9657 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:14.216511  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:14.218637  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:14.217856  4045 rpcz_store.cc:269] 0709 13:18:12.113414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:12.243362 (+129948us) service_pool.cc:224] Handling call
0709 13:18:14.158712 (+1915350us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54000f0854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:14.158822 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3949254912}
I20260709 13:18:14.175215  9816 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:14.227157  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.238082  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.241477  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.243199  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:14.173903  9393 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.266916  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.349634  3966 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:14.191767  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40680 (request call id 64) took 1050 ms. Trace:
I20260709 13:18:14.350064  4121 rpcz_store.cc:276] 0709 13:18:13.137212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.137327 (+   115us) service_pool.cc:224] Handling call
0709 13:18:14.187134 (+1049807us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001b1f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:14.187251 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754424192}
I20260709 13:18:14.291383  3868 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 14, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.292835  4678 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:14.302119  9601 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.224082  9489 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:18:14.359074  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.357803  9470 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:14.303515  9621 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.305493  9724 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:14.307192  9814 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:18:14.287698  9682 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:14.318699  9483 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.209033  9620 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.211057  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.309782  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.309736  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.346706  9816 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:14.329213  3965 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:14.334143  4115 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:14.334199  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.370275  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.370965  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.316990  9827 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:14.371850  3967 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:18:14.337852  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 155048us
I20260709 13:18:14.376189  4013 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:14.377085  9827 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.377642  9657 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:14.378175  9657 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:14.378980  9657 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.385013  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.386489  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.387271  3967 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:14.389262  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:14.340513  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 168219us
I20260709 13:18:14.341105  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.307132  9612 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:14.344956  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 126388us
I20260709 13:18:14.347610  4118 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:14.347892  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:14.353027  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 109973us
I20260709 13:18:14.333906  9795 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:14.355872  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 117872us
I20260709 13:18:14.407506  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:14.415670  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.357033  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.346412  9367 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:18:14.303380  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.420491  3968 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:14.361941  3868 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 9 to 13, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.354768  9370 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:14.367048  3964 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:14.320672  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 832) took 1087 ms. Trace:
I20260709 13:18:14.349335  9677 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:14.389650  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2892) took 1077 ms. Trace:
I20260709 13:18:14.437285  3969 rpcz_store.cc:276] 0709 13:18:13.312654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.457019 (+144365us) service_pool.cc:224] Handling call
0709 13:18:13.485530 (+ 28511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.506468 (+ 20938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:13.506498 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:13.506941 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 13:18:13.782288 (+275347us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:13.782341 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:13.782429 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.389421 (+606992us) raft_consensus.cc:1685] finished
0709 13:18:14.389442 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.389591 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4889,"raft.queue_time_us":20921,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":5285,"thread_start_us":275073,"threads_started":1,"wal-append.queue_time_us":628614}
I20260709 13:18:14.426333  3970 rpcz_store.cc:276] 0709 13:18:13.233216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.233359 (+   143us) service_pool.cc:224] Handling call
0709 13:18:13.258159 (+ 24800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:13.478968 (+220809us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:13.849960 (+370992us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.133080 (+283120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.133135 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:14.133186 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.320447 (+187261us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400279a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:14.320500 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.320615 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9299,"prepare.queue_time_us":473644,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":1440,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":11887,"spinlock_wait_cycles":507314048,"thread_start_us":587992,"threads_started":2,"wal-append.queue_time_us":357052}
I20260709 13:18:14.391278  9620 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:14.373664  9816 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.394745  9823 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:14.395783  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.455302  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3387) took 3174 ms. Trace:
I20260709 13:18:14.397670  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:14.364161  9470 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:14.399384  9834 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:18:14.401408  9774 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.343312  4120 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:14.362011  9718 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:14.403000  4116 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:14.409309  4118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:14.409629  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:14.410348  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:14.359959  4112 raft_consensus.cc:2410] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:14.421615  3868 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 12 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:14.422163  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.428012  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.470876  3966 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:14.443665  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.471787  3964 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:14.472227  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2901) took 1013 ms. Trace:
I20260709 13:18:14.472509  3964 rpcz_store.cc:276] 0709 13:18:13.458843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.443255 (+984412us) service_pool.cc:224] Handling call
0709 13:18:14.472176 (+ 28921us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.473309  9827 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.419639  9795 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:14.473717  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51641.3us
W20260709 13:18:14.469849  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59571.1us
I20260709 13:18:14.425971  9612 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:14.476501  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:14.477016  4117 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:18:14.477236  4085 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.853s (SENT) [suppressed 19 similar messages]
I20260709 13:18:14.425411  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:14.445619  9828 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:14.485723  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76187.5us
I20260709 13:18:14.491631  3868 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:14.487936  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.488323  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.449559  9794 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.495743  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.496369  3970 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.454610  9370 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:14.493168  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.487686  4118 raft_consensus.cc:606] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.471415  9630 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.498567  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.465906  9470 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:14.489988  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.464434  9655 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:14.454393  9677 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.461143  9810 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.571434  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.562938  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.581918  3970 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
W20260709 13:18:14.543956  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.475616  9543 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:14.455667  3971 rpcz_store.cc:276] 0709 13:18:11.280556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:11.280718 (+   162us) service_pool.cc:224] Handling call
0709 13:18:11.306320 (+ 25602us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:11.306509 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:11.325109 (+ 18600us) log.cc:844] Serialized 14 byte log entry
0709 13:18:13.322274 (+1997165us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:18:13.665240 (+342966us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.454777 (+789537us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b1800441e20. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a
0709 13:18:14.454978 (+   201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:14.455028 (+    50us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:14.455072 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.455139 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.455249 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1145983,"prepare.queue_time_us":614524,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":1192384,"raft.run_cpu_time_us":2239,"raft.run_wall_time_us":114418,"spinlock_wait_cycles":81607808,"thread_start_us":1455285,"threads_started":4,"wal-append.queue_time_us":1320517,"wal-append.run_cpu_time_us":2421,"wal-append.run_wall_time_us":1315667}
I20260709 13:18:14.475656  9827 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.523223  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.467429  9631 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:14.484540  9722 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:14.612236  4118 raft_consensus.cc:614] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:14.530776  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.490912  9688 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:14.612495  3968 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:14.495379  9751 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.616302  9737 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:14.517289  9794 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.562911  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2891) took 1250 ms. Trace:
I20260709 13:18:14.652829  4046 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:14.652567  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:14.545652  9393 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.477814  9718 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:14.603781  3868 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 6 to 9, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 9 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:14.548146  9200 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:18:14.549405  9847 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:18:14.636981  3964 raft_consensus.cc:2376] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21. Re-sending same reply.
W20260709 13:18:14.614730  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 124810us
I20260709 13:18:14.710243  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:14.545966  9856 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:14.491217  9804 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:14.645701  3965 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:14.503010  9658 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.602692  9708 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.537902  9730 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:14.572359  9830 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:14.613533  9492 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.529780  9623 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.558682  9723 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.490962  9828 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:14.735895  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.653823  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:14.656365  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.736744  3972 raft_consensus.cc:2376] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20. Re-sending same reply.
I20260709 13:18:14.536725  9682 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.652021  3963 rpcz_store.cc:276] 0709 13:18:13.312447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.430560 (+118113us) service_pool.cc:224] Handling call
0709 13:18:13.475652 (+ 45092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:13.484883 (+  9231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:13.619937 (+135054us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b18003c6d60. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:18:13.943381 (+323444us) log.cc:844] Serialized 14 byte log entry
0709 13:18:14.324209 (+380828us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.334883 (+ 10674us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.335047 (+   164us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:14.335081 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.335145 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.562608 (+227463us) raft_consensus.cc:1685] finished
0709 13:18:14.562712 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.562847 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30371,"prepare.queue_time_us":549221,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":4905,"raft.queue_time_us":11395,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":15140,"spinlock_wait_cycles":13151616,"thread_start_us":664576,"threads_started":2,"wal-append.queue_time_us":512431}
I20260709 13:18:14.660914  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.655541  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:14.739928  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 84465.2us
W20260709 13:18:14.683988  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 190888us
I20260709 13:18:14.641896  9722 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.643988  9367 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:14.745702  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:14.628805  9721 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:14.687628  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:14.540558  9795 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.687765  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.901425  4043 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.688534  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:14.902227  4045 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:14.683380  9601 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:14.705118  3868 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 14, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 14 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:14.683845  9657 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.706008  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:14.618794  9655 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.710357  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.551684  9815 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:14.685642  9827 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.713407  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:14.717859  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:14.646513  9631 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.688907  9662 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:14.723251  4046 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:18:14.704407  9718 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:14.725425  4112 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [17.9-19.10]
I20260709 13:18:14.725471  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.726859  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:14.730804  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:14.731770  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:14.732282  3965 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:14.732908  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.733201  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:14.707557  9200 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:14.629973  9731 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.647166  9688 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:14.855649  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 113412us
I20260709 13:18:14.793028  4121 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:14.877394  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 131642us
I20260709 13:18:14.799585  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.798321  9682 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:14.793190  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.733630  9492 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.735381  9370 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:14.782467  9857 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:18:14.785450  9863 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:14.725108  9724 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:14.800985  9367 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.726553  9823 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:14.800045  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.863305  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:14.724875  9830 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:14.797243  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:14.745633  9722 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.801143  9751 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.729454  9708 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.974478  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:14.976020  3972 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:14.789397  9861 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:18:14.798683  9794 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.880328  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3533) took 1271 ms. Trace:
I20260709 13:18:14.854351  9737 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:14.909225  3868 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:14.926155  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:14.901628  3971 raft_consensus.cc:2376] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14. Re-sending same reply.
I20260709 13:18:15.009007  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3426) took 1211 ms. Trace:
I20260709 13:18:15.009366  3971 rpcz_store.cc:276] 0709 13:18:13.797135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.650151 (+853016us) service_pool.cc:224] Handling call
0709 13:18:15.008932 (+358781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.931919  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3418) took 1160 ms. Trace:
I20260709 13:18:14.849011  9393 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:14.934820  4043 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:15.017921  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.018683  4043 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:15.019624  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.020434  4043 raft_consensus.cc:2410] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:14.894418  9612 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.933990  9815 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:14.952174  4044 raft_consensus.cc:2368] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:18:15.042480  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.042291  9815 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.043373  9815 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:14.952533  3963 raft_consensus.cc:2410] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:18:15.043545  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:14.951756  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3427) took 1154 ms. Trace:
I20260709 13:18:15.044500  3968 rpcz_store.cc:276] 0709 13:18:13.797377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.690093 (+892716us) service_pool.cc:224] Handling call
0709 13:18:14.951696 (+261603us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.045410  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.046132  3968 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:15.046535  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3421) took 1255 ms. Trace:
I20260709 13:18:15.046823  3968 rpcz_store.cc:276] 0709 13:18:13.791512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.045172 (+1253660us) service_pool.cc:224] Handling call
0709 13:18:15.046478 (+  1306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.047667  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.048312  3968 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:14.941654  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:14.952394  4038 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.049263  4046 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:15.050153  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.050704  4046 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:15.051438  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.051934  4046 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
W20260709 13:18:14.949142  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 231354us
I20260709 13:18:15.053186  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:15.053838  9795 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:15.054322  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:14.933524  9721 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.953524  4115 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.056869  9721 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:15.058286  9816 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 13:18:15.052677  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.060281  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.061566  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.062085  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.063098  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.063859  3968 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:15.064240  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3422) took 1272 ms. Trace:
I20260709 13:18:14.953505  4113 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:14.946157  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.044226  4044 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:15.064524  3968 rpcz_store.cc:276] 0709 13:18:13.791741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.062835 (+1271094us) service_pool.cc:224] Handling call
0709 13:18:15.064185 (+  1350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.953478  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.952672  3966 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:15.065675  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2920) took 1035 ms. Trace:
I20260709 13:18:15.065975  3966 rpcz_store.cc:276] 0709 13:18:14.030604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.799796 (+769192us) service_pool.cc:224] Handling call
0709 13:18:15.065620 (+265824us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.976598  4039 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:14.740309  9828 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:14.957198  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 157685us
W20260709 13:18:15.069180  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115775us
I20260709 13:18:15.071166  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:14.911454  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:14.983515  9830 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.974882  9677 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.985942  9492 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:14.987548  9367 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:14.956341  9723 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:14.988406  9200 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.934499  9601 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:14.990953  9718 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.991436  9618 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.077443  9838 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.058691  9816 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.945205  9865 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.957908  9731 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:14.899518  9483 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:14.957340  9688 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:14.982936  4045 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:14.991058  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:14.998136  4042 rpcz_store.cc:276] 0709 13:18:13.608843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.979725 (+370882us) service_pool.cc:224] Handling call
0709 13:18:13.980058 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.051797 (+ 71739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.051828 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.052996 (+  1168us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.233843 (+180847us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:14.233885 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.233954 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:14.880097 (+646143us) raft_consensus.cc:1685] finished
0709 13:18:14.880117 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:14.880245 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88345,"raft.queue_time_us":73944,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":145075,"threads_started":1,"wal-append.queue_time_us":290494}
I20260709 13:18:15.132711  3967 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
W20260709 13:18:15.133087  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 142121us
I20260709 13:18:14.981348  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.010366  4675 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:15.010066  3964 rpcz_store.cc:276] 0709 13:18:13.771760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.710169 (+938409us) service_pool.cc:224] Handling call
0709 13:18:14.931841 (+221672us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:14.933359  9657 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.956738  9724 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:15.024955  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.134342  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.135615  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.028434  3972 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:14.981134  9821 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:15.029474  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.136647  4119 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.029220  9470 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.031169  9810 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:14.941504  9827 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:14.981683  9823 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.037385  9722 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.044137  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 841) took 1038 ms. Trace:
I20260709 13:18:15.145587  3963 rpcz_store.cc:276] 0709 13:18:14.006079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.796967 (+790888us) service_pool.cc:224] Handling call
0709 13:18:15.044073 (+247106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.054450  9795 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:14.974761  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.068387  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.072422  4121 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:15.077610  4041 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:15.149636  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.078902  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:15.082147  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.150616  4041 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:15.087301  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.132033  9623 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.091272  4038 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:15.091929  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.086844  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:18:15.097009  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 294833us
I20260709 13:18:15.072233  9804 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:18:15.098284  4039 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:15.097289  4115 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:14.992156  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:15.104888  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.255729  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:15.079432  9662 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:14.993482  9774 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 13:18:15.017664  9737 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:15.121764  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.121307  4678 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:15.072254  9612 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.136893  3971 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:15.137140  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2919) took 1129 ms. Trace:
I20260709 13:18:15.134615  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.137763  4086 leader_election.cc:400] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
W20260709 13:18:15.137658  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 135593us
I20260709 13:18:15.118000  9185 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:15.294541  3972 rpcz_store.cc:276] 0709 13:18:14.007347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.956344 (+948997us) service_pool.cc:224] Handling call
0709 13:18:15.137084 (+180740us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.119704  9618 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.301667  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.302186  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.303318  4113 raft_consensus.cc:2368] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22.
I20260709 13:18:15.303879  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.304683  3972 raft_consensus.cc:2410] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:18:15.305094  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2914) took 1518 ms. Trace:
I20260709 13:18:15.305372  3972 rpcz_store.cc:276] 0709 13:18:13.786775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.303638 (+1516863us) service_pool.cc:224] Handling call
0709 13:18:15.305037 (+  1399us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.120719  9830 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.152696  4041 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:15.149658  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.311451  4121 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:15.311626  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3430) took 1341 ms. Trace:
I20260709 13:18:15.089128  4118 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:15.312038  3966 rpcz_store.cc:276] 0709 13:18:13.970302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.251085 (+1280783us) service_pool.cc:224] Handling call
0709 13:18:15.311559 (+ 60474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.150264  4112 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:15.153208  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:15.148835  9821 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:15.131845  9731 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:15.251346  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 172494us
I20260709 13:18:15.253326  4042 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:15.251857  4681 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:15.318318  4041 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:15.254688  9300 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:15.290915  9708 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:15.260907  3968 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.138032  9724 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:15.263315  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:15.135237  9367 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:15.288966  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.132174  9865 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.135402  9483 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.138149  9721 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
I20260709 13:18:15.141215  4043 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:15.300187  3964 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.294797  4086 leader_election.cc:403] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:18:15.140548  9393 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:15.308957  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.151352  9795 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:15.398512  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 260852us
I20260709 13:18:15.302259  3963 raft_consensus.cc:2376] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14. Re-sending same reply.
I20260709 13:18:15.122753  9200 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.314805  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.120903  9838 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:15.316392  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:15.410531  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 94254.9us
I20260709 13:18:15.405512  3971 raft_consensus.cc:2376] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15. Re-sending same reply.
I20260709 13:18:15.411793  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:15.291361  9682 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:15.156651  4679 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:15.324295  9837 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:18:15.146438  9658 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.233s
I20260709 13:18:15.379158  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.415444  3966 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:15.399250  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.261364  9623 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:15.386655  3968 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
W20260709 13:18:15.389424  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 126185us
I20260709 13:18:15.420131  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:15.260443  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:18:15.396629  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 340900us
I20260709 13:18:15.397220  3972 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:15.399905  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3436) took 1065 ms. Trace:
I20260709 13:18:15.422022  3963 rpcz_store.cc:276] 0709 13:18:14.334971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.253657 (+918686us) service_pool.cc:224] Handling call
0709 13:18:15.399845 (+146188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.422895  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:15.423060  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:15.412621  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.399562  9774 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:15.421388  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.422523  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.424423  4046 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:15.424448  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3433) took 1161 ms. Trace:
I20260709 13:18:15.427296  4046 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:18:15.427491  3963 rpcz_store.cc:276] 0709 13:18:14.263206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.422671 (+1159465us) service_pool.cc:224] Handling call
0709 13:18:15.424389 (+  1718us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.423996  3964 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:15.429129  3972 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:15.434216  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.435062  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.435568  3972 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:18:15.437537  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:15.410531  9795 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.400940  9852 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:15.435000  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:15.434216  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.415405  9367 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.417104  9393 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:15.442579  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.445784  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.421559  9683 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:15.443964  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.452631  3964 raft_consensus.cc:2410] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:18:15.453080  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2923) took 1406 ms. Trace:
I20260709 13:18:15.444734  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3439) took 1088 ms. Trace:
I20260709 13:18:15.453733  3971 rpcz_store.cc:276] 0709 13:18:14.359961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.419409 (+1059448us) service_pool.cc:224] Handling call
0709 13:18:15.444674 (+ 25265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.443838  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:15.448448  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3432) took 1204 ms. Trace:
I20260709 13:18:15.442010  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3434) took 1171 ms. Trace:
I20260709 13:18:15.455407  3972 rpcz_store.cc:276] 0709 13:18:14.270619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.431099 (+1160480us) service_pool.cc:224] Handling call
0709 13:18:15.441948 (+ 10849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.455376  3963 rpcz_store.cc:276] 0709 13:18:14.244682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.428800 (+1184118us) service_pool.cc:224] Handling call
0709 13:18:15.448390 (+ 19590us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.453460  3964 rpcz_store.cc:276] 0709 13:18:14.046417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.439758 (+1393341us) service_pool.cc:224] Handling call
0709 13:18:15.453019 (+ 13261us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:15.458262  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 387058us
I20260709 13:18:15.462584  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.466290  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 843) took 1278 ms. Trace:
I20260709 13:18:15.466392  9777 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:15.444675  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 844) took 1239 ms. Trace:
W20260709 13:18:15.469713  9850 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.757s	user 0.001s	sys 0.006s
I20260709 13:18:15.472407  3970 rpcz_store.cc:276] 0709 13:18:14.187628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.465470 (+1277842us) service_pool.cc:224] Handling call
0709 13:18:15.465788 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.465970 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.465995 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.466041 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:15.466072 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.466125 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.466230 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.433983  9872 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:15.476460  3972 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:15.424255  9829 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:18:15.496155  3971 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:15.448451  9682 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:15.476450  3968 rpcz_store.cc:276] 0709 13:18:14.205062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.065543 (+860481us) service_pool.cc:224] Handling call
0709 13:18:15.444619 (+379076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.478556  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3420) took 1687 ms. Trace:
I20260709 13:18:15.475711  9718 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:15.505059  9393 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.506141  9794 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:15.506609  9794 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.507207  4119 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:15.507625  9794 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:15.508455  9601 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:15.509084  9601 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:15.509418  9601 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:15.509753  9601 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:15.512354  9868 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260709 13:18:15.441104  9774 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:15.514493  9774 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:15.514933  4116 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:15.516330  9618 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:15.521440  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:15.501135  3966 rpcz_store.cc:276] 0709 13:18:13.791266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.444120 (+1652854us) service_pool.cc:224] Handling call
0709 13:18:15.478489 (+ 34369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.493280  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3413) took 1724 ms. Trace:
I20260709 13:18:15.445886  9870 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:15.496850  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2897) took 2157 ms. Trace:
I20260709 13:18:15.528932  3971 rpcz_store.cc:276] 0709 13:18:13.339380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.471120 (+2131740us) service_pool.cc:224] Handling call
0709 13:18:15.495808 (+ 24688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.496587 (+   779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.496791 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.450614  9683 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:15.460856  9370 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:15.442543  9876 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:15.523415  3972 rpcz_store.cc:276] 0709 13:18:13.769092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.456264 (+1687172us) service_pool.cc:224] Handling call
0709 13:18:15.456654 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.493001 (+ 36347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.493225 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.493243  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 840) took 1565 ms. Trace:
I20260709 13:18:15.528728  9879 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:15.537396  9816 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:15.474944  9544 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:18:15.541079  9370 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:15.495543  9872 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:15.568496  3970 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.14-14.14]
I20260709 13:18:15.579344  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3440) took 1216 ms. Trace:
I20260709 13:18:15.579782  3970 rpcz_store.cc:276] 0709 13:18:14.362850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.525372 (+1162522us) service_pool.cc:224] Handling call
0709 13:18:15.568268 (+ 42896us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.578997 (+ 10729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.579277 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.566852  3972 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:18:15.581727  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3442) took 1168 ms. Trace:
I20260709 13:18:15.582304  3972 rpcz_store.cc:276] 0709 13:18:14.413369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.566197 (+1152828us) service_pool.cc:224] Handling call
0709 13:18:15.566508 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.581357 (+ 14849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.581644 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.542186  9618 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:15.542651  4116 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:15.600871  4116 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:15.568240  3963 rpcz_store.cc:276] 0709 13:18:13.927851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.456874 (+1529023us) service_pool.cc:224] Handling call
0709 13:18:15.492702 (+ 35828us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.492900 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.492930 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.492976 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:15.493008 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.493060 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.493178 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:15.585510  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2783) took 1321 ms (client timeout 1623 ms). Trace:
W20260709 13:18:15.601944  4117 rpcz_store.cc:269] 0709 13:18:14.264490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.318002 (+ 53512us) service_pool.cc:224] Handling call
0709 13:18:15.585301 (+1267299us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400096d54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:15.585449 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":355572096}
I20260709 13:18:15.607473  3972 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:15.608210  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3447) took 1038 ms. Trace:
I20260709 13:18:15.608522  3972 rpcz_store.cc:276] 0709 13:18:14.569945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.589917 (+1019972us) service_pool.cc:224] Handling call
0709 13:18:15.590561 (+   644us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.607937 (+ 17376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.608156 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:15.568338  9870 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:15.603132  4116 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:15.542637  9683 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.654855  4116 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:15.569944  9879 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:15.661310  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 234340us
I20260709 13:18:15.662154  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:15.584501  9872 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:15.620932  9612 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:15.621145  9823 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:15.658460  9657 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:15.621824  9827 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:15.499682  9821 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.662544  9879 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:15.675420  9658 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:15.657548  9618 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:15.618670  9470 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:15.673430  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 253347us
I20260709 13:18:15.711882  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:15.681983  9483 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:15.716017  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 272227us
I20260709 13:18:15.717134  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:15.718655  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:15.700572  4116 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
W20260709 13:18:15.713668  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 276191us
I20260709 13:18:15.723909  4116 pending_rounds.cc:85] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 13
I20260709 13:18:15.724841  4116 pending_rounds.cc:107] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 13:18:15.725095  4116 raft_consensus.cc:2889] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:15.735790  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 293244us
I20260709 13:18:15.703873  9658 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:15.714608  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.737411  9612 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:15.742889  9612 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:15.743263  4042 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:15.737685  9483 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.745026  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.740037  9470 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.745692  9618 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:15.746297  9867 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.808s	user 0.002s	sys 0.000s
W20260709 13:18:15.746594  9871 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:18:15.746872  9295 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:15.740991  9489 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
W20260709 13:18:15.750496  9815 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.003s
I20260709 13:18:15.754599  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2803) took 1016 ms. Trace:
I20260709 13:18:15.799764  9810 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:15.811275  9810 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:15.741555  9724 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.810773  4046 rpcz_store.cc:276] 0709 13:18:14.737941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.065744 (+327803us) service_pool.cc:224] Handling call
0709 13:18:15.754278 (+688534us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54000c9c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:15.754524 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633232128}
I20260709 13:18:15.756083  9731 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:15.757578  9880 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
W20260709 13:18:15.758963  9688 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.000s
W20260709 13:18:15.761222  9875 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.336s	user 0.000s	sys 0.002s
I20260709 13:18:15.715200  9838 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:15.711897  9623 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:15.768601  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.769259  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:15.774075  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.838480  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.681380  9370 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.747972  9543 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:18:15.782393  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63806.9us
I20260709 13:18:15.743270  9612 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:15.744612  9658 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:15.802119  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77573.9us
I20260709 13:18:15.818048  9295 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:15.800907  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:15.803773  4085 leader_election.cc:336] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.739s (SENT)
I20260709 13:18:15.780265  9751 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:18:15.781555  9723 consensus_meta.cc:287] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.002s
I20260709 13:18:15.815220  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3121) took 1018 ms. Trace:
I20260709 13:18:15.879267  4118 rpcz_store.cc:276] 0709 13:18:14.796283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.313048 (+516765us) service_pool.cc:224] Handling call
0709 13:18:15.313303 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.313479 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:15.735179 (+421700us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.814243 (+ 79064us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.814720 (+   477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.814802 (+    82us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:15.814905 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.815007 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.815154 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104283,"prepare.queue_time_us":249557,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":3363,"raft.run_wall_time_us":16587,"spinlock_wait_cycles":5643008,"thread_start_us":379396,"threads_started":2,"wal-append.queue_time_us":100157}
I20260709 13:18:15.781810  9718 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:15.885164  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:15.836611  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63928.4us
I20260709 13:18:15.840626  4041 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:15.885700  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.886998  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:15.840560  4039 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:15.811638  9810 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:15.811725  9677 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:15.845780  3969 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:15.849675  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 81118.8us
W20260709 13:18:15.852689  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.911805  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:15.856917  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 156802us
I20260709 13:18:15.858392  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.858676  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.915499  4046 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:15.779892  9483 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.714644  9601 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:15.780197  9470 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.861860  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:15.873982  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:15.839141  4676 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:15.877257  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3113) took 1083 ms. Trace:
I20260709 13:18:15.836376  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:15.838980  9688 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:15.902465  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.911767  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.845017  9838 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:15.912343  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.887468  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.917277  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.844686  9543 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:15.918882  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:15.913668  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:15.921800  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.921988  4038 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:15.921820  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.874434  9623 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:15.743927  9870 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:15.929747  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67977.6us
I20260709 13:18:15.930018  3968 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:15.930790  4118 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:15.922659  9200 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:15.930498  9367 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:18:15.929739  4115 rpcz_store.cc:276] 0709 13:18:14.794324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.307904 (+513580us) service_pool.cc:224] Handling call
0709 13:18:15.308205 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.308409 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:15.650115 (+341706us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.876903 (+226788us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.876955 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:15.877016 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.877080 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.877201 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14283,"prepare.queue_time_us":167097,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3981,"thread_start_us":497440,"threads_started":2}
I20260709 13:18:15.971066  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.885768  9723 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:15.941612  4116 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:15.885963  9829 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:15.941869  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3123) took 1145 ms. Trace:
I20260709 13:18:15.942308  4039 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:15.943404  4042 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:15.946827  4679 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:18:15.943676  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 139929us
W20260709 13:18:15.980944  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 64511.3us
I20260709 13:18:15.920228  9718 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:15.990834  4112 rpcz_store.cc:276] 0709 13:18:14.796736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.319715 (+522979us) service_pool.cc:224] Handling call
0709 13:18:15.319997 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.320220 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:15.663956 (+343736us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.941500 (+277544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.941569 (+    69us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:15.941616 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.941680 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:15.941808 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156482,"prepare.queue_time_us":246613,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":6276,"raft.queue_time_us":64100,"spinlock_wait_cycles":9967488,"thread_start_us":445118,"threads_started":2}
I20260709 13:18:15.995222  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:15.977723  9828 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.000s
I20260709 13:18:15.951478  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.912381  9751 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:15.931500  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.954435  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:15.998266  4046 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:15.999219  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:15.962430  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.960259  9657 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:15.966768  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.966720  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:15.967159  4044 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:15.925593  9677 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:15.942791  9875 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:18:15.940656  9544 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.022147  9544 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.023224  9677 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:16.023418  9903 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:18:15.997207  9828 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.024204  9544 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:15.972558  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:15.939924  9492 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.026067  4115 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:16.000445  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.969224  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 459) took 1102 ms. Trace:
I20260709 13:18:16.026895  4039 raft_consensus.cc:2410] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:15.954502  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.027536  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3441) took 1623 ms. Trace:
I20260709 13:18:15.977496  9393 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:18:16.030980  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 76575.6us
I20260709 13:18:16.027954  3971 rpcz_store.cc:276] 0709 13:18:14.404580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.529753 (+1125173us) service_pool.cc:224] Handling call
0709 13:18:15.530082 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.530427 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.530454 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.530924 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.780186 (+249262us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:15.780227 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.780299 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.027324 (+247025us) raft_consensus.cc:1685] finished
0709 13:18:16.027346 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.027477 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":80,"thread_start_us":248956,"threads_started":1,"wal-append.queue_time_us":348262}
I20260709 13:18:16.004909  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.006348  4046 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:16.006373  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.010780  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.014266  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.018065  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:15.975808  9662 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:15.948639  9838 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:15.973560  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:15.977955  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.004153  4041 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:16.028950  4114 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:16.055099  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.030380  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.056113  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:15.991086  9623 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:16.041425  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:16.043635  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89282.3us
I20260709 13:18:16.047665  4038 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:16.047665  4112 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:16.013943  9657 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:16.059284  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 85792.4us
I20260709 13:18:16.060900  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:16.067574  3971 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:16.072443  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:16.072577  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 112020us
I20260709 13:18:16.060415  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.074659  4046 raft_consensus.cc:2410] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:18:16.069072  4041 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22.
I20260709 13:18:16.080675  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3119) took 1284 ms. Trace:
I20260709 13:18:16.054697  9662 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:16.084729  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.000561  9897 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:18:16.086371  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.037833  4676 rpcz_store.cc:276] 0709 13:18:14.863280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.873963 (+ 10683us) service_pool.cc:224] Handling call
0709 13:18:15.766316 (+892353us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:15.780953 (+ 14637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.940038 (+159085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.966034 (+ 25996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9674496}
I20260709 13:18:16.040999  9774 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:16.118885  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:15.976943  9295 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:16.081224  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50924us
I20260709 13:18:16.059322  9367 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:16.059345  9900 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.027563  9917 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:16.079720  9185 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:16.169006  3967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3415) took 2373 ms (client timeout 1853 ms). Trace:
W20260709 13:18:16.093854  9830 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.771s	user 0.004s	sys 0.008s
I20260709 13:18:16.079897  9682 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:18:16.070791  9751 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:16.097854  9916 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 13:18:16.237447  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 148729us
I20260709 13:18:16.095661  9544 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:16.094206  9901 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:16.241709  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3444) took 1827 ms. Trace:
I20260709 13:18:16.245651  3970 rpcz_store.cc:276] 0709 13:18:14.413909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.580712 (+1166803us) service_pool.cc:224] Handling call
0709 13:18:15.620930 (+ 40218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.621143 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:15.921630 (+300487us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.241086 (+319456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.241192 (+   106us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:16.241262 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.241457 (+   195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.241647 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":434621,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"thread_start_us":571939,"threads_started":3}
I20260709 13:18:16.110052  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.113245  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.017489  9543 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:16.144848  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.010823  9829 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.190708  4046 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:16.076869  9657 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:16.076992  9816 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:16.191648  9662 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.147641  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3438) took 1807 ms. Trace:
I20260709 13:18:16.187294  3968 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
W20260709 13:18:16.095146  9891 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:18:16.071852  9300 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:18:16.251075  9917 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:16.196702  9900 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.072006  9200 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:18:16.170693  4117 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: []
W20260709 13:18:16.196444  3967 rpcz_store.cc:269] 0709 13:18:13.769588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.388927 (+619339us) service_pool.cc:224] Handling call
0709 13:18:16.142447 (+1753520us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002599d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:16.142597 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679332608}
I20260709 13:18:16.237246  9926 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:16.096376  4121 rpcz_store.cc:276] 0709 13:18:14.795755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.312086 (+516331us) service_pool.cc:224] Handling call
0709 13:18:15.312355 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.312556 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:15.658452 (+345896us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.080334 (+421882us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.080389 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:16.080447 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.080509 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.080619 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71272,"prepare.queue_time_us":228000,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":29106,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":5577,"thread_start_us":659629,"threads_started":2}
I20260709 13:18:16.198477  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:16.142028  9876 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:16.199770  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 138956us
I20260709 13:18:16.288542  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.288888  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.188464  9827 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:18:16.256755  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.266795  9718 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.195875  9896 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:16.308209  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 229454us
I20260709 13:18:16.265084  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.284085  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.277796  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.269712  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.316272  3968 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:16.316478  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:16.317247  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.318321  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.298607  9876 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.318846  3968 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:16.319360  9829 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:16.319617  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.243680  9724 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.320130  9876 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:16.320932  9916 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:18:16.321540  9483 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.315382  4112 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:16.295114  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.320194  3968 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:16.252856  9794 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.744s	user 0.013s	sys 0.001s
I20260709 13:18:16.329090  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:16.276578  9907 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
I20260709 13:18:16.267959  9927 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:16.233271  9774 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:16.247149  9601 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.268921  3966 rpcz_store.cc:276] 0709 13:18:14.339916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.523110 (+1183194us) service_pool.cc:224] Handling call
0709 13:18:15.565925 (+ 42815us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.566138 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:15.822135 (+255997us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.147270 (+325135us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.147336 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:16.147384 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.147453 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.147579 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":425404,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":75744,"spinlock_wait_cycles":39745280,"thread_start_us":548739,"threads_started":3,"wal-append.queue_time_us":204338}
I20260709 13:18:16.248061  9731 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.326660  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:16.295420  4116 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:16.315588  9901 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.267774  9911 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:16.294143  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 95748.4us
I20260709 13:18:16.267793  9828 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:16.275516  9900 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:16.339872  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.363520  9718 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:16.381621  9612 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.002s
I20260709 13:18:16.382032  9612 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.279425  9926 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.381836  9911 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.337904  9927 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.384027  9612 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.328420  9896 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.384022  9927 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:16.386354  9896 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.330772  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:16.387176  9810 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.332082  9794 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:16.388085  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57403.3us
I20260709 13:18:16.373267  9901 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:16.389346  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.390617  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:16.341020  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45992.2us
I20260709 13:18:16.251636  9544 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.289075  9838 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.379117  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.371713  9655 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.314917  9623 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.392441  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.394971  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.410728  3966 raft_consensus.cc:2376] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17. Re-sending same reply.
W20260709 13:18:16.391191  9922 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 13:18:16.382745  9804 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.090s	user 0.007s	sys 0.004s
I20260709 13:18:16.413239  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.361955  9876 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:16.427484  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:16.389701  9901 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:16.389642  9890 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:16.441996  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47089us
I20260709 13:18:16.442955  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:16.443976  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.440570  3968 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:16.445047  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.445797  3968 raft_consensus.cc:2368] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22.
I20260709 13:18:16.446133  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.411355  9200 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:16.411484  9185 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:16.413919  9936 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.447628  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.273617  9917 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.447005  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.466892  9938 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:16.469847  9938 raft_consensus.cc:2764] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
W20260709 13:18:16.470162  9928 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:18:16.470487  9938 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:16.470844  9938 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:16.471639  9938 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.472168  9810 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:16.466977  9936 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.473295  9657 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.475113  9936 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:16.475289  9683 consensus_meta.cc:287] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.803s	user 0.006s	sys 0.002s
I20260709 13:18:16.475696  9683 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.476886  4041 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:16.389284  9662 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.477866  9544 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:16.433983  9879 consensus_meta.cc:287] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.730s	user 0.009s	sys 0.001s
I20260709 13:18:16.478950  9662 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.479701  4042 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.442301  9816 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.460246  9935 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:16.482043  9935 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.477383  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.482856  9865 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:16.483618  3937 leader_election.cc:400] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22.
I20260709 13:18:16.482558  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 842) took 2466 ms. Trace:
W20260709 13:18:16.484005  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3120) took 1688 ms (client timeout 1836 ms). Trace:
I20260709 13:18:16.481963  9816 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.478695  9879 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.449774  9774 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.484826  3964 rpcz_store.cc:276] 0709 13:18:14.015749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.457232 (+1441483us) service_pool.cc:224] Handling call
0709 13:18:15.457528 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.769252 (+311724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.769285 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:15.777149 (+  7864us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.941486 (+164337us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:15.941544 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.941647 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.482333 (+540686us) raft_consensus.cc:1685] finished
0709 13:18:16.482359 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.482496 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63171,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":443950,"threads_started":2,"wal-append.queue_time_us":673938}
I20260709 13:18:16.479692  9631 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.482474  9935 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.448510  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.488871  9879 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.489584  9879 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:16.451030  9612 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:16.449193  9300 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.489975  9879 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.497907  9879 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.499810  9927 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.501276  9942 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:16.449895  9185 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.443137  9804 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:18:16.502374  9185 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:16.503947  9926 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:16.504428  9873 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.055s	user 0.001s	sys 0.001s
I20260709 13:18:16.504791  3937 leader_election.cc:403] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:18:16.489503  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:16.481045  9795 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.034s	user 0.008s	sys 0.004s
W20260709 13:18:16.484421  4114 rpcz_store.cc:269] 0709 13:18:14.796005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.974646 (+178641us) service_pool.cc:224] Handling call
0709 13:18:16.483850 (+1509204us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540034e754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:16.483951 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779429632}
I20260709 13:18:16.506559  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.436264  9718 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:16.450088  9200 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.475630  9657 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.458542  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.492214  9612 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:16.450047  9731 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:18:16.513629  9938 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.525063  9731 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:16.525405  9731 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:16.526141  9731 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.527437  9731 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.521799  9200 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:16.515399  9804 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:18:16.513427  9926 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:16.532546  3967 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:16.534065  9927 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.515170  9838 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:16.515475  3964 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:16.508272  9922 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:16.510516  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.491349  9816 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.524230  9612 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:16.543385  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.551960  3968 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:16.545480  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3534) took 1893 ms. Trace:
I20260709 13:18:16.552467  4047 rpcz_store.cc:276] 0709 13:18:14.651954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.683339 (+ 31385us) service_pool.cc:224] Handling call
0709 13:18:14.707895 (+ 24556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:14.951654 (+243759us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:14.987165 (+ 35511us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.457867 (+470702us) log.cc:844] Serialized 14 byte log entry
0709 13:18:15.469321 (+ 11454us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.469402 (+    81us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:15.469485 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.760690 (+291205us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:16.545234 (+784544us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54003dbb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:16.545289 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.545417 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109395,"prepare.queue_time_us":407470,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":1784,"raft.queue_time_us":106824,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":37712,"spinlock_wait_cycles":565533696,"thread_start_us":371300,"threads_started":2,"wal-append.queue_time_us":397581}
I20260709 13:18:16.559213  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.559899  3964 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:16.562155  9658 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.000s
I20260709 13:18:16.562582  9658 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.567075  9722 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:16.569753  9185 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.571007  9794 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:16.572265  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61823.7us
I20260709 13:18:16.573122  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.574453  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.575150  9936 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:16.575878  9936 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.576709  9936 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:16.578902  9185 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.581281  4047 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:16.582686  4047 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:16.516551  9795 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.585808  9935 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.586827  9795 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.587611  3966 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.588023  9935 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.569758  9683 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:16.602680  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.601811  9901 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:16.605654  9737 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:16.606917  9901 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:16.564548  9658 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.617455  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:16.639137  3965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3424) took 2846 ms (client timeout 1739 ms). Trace:
W20260709 13:18:16.631088  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2922) took 2585 ms (client timeout 1678 ms). Trace:
I20260709 13:18:16.624002  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3103) took 1900 ms. Trace:
I20260709 13:18:16.636597  9543 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:18:16.644237  3969 rpcz_store.cc:269] 0709 13:18:14.046137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.522779 (+476642us) service_pool.cc:224] Handling call
0709 13:18:16.630777 (+2107998us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400407ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:16.630983 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2782798208}
W20260709 13:18:16.644738  9866 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 1.707s	user 0.011s	sys 0.000s
I20260709 13:18:16.646193  3969 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:16.642680  3965 rpcz_store.cc:269] 0709 13:18:13.796557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.370035 (+573478us) service_pool.cc:224] Handling call
0709 13:18:16.638977 (+2268942us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540044cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:16.639071 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":631811456}
I20260709 13:18:16.637578  9200 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.649564  3965 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:16.641608  4047 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:16.651301  9200 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.652245  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.643630  4120 rpcz_store.cc:276] 0709 13:18:14.723593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.723702 (+   109us) service_pool.cc:224] Handling call
0709 13:18:14.724715 (+  1013us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.725069 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:14.725098 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.725520 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:18:15.119767 (+394247us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:15.119812 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:15.119889 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.623030 (+1503141us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b24003a20f8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed731e59c4 00007fed731e3acb 00007fed7339edc9 00007fed7339ea55 00007fed7339dfb0 00007fed76014488 00007fed76014be8 00007fed75fec398 00007fed75fe776a 00007fed75fe6bb6
0709 13:18:16.623710 (+   680us) raft_consensus.cc:1685] finished
0709 13:18:16.623731 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.623941 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2518,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6171,"spinlock_wait_cycles":4811136,"thread_start_us":246344,"threads_started":1,"wal-append.queue_time_us":749597}
I20260709 13:18:16.627027  9911 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.653584  9470 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.653129  4047 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:18:16.655133  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.658608  4047 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:16.661043  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 224822us
I20260709 13:18:16.661628  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3548) took 1935 ms. Trace:
I20260709 13:18:16.661975  4043 rpcz_store.cc:276] 0709 13:18:14.726211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.135787 (+409576us) service_pool.cc:224] Handling call
0709 13:18:15.136104 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.389634 (+253530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.661424 (+1271790us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b540003b954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:16.661573 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11355904}
I20260709 13:18:16.663019  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.663857  4043 raft_consensus.cc:2368] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19.
I20260709 13:18:16.664131  3970 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:16.664912  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.638226  9612 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.665603  4043 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:16.666719  4117 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:16.666832  9612 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.667369  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.668399  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.668984  9393 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:16.669591  4043 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:16.681046  9393 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.681339  9719 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:16.681922  9719 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.683643  4683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 460) took 1820 ms. Trace:
I20260709 13:18:16.684270  9719 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:16.685721  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:16.669842  3968 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:16.681030  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3115) took 1886 ms (client timeout 2076 ms). Trace:
I20260709 13:18:16.688159  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53318 (request call id 428) took 2282 ms. Trace:
I20260709 13:18:16.688627  4682 rpcz_store.cc:276] 0709 13:18:14.405698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.406285 (+   587us) service_pool.cc:224] Handling call
0709 13:18:14.426280 (+ 19995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:14.426729 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:14.426757 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:14.450697 (+ 23940us) log.cc:844] Serialized 26 byte log entry
0709 13:18:14.713976 (+263279us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:14.714018 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:14.714110 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:16.644448 (+1930338us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b2400349808. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed731e59c4 00007fed731e3acb 00007fed7339edc9 00007fed7339ea55 00007fed7339e09d 00007fed75fd010e 00007fed75fe788c 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221
0709 13:18:16.687823 (+ 43375us) raft_consensus.cc:1685] finished
0709 13:18:16.687847 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.688079 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8839,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":13266,"spinlock_wait_cycles":7780224,"thread_start_us":208608,"threads_started":1,"wal-append.queue_time_us":440211}
W20260709 13:18:16.688509  4113 rpcz_store.cc:269] 0709 13:18:14.794801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.081869 (+287068us) service_pool.cc:224] Handling call
0709 13:18:16.680850 (+1598981us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002ab7d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:16.680970 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328034048}
W20260709 13:18:16.691906  9872 consensus_meta.cc:287] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.015s	user 0.007s	sys 0.006s
I20260709 13:18:16.692370  9872 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.694433  9393 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:16.670652  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.684008  4683 rpcz_store.cc:276] 0709 13:18:14.863578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.863713 (+   135us) service_pool.cc:224] Handling call
0709 13:18:14.871842 (+  8129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.132695 (+260853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:15.132724 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:15.132783 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:15.132812 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.683422 (+1550610us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54005618d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:16.683468 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.683588 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599404928}
I20260709 13:18:16.674437  4041 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:16.668599  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.677307  4039 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:16.721680  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 104327us
I20260709 13:18:16.722273  4118 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:16.722533  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:16.723546  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 271216us
I20260709 13:18:16.672576  9688 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:16.687286  9823 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:16.713919  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3544) took 1994 ms. Trace:
I20260709 13:18:16.734927  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.737032  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.677896  3964 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:16.713382  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.724512  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.729985  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.730855  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.731571  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.731840  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.744241  4115 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:18:16.732219  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.744547  4114 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:16.744410  4121 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:16.746035  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:16.750207  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 81663.2us
I20260709 13:18:16.733208  4044 rpcz_store.cc:276] 0709 13:18:14.719869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.092576 (+372707us) service_pool.cc:224] Handling call
0709 13:18:15.119067 (+ 26491us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.010698 (+891631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.713677 (+702979us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540011a8d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:16.713866 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949831552}
I20260709 13:18:16.757012  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.759565  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.760079  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:16.766256  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3525) took 3261 ms. Trace:
I20260709 13:18:16.769321  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3451) took 1472 ms. Trace:
I20260709 13:18:16.769795  3963 rpcz_store.cc:276] 0709 13:18:15.297389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.659085 (+361696us) service_pool.cc:224] Handling call
0709 13:18:15.675859 (+ 16774us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.676089 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:15.922216 (+246127us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.768485 (+846269us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18003c4e40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf 00007fed76466038
0709 13:18:16.768748 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.768977 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.769034 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:16.769083 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.769153 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.769264 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39239,"prepare.queue_time_us":404511,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":166578,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":4542,"spinlock_wait_cycles":6926720,"thread_start_us":512078,"threads_started":3,"wal-append.queue_time_us":521255}
I20260709 13:18:16.757220  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.760776  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.761600  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.762738  9731 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:16.763286  9723 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:16.763792  9926 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22.
I20260709 13:18:16.755779  9612 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.765355  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.724606  9543 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:16.776813  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.777871  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.778604  3968 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:16.778247  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.779448  4043 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.779683  4041 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:16.775964  4120 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:16.781955  4011 leader_election.cc:400] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22.
I20260709 13:18:16.780542  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.782510  4011 leader_election.cc:403] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:18:16.782913  3964 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:16.783875  4011 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:16.784852  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.732748  9724 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:16.766655  4040 rpcz_store.cc:276] 0709 13:18:13.505050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:13.752859 (+247809us) service_pool.cc:224] Handling call
0709 13:18:13.753163 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:15.521043 (+1767880us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:15.812960 (+291917us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.012973 (+200013us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.013191 (+   218us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:16.013339 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.766016 (+752677us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54001199d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:16.766062 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.766190 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28858,"prepare.queue_time_us":193274,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":33919,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":24992,"spinlock_wait_cycles":4064852864,"thread_start_us":457514,"threads_started":2,"wal-append.queue_time_us":424190}
I20260709 13:18:16.786175  3968 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.788117  9683 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:16.788476  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.789871  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.790581  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.790612  4041 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.786342  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.793305  4121 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:16.794577  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.746384  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:16.796605  4040 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.716109  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.772571  9911 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:16.798488  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.798166  4047 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:16.801944  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:16.784217  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.803472  4043 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:16.804359  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.775454  9950 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:16.789436  9723 consensus_queue.cc:1243] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:16.786391  9200 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:16.810731  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.786702  9688 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:16.811313  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.817545  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2935) took 1013 ms. Trace:
I20260709 13:18:16.831066  3966 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:16.830847  3970 rpcz_store.cc:276] 0709 13:18:15.804319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.247022 (+442703us) service_pool.cc:224] Handling call
0709 13:18:16.807972 (+560950us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001caa54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:16.817476 (+  9504us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840749312}
I20260709 13:18:16.804628  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.822724  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.822999  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.822961  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.833873  4117 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.830571  4041 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.835186  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.796420  9544 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:16.841387  4679 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12. Ops: []
I20260709 13:18:16.841928  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.812561  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.842722  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.830449  4120 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:18:16.843333  4120 pending_rounds.cc:85] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 7
I20260709 13:18:16.832864  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.810748  9950 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.852725  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.798612  9731 consensus_queue.cc:1243] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 15.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:18:16.857568  4086 leader_election.cc:400] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19.
W20260709 13:18:16.826669  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80375.6us
W20260709 13:18:16.826092  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.857914  4086 leader_election.cc:403] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:16.843592  4120 pending_rounds.cc:107] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:18:16.860988  4120 raft_consensus.cc:2889] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:16.862156  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.843653  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:16.844622  4044 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.844830  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:16.845355  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 289577us
I20260709 13:18:16.851677  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:16.852842  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:16.867246  4085 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 1.943s (SENT)
I20260709 13:18:16.867743  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.856133  3968 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:16.805948  9823 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:16.869876  4120 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:16.870141  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:16.873625  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.877228  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.798291  9683 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:18:16.798647  9730 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:18:16.868615  9823 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:16.880115  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.879303  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.896399  4117 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:16.876688  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.896584  3938 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.880865  4119 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:16.829262  9185 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:16.830214  9901 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:16.879315  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 85159.6us
I20260709 13:18:16.869057  9612 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:16.869489  9367 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:18:16.888890  9470 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:16.889382  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.889981  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.890746  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:16.999858  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:16.890915  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:16.881386  9731 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.838971  9915 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
W20260709 13:18:16.893420  9952 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:16.899309  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.840449  9911 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:16.843978  9544 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:16.902004  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2821) took 1049 ms. Trace:
I20260709 13:18:16.906620  9941 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:16.905370  4085 leader_election.cc:336] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 2.177s (SENT)
W20260709 13:18:17.029755  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 124411us
W20260709 13:18:16.978179  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:16.852264  9688 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:16.869642  9722 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:16.906113  4041 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:17.039126  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:16.985893  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.858577  9950 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:17.041384  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55597.2us
I20260709 13:18:17.042117  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:16.995398  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:17.043398  3968 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:17.044278  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:17.045692  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.000334  4044 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:16.891798  4012 leader_election.cc:400] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22.
I20260709 13:18:16.881716  9926 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:17.002909  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 112067us
I20260709 13:18:16.902367  9823 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:16.900478  9794 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:16.905825  9927 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:16.901201  9708 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.015269  4121 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:17.009086  9864 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:16.978770  9185 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:16.879657  9723 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:18:17.026389  4046 rpcz_store.cc:276] 0709 13:18:15.852287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.267905 (+415618us) service_pool.cc:224] Handling call
0709 13:18:16.268183 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.268399 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:16.314779 (+ 46380us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.612453 (+297674us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b18002557c0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:18:16.901505 (+289052us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:16.901582 (+    77us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:16.901633 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.901795 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:16.901937 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32369,"prepare.queue_time_us":46234,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4540,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":20300,"spinlock_wait_cycles":18996992,"thread_start_us":288768,"threads_started":1}
W20260709 13:18:17.047974  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 156310us
I20260709 13:18:16.980054  9828 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:17.027772  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:17.035486  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 136242us
W20260709 13:18:17.046840  9879 consensus_meta.cc:287] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.003s
I20260709 13:18:17.032275  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2947) took 1098 ms. Trace:
I20260709 13:18:16.998471  9470 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.032186  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:17.046602  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:17.009322  9935 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:17.049289  3968 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:17.079214  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:17.079921  3970 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 11.
I20260709 13:18:17.081562  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:17.054286  9838 consensus_meta.cc:287] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.004s
I20260709 13:18:17.058247  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:17.028231  9544 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.061501  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:16.903774  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:17.030422  9815 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:17.064491  3972 rpcz_store.cc:276] 0709 13:18:15.933385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.659883 (+726498us) service_pool.cc:224] Handling call
0709 13:18:16.660136 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.660311 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:16.842177 (+181866us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.031949 (+189772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.032001 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:17.032043 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.032106 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.032217 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151277,"prepare.queue_time_us":319083,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":77,"raft.queue_time_us":95,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":13134,"thread_start_us":189437,"threads_started":1}
I20260709 13:18:17.057296  9927 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.106014  9927 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.106566  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:17.107272  4120 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:17.036998  9941 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.114542  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:17.043042  9917 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.060415  9864 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:17.122269  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60849.1us
I20260709 13:18:17.070228  4046 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:17.065080  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:17.036625  9724 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:17.075709  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:17.073804  9470 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:17.053609  9655 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:17.055049  9915 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:17.138403  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:17.139053  3967 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:17.087113  4117 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:17.088914  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:16.998550  9901 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.089247  4121 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:17.806229  9393 consensus_meta.cc:287] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.111s	user 0.008s	sys 0.012s
W20260709 13:18:17.184407  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 142359us
I20260709 13:18:17.807040  9393 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:17.137807  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72786.5us
I20260709 13:18:17.809111  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:17.137699  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2941) took 1287 ms. Trace:
I20260709 13:18:17.811053  9393 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:17.812655  9393 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.811261  3969 rpcz_store.cc:276] 0709 13:18:15.850072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.655634 (+805562us) service_pool.cc:224] Handling call
0709 13:18:16.655915 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.656125 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:16.811785 (+155660us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.137289 (+325504us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.137341 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:17.137397 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.137544 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.137643 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155332,"prepare.queue_time_us":249813,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":13580,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":41572,"thread_start_us":313069,"threads_started":1}
I20260709 13:18:17.780043  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:17.814620  9185 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:17.814857  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:17.123088  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:17.815388  9185 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:17.795321  4041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.022s	sys 0.021s
W20260709 13:18:17.801107  4084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.008s	sys 0.008s
I20260709 13:18:17.063308  9640 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 13:18:17.802110  3967 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.662s	user 0.007s	sys 0.007s
W20260709 13:18:17.802055  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.002s	sys 0.015s
I20260709 13:18:17.140074  3972 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:17.802888  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:17.116847  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2799) took 1226 ms. Trace:
I20260709 13:18:17.102089  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3124) took 2241 ms. Trace:
I20260709 13:18:17.264391  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:17.102983  9366 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:17.048976  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2940) took 1199 ms. Trace:
I20260709 13:18:17.907464  9901 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:17.908077  3965 rpcz_store.cc:276] 0709 13:18:15.849670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.650296 (+800626us) service_pool.cc:224] Handling call
0709 13:18:16.650582 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.650776 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:16.810133 (+159357us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.048474 (+238341us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.048639 (+   165us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.048682 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:17.048723 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.048810 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.048925 (+   115us) inbound_call.cc:177] Queueing success response
0709 13:18:17.104138 (+ 55213us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b18004338a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f
0709 13:18:17.104857 (+   719us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
Metrics: {"mutex_wait_us":238669,"prepare.queue_time_us":194251,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":69,"raft.queue_time_us":2424,"raft.run_cpu_time_us":2072,"raft.run_wall_time_us":60686,"spinlock_wait_cycles":37173632,"thread_start_us":234621,"threads_started":1}
I20260709 13:18:17.911378  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:17.911547  9200 consensus_meta.cc:287] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.026s	user 0.004s	sys 0.043s
I20260709 13:18:17.912361  3965 raft_consensus.cc:2393] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:17.150378  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:17.095851  9483 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:17.059705  9489 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:18:17.913664  3970 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:17.914498  9489 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:17.915324  9489 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:17.062813  9618 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:18:17.036654  9623 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.801581  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.006s
W20260709 13:18:17.917514  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.006s	sys 0.006s
I20260709 13:18:17.918252  9618 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:17.918844  9618 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:17.145351  9655 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:17.095126  9688 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.132177  9657 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:17.124557  9828 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:17.921936  9828 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.922271  9655 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:17.922407  9828 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:17.182950  9718 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.135455  9864 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.950336  9976 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.951364  9976 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:17.085069  9821 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:17.953334  9821 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:17.953925  9821 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.058360  9865 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:18:17.897408  9543 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:18:17.958186  9865 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:17.958598  9543 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:17.958766  9655 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:17.959527  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:17.959785  9543 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.066475  9870 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:17.961185  9870 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:17.916980  9489 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.082799  9872 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:17.962826  9870 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.963935  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3572) took 1306 ms. Trace:
I20260709 13:18:17.076416  9879 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.094075  9911 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:17.964460  4042 rpcz_store.cc:276] 0709 13:18:16.657223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.675516 (+ 18293us) service_pool.cc:224] Handling call
0709 13:18:16.675849 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.676206 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.676230 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.676683 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.028479 (+351796us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:17.028525 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.028593 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.963407 (+934814us) raft_consensus.cc:1685] finished
0709 13:18:17.963457 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.963688 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25047,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87,"thread_start_us":351473,"threads_started":1,"wal-append.queue_time_us":1255868}
W20260709 13:18:17.233073  9919 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:17.077780  9926 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.971407  3963 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:17.972874  3970 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:17.973642  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2959) took 1216 ms. Trace:
I20260709 13:18:17.974058  3970 rpcz_store.cc:276] 0709 13:18:16.756865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.123718 (+366853us) service_pool.cc:224] Handling call
0709 13:18:17.973551 (+849833us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.975572  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:17.976416  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3464) took 1109 ms. Trace:
W20260709 13:18:17.110028  9947 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:18:17.105315  9953 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:18:17.971309  9926 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:17.959787  9655 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.983687  9655 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:17.985420  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3561) took 2141 ms. Trace:
I20260709 13:18:17.958628  9865 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:17.985853  4038 rpcz_store.cc:276] 0709 13:18:15.843438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.065838 (+222400us) service_pool.cc:224] Handling call
0709 13:18:16.066174 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:16.073487 (+  7313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.073521 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:16.085708 (+ 12187us) log.cc:844] Serialized 52 byte log entry
0709 13:18:16.522008 (+436300us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:16.549573 (+ 27565us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.549837 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.549913 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.984900 (+1434987us) raft_consensus.cc:1685] finished
0709 13:18:17.984944 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.985191 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6852,"prepare.queue_time_us":55202,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":14669,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":16602,"thread_start_us":346332,"threads_started":1,"wal-append.queue_time_us":756768}
W20260709 13:18:17.217959  9959 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:18:17.987582  9865 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.989670  9865 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:17.990043  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 469) took 1595 ms. Trace:
I20260709 13:18:17.990504  4676 rpcz_store.cc:276] 0709 13:18:16.394603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.394711 (+   108us) service_pool.cc:224] Handling call
0709 13:18:16.395061 (+   350us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:16.406038 (+ 10977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.406070 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:16.406651 (+   581us) log.cc:844] Serialized 52 byte log entry
0709 13:18:16.713254 (+306603us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:16.713300 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:16.713378 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.989620 (+1276242us) raft_consensus.cc:1685] finished
0709 13:18:17.989653 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.989838 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10841,"raft.queue_time_us":16096,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":9449,"thread_start_us":261682,"threads_started":1,"wal-append.queue_time_us":404819}
W20260709 13:18:17.824119  4084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.008s	sys 0.008s
I20260709 13:18:17.995496  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3149) took 1113 ms. Trace:
W20260709 13:18:17.995834  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:17.829674  4041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.022s	sys 0.022s
I20260709 13:18:17.816363  9185 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:17.997713  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 507) took 1260 ms. Trace:
I20260709 13:18:17.998788  9185 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:17.998077  4041 rpcz_store.cc:276] 0709 13:18:16.736821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.039955 (+303134us) service_pool.cc:224] Handling call
0709 13:18:17.040235 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.040440 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:17.040734 (+   294us) log.cc:844] Serialized 14 byte log entry
0709 13:18:17.997134 (+956400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.997234 (+   100us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:17.997298 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.997433 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.997621 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":174,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":953566,"threads_started":1,"wal-append.queue_time_us":855026}
I20260709 13:18:17.844481  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:17.844777  9751 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:17.846024  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 722834us
I20260709 13:18:17.976529  9879 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:17.846686  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.002s	sys 0.015s
I20260709 13:18:18.001139  9751 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:17.855880  9984 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.002104  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:17.996652  9901 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:18.003768  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.004258  9185 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:17.870528  9544 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.744s	user 0.018s	sys 0.018s
I20260709 13:18:18.004312  9901 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.005853  9677 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.002648  9751 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:18.006842  9722 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.957s	user 0.009s	sys 0.014s
I20260709 13:18:17.888368  4118 rpcz_store.cc:276] 0709 13:18:15.890522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.047759 (+157237us) service_pool.cc:224] Handling call
0709 13:18:16.048081 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.722766 (+674685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.116597 (+393831us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b540026b6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:17.116781 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549975424}
I20260709 13:18:18.007409  9722 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:17.906291  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:18.002614  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 944352us
I20260709 13:18:18.008558  3971 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.009147  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3459) took 1143 ms. Trace:
I20260709 13:18:17.906951  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3474) took 1018 ms. Trace:
I20260709 13:18:17.917773  9623 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.009421  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3150) took 1127 ms. Trace:
I20260709 13:18:18.009898  4118 rpcz_store.cc:276] 0709 13:18:16.881937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.008194 (+1126257us) service_pool.cc:224] Handling call
0709 13:18:18.008700 (+   506us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.009057 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.009085 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.009145 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:18.009174 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.009227 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.009362 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.010592  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.011454  9623 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:17.122007  9838 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:17.888293  4119 rpcz_store.cc:276] 0709 13:18:14.860800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.507950 (+647150us) service_pool.cc:224] Handling call
0709 13:18:15.508253 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.897858 (+1389605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.101847 (+203989us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400207bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:17.102030 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3156138880}
I20260709 13:18:18.009461  3971 rpcz_store.cc:276] 0709 13:18:16.865581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.898301 (+1032720us) service_pool.cc:224] Handling call
0709 13:18:18.009060 (+110759us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:17.919309  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 843600us
I20260709 13:18:17.912253  9200 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22.
I20260709 13:18:18.015005  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.015901  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3462) took 1149 ms. Trace:
I20260709 13:18:18.016666  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:17.945715  9366 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:18.032632  9483 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:17.920516  9618 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:17.949239  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3545) took 3229 ms. Trace:
I20260709 13:18:17.960582  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:17.952126  9976 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.034152  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3463) took 1167 ms. Trace:
I20260709 13:18:18.034556  3965 rpcz_store.cc:276] 0709 13:18:16.866753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.960056 (+1093303us) service_pool.cc:224] Handling call
0709 13:18:18.034086 (+ 74030us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.035066  9489 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.035727  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:17.967371  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 158915us
I20260709 13:18:17.087092  9935 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.036484  9976 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.036746  3965 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.044164  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3469) took 1173 ms. Trace:
I20260709 13:18:18.044476  3965 rpcz_store.cc:276] 0709 13:18:16.870618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.035298 (+1164680us) service_pool.cc:224] Handling call
0709 13:18:18.044102 (+  8804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.045192  9976 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.045526  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.033110  9543 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.045977  9976 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.003206  9984 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.033164  9366 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:17.862629  9950 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.821s	user 0.016s	sys 0.003s
I20260709 13:18:18.048509  9366 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:17.893934  4113 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:17.905877  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67004.1us
I20260709 13:18:18.048986  9976 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.049824  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.051479  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.039315  4121 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:18.039372  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3557) took 2214 ms. Trace:
I20260709 13:18:18.048950  9950 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.037436  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.056149  9950 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.037932  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3457) took 1173 ms. Trace:
I20260709 13:18:18.038102  4044 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 15 index: 7. (index mismatch)
I20260709 13:18:18.057224  3963 rpcz_store.cc:276] 0709 13:18:16.864854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.114248 (+249394us) service_pool.cc:224] Handling call
0709 13:18:18.037702 (+923454us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400277c54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.037873 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952252800}
I20260709 13:18:18.043201  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.059149  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.002880  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3135) took 1716 ms. Trace:
I20260709 13:18:17.945176  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2813) took 1075 ms. Trace:
I20260709 13:18:18.059968  4120 rpcz_store.cc:276] 0709 13:18:16.869468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.107846 (+238378us) service_pool.cc:224] Handling call
0709 13:18:17.944828 (+836982us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.016116  3972 rpcz_store.cc:276] 0709 13:18:16.871859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.088646 (+216787us) service_pool.cc:224] Handling call
0709 13:18:17.886723 (+798077us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.061650  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.062588  3972 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.063104  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2957) took 1310 ms. Trace:
I20260709 13:18:18.063436  3972 rpcz_store.cc:276] 0709 13:18:16.753095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.061202 (+1308107us) service_pool.cc:224] Handling call
0709 13:18:18.063038 (+  1836us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:17.868610  3967 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:18.069989  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.070673  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2958) took 1316 ms. Trace:
W20260709 13:18:18.071292  9971 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.207s	user 0.004s	sys 0.000s
I20260709 13:18:18.007855  4117 rpcz_store.cc:276] 0709 13:18:16.881681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.993706 (+1112025us) service_pool.cc:224] Handling call
0709 13:18:17.994488 (+   782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:17.994886 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:17.994920 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:17.994993 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:17.995032 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.995099 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.995245 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.071583  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.054077  4039 rpcz_store.cc:276] 0709 13:18:15.824725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.063186 (+238461us) service_pool.cc:224] Handling call
0709 13:18:16.677141 (+613955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:16.719882 (+ 42741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.038969 (+1319087us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540035d9d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.039198 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1411349248}
I20260709 13:18:18.072014  3963 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.073717  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3470) took 1202 ms. Trace:
I20260709 13:18:18.073992  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:18.074826  9722 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:18.075229  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58738.6us
I20260709 13:18:18.075748  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:18.016870  9470 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.870s	user 0.009s	sys 0.013s
I20260709 13:18:18.077087  9470 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.079388  9470 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.006863  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:18.024206  9719 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:18.080809  3964 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:18.080524  9719 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.025044  9730 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:18.071863  9185 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.081642  9730 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.081933  9185 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.084065  9730 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.025833  9370 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.071169  3972 raft_consensus.cc:2410] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 21 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 13:18:18.026002  9901 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.023097  3971 rpcz_store.cc:276] 0709 13:18:16.866395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.014502 (+1148107us) service_pool.cc:224] Handling call
0709 13:18:18.015844 (+  1342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.027259  9941 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.029580  9977 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.030442  9926 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.084739  9185 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:18.006137  9927 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.900s	user 0.011s	sys 0.014s
I20260709 13:18:18.081455  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 852) took 1531 ms. Trace:
I20260709 13:18:18.105675  9977 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.031530  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.106395  9927 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.059894  4112 rpcz_store.cc:276] 0709 13:18:16.286158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.324154 (+ 37996us) service_pool.cc:224] Handling call
0709 13:18:16.324416 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:16.324794 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:16.324826 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:16.325312 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:18:16.640032 (+314720us) spinlock_profiling.cc:243] Waited 7.2 ms on lock 0x7b1800317140. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:18:17.125306 (+485274us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:17.125347 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.125412 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.002342 (+876930us) raft_consensus.cc:1685] finished
0709 13:18:18.002383 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.002700 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7286,"spinlock_wait_cycles":16560000,"thread_start_us":485105,"threads_started":1,"wal-append.queue_time_us":1651105}
I20260709 13:18:18.088218  3963 rpcz_store.cc:276] 0709 13:18:16.870884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.058769 (+1187885us) service_pool.cc:224] Handling call
0709 13:18:18.073651 (+ 14882us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.109244  9927 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.110096  9927 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:18.110827  9927 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:17.964488  9870 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:18.121233  9927 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:18.121795  9927 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:18.122388  9926 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.122970  9927 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.106583  3964 rpcz_store.cc:276] 0709 13:18:16.550498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.080028 (+1529530us) service_pool.cc:224] Handling call
0709 13:18:18.080474 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.081217 (+   743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.081388 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.046386  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3468) took 1177 ms. Trace:
I20260709 13:18:18.126402  3965 rpcz_store.cc:276] 0709 13:18:16.870325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.045142 (+1174817us) service_pool.cc:224] Handling call
0709 13:18:18.046320 (+  1178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.047297  9830 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.005604  9544 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.064293  9915 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:18.012494  9737 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:18.141430  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.033594  4045 rpcz_store.cc:276] 0709 13:18:14.720093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.132688 (+412595us) service_pool.cc:224] Handling call
0709 13:18:15.144381 (+ 11693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:15.144743 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:15.253846 (+109103us) log.cc:844] Serialized 14 byte log entry
0709 13:18:16.529688 (+1275842us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b1800017ce0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:16.770492 (+240804us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800017ce0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:18:17.085288 (+314796us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:17.085765 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:18:17.085900 (+   135us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:17.085930 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:17.086037 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:17.925463 (+839426us) raft_consensus.cc:1685] finished
0709 13:18:17.932647 (+  7184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:17.949009 (+ 16362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21338,"prepare.queue_time_us":108927,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":2899,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":19674,"spinlock_wait_cycles":110583296,"thread_start_us":295488,"threads_started":1,"wal-append.queue_time_us":2603292}
I20260709 13:18:18.095227  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:18.066366  9879 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.033174  9483 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.038990  9935 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:18.031056  3966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2936) took 2226 ms (client timeout 2039 ms). Trace:
I20260709 13:18:18.043496  9618 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.066567  9890 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.048432  9984 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.057279  4115 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:18.146548  3966 rpcz_store.cc:269] 0709 13:18:15.804578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.443730 (+639152us) service_pool.cc:224] Handling call
0709 13:18:18.030695 (+1586965us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400278154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.030859 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":328962304}
I20260709 13:18:18.071077  3967 rpcz_store.cc:276] 0709 13:18:16.754694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.138117 (+383423us) service_pool.cc:224] Handling call
0709 13:18:18.070578 (+932461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.006348  9677 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:18.159494  9677 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.160143  9708 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.097s	user 0.016s	sys 0.027s
I20260709 13:18:18.076541  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3575) took 1217 ms. Trace:
I20260709 13:18:18.081099  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3151) took 1194 ms. Trace:
I20260709 13:18:18.105278  9941 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.160720  9708 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19.
W20260709 13:18:18.080932  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74293.6us
I20260709 13:18:18.160806  4044 rpcz_store.cc:276] 0709 13:18:16.859411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.073949 (+214538us) service_pool.cc:224] Handling call
0709 13:18:17.081461 (+  7512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.058385 (+976924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.076252 (+ 17867us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54000b8e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:18.076483 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198444800}
I20260709 13:18:18.162297  4043 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:18.163082  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:18.112013  3970 rpcz_store.cc:276] 0709 13:18:16.867523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.975197 (+1107674us) service_pool.cc:224] Handling call
0709 13:18:17.976344 (+  1147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:18.113217  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 85077.9us
I20260709 13:18:18.165547  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.166216  9926 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:18.166877  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.167491  3970 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
W20260709 13:18:18.026855  9731 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.020s	user 0.008s	sys 0.020s
I20260709 13:18:18.168442  4040 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:18.169104  9935 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:18.169606  9935 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:18.170069  9935 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.173457  3965 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:18.174130  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3461) took 1308 ms. Trace:
I20260709 13:18:18.174518  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.175246  3966 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:18.175695  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.175879  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3472) took 1304 ms. Trace:
I20260709 13:18:18.088526  4113 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
W20260709 13:18:18.092159  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.089355  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3458) took 1224 ms. Trace:
W20260709 13:18:18.085247  3968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 3460) took 1219 ms (client timeout 1572 ms). Trace:
I20260709 13:18:18.177739  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.180794  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3147) took 1301 ms. Trace:
I20260709 13:18:18.135268  9830 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:18.181440  3972 rpcz_store.cc:276] 0709 13:18:16.865141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.069510 (+1204369us) service_pool.cc:224] Handling call
0709 13:18:18.089180 (+ 19670us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.085011  9370 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.183440  3972 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:18.184208  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2962) took 1128 ms. Trace:
W20260709 13:18:18.141642  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66013.8us
W20260709 13:18:18.101711  9823 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.040s	user 0.011s	sys 0.041s
I20260709 13:18:18.093595  9942 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:18.121876  9977 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.101984  9543 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:18.090584  9897 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:18:18.157244  9890 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.176281  4038 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.176224  3966 rpcz_store.cc:276] 0709 13:18:16.871380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.174519 (+1303139us) service_pool.cc:224] Handling call
0709 13:18:18.174863 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.175652 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.175826 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.164491  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.176160  3964 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:18.162127  9544 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.090253  9719 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.090751  9950 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:18:18.181160  4113 rpcz_store.cc:276] 0709 13:18:16.879059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.256324 (+377265us) service_pool.cc:224] Handling call
0709 13:18:18.180691 (+924367us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.174463  3965 rpcz_store.cc:276] 0709 13:18:16.866125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.127164 (+1261039us) service_pool.cc:224] Handling call
0709 13:18:18.173081 (+ 45917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.173873 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.174061 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.184502  3972 rpcz_store.cc:276] 0709 13:18:17.055963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.182246 (+1126283us) service_pool.cc:224] Handling call
0709 13:18:18.182833 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.183948 (+  1115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.184152 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.143757  9737 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:18.122119  9901 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.186184  4121 rpcz_store.cc:276] 0709 13:18:16.886401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.058141 (+171740us) service_pool.cc:224] Handling call
0709 13:18:18.080892 (+1022751us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b54001b2954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.081042 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15666560}
I20260709 13:18:18.187382  9366 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:18.175218  4044 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:18.181334  9879 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.185421  3968 rpcz_store.cc:269] 0709 13:18:16.865868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.044042 (+178174us) service_pool.cc:224] Handling call
0709 13:18:18.084935 (+1040893us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b54001568d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.085073 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9964800}
I20260709 13:18:18.187604  9942 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:18.195360  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.184922  9731 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.201028  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3473) took 1327 ms. Trace:
I20260709 13:18:18.137488  9751 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.207867  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43490.8us
I20260709 13:18:18.205137  3964 rpcz_store.cc:276] 0709 13:18:16.871597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.175507 (+1303910us) service_pool.cc:224] Handling call
0709 13:18:18.175829 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.194130 (+ 18301us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.198670 (+  4540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.184805  9370 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.210907  4039 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:18.214175  9737 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.217200  9737 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.204329  9366 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:18.221036  9721 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.214175  9942 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.222229  9942 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.221969  9879 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.222950  9987 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:18.223556  9987 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:18.224083  9984 consensus_queue.cc:1175] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e032f02b0aa450384dda978641ba666" responder_term: 17 status { last_received { term: 16 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:18.226106  9677 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.226442  9987 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.226816  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 853) took 1169 ms. Trace:
I20260709 13:18:18.227360  3972 rpcz_store.cc:276] 0709 13:18:17.057614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.210196 (+1152582us) service_pool.cc:224] Handling call
0709 13:18:18.226153 (+ 15957us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.226441 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.226466 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:18.226546 (+    80us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:18.226579 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.226634 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.226752 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:18.229450  9751 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.214682  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.222481  9543 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.225461  9864 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.231132  9543 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.233039  9828 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.221817  9721 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.166890  9926 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.224414  9879 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.225212  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.251114  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.247550  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.221171  9366 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:18.191844  9823 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.260404  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 436577us
I20260709 13:18:18.260151  3966 raft_consensus.cc:2376] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20. Re-sending same reply.
I20260709 13:18:18.264595  3968 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:18.266605  9721 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.269534  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.270296  4679 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:18.271338  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.274052  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.295014  4121 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:18.295856  3969 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:18.275087  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.236696  9821 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.280689  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.298324  3965 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.280997  9926 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.281260  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.282418  4112 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:18:18.283048  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.283264  9483 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.283785  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.284538  9544 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:18.286274  9719 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:18:18.287108  9489 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:18.291589  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.264022  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.292613  4041 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:18.246750  9987 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.271554  4114 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:18.300614  4044 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:18.309190  3967 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 7. (term mismatch)
I20260709 13:18:18.312201  3937 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:18.319110  3937 leader_election.cc:403] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:18:18.263381  9470 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:18.246268  9901 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.319789  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45861.2us
I20260709 13:18:18.318663  3967 pending_rounds.cc:85] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 6
I20260709 13:18:18.327713  9483 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.328153  9941 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:18.329144  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.328052  4116 raft_consensus.cc:2368] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 11. Current term is 12.
I20260709 13:18:18.330749  4113 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:18.330775  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.331995  3964 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:18.334846  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.323493  3967 pending_rounds.cc:107] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 14.7
I20260709 13:18:18.316159  9864 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.335721  3967 raft_consensus.cc:2889] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:18.335968  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 90808.3us
I20260709 13:18:18.334662  3972 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:18.328708  9941 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:18.343155  4047 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:18.346285  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.344218  9737 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:18.350143  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.355371  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.334688  9543 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.335366  9470 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:18.359277  9821 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.356796  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.360388  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.362968  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.368145  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.372181  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.373129  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.330358  9987 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.348330  9926 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.378455  3965 raft_consensus.cc:2368] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:18:18.371245  9719 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:18.359622  9901 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.390283  3964 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:18.384100  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.362088  9544 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:18.395975  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.395993  3970 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:18:18.397454  4041 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:18.381814  9543 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:18.394345  9688 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.398144  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.396989  3970 pending_rounds.cc:85] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:18:18.388957  9751 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:18.405591  9941 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.389232  9890 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.394755  9926 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.410784  9926 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.411794  4120 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:18.413512  4120 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:18.414899  4118 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:18.402228  3970 pending_rounds.cc:107] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:18:18.418098  3970 raft_consensus.cc:2889] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:18.418371  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50332.2us
I20260709 13:18:18.385710  9719 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:18.403548  4676 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:18:18.383742  9823 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.420610  3964 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:18.391387  9864 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:18.427803  3972 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:18:18.439838  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.440683  3964 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:18.436697  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.450387  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:18.424880  9719 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.458180  4044 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:18.447849  9489 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:18.462459  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.465598  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.449788  9751 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:18.453962  9864 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:18.355238  9935 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.468179  4120 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:18.459090  9984 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:18.482453  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.485724  4047 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:18.495065  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.500609  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.474663  9985 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
W20260709 13:18:18.507447  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.512668  9751 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.514369  9185 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.514876  9185 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.516873  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.517953  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3471) took 1646 ms. Trace:
I20260709 13:18:18.518111  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.518316  3967 rpcz_store.cc:276] 0709 13:18:16.871125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.173625 (+1302500us) service_pool.cc:224] Handling call
0709 13:18:18.173952 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.342246 (+168294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.517725 (+175479us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400398ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:18.517878 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280464256}
I20260709 13:18:18.519249  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.519451  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.520021  3967 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:18.520303  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.521286  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.521859  3972 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:18.523942  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.524873  3965 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.525104  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.527356  9721 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:18.527786  9721 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:18.525615  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2841) took 1764 ms (client timeout 2175 ms). Trace:
W20260709 13:18:18.530030  4043 rpcz_store.cc:269] 0709 13:18:16.761057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.804117 (+ 43060us) service_pool.cc:224] Handling call
0709 13:18:18.525395 (+1721278us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000ca154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.525532 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2783663360}
W20260709 13:18:18.533393  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3148) took 1652 ms (client timeout 1839 ms). Trace:
W20260709 13:18:18.533785  4114 rpcz_store.cc:269] 0709 13:18:16.881372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.025090 (+143718us) service_pool.cc:224] Handling call
0709 13:18:18.533198 (+1508108us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540034e754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.533339 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570086784}
I20260709 13:18:18.528707  9721 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.529258  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2810) took 1678 ms (client timeout 1586 ms). Trace:
W20260709 13:18:18.538806  4115 rpcz_store.cc:269] 0709 13:18:16.851056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.852470 (+  1414us) service_pool.cc:224] Handling call
0709 13:18:18.529004 (+1676534us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003a8ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.529157 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2741064192}
W20260709 13:18:18.540580  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.541397  9543 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.542466  9543 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.450034  9688 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.530468  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.547158  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.547326  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.546717  4044 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:18:18.516685  9185 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.529141  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:18.555337  4039 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:18.481745  9984 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:18.557000  3972 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:18.558671  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.559528  9185 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.455638  9470 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.560127  9185 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:18.561926  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.566285  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:18.570798  4044 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:18.571606  4041 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:18.577555  4043 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:18.578059  9719 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.579947  4120 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:18.581410  9989 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:18:18.583155  9864 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.544672  9543 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:18.593554  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.595085  9992 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.595599  9992 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.597610  9992 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:18.598097  9896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.019s	sys 0.028s
W20260709 13:18:18.598544  9896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.019s	sys 0.028s
I20260709 13:18:18.599510  3967 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:18.600327  9985 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:18:18.604923  3964 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:18.600528  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.595098  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.612339  4043 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:18.618000  4038 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:18.564313  9984 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.556257  9483 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:18.633270  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:18.622210  9737 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:18:18.648772  9618 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.649183  9896 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.649379  9618 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.649757  9896 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.651481  9618 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.652074  9896 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.653307  9992 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.653915  9992 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.654696  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:18.655589  9986 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:18.656134  9986 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.656711  9731 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:18.656004  9992 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.656461  9543 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.656215  9896 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.657801  9543 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.658143  9896 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.660005  9543 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.658950  9986 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.657152  3967 raft_consensus.cc:2376] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12. Re-sending same reply.
I20260709 13:18:18.655987  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:18.662623  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.660665  9731 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:18.666270  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.665748  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.667086  4121 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:18.667454  3964 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:18:18.668262  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101243us
I20260709 13:18:18.660650  9896 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.664364  9987 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.690512  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:18.697381  4117 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:18.656989  9981 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:18:18.699776  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:18.701733  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.704506  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.664860  9200 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:18:18.699391  9986 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:18.657264  9890 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:18.714720  9986 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.715277  9986 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.717906  9986 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:18.693548  9543 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.672647  9483 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.734011  4121 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:18.695644  9941 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:18.740157  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:18.741217  4038 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
W20260709 13:18:18.749451  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93548.2us
I20260709 13:18:18.732688  9935 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:18.761056  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70646.3us
I20260709 13:18:18.762154  3967 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:18.733892  9981 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:18.733322  9543 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.779114  9721 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:18.779831  3967 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:18.780634  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:18.782611  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:18.767169  9618 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:18.786645  3969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2952) took 2043 ms (client timeout 1871 ms). Trace:
W20260709 13:18:18.787089  3969 rpcz_store.cc:269] 0709 13:18:16.743276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:17.844037 (+1100761us) service_pool.cc:224] Handling call
0709 13:18:18.786485 (+942448us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b5400278654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:18.786577 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575716736}
I20260709 13:18:18.789595  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.797113  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3465) took 1920 ms. Trace:
I20260709 13:18:18.797614  3970 rpcz_store.cc:276] 0709 13:18:16.868141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.168548 (+1300407us) service_pool.cc:224] Handling call
0709 13:18:18.186238 (+ 17690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.418579 (+232341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.788191 (+369612us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54003138d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:18.788362 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481536256}
I20260709 13:18:18.722278  9731 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.805991  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.806879  4113 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:18.761408  9941 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.784426  9370 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:18.802412  9935 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:18.819206  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.819356  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.800998  9688 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.815698  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.819893  3966 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:18.818185  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:18.810864  9896 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:18:18.820806  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 185685us
I20260709 13:18:18.821376  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:18.823422  3970 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:18.821028  4120 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:18.826040  4117 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:18.799798  9618 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.818787  9981 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:18.799396  9830 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:18.823001  9935 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.843511  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3456) took 1982 ms. Trace:
I20260709 13:18:18.843951  9935 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:18.825642  9995 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:18.836061  9941 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.830899  9370 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.843883  3963 rpcz_store.cc:276] 0709 13:18:16.864321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.109434 (+1245113us) service_pool.cc:224] Handling call
0709 13:18:18.109879 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.378760 (+268881us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:18.456363 (+ 77603us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.742313 (+285950us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.750971 (+  8658us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.759368 (+  8397us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.759516 (+   148us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:18.759554 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.759622 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.843285 (+ 83663us) raft_consensus.cc:1685] finished
0709 13:18:18.843306 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.843449 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13087,"prepare.queue_time_us":58822,"prepare.run_cpu_time_us":138,"prepare.run_wall_time_us":5055,"raft.queue_time_us":21879,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":85,"spinlock_wait_cycles":36002432,"thread_start_us":501898,"threads_started":2,"wal-append.queue_time_us":365166}
I20260709 13:18:18.846158  9370 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.846402  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:18.837970  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57424.7us
I20260709 13:18:18.847844  3963 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:18.848699  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.849306  3963 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:18.849466  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:18.850203  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.841102  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.841941  9830 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:18.851272  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.852800  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.853873  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.854807  9618 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.854993  9828 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:18.837260  9483 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:18.838372  9896 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:18.857540  9896 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.854828  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:18.859129  3963 raft_consensus.cc:2410] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:18.860215  3963 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:18.860658  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:18.851272  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.861608  3963 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:18:18.862735  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:18.862913  3963 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:18:18.863431  4117 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:18.836112  9366 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.004s
I20260709 13:18:18.870311  9366 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:18.871011  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:18.873252  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:18.873334  4121 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:18.864462  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:18.876451  3970 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:18:18.879830  9981 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:18.880213  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:18.883139  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 2953) took 2138 ms. Trace:
W20260709 13:18:19.023614  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.067260  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 238962us
I20260709 13:18:19.070621  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.071542  4043 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:19.072916  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.107571  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:19.108381  4121 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:19.108598  4045 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:19.070211 10004 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
I20260709 13:18:19.134042  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:19.134811  4042 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:19.136879  9994 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:18:18.873216  9366 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:19.067294  9987 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:19.146482  9987 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.146908  9987 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:19.160635  9981 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.175982  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:19.178701  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.179627  4046 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:19.186120  9984 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.000s
I20260709 13:18:19.186654  9984 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:19.189162  4040 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:18.957612  3971 rpcz_store.cc:276] 0709 13:18:16.744933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.109151 (+1364218us) service_pool.cc:224] Handling call
0709 13:18:18.109791 (+   640us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:18.110305 (+   514us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:18.110338 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:18.110850 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:18:18.469288 (+358438us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:18.878635 (+409347us) log.cc:844] Serialized 14 byte log entry
0709 13:18:18.882841 (+  4206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:18.882933 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:18.882974 (+    41us) raft_consensus.cc:1685] finished
0709 13:18:18.882983 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:18.883095 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3862,"prepare.queue_time_us":78236,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":23731,"raft.queue_time_us":16801,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":208,"thread_start_us":734025,"threads_started":2,"wal-append.queue_time_us":557093}
W20260709 13:18:19.200312  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87760.7us
I20260709 13:18:19.134793  4117 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:19.206532  9941 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.211251  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.217383  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:19.218441  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.237577  4045 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:19.238695  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:19.202095  9483 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:19.240849  4115 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:18:19.243244  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.243814  4047 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:19.241611  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.241207  4115 pending_rounds.cc:85] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 10
I20260709 13:18:19.246021  4115 pending_rounds.cc:107] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:18:19.246253  4115 raft_consensus.cc:2889] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:19.245494  4046 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:19.249209  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:19.207088  9890 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:18:19.263571  3970 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:19.249866  4112 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:19.252569  4046 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:18:19.256395  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:19.267714  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.268901  4119 raft_consensus.cc:2393] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:19.269400  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:19.271848  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:19.279429  4043 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:19.281076  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:19.282215  4112 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:19.285640  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:19.318842  4121 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:18:19.319136  4119 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:19.318645  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.258548  9483 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.329587  4121 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:19.330222  4114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.020s	sys 0.021s
W20260709 13:18:19.330252  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 104868us
W20260709 13:18:19.332685  4114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.021s	sys 0.021s
I20260709 13:18:19.341061  4112 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 13:18:19.343096  4043 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 12.
I20260709 13:18:19.349838 10014 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:19.324546  9984 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:19.376000  4085 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.037s	sys 0.035s
W20260709 13:18:19.376477  4085 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.037s	sys 0.036s
W20260709 13:18:19.376814  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 556131us
W20260709 13:18:19.377705  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 201795us
I20260709 13:18:19.378710  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.362177 10014 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:19.385473  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.388485 10014 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:19.381659  9935 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:19.399700  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.401067  9872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.018s	sys 0.034s
W20260709 13:18:19.404071  9872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.018s	sys 0.035s
I20260709 13:18:19.409075  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.402454  9935 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.403275 10014 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:19.393376  9941 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 13:18:19.415709  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 206185us
I20260709 13:18:19.417725  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:19.414072  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.416610  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:19.419968  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:19.420300  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:19.414093  9935 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.414744 10014 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:19.414428 10026 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:19.418452  9483 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:19.421916  9731 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:18:19.426194 10018 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
I20260709 13:18:19.436160  9890 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:19.441363  9941 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.422194  9981 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:18:19.435556 10028 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:19.428118  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:19.454941  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3485) took 1230 ms. Trace:
I20260709 13:18:19.425442  9950 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.475045  9896 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:18:19.475996  4085 leader_election.cc:336] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 2.127s (SENT)
I20260709 13:18:19.427976  9992 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.476514  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:19.485067  9872 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:19.486092  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:19.487691  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.488902  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:19.491359 10028 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:19.492393 10028 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.451841  9731 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:19.498109  9731 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:19.460353  9890 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:19.501899  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2803) took 2679 ms (client timeout 2145 ms). Trace:
I20260709 13:18:19.503029  9890 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:19.503139  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.541306 10026 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:19.545593  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:19.546201  4042 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:19.545207  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.530953  9830 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:19.551127  9721 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:19.551736  4047 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:19.541364  9992 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.543926  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.423563 10014 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:19.552492  9992 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.573782  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:19.580240  9941 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.551941  9864 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:19.579948 10026 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.587262  9941 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.584951  9864 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:19.595396  9864 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.596562  9864 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:19.584367  9830 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:19.510432  9950 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:19.599597  9830 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:19.601136  9719 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:19.594331  9718 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:19.605444  9718 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:19.617707  9718 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.619489  9718 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:19.625280  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 81422.1us
I20260709 13:18:19.626147  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.626057  9830 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:19.627233  9830 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:19.628341  9830 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.646359  9897 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:19.646927  9897 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:19.647904  9897 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.652812  9984 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:19.655172  9986 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.660318  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3157) took 1240 ms. Trace:
I20260709 13:18:19.660928  4118 rpcz_store.cc:276] 0709 13:18:18.420311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.421016 (+   705us) service_pool.cc:224] Handling call
0709 13:18:19.660110 (+1239094us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b540026b6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:19.660249 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":995733888}
I20260709 13:18:19.663148  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2850) took 1116 ms. Trace:
I20260709 13:18:19.663563  4041 rpcz_store.cc:276] 0709 13:18:18.546603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.547276 (+   673us) service_pool.cc:224] Handling call
0709 13:18:19.662957 (+1115681us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b54001121d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:19.663090 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15397760}
I20260709 13:18:19.666491  9751 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:19.666929  9751 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:19.667866  9751 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.673573  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 600) took 1218 ms. Trace:
I20260709 13:18:19.674022  4115 rpcz_store.cc:276] 0709 13:18:18.455249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.539611 (+ 84362us) service_pool.cc:224] Handling call
0709 13:18:18.539995 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:19.250896 (+710901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.673260 (+422364us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b5400080f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:19.673493 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1580160896}
I20260709 13:18:19.690910  9200 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:19.691599  9200 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.703161  9751 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:19.723479  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55581.1us
I20260709 13:18:19.724591  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:19.725544  9721 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:19.730998  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 302946us
I20260709 13:18:19.731674  9543 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:19.733445  9950 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:19.742353  9993 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:19.742377  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:19.742589  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.743212  9993 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.742975  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:19.744326  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:19.744648  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:19.745406  4045 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:19.735368  9986 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:19.751368  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:19.502348  4116 rpcz_store.cc:269] 0709 13:18:16.822294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:16.822393 (+    99us) service_pool.cc:224] Handling call
0709 13:18:19.501627 (+2679234us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54002ab2d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:19.501791 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3413808640}
W20260709 13:18:19.754557  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.753432  9185 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:19.735431  9992 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:19.465054  3972 rpcz_store.cc:276] 0709 13:18:18.224981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:18.526220 (+301239us) service_pool.cc:224] Handling call
0709 13:18:18.549337 (+ 23117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:18.566567 (+ 17230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:19.454719 (+888152us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54001c9650. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:19.454877 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52174208}
I20260709 13:18:19.760103  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:19.731989  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 256040us
I20260709 13:18:19.745661  4679 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
W20260709 13:18:19.775135  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.776811  4113 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:19.785477  4045 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:19.789274  9721 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:19.790992  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:19.794469  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:19.794924  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:19.796428  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:19.801812  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:19.665733  3870 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 14 to 18, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 18 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:19.802132  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 382183us
I20260709 13:18:19.733507  9200 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:19.804589  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:19.811468  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:19.809891  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:19.790448  9721 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:19.801648  9470 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.019s	sys 0.092s
I20260709 13:18:19.803225  9992 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:19.814226  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88632.1us
I20260709 13:18:19.805603  9737 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:19.811189  9543 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:19.820163  9185 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:19.815045  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:19.820499  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:19.813153  9879 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:19.812608  9896 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.814121  9941 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:19.815793  9987 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.668s	user 0.018s	sys 0.000s
I20260709 13:18:19.827899  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:19.838032  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.817868  9986 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:19.856817  9992 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.861344  9992 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:19.861714  9992 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:19.864894  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.830186  9731 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:19.870564  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:19.874358  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46514.4us
I20260709 13:18:19.858845 10043 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:19.832185 10033 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:19.832841  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:19.819286  9470 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.174s	user 0.019s	sys 0.093s
W20260709 13:18:19.857936  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 141158us
I20260709 13:18:19.827620  9879 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:19.891620  9950 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:19.857395  9987 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:19.913493  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 81687.1us
I20260709 13:18:19.915740  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:19.911895  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 156499us
W20260709 13:18:19.918530  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:19.869390  9896 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:19.934886  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:19.908164  9879 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:19.938480  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:19.942339  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 132534us
I20260709 13:18:19.945567  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:19.934145  9950 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:19.933283  9470 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:19.954044  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:19.911525  9719 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:18:19.936981  9751 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:19.966148  9987 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:19.948616  9718 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:19.986101  9987 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:19.987402  9986 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:19.987644 10050 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:19.988306  9986 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:19.988596  9987 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:19.988992  9987 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:19.991721  3937 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 2.145s (SENT) [suppressed 17 similar messages]
I20260709 13:18:19.991364  9987 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:19.993875  9987 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:19.958635  9543 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:19.956306 10034 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:20.002660  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.001094  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:20.002316  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 99704.6us
I20260709 13:18:20.011857  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:19.964581  9751 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:20.029364  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 214104us
I20260709 13:18:20.031543  4043 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:20.030828  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 97001.5us
I20260709 13:18:20.036509  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:20.038932  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 118217us
I20260709 13:18:20.039320  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.001534 10028 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.044189  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:20.002748  9543 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:20.050383  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.054695  4011 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:20.054993  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43943.3us
I20260709 13:18:20.056233 10029 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:20.057068 10029 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:20.056932 10026 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:20.059190  4114 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:20.056416  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:20.048991  9543 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.031917  9751 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:20.054611  4116 raft_consensus.cc:2376] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19. Re-sending same reply.
I20260709 13:18:19.998404  9718 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.066334  4115 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:18:20.067638  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.068024  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:20.060719  9890 consensus_meta.cc:287] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.557s	user 0.014s	sys 0.004s
I20260709 13:18:20.049762 10034 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:20.081422  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89733.9us
I20260709 13:18:20.080614  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:20.075351 10045 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:20.081523  9731 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.079259  9981 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:20.079644  9470 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:20.066500 10028 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.081959  9830 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:20.121083  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 222211us
I20260709 13:18:20.081707  9890 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:20.143865 10052 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:20.145062  9890 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.145232  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:20.145701  9470 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:20.146679  9470 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.140878  9981 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.151268  9981 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.152189 10064 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:20.152730 10064 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.153951 10068 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.154830 10064 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:20.154559 10068 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.118986 10050 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.163242  9896 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:20.163831  9896 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:20.163960  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.165131  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:20.165607  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.163266  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.167150  4040 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:20.165925  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.168378  4046 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:20.148615  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.183357  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.184968  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.185832  3972 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:20.186213  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:20.187350  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.187515 10034 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:20.188354 10040 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:18:20.189407  3967 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:20.190546  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.185242  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:20.130781  9830 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:20.185854  3963 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:20.185722  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:20.195231  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.195398  3964 raft_consensus.cc:2376] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18. Re-sending same reply.
W20260709 13:18:20.192866  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72884.1us
I20260709 13:18:20.191155  3968 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:20.164369  9896 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.084149  9950 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.194371  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.196095  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.206753  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.207511  3969 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:20.160953 10068 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.214093  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.237926  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:20.237685  3972 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:20.238039  4119 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:20.245404  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.203958  9897 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:20.248580  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:20.258117  3857 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 293c0ff21e6f4e9f93555aaba177566b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:20.258901 10060 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:20.259207 10072 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 13:18:20.260299 10059 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:20.253688 10064 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.261278  9897 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:20.261930 10028 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.262229  9897 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:20.263540 10014 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.574s	user 0.003s	sys 0.009s
I20260709 13:18:20.263926 10014 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.254176  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:20.276861  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 128325us
I20260709 13:18:20.242434 10033 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.244401  9872 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:20.205164  9992 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.249120 10054 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:20.281999  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.176342 10050 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.285315  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.241487 10062 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.287604  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.289207  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.295152  4114 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
W20260709 13:18:20.324249  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 75722.3us
I20260709 13:18:20.325217  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.330924  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.326875  3965 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:20.300896  9718 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.340425  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.341125  3972 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:20.342880  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.346240  4121 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:20.332620  9984 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:20.349282  3967 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:18:20.353376  3963 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:20.337783 10014 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.355875  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.358701  4119 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:20.338150 10066 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:20.359679 10066 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:20.361100 10066 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.371788  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.372434  9872 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:20.375860  9872 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.288309  9830 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.287789 10033 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.385907  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:20.401793  3972 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:20.390718  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:20.389482  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 99326.6us
I20260709 13:18:20.300129 10062 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.349390  9718 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.333374 10060 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:18:20.398063  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.352299  9984 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:20.439154  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.395653 10088 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:20.449672  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.459156  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:20.465855  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.466522  4121 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:18:20.467993  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89413.1us
I20260709 13:18:20.510365  4121 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:20.462616  9718 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.515312  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:20.515935 10075 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:18:20.517244  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.519925  9911 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:20.520471  9911 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:20.520887  9911 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:20.516544  9718 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.529162  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:20.530398 10058 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 13:18:20.532720  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.541075  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:20.541579 10076 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:18:20.462320 10071 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.541833  3966 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:20.471300  9984 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:20.557471  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.564575  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.472924 10081 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:20.515390 10078 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:18:20.474078  9830 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:20.571559  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:20.586639  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71386.6us
I20260709 13:18:20.591394  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.596817  3966 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:20.549664  9896 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.613442  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:20.614945  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.576486  9992 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.477054 10088 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.614248  4676 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 12.
I20260709 13:18:20.595965 10068 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:20.623986  9718 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:20.617596 10091 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:20.624836 10091 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:20.624503  9718 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.625361 10068 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.625818 10068 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:20.627049  9718 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.593227 10081 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.617949  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:20.620556  9864 consensus_meta.cc:287] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.020s	user 0.012s	sys 0.009s
I20260709 13:18:20.641252  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.636225  3938 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:20.642012  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.634632 10088 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.637948  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.599637 10090 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:20.616621 10050 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:20.656989  4115 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:20.565888 10071 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.659588  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:20.612479  9935 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.184s	user 0.023s	sys 0.022s
I20260709 13:18:20.625216 10091 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:20.661319  9879 consensus_meta.cc:287] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.000s
I20260709 13:18:20.612892  9721 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:18:20.625099  9992 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:20.664927 10086 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:18:20.658766  9543 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.005s
I20260709 13:18:20.667838  9896 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:20.668392  9864 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.687100  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:20.716166  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 125121us
I20260709 13:18:20.718359  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:20.718503  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:20.723068  9200 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:20.690825  9896 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.725394  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:20.691890 10090 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:20.679412  9879 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.733603  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:20.736047  3966 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:20.718701 10014 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:20.739612 10077 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:20.766988 10077 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.767400 10077 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:20.740355  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:20.773715 10049 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.640s	user 0.001s	sys 0.001s
I20260709 13:18:20.774080  9879 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.774739  9879 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:20.775094  9879 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:20.775234  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.766470 10033 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.775499  9879 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.776831  9718 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:20.777793  9987 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.783s	user 0.013s	sys 0.000s
I20260709 13:18:20.777837  9718 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.765280  9993 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:20.741843 10087 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 13:18:20.742712 10089 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:18:20.723559  9688 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:20.749382 10090 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.752364 10088 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:20.722654  9864 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.754290  9911 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.680297  9935 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.789157  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.789368  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:20.789171  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.791540  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.757951 10091 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.796433  4041 raft_consensus.cc:2368] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:20.797467  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.797637  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.798007 10091 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.684314  9543 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.763677 10071 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.764815 10081 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.732097 10093 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.776968  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:20.740859 10092 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:18:20.722204 10062 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.781888  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.782855  3966 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:20.732615 10050 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:20.785158  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.785450  4046 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:20.805590  4682 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:20.798681  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.790071  3963 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:20.804941  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.798909  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.798589  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.722368  9470 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:20.801718  4038 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 13: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:20.801708  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.810143  4119 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:20.811631  3966 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:20.821141  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.821048  4039 raft_consensus.cc:2368] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19.
I20260709 13:18:20.822865  3968 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:20.734285 10084 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.781965  9731 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.796603  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.823114  4046 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:20.823649  3966 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:20.808640 10050 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.866379 10050 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.868947  9731 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.871152  9731 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.872756  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:20.827265  9987 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:18:20.877575  9987 consensus_queue.cc:1243] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:20.878144  9987 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:20.878458  9987 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:20.879257  9987 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.880410  9987 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:20.882588  4013 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.733807  9896 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:20.780630 10068 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.828864  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.829808 10090 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.829061  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.910841  4115 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:20.830641  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.911856  4047 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:20.831514 10062 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:20.914309  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 182279us
W20260709 13:18:20.832104  9751 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.002s
I20260709 13:18:20.837767  3972 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:20.827450 10084 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.805254 10093 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.842123  9986 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:20.845275  9879 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.848592  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.850651  4118 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
W20260709 13:18:20.850679 10056 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.702s	user 0.002s	sys 0.000s
I20260709 13:18:20.844484  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.859931  9864 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:20.861568  9911 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:20.861837  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:20.863507  9935 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:20.864991  9543 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.865293  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.926226  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.927389  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.928092  4114 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:20.790573  9984 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:20.931994  9984 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:20.883409  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.825017  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.882460  4044 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:20.936236  4119 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:20.899629  4112 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
W20260709 13:18:20.909963  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 81177.9us
I20260709 13:18:20.938776  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.942245  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.944722  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.946142  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.916101  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:20.884655 10065 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.915654  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:20.912128 10028 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:20.924830  4042 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:20.913625  9731 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:20.960479  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.947608  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.951354  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.918515 10043 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:20.965799  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:20.957283  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.952168 10088 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:20.957954 10028 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:20.838068 10077 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:20.921175  9986 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:20.992625  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.965476  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:20.967568  4042 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:20.995515  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:20.975646  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.968241  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:20.978448  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:20.980564  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:20.991801  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66767.2us
I20260709 13:18:20.997618 10080 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:20.964643  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:20.999617  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.001056  4113 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:21.002117  4113 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:20.996153  4115 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:21.014699  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.031123  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:20.920621  9751 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.033886  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:20.958644  9864 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:21.035272  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:20.979655  9543 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:21.038251  9200 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.990602 10028 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:20.990765 10031 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:20.990638  9992 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:20.958268 10044 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:18:21.031154 10033 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:21.031072 10088 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:21.066200  4045 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.098356  4119 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:18:21.100353  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65156.8us
I20260709 13:18:21.042481 10039 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.040724  9543 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.108659  4113 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.019721  9470 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:18:21.061721 10031 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:21.034505 10026 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:18:20.959384 10065 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.104056  9941 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:21.066685  9731 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:18:20.979851 10043 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.036509 10034 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:18:21.040141 10014 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:18:21.069386 10033 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.068959 10088 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.110642 10039 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.125923  4038 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:21.113233  4119 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 13:18:21.133369  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:21.147768  4116 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:21.148262  3970 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.122823  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:21.124286  4121 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:18:21.134090  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 137214us
I20260709 13:18:21.119143  9981 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.114548 10053 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.083s	user 0.000s	sys 0.013s
I20260709 13:18:21.149864  9981 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.151662  4121 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:21.130986 10093 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.133510 10068 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.149962  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.115243 10116 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:21.145351  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3181) took 1110 ms. Trace:
I20260709 13:18:21.149327  4119 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 9
I20260709 13:18:21.156148  4119 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 13:18:21.156535  4119 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.154374  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.156860  4116 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:21.111207  9543 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.139019 10031 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.160605  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.143013  9941 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.133076 10084 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:21.155476  4117 rpcz_store.cc:276] 0709 13:18:20.035318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.042380 (+  7062us) service_pool.cc:224] Handling call
0709 13:18:20.061305 (+ 18925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:20.119513 (+ 58208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:20.119571 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:20.684025 (+564454us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b2c000875c8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:20.715499 (+ 31474us) log.cc:844] Serialized 26 byte log entry
0709 13:18:20.805641 (+ 90142us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:20.805675 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:20.805735 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:21.139432 (+333697us) raft_consensus.cc:1685] finished
0709 13:18:21.139456 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:21.145264 (+  5808us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50239,"raft.queue_time_us":52628,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":7412,"spinlock_wait_cycles":3031936,"thread_start_us":65801,"threads_started":1,"wal-append.queue_time_us":239765}
I20260709 13:18:21.135023 10077 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.169183  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.159052 10093 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:21.169922  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.170228  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.169953  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.174520  4116 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:21.170295  9896 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.151865  9981 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.153997 10088 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.154196 10033 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:21.179127  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:21.179749  3937 leader_election.cc:400] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:21.180370  3937 leader_election.cc:403] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:21.181635  3970 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:21.183174  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:21.183650  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.173579  9731 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:21.184553 10069 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.185575 10065 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.112675  9986 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.165163  9941 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.173872 10090 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.015s
I20260709 13:18:21.189214  9911 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:21.189764  9911 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:21.190598  9911 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.191294  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.192229 10062 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:21.171667  9751 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:21.192845 10062 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:21.193100  9879 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:21.193737  9879 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:21.194447 10096 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:18:21.194775  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.199463  9864 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:21.199875  9864 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:21.200142 10069 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:21.165072  9987 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:21.193653  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.188704  4112 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:21.201707 10090 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:21.207502 10050 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.201426  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.159380  9872 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:18:21.208652  9872 consensus_queue.cc:1243] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:21.209726 10050 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:21.211120 10028 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.214493  4119 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
W20260709 13:18:21.214486  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 176554us
I20260709 13:18:21.215405  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:21.216018  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.216182  4012 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:21.173529 10093 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.218302  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:21.217466  4115 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:21.218523  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.218952  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:21.223919  4679 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.224613  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.193246 10043 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:21.202042 10077 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.184511  9731 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.201548  9987 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.218132  9981 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:21.228320  9950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.005s	sys 0.006s
I20260709 13:18:21.218829 10069 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:21.220707 10050 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:21.275571 10050 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.275982 10050 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.268929 10028 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:21.234552  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.278123  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.232270 10065 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.235816  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.200698  9864 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.233325  9731 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.241261  9987 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.245134  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 510) took 1103 ms. Trace:
I20260709 13:18:21.245745 10039 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.248275 10090 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.249948 10066 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:21.250208  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.252727  4683 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:18:21.254277  9543 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.256047  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.259656  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:21.232808 10077 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.261027  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.264537  9737 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:21.265748  4682 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:21.257237 10031 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.268939 10043 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:21.269915  4116 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:21.270459  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:21.314191  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66477.6us
I20260709 13:18:21.315436  4115 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.271013  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:21.271937  9896 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:21.272440  3967 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:21.273502  4679 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
W20260709 13:18:20.595384  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 124731us
I20260709 13:18:21.223449 10093 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.228160  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:21.283152  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3192) took 1041 ms. Trace:
I20260709 13:18:21.283864  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 2978) took 1104 ms. Trace:
I20260709 13:18:21.285300  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:21.285415  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 181772us
I20260709 13:18:21.286001  4120 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:18:21.279045  9950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.006s	sys 0.006s
I20260709 13:18:21.287837  4046 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:21.302438  9864 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.328657  4118 rpcz_store.cc:276] 0709 13:18:20.241896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.242037 (+   141us) service_pool.cc:224] Handling call
0709 13:18:21.282987 (+1040950us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54003a7ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:21.283098 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312193920}
I20260709 13:18:21.289299  4042 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:21.291957  4045 rpcz_store.cc:276] 0709 13:18:20.141562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.141711 (+   149us) service_pool.cc:224] Handling call
0709 13:18:20.175874 (+ 34163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.067726 (+891852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.244909 (+177183us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54000b7f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:21.245075 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2047080192}
I20260709 13:18:21.295996  4038 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:21.296518  4043 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:21.267153  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.295434 10090 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.303907  3870 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 15 to 17, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:21.303020  9737 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.286851 10088 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.286864 10033 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.305115  9543 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.305490 10077 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.306820 10070 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:21.308068  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.308454 10069 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:21.276872  9941 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.312065  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:21.313441  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.321190  9935 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:21.328714  3965 rpcz_store.cc:276] 0709 13:18:20.179616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.179762 (+   146us) service_pool.cc:224] Handling call
0709 13:18:21.283699 (+1103937us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400279054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:21.283802 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":319262080}
W20260709 13:18:21.329005  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 100899us
I20260709 13:18:21.288868 10065 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.349153  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.355253  4041 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:21.354949  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:21.322357  4678 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:21.348016  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.319151  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.352551  3970 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:21.353956  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:21.355942  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47949.5us
I20260709 13:18:21.357530  4041 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [14.8-15.9]
I20260709 13:18:21.357903 10033 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.361369  4041 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:21.358188  9941 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.302227 10066 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.360613  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.360883  4045 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.363150  4047 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:21.363583  4044 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:21.365718  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.364746  4115 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:21.348150 10117 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:21.372663  4044 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:18:21.376407  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.358971  9896 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:21.378966  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.380659  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.380209  4045 raft_consensus.cc:1217] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-21.11]   Dedup: 14.8->[17.9-21.11]
I20260709 13:18:21.562896  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:21.570545  3965 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:21.353499  9872 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:21.349928 10039 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:18:21.419059  9737 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.560048  9896 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:21.564654  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.565176  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:21.562525  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.560624 10048 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:21.560009  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.558434  4115 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.566239 10090 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:21.377612  9543 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:21.429159 10065 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.381814 10077 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:21.369230 10069 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:21.561635 10050 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.363911 10120 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 13:18:21.567682  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 188797us
I20260709 13:18:21.586148  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.361471 10064 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:18:21.563052 10093 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.561798 10066 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.571920  4045 pending_rounds.cc:85] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 8
I20260709 13:18:21.590935  4045 pending_rounds.cc:107] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:18:21.591753  4045 raft_consensus.cc:2889] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:21.573017  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:21.576907  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.593389  4116 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:21.594697  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.595448 10081 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:21.595886 10081 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.596211 10081 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.596606  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.597203  4116 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.595345 10093 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.585114 10077 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.597846 10090 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.598284 10077 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.598322 10090 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.578234  9987 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:21.568234 10031 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:21.583168  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.582923 10069 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:21.577672  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.591187 10043 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:21.584883  9543 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.603694  4117 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:21.584709  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.603741 10043 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.604993  4112 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:21.604423  9543 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:21.602805  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.607755  4085 leader_election.cc:400] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17.
I20260709 13:18:21.603704 10050 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.603514 10069 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.609984  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.611182  4678 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:21.612120  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:21.600106  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.604941 10043 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.612890 10067 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:21.613263 10067 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.613606 10067 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.578686 10048 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.616325 10048 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.564724  9731 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.578686  9864 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.611032  9737 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.582577  9896 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.623348  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.626994  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.632938  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2839) took 1066 ms. Trace:
I20260709 13:18:21.650820  4120 rpcz_store.cc:276] 0709 13:18:20.566607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:20.566950 (+   343us) service_pool.cc:224] Handling call
0709 13:18:21.283124 (+716174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.329504 (+ 46380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:21.632713 (+303209us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b54003a7ad0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:21.632872 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1646138624}
W20260709 13:18:21.636618  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:21.645078  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:21.656641  4118 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:21.657325  4115 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
W20260709 13:18:21.666896  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43648.1us
I20260709 13:18:21.645392  3938 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:21.659993  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87058.1us
I20260709 13:18:21.626379  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.648306  4116 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:21.624302  9986 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.662410  9984 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:21.622109  9830 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:18:21.629026 10088 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.621253  9950 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.662940  4682 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:21.637445 10117 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:21.663715 10124 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:18:21.631650 10067 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.664647 10043 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.625207  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.663849 10048 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:21.691378  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66247.2us
I20260709 13:18:21.668062  3938 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:21.623616  9731 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.640906  9896 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.672358  9737 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:21.620748 10069 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.683666  9830 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:21.672117 10082 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:21.683972  3870 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 8 to 13, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 13 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:21.698732  3938 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:21.673326  9984 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:21.625535  9864 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.676683 10117 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.694904  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.674163 10111 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:18:21.716152  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:21.677623  9950 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.723173  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:21.725472  4116 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:21.724272  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:21.697535 10088 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:21.706248  9731 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:21.720623  9984 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.700342 10082 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:21.735066  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.699730 10062 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:18:21.719199  9896 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:21.698807 10084 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:18:21.719713  9737 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.721035 10050 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.747350  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.731173  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:21.757510  4112 raft_consensus.cc:2410] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 22 because replica has last-logged OpId of term: 20 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:18:21.706416 10081 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.750456  9950 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:21.727464  9987 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:21.728652 10088 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.744024  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:21.744673 10082 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:21.748461 10062 consensus_queue.cc:1243] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:21.746687 10093 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:21.748009 10057 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:21.751641 10111 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:21.751945  9731 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:21.775401  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 421504us
I20260709 13:18:21.766650 10093 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:21.794349  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 414513us
I20260709 13:18:21.759379 10077 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:21.765892 10088 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.790421 10111 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:21.797672 10093 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.773789 10057 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:21.766921  9987 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.766880  9543 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:21.809458 10048 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:21.810127 10048 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:18:21.812809  9731 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.817299 10067 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:21.804299  9751 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.819520  9751 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.821951 10069 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.821727  9737 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.795936 10096 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:21.822602  9987 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.807437 10070 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:21.827498 10070 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.828989 10029 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:21.830736  4038 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:21.832650  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.833598  4047 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:21.834856  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.836258  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:21.837018  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44651.9us
I20260709 13:18:21.834914  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.843292  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.844797  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.845100  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.845662  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.846607  4682 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:21.848057  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.842545  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:21.848623  4046 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:21.860693  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:21.860950  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.861629  4038 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:21.861956  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:21.860745  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.869182  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.870941  4042 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:21.824189 10096 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:21.873070  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:21.867735  9941 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:21.878218  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.890976  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.891765  4044 raft_consensus.cc:2368] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19.
I20260709 13:18:21.879698  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.868803 10120 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:21.900827  3965 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:21.899108  4047 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:21.898401  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:21.874926  9935 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:21.904922  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:21.905579  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:21.906400  3967 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:21.907424  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:21.910940  3965 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.877883 10096 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:21.908468  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:21.916162  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 215309us
W20260709 13:18:21.916996  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 244899us
I20260709 13:18:21.919521  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:21.921211  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.880151 10043 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:21.870138 10029 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:21.924134  3966 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:21.922784  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 133697us
W20260709 13:18:21.935796  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 69993.7us
W20260709 13:18:21.936178  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70195.2us
I20260709 13:18:21.936510 10131 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:21.938735 10131 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:21.920070 10120 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:21.939800 10066 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:21.939190 10084 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:21.940246 10126 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:18:21.940913 10084 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:21.941284 10084 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:21.942086 10084 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.943252 10084 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:21.938621  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:21.946079  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 198858us
I20260709 13:18:21.927801  9751 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.949294 10068 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:21.949713 10068 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:21.950560 10068 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.951682 10068 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:21.910416  9941 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:18:21.955919  3965 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:21.956351  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:21.939136 10131 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:21.969897  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:21.971596  3965 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:21.972002  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:21.947393  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.902935  9890 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:18:21.969833  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:21.924319 10070 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:21.940200 10066 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:21.980226  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.993068  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:21.996169  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:21.874500 10057 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:21.994088  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:22.010281  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:22.010958  4039 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:21.940111 10120 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:21.969785  9950 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:18:21.977607 10142 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:18:21.988754 10119 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.753s	user 0.013s	sys 0.017s
I20260709 13:18:21.978045 10081 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:22.012033  3969 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:18:21.994659  9896 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:21.969476  9751 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 13:18:22.029312  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 81984.9us
I20260709 13:18:22.037595 10066 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:22.000021 10067 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:22.051332  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:21.979360  9935 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:18:22.024542  9872 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:22.016008 10136 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:22.026243 10057 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:21.976543 10141 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:18:22.040478 10133 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:18:22.084920  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.098805  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 474213us
W20260709 13:18:22.100210  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.086962  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:22.041527 10031 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:22.042631 10048 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:22.081293  9751 consensus_queue.cc:1243] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:18:22.162950  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 76054.3us
I20260709 13:18:22.165532  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:22.147202  3966 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:22.198274  3870 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:22.203974 10055 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:22.205160 10055 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:22.205549 10055 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:18:22.203819  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101296us
I20260709 13:18:22.206327 10055 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:22.207099  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.208510 10126 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.207902 10055 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:22.210421  4649 leader_election.cc:400] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19.
I20260709 13:18:22.220988  9941 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:22.225169  9896 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.088563  9879 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.228608  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:22.231724  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.206377  4112 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:18:22.052040 10070 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.108s
I20260709 13:18:22.197841 10069 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:22.321643  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 374573us
W20260709 13:18:22.286787  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 121312us
I20260709 13:18:22.089102 10081 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.084667 10136 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:22.262559  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 290592us
I20260709 13:18:22.497668  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:22.498620  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:22.092527 10066 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:22.504868  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.507352  4039 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
W20260709 13:18:22.298877  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72583.3us
W20260709 13:18:22.210351 10143 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:18:22.080891 10067 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.526489 10067 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:22.402721  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.529191  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.323920 10069 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:22.405861  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 409739us
W20260709 13:18:22.482216  3970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.017s	sys 0.077s
I20260709 13:18:22.307740  9950 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:22.530463 10069 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.297948 10065 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:22.303285 10130 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:22.530983  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.407250  3967 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:18:22.347509 10144 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:18:22.200596 10048 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.534204 10048 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:22.406308  3964 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
W20260709 13:18:22.482831  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154199us
W20260709 13:18:22.535857  3970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.018s	sys 0.077s
W20260709 13:18:22.470117 10145 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:18:22.319738 10093 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.541566  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:22.542757  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:22.543313  4117 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:22.544039  4120 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:18:22.545274  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:22.546415  4119 raft_consensus.cc:2410] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 20 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:22.547511  9941 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:22.547951  9941 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:22.548267  9941 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.548688  4115 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
W20260709 13:18:22.549881 10082 consensus_meta.cc:287] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.760s	user 0.007s	sys 0.003s
I20260709 13:18:22.550285  4117 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
W20260709 13:18:22.552333 10122 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.985s	user 0.003s	sys 0.017s
I20260709 13:18:22.553117  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.554342  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.555423  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.543187  4118 pending_rounds.cc:85] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 8
I20260709 13:18:22.557991  4118 pending_rounds.cc:107] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:18:22.558234  4118 raft_consensus.cc:2889] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.559762  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.560730  9200 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:22.495652  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:22.510159  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:22.513062  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.567685  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57631.8us
I20260709 13:18:22.569167 10065 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:22.642807 10065 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.480697 10028 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:22.503130  9935 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:18:22.550328 10082 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.647853 10082 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:22.573097 10150 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:22.572860 10070 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:22.571696  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:22.573554 10048 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:22.574185  9872 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:22.650143  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78512.8us
I20260709 13:18:22.650897  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:22.652912  9896 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:22.654472  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:22.654659  9731 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:22.530858  9950 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:22.657193  9950 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:22.658687 10070 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.659232 10070 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.661476 10070 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:22.578397 10093 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:22.549018 10088 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.740s	user 0.007s	sys 0.003s
I20260709 13:18:22.662997 10088 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.665138 10088 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:22.578866 10149 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:22.516229 10136 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:22.667446  3963 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
W20260709 13:18:22.580968 10146 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:18:22.674059  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:22.674373  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:22.675033  4119 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:22.591217 10050 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.001s
I20260709 13:18:22.682000 10050 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:22.594717  9986 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.922s	user 0.000s	sys 0.012s
I20260709 13:18:22.605921  4044 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:22.690737  4044 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:22.691104  4044 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:22.691836  4044 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:22.605993  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:22.571487  9879 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:22.694911  9879 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:22.696010  9879 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.697500  4044 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:22.712965 10050 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:22.714143 10050 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:22.714676 10050 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:22.715574 10050 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.720923 10050 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:22.614152  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:22.726025  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:22.727788  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:22.728871  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:22.730110  4038 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:22.730870  4038 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:22.731689  4038 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.734229  4038 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:22.636929 10068 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.685s	user 0.010s	sys 0.000s
I20260709 13:18:22.739733  3972 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:22.639891  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:22.745771  4039 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:22.609119  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47842.2us
I20260709 13:18:22.749511  9872 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:22.750456  9872 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:22.750823  9872 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:22.559895 10117 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
I20260709 13:18:22.751711  9872 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.751799 10117 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.753319  4043 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:22.753430  9872 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:22.754448 10117 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:22.755134  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:22.757339  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.758685  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.759675 10088 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:22.761512  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:22.762312 10088 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:22.479032 10081 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:22.724515  4119 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:22.610822 10039 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:22.868660  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3627) took 1736 ms. Trace:
I20260709 13:18:22.506431 10141 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.133s
W20260709 13:18:22.864936  3969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.000s	sys 0.010s
W20260709 13:18:22.877604  3969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.001s	sys 0.010s
I20260709 13:18:22.878566  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:22.892730  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:22.876125  9984 consensus_meta.cc:287] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 1.124s	user 0.020s	sys 0.008s
I20260709 13:18:22.965056  4044 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:18:22.965880  4044 pending_rounds.cc:85] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:18:22.966452  4044 pending_rounds.cc:107] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:18:22.966893  4044 raft_consensus.cc:2889] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.968442  4038 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:18:22.972540  4038 pending_rounds.cc:85] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 11
I20260709 13:18:22.972916  4038 pending_rounds.cc:107] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:18:22.973152  4038 raft_consensus.cc:2889] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:22.970789  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:22.720573 10136 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:22.877359  4040 rpcz_store.cc:276] 0709 13:18:21.132576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.358237 (+225661us) service_pool.cc:224] Handling call
0709 13:18:21.358541 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.358897 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.358923 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.738340 (+379417us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18000c1cc0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a
0709 13:18:22.161460 (+423120us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b2c000a5238. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:22.294211 (+132751us) log.cc:844] Serialized 26 byte log entry
0709 13:18:22.480005 (+185794us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:22.480112 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.480253 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:22.865583 (+385330us) raft_consensus.cc:1685] finished
0709 13:18:22.865607 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:22.868593 (+  2986us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":406400,"raft.queue_time_us":716,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5106,"spinlock_wait_cycles":7087232,"thread_start_us":108923,"threads_started":1,"wal-append.queue_time_us":263521}
I20260709 13:18:22.880996 10093 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.978865  3969 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:22.881431 10088 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:22.874917 10158 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.021344  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.044440  9200 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.017894 10070 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:23.014703 10048 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.047638  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:22.978178  9984 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.015865 10159 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.071826 10153 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.085803 10153 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:23.084899 10162 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.560s	user 0.003s	sys 0.000s
I20260709 13:18:23.088629  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 518) took 1222 ms. Trace:
I20260709 13:18:23.089254 10159 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.063531 10152 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 13:18:23.090031  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 520) took 1223 ms. Trace:
I20260709 13:18:23.090469  4042 rpcz_store.cc:276] 0709 13:18:21.866984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.867573 (+   589us) service_pool.cc:224] Handling call
0709 13:18:21.870762 (+  3189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.871336 (+   574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.089820 (+1218484us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b540041cb50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:23.089975 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6686592}
I20260709 13:18:23.091518  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3020) took 1203 ms. Trace:
I20260709 13:18:23.091897  3968 rpcz_store.cc:276] 0709 13:18:21.888398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.945110 (+ 56712us) service_pool.cc:224] Handling call
0709 13:18:21.969819 (+ 24709us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:21.970200 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.970230 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:21.977841 (+  7611us) log.cc:844] Serialized 52 byte log entry
0709 13:18:22.310831 (+332990us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:22.396531 (+ 85700us) log.cc:844] Serialized 14 byte log entry
0709 13:18:22.568903 (+172372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.568983 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.091302 (+522319us) raft_consensus.cc:1685] finished
0709 13:18:23.091322 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.091446 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173070,"prepare.queue_time_us":85737,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":2310,"raft.queue_time_us":177545,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":1727,"thread_start_us":282417,"threads_started":1,"wal-append.queue_time_us":777773}
I20260709 13:18:23.094020  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.095016  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.095956  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:23.096097 10029 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:18:23.096586  3968 raft_consensus.cc:2368] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:23.098580  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.099679  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.100862  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.101641  3968 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:23.097536  9864 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.102381  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.089090  4046 rpcz_store.cc:276] 0709 13:18:21.866422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.869243 (+  2821us) service_pool.cc:224] Handling call
0709 13:18:21.869517 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:21.896219 (+ 26702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.896255 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:21.896300 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:21.896341 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.088363 (+1192022us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54000cb054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:23.088419 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.088563 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60899712}
I20260709 13:18:23.103314  9200 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.109654 10157 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:18:23.112836  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3007) took 1227 ms. Trace:
I20260709 13:18:23.113265  3970 rpcz_store.cc:276] 0709 13:18:21.885369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.899400 (+ 14031us) service_pool.cc:224] Handling call
0709 13:18:21.918238 (+ 18838us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:21.918645 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.918673 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:21.919232 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 13:18:22.536489 (+617257us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:22.536537 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:22.558610 (+ 22073us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.112553 (+553943us) raft_consensus.cc:1685] finished
0709 13:18:23.112577 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.112752 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1699,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12068,"thread_start_us":578602,"threads_started":1,"wal-append.queue_time_us":1084581}
I20260709 13:18:23.114876  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.116047  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.121790  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:23.122694  9864 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.124006 10136 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:23.149175  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.155504  4118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.014s	sys 0.035s
W20260709 13:18:23.155921  4118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.014s	sys 0.035s
I20260709 13:18:23.014604 10093 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.046954  9731 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:23.020217 10088 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.071775 10055 consensus_meta.cc:287] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.861s	user 0.012s	sys 0.000s
W20260709 13:18:23.182762  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 61051.7us
I20260709 13:18:23.169615  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.183478  3969 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:23.186479  4011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.025s	sys 0.044s
W20260709 13:18:23.186887  4011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.025s	sys 0.044s
W20260709 13:18:23.154213 10131 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.144s	user 0.006s	sys 0.004s
W20260709 13:18:23.189661  3971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.012s	sys 0.049s
I20260709 13:18:23.020457 10158 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.191412  3965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.177s	user 0.015s	sys 0.041s
W20260709 13:18:23.200145  3965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.016s	sys 0.041s
W20260709 13:18:23.192122  3971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.016s	sys 0.052s
I20260709 13:18:23.153280 10039 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.137033 10070 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:23.205725  3968 raft_consensus.cc:2410] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:18:23.206434  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.207762  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.185849  9879 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.185178 10062 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.208673  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.188287  9737 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:23.210387  4115 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.022s	sys 0.012s
W20260709 13:18:23.214980  4115 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.022s	sys 0.012s
I20260709 13:18:23.137678 10048 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.190094 10134 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:23.209272  4012 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.021s	sys 0.051s
I20260709 13:18:23.217463  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:23.229058  4012 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.022s	sys 0.052s
I20260709 13:18:23.218583  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3638) took 1225 ms. Trace:
W20260709 13:18:23.208968  9896 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.021s	sys 0.011s
I20260709 13:18:23.215839 10120 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.229606  4047 rpcz_store.cc:276] 0709 13:18:21.993000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.993373 (+   373us) service_pool.cc:224] Handling call
0709 13:18:21.993692 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:22.301246 (+307554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.301279 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:22.310550 (+  9271us) log.cc:844] Serialized 52 byte log entry
0709 13:18:22.813150 (+502600us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:18:23.216943 (+403793us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.218194 (+  1251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.218288 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.218343 (+    55us) raft_consensus.cc:1685] finished
0709 13:18:23.218356 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.218515 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68689,"raft.queue_time_us":91578,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4749,"thread_start_us":955144,"threads_started":3,"wal-append.queue_time_us":685079}
W20260709 13:18:23.228538  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.205646  9986 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:23.230505  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 734859us
I20260709 13:18:23.071563  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:23.243950  3969 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:23.251098  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.210633 10090 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:23.230576  9896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.021s	sys 0.012s
I20260709 13:18:23.254489  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.255525  4046 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:23.254590  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.259528  3970 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.256471  4120 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:23.260289  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.260815  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.257040  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.262249  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.218343 10033 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.229233 10136 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.264498  4117 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:23.259029  4046 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.262482  9896 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:23.236604  9864 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.201503 10131 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.248920  9950 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.207935 10039 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:23.261436 10057 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 1.164s	user 0.014s	sys 0.001s
I20260709 13:18:23.279805  4085 leader_election.cc:400] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
W20260709 13:18:23.281608  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.282598  4118 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.238523 10134 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.282915 10177 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 13:18:23.319029  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.283665 10168 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 13:18:23.277019 10065 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:23.273250  9935 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:23.285185 10140 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.057s	user 0.000s	sys 0.003s
I20260709 13:18:23.287235 10174 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.272987 10033 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.289197 10176 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.273205 10136 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.290526  9896 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.290987 10153 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.291688  9751 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:23.294359  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.295830  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3030) took 1341 ms. Trace:
I20260709 13:18:23.327433 10155 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.297307  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3015) took 1410 ms. Trace:
I20260709 13:18:23.347236  3971 rpcz_store.cc:276] 0709 13:18:21.954711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.544026 (+589315us) service_pool.cc:224] Handling call
0709 13:18:22.544358 (+   332us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:22.601637 (+ 57279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.601671 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:22.602388 (+   717us) log.cc:844] Serialized 52 byte log entry
0709 13:18:23.204147 (+601759us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:23.204188 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.204263 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.295615 (+ 91352us) raft_consensus.cc:1685] finished
0709 13:18:23.295634 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.295775 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56787,"raft.queue_time_us":58227,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":21743,"thread_start_us":601331,"threads_started":1,"wal-append.queue_time_us":689073}
I20260709 13:18:23.299625  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:23.301440  9941 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.000s
I20260709 13:18:23.301704  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3011) took 1415 ms. Trace:
I20260709 13:18:23.352854  3972 rpcz_store.cc:276] 0709 13:18:21.886385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.889007 (+  2622us) service_pool.cc:224] Handling call
0709 13:18:23.301551 (+1412544us) spinlock_profiling.cc:243] Waited 772 ms on lock 0x7b54003985d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:23.301651 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1775952128}
I20260709 13:18:23.303162  3970 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:23.272293  4046 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.306380  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3016) took 1418 ms. Trace:
I20260709 13:18:23.216137  9879 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.252403 10081 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.217015 10062 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.265189 10090 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:23.318877  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.325201  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.326593  4114 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
W20260709 13:18:23.340592 10066 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.777s	user 0.008s	sys 0.005s
I20260709 13:18:23.269611 10048 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:23.328992  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55931.9us
I20260709 13:18:23.250430 10120 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.327100 10166 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.367261  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.347877  3963 rpcz_store.cc:276] 0709 13:18:21.887281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.897403 (+ 10122us) service_pool.cc:224] Handling call
0709 13:18:21.897711 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.667889 (+770178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.297071 (+629182us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54004088d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:23.297251 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766023040}
I20260709 13:18:23.327971 10141 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.354619  4046 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.354914  3964 rpcz_store.cc:276] 0709 13:18:21.887557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.897873 (+ 10316us) service_pool.cc:224] Handling call
0709 13:18:21.921416 (+ 23543us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:22.534804 (+613388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.306126 (+771322us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b54001edf54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:23.306321 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114164096}
I20260709 13:18:23.218950  9737 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.345834 10096 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.409s	user 0.016s	sys 0.000s
I20260709 13:18:23.338893 10174 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.382881 10096 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.393338  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3025) took 1481 ms. Trace:
I20260709 13:18:23.270148 10154 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.360972 10155 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.394451 10154 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.395238  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3017) took 1507 ms. Trace:
I20260709 13:18:23.359189  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.396492  4112 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:23.359789  4118 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.359843  3970 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:18:23.359453 10067 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.832s	user 0.012s	sys 0.000s
I20260709 13:18:23.360213  3972 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:23.263404  9731 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.364089  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:23.336831 10029 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.370987  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.373344  3963 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:23.374451 10088 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.374657 10183 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:23.362955 10093 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.330185 10070 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.375376 10120 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.376013  3968 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:23.379398  9737 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.380544 10039 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.381346  3964 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:18:23.371624  9984 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.375821 10166 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.384081 10174 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.346603  9751 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.333560  9935 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.385040 10048 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.360527  4113 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:18:23.376080 10141 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.395622  3967 rpcz_store.cc:276] 0709 13:18:21.887782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.923545 (+ 35763us) service_pool.cc:224] Handling call
0709 13:18:21.923848 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.531989 (+608141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.395022 (+863033us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b540044cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:23.395188 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111114624}
I20260709 13:18:23.307734  9864 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.397768  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 617) took 1297 ms. Trace:
W20260709 13:18:23.379422 10069 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.848s	user 0.009s	sys 0.000s
I20260709 13:18:23.398348  4046 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 13:18:23.393756  3965 rpcz_store.cc:276] 0709 13:18:21.911695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.972484 (+ 60789us) service_pool.cc:224] Handling call
0709 13:18:21.972833 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:21.974821 (+  1988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:21.974851 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:21.978515 (+  3664us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.082796 (+1104281us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b48000030d8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7b375aa1 00007fed7b36cb37 00007fed7b36c9ca 00007fed7b46426f 00007fed7b463f37 00007fed7b47855c 00007fed7b478508 00007fed7b478488 00007fed7b478443 00007fed7b4776ec 00007fed7a3a1a96
0709 13:18:23.200621 (+117825us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:23.200663 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.200731 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.393035 (+192304us) raft_consensus.cc:1685] finished
0709 13:18:23.393058 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.393270 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55693,"raft.queue_time_us":3241,"raft.run_cpu_time_us":17433,"raft.run_wall_time_us":1105015,"spinlock_wait_cycles":4045184,"thread_start_us":1186387,"threads_started":1,"wal-append.queue_time_us":1379310}
W20260709 13:18:23.399964  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 93516.2us
I20260709 13:18:23.432945  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.432322  4119 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.433531  4119 raft_consensus.cc:614] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:23.434180  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.434559  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.434983  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.403750  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:23.435567  4042 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:23.356941 10159 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.408918  3971 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:18:23.368211 10081 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.375927 10136 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:23.401278 10170 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:18:23.340824 10176 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.356503  9941 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.417479  3972 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:23.397517  9872 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:23.420652  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.425765 10065 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:18:23.425062  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.409861  9950 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:23.430896  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.474378  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.418314 10028 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.398420 10090 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.415279 10173 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:23.436432  4046 pending_rounds.cc:85] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 8
I20260709 13:18:23.485599  4046 pending_rounds.cc:107] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:18:23.485877  4046 raft_consensus.cc:2889] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:23.486209  4046 pending_rounds.cc:107] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:18:23.486439  4046 raft_consensus.cc:2889] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:23.487275  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44712.4us
I20260709 13:18:23.436811  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.432085 10048 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.488494  4040 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:23.488613  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:23.430686  4116 rpcz_store.cc:276] 0709 13:18:22.100135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.100628 (+   493us) service_pool.cc:224] Handling call
0709 13:18:22.100950 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.397165 (+1296215us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b180043bc40. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76444bfb 00007fed7644f64b
0709 13:18:23.397293 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.397319 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.397372 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:23.397404 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.397611 (+   207us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.397718 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27503,"raft.queue_time_us":215026,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":11585,"spinlock_wait_cycles":78139264,"thread_start_us":316913,"threads_started":1}
I20260709 13:18:23.440972 10069 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.423801 10158 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.404532 10067 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.508983  4120 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:23.509922 10067 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.444828  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.482697 10131 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.448580  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.511340  4043 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 10.
I20260709 13:18:23.449509  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.511981 10136 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:23.458535  9935 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.426115 10155 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.413455 10029 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.512192  3965 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:23.471621  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.473834  4121 raft_consensus.cc:1813] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.514266  3969 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.514545  4121 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:18:23.510676  3968 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:23.477139  3967 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:23.512267  4118 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:23.430940  3964 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:18:23.462913  9830 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.467193  9890 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.427382 10120 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:18:23.483240  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.519392  3972 raft_consensus.cc:2410] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:23.520704 10176 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.490715 10173 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.464648 10081 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.490325  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.490388  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:23.494887 10048 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.478464  9872 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.527426  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.527623  9935 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:23.495990 10142 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:23.528292 10142 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.528553  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.529580 10142 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.531003  4121 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:23.484489 10028 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.531450 10173 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.498564  9896 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:23.532070  9896 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.532446  9896 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.532830  3972 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.534970  3972 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:23.536091  3972 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:18:23.536172  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.537120 10029 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.538342  9830 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:23.538595 10141 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:23.539062  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48768.6us
I20260709 13:18:23.505343  9879 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.506137  9941 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.530954 10142 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.538348 10028 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.507998 10062 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.510600  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:23.461858 10050 consensus_meta.cc:287] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.588s	user 0.014s	sys 0.000s
I20260709 13:18:23.421752 10153 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.485349 10134 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.512780 10166 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.517930  3964 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:23.480049 10190 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.522679  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.625536  3972 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:23.625982 10163 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.056s	user 0.003s	sys 0.000s
I20260709 13:18:23.629608 10050 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.630013 10111 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.631210 10111 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:23.620278 10153 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.633038 10190 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.634953 10153 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.635284 10190 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.635859 10190 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.630067 10050 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.523694 10183 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:23.524791  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.632165  9896 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.539487 10154 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:23.567237  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 112697us
I20260709 13:18:23.469702 10174 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.641870  4118 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [14.9-16.10]
I20260709 13:18:23.516650 10188 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:23.614781  3971 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:23.484622  9751 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.643781  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 215254us
I20260709 13:18:23.615648  4120 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:23.637254 10050 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:23.622277  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 99657.3us
I20260709 13:18:23.526441  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.646100  4116 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:23.647616  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.648489  4042 raft_consensus.cc:2410] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:23.645313  4120 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
W20260709 13:18:23.619364 10191 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.068s	user 0.005s	sys 0.000s
I20260709 13:18:23.649775  4120 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:23.650751  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.651245  4118 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:18:23.652021  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.651494  4046 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:23.653499  4120 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:23.654713  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.655607  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.636475 10190 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.659273  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.660248  4043 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:23.665627  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2916) took 1053 ms. Trace:
I20260709 13:18:23.666074  4041 rpcz_store.cc:276] 0709 13:18:22.612087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.693399 (+ 81312us) service_pool.cc:224] Handling call
0709 13:18:22.693755 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.886710 (+192955us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.886743 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:23.513239 (+626496us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b2c000a5238. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:23.513659 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.523149 (+  9490us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:23.523762 (+   613us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.525207 (+  1445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.525325 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.665319 (+139994us) raft_consensus.cc:1685] finished
0709 13:18:23.665428 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:23.665563 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":193718,"prepare.queue_time_us":165,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":194297,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":61667,"spinlock_wait_cycles":9736064,"thread_start_us":9141,"threads_started":1,"wal-append.queue_time_us":107316}
I20260709 13:18:23.668915  9751 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.663328  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.670596  4120 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:23.670912  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:23.671399  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.672077  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:23.675865  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:23.678977  4120 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:23.679328  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.680994  4120 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:23.684296  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.678454 10153 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:23.686075 10153 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.687278  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:23.688619  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.691098  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:23.677875  9737 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.695286 10153 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.697907 10141 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:23.698392 10141 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.699298 10141 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.699982 10158 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:23.702543 10096 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.656036 10174 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:23.703896  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.681588  9731 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.680936 10155 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:23.681442 10067 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:23.699342  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.706709  9864 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.693890 10028 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:23.686827  9941 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:23.682973  9830 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:23.704670  9737 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.712987 10090 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.729842  3971 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:23.684327 10159 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:18:23.696516 10153 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.681923 10195 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:23.717334  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.721432  4011 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.694316 10048 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.704442 10069 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.736068  3964 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:23.683804  9950 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:18:23.684437 10057 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:18:23.703780 10136 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:18:23.736449  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.732470  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.723186  4120 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.721765 10155 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:23.725076 10142 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:23.750190  4121 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:23.741204 10028 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.739672  9830 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:23.755452 10088 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:23.720709 10131 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:23.722025 10149 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:18:23.757078  9864 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:23.759109  9890 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:23.761934  9872 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.762761  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.768345 10136 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:23.740926 10048 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.756999  9941 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:23.778309  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.720118  9731 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.785017  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:23.789160  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.791644  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.794986  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.783738 10088 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:23.794687  3964 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:23.781853 10031 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:23.782660 10142 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.782869 10174 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.801209  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.794225  9890 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.782183  9984 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.785935 10195 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:18:23.803057  4683 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:18:23.804672  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:23.814602  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.819571  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3018) took 1931 ms. Trace:
I20260709 13:18:23.790210 10154 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:18:23.793149 10159 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:23.788466  9864 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:23.782188 10028 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:23.797403  9941 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.825034  4121 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:23.793988 10039 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.827104  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.802647  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.820818 10202 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:23.797178 10136 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:23.837543  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.839552  3966 rpcz_store.cc:276] 0709 13:18:21.887978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.938649 (+ 50671us) service_pool.cc:224] Handling call
0709 13:18:21.938939 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:22.166947 (+228008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.819320 (+1652373us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001caa54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:23.819501 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478281088}
I20260709 13:18:23.788187  9911 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:23.829178  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.820070 10031 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.825557 10142 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:23.840842  9984 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.878954  9984 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.880380  4676 raft_consensus.cc:1813] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.828426  9896 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.799156  9935 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:18:23.857195 10155 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.883304  9935 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:23.883455 10178 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.460s	user 0.002s	sys 0.002s
I20260709 13:18:23.883709  9935 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.884747  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.884635  9935 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.885780  3969 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.886128  9935 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.857955  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.864689  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.890852  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.881042  4676 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
W20260709 13:18:23.865101  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.866549 10057 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.892392 10057 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.893419  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.893689  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.873971 10039 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.894253  9950 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:23.854984  9731 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.844620 10066 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:18:23.876667  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.872633  9911 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.894948 10066 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:23.895121  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.895381 10066 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:23.895931  4675 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:23.896656  9911 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.897210  9911 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.860286 10159 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:23.898165  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.898684  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.899307  3969 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:23.899516  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:23.899976 10081 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.880956 10070 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:23.900520  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.900935 10070 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.901434  4119 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:23.902459  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.903015 10070 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:23.898453 10202 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:23.905985  9731 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.906653  9731 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.908649  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:23.909166  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:23.909456  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.877074 10031 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.925508  4118 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:23.910641  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.909166  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.868983  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:23.911489  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.927924  3966 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.866245 10028 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:23.853790  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.890769  4121 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:23.866951  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.912304  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.930231  4683 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:23.913573  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.875583  9864 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.890769  3967 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.906145  4119 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:23.928784  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.930363  3969 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.930433  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:23.933835  3968 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.933902  4012 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:23.934289  4121 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:23.935081  4112 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:23.937188  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.937095  4119 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:23.853022  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:23.891486 10203 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:18:23.868695  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 149830us
I20260709 13:18:23.937927  3967 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.904461  9950 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:23.897645  9911 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:23.969439 10158 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:18:23.897656 10136 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.947858  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.980114  4038 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:23.980789 10039 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.858027 10050 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.981796  4675 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.982098  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:23.982949 10050 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:23.983282  3964 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:23.925802 10070 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.894649 10057 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:23.991384  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.953819  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.858172 10088 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.938642  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.980576  3970 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:23.985430  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:23.949576 10154 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:23.982852  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:23.970515  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:23.986369  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:23.947974  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:23.983141  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:23.943099 10195 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:23.984395  9864 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:23.929354  9984 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:23.943061  9751 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 13:18:23.942903 10067 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.066872  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:23.955520  4678 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:24.026638  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3631) took 2714 ms. Trace:
I20260709 13:18:24.114198  4045 rpcz_store.cc:276] 0709 13:18:21.312608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:21.376606 (+ 63998us) service_pool.cc:224] Handling call
0709 13:18:21.377047 (+   441us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:18:21.797874 (+420827us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:18:21.808283 (+ 10409us) log.cc:844] Serialized 14 byte log entry
0709 13:18:21.957145 (+148862us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:18:21.958323 (+  1178us) log.cc:844] Serialized 78 byte log entry
0709 13:18:21.958490 (+   167us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:21.976841 (+ 18351us) log.cc:844] Serialized 14 byte log entry
0709 13:18:23.282125 (+1305284us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b18004a9500. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:23.284650 (+  2525us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:24.006991 (+722341us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b18004a9500. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287
0709 13:18:24.007333 (+   342us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.026275 (+ 18942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.026359 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.026397 (+    38us) raft_consensus.cc:1685] finished
0709 13:18:24.026408 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.026574 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":254765,"prepare.queue_time_us":1354546,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":282369,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":15886,"spinlock_wait_cycles":94085376,"thread_start_us":154207,"threads_started":2,"wal-append.queue_time_us":180789}
I20260709 13:18:23.950485  9731 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.079041  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:24.127550  3965 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:24.080386  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.075103  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3517) took 1103 ms. Trace:
I20260709 13:18:24.080937  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.068900  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:24.130353  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:23.984159  9872 consensus_queue.cc:1175] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8c8b10100a146e6a81f308505fe9f46" responder_term: 19 status { last_received { term: 19 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 19 index: 12 } }
I20260709 13:18:23.969249  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:24.132514  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:24.132917  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.082086 10195 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:24.134474 10195 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.129546  3970 rpcz_store.cc:276] 0709 13:18:22.972081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.402570 (+430489us) service_pool.cc:224] Handling call
0709 13:18:23.980272 (+577702us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b5800002a98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327eee 0000000000375939 00007fed7b39b1e0 00007fed7b4640c4 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:23.980423 (+   151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.074546 (+ 94123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.074991 (+   445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4610816}
I20260709 13:18:23.898574 10159 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.086902  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2885) took 1432 ms. Trace:
I20260709 13:18:24.142550  4115 rpcz_store.cc:276] 0709 13:18:22.654368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:22.654483 (+   115us) service_pool.cc:224] Handling call
0709 13:18:22.654792 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:22.655169 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:22.655196 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:22.655651 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:18:23.215642 (+559991us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:23.215681 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:23.215745 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:23.882839 (+667094us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:24.082376 (+199537us) raft_consensus.cc:1685] finished
0709 13:18:24.082402 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.086817 (+  4415us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1365,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"spinlock_wait_cycles":14381440,"thread_start_us":559592,"threads_started":1,"wal-append.queue_time_us":716702}
I20260709 13:18:23.980177 10136 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:23.970752 10116 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:18:24.085772 10154 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:24.075088  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 104645us
I20260709 13:18:24.092473  4044 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:23.904538 10202 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:23.853845  9830 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.121145  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.122035  4045 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.123904  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.130580  4047 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:24.083130  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 131968us
I20260709 13:18:24.131290  3968 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:18:24.125677 10088 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.083904 10174 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:24.139003  4677 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:24.146256  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:24.133544 10140 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:24.066857 10070 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.146652  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:24.149772  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:24.165293  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:24.150907 10203 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.063s	user 0.002s	sys 0.001s
I20260709 13:18:24.197284  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:24.126060 10067 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.111167  9984 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.146072  9950 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:24.268296  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.197937  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 252574us
I20260709 13:18:24.209204  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.247905  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:24.200400  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70016.8us
W20260709 13:18:24.300230  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.327171  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 203321us
I20260709 13:18:24.328377  3937 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.328804  4675 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
W20260709 13:18:24.329478  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.329869  4043 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:24.330780  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:24.331344  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.331467  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:24.332023  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.333913  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:24.332190  4120 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:24.329458  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.341898  4043 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.343058  4038 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:24.343758  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:24.350987  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:24.351579  4047 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.351897  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:24.352308  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.352576  4013 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:24.353096  4042 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:24.354418  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:24.350895  4116 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:24.351464  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.352690  4118 raft_consensus.cc:2410] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:18:24.357839  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:24.359586  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 162376us
I20260709 13:18:24.360633  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:24.360715  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:24.305195 10211 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:18:24.365773  4038 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:24.370187  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:24.366072  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.366525  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:24.371510  4118 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:24.371907  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:24.305963 10205 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:18:24.360998  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:24.375010  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.373241  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.370559  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:24.288137  9737 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.270679 10217 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.386572  4684 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:24.378796  4112 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:24.426611  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:24.359699 10081 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:24.364934 10131 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:24.429659  4043 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:24.427800  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:24.367993 10116 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:24.453267  4047 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:24.371712 10187 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:24.455854 10187 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:24.456362  4047 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:24.456890  4042 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.371857 10134 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.373132 10096 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:24.373021 10120 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:24.464619  4118 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:24.401647 10217 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.388360  9911 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:24.453760  9737 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:24.357321 10154 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.8, Last appended by leader: 8, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:24.496037  9890 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.002s
I20260709 13:18:24.456357 10187 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:24.497550 10219 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:18:24.485450 10217 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:24.499806 10216 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:18:24.501258 10215 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.461570 10174 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.505759 10070 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.462436 10214 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:24.508400 10142 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.631s	user 0.006s	sys 0.002s
I20260709 13:18:24.454946 10131 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.512266 10134 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:24.547832  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 120092us
W20260709 13:18:24.514870  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:24.499879 10066 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.000s
I20260709 13:18:24.517731  4684 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:18:24.553220  4684 pending_rounds.cc:85] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 12
I20260709 13:18:24.553539  4684 pending_rounds.cc:107] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260709 13:18:24.553776  4684 raft_consensus.cc:2889] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:24.486620 10081 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.527983  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3041) took 1099 ms. Trace:
I20260709 13:18:24.555130 10081 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:24.528519 10215 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.525170 10148 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.512674  9911 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.553220 10066 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.556447 10081 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.556178  9911 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.558904  9911 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:24.555116  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 181943us
I20260709 13:18:24.555985 10148 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.563645 10148 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:24.555840  3963 rpcz_store.cc:276] 0709 13:18:23.428570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.623587 (+195017us) service_pool.cc:224] Handling call
0709 13:18:23.623853 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.637219 (+ 13366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.637250 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.637290 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:23.637319 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.527746 (+890427us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540030be54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:24.527794 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.527924 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30322432}
I20260709 13:18:24.565068  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:24.565667  3963 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:24.566596  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:24.570399  4682 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:24.571399 10066 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:24.574033  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 202525us
I20260709 13:18:24.575230  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:24.524005 10174 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:24.582017  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 221068us
I20260709 13:18:24.583281  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:24.591910  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:24.524130 10226 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.595405  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:24.549877 10131 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.516508  9890 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.627000  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:24.645200  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:18:24.646037  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54216.8us
W20260709 13:18:24.629216  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.647501  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:24.648146  4121 raft_consensus.cc:606] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:24.648500  4121 raft_consensus.cc:614] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:24.629292  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.550110 10142 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.621572 10212 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.621109 10148 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.682601  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:24.548285 10214 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.576133 10134 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.666774 10117 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:18:24.694628  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 328611us
I20260709 13:18:24.695551  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.728570  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:24.626267 10239 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:24.677821 10226 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.731590  4047 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:24.765604 10226 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.667366 10158 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:24.678390 10116 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:24.766001 10226 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.766211  9890 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.729988  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.689291 10148 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.742039 10151 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:24.741935 10235 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:24.749183  9984 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:24.753425  3972 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:18:24.689831 10067 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:24.681473  9935 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:18:24.756515 10142 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.681294 10111 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:24.761512 10136 consensus_meta.cc:287] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.001s
I20260709 13:18:24.645494  9737 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:18:24.625747 10195 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.669911 10234 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:24.691365 10065 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:18:24.811636  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:24.815594  4114 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.830901  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3051) took 1019 ms. Trace:
I20260709 13:18:24.861657  3970 rpcz_store.cc:276] 0709 13:18:23.809522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.135958 (+326436us) service_pool.cc:224] Handling call
0709 13:18:24.136253 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.136440 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:24.274032 (+137592us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.821144 (+547112us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.823940 (+  2796us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.825140 (+  1200us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:24.825747 (+   607us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.826541 (+   794us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.828207 (+  1666us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26084,"prepare.queue_time_us":322125,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":46204,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":3982,"spinlock_wait_cycles":59630336,"thread_start_us":678225,"threads_started":3,"wal-append.queue_time_us":253492}
I20260709 13:18:24.863929  3970 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:24.832747  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3056) took 1017 ms. Trace:
W20260709 13:18:24.797397  9864 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.005s
I20260709 13:18:24.772578 10148 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.793136 10151 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:24.869071 10151 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.873546 10236 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:24.677325 10224 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 13:18:24.769239 10158 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:24.853478  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
W20260709 13:18:24.841073 10031 consensus_meta.cc:287] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.888s	user 0.007s	sys 0.005s
I20260709 13:18:24.876151 10031 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:24.855144 10028 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.908s	user 0.010s	sys 0.000s
I20260709 13:18:24.844517 10067 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:24.844264 10111 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.857406  4046 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:24.858183 10195 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:24.859917 10234 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:24.882871  4044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.006s
W20260709 13:18:24.885205  4044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.007s	sys 0.006s
I20260709 13:18:24.883870  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3536) took 1207 ms. Trace:
I20260709 13:18:24.886559  3965 rpcz_store.cc:276] 0709 13:18:23.676164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.128438 (+452274us) service_pool.cc:224] Handling call
0709 13:18:24.136954 (+  8516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.137304 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.137335 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.137807 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.334656 (+196849us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:24.846470 (+511814us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.883424 (+ 36954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.883627 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:24.883680 (+    53us) raft_consensus.cc:1685] finished
0709 13:18:24.883692 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.883814 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34684,"prepare.queue_time_us":155454,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":39756,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11505,"thread_start_us":663354,"threads_started":2,"wal-append.queue_time_us":342468}
I20260709 13:18:24.890945  3965 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:24.892194  3965 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:24.881714  3968 rpcz_store.cc:276] 0709 13:18:23.815464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.327815 (+512351us) service_pool.cc:224] Handling call
0709 13:18:24.371043 (+ 43228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.371225 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:24.575940 (+204715us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.832396 (+256456us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.832453 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:24.832499 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.832567 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.832690 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43318,"prepare.queue_time_us":119107,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":10664,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10581,"thread_start_us":443846,"threads_started":2}
I20260709 13:18:24.861451 10237 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.848799 10096 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:24.900823  4038 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:24.875838 10158 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:24.729140 10212 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.914160  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:24.920578 10134 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:24.921583  4120 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 13:18:24.921913 10214 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:24.922564  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:24.925833  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 503) took 1130 ms. Trace:
I20260709 13:18:24.926198  4679 rpcz_store.cc:276] 0709 13:18:23.795160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.795358 (+   198us) service_pool.cc:224] Handling call
0709 13:18:23.795666 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:23.910938 (+115272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:23.910971 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:23.911018 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:23.911049 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.925616 (+1014567us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54009826d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:24.925661 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.925768 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264567168}
I20260709 13:18:24.879770 10217 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.927472 10174 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.928865 10217 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:24.931991 10031 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.926767 10151 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.942711 10151 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.943255 10151 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.943691 10151 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.945816 10151 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.947049 10131 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:24.949122  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:24.949354 10131 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:24.906108 10237 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:24.950655  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3215) took 1697 ms (client timeout 1911 ms). Trace:
W20260709 13:18:24.951063  4113 rpcz_store.cc:269] 0709 13:18:23.253571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.262008 (+  8437us) service_pool.cc:224] Handling call
0709 13:18:24.950437 (+1688429us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54001446d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:24.950579 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218025984}
I20260709 13:18:24.953336  4684 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:24.914556  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:24.955996  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:24.905524  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 175620us
I20260709 13:18:24.959152  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:24.959475  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:24.959681  4677 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.920833  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:24.882195 10067 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:24.876665 10033 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.964073  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:24.964259  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:24.979807  3965 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:24.965307  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3052) took 1155 ms. Trace:
I20260709 13:18:24.965405  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:24.965730  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 336473us
I20260709 13:18:24.982412  4113 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:24.966768  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:24.963274 10148 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:24.987339 10148 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.966995  3938 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:24.967480  4112 raft_consensus.cc:2368] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:24.899744  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3054) took 1087 ms. Trace:
I20260709 13:18:24.887333 10234 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:24.990754  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:24.903264  9984 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.905273 10195 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.982218  3964 rpcz_store.cc:276] 0709 13:18:23.810259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.309084 (+498825us) service_pool.cc:224] Handling call
0709 13:18:24.309434 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.309668 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:24.668916 (+359248us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.964980 (+296064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.965036 (+    56us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:24.965081 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.965146 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.965251 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179762,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"thread_start_us":629443,"threads_started":2}
I20260709 13:18:24.989807  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.993057  4120 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:24.993413  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.001315  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:24.918936  9935 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:25.004240  9935 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.004627  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.005930  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.006572  9935 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.882515 10028 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.008854 10028 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.009918  9872 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.006873  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.010663  9872 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:25.011895  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.009569  4041 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:18:25.016944  3968 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.021802  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.022958 10217 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.025904  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.027031 10217 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:24.967810  9879 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:24.962091 10237 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:24.962781 10096 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:24.979110 10067 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:24.990490  3966 rpcz_store.cc:276] 0709 13:18:23.812348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.314557 (+502209us) service_pool.cc:224] Handling call
0709 13:18:24.314840 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.315046 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:18:24.677779 (+362733us) log.cc:844] Serialized 14 byte log entry
0709 13:18:24.899453 (+221674us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.899504 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:24.899544 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.899598 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:24.899696 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13807,"prepare.queue_time_us":174877,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":13916,"spinlock_wait_cycles":3432320,"thread_start_us":560161,"threads_started":2}
W20260709 13:18:25.038193  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 179828us
I20260709 13:18:25.036386  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:24.940455 10187 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:25.038597  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49736.5us
I20260709 13:18:24.990454 10081 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.045446  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.035442  3965 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:25.041225  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:24.994415 10151 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.036105  3968 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:25.066233  4113 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:25.070256  3972 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.071795  3966 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:25.076591  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.079145 10081 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.079725 10081 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:25.079527  9941 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.080535  9941 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.082264 10187 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.034456  9984 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.086115 10212 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.087248  9984 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.093537 10254 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.097376 10254 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.098922 10236 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.099401 10236 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.093717  9830 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:25.100277  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:25.100926  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60686.9us
I20260709 13:18:25.102445 10174 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.105489  4677 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:25.106771  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:25.107328  9200 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.035302 10131 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:18:25.107684 10120 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:25.031011 10235 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
I20260709 13:18:25.109696 10235 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:25.110009 10235 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:25.110780 10235 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.111913 10235 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.099433 10254 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.113425 10254 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:25.113941  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 445) took 1322 ms. Trace:
I20260709 13:18:25.114074 10254 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:25.114311  4676 rpcz_store.cc:276] 0709 13:18:23.791254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.791388 (+   134us) service_pool.cc:224] Handling call
0709 13:18:25.113715 (+1322327us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b54008d9ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.113864 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181677824}
I20260709 13:18:25.114934 10254 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.037901  9879 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.073765 10151 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.119498  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:25.120083  4039 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.039783 10096 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.118439  4680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 510) took 1225 ms. Trace:
I20260709 13:18:25.100423  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.124440  4121 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:25.104467  4012 leader_election.cc:400] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:25.129395  4012 leader_election.cc:403] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:25.100433 10251 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:25.108534 10131 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:25.035812 10195 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.107769  9200 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.128609  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.084910  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 881) took 1156 ms. Trace:
W20260709 13:18:25.094434 10242 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 13:18:25.134799  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58278.3us
I20260709 13:18:25.120477 10151 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.107051 10252 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:25.119732  9879 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.123112  4680 rpcz_store.cc:276] 0709 13:18:23.892578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.892931 (+   353us) service_pool.cc:224] Handling call
0709 13:18:25.115961 (+1223030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.116132 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.116155 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.116195 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:25.116223 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.116274 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.118179 (+  1905us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54008d9ad0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.118279 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2811828480}
I20260709 13:18:25.160986  4039 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:25.168279  3963 rpcz_store.cc:276] 0709 13:18:23.928355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.567527 (+639172us) service_pool.cc:224] Handling call
0709 13:18:24.567820 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.568499 (+   679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.568536 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.569159 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 13:18:24.884392 (+315233us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:24.884437 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.884501 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.084694 (+200193us) raft_consensus.cc:1685] finished
0709 13:18:25.084716 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.084855 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":313369,"threads_started":1,"wal-append.queue_time_us":513715}
I20260709 13:18:25.104506 10174 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:18:25.075623 10134 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:18:25.169623  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65314.3us
I20260709 13:18:25.181598  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:25.116631 10088 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.759s	user 0.006s	sys 0.000s
I20260709 13:18:25.169713 10081 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.172695  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.166756  9986 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:25.124058  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.092741 10226 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:25.187606  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63634.1us
I20260709 13:18:25.188344 10246 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:18:25.185088  9935 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.183089 10212 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:25.194072 10212 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.183039 10134 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.195933 10134 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.199729  4040 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:25.133319 10159 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:25.178535  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.127467  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.206411  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.122354 10096 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.100409  9830 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:25.169435 10155 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:25.166899 10131 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:25.183414  9200 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.171911  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.184268  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:25.176550 10141 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:25.185952  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 191177us
I20260709 13:18:25.187755  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3053) took 1376 ms. Trace:
I20260709 13:18:25.207706  3963 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:25.169199 10251 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:25.208312  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 214955us
W20260709 13:18:25.216533  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44722.3us
I20260709 13:18:25.177022 10158 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.224076  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.223305  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.228147  3963 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.223233  3971 rpcz_store.cc:276] 0709 13:18:23.810868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.310769 (+499901us) service_pool.cc:224] Handling call
0709 13:18:24.311063 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.311252 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:24.769199 (+457947us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.179344 (+410145us) log.cc:844] Serialized 14 byte log entry
0709 13:18:25.187405 (+  8061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:25.187456 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:25.187503 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.187577 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.187693 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31172,"prepare.queue_time_us":179902,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":66,"raft.queue_time_us":48115,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"thread_start_us":838177,"threads_started":3,"wal-append.queue_time_us":401823}
I20260709 13:18:25.204530 10142 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:25.225251  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:25.225771  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.231024  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.231778  4039 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:25.222401  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:25.236544  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.237834  3967 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:25.233290 10233 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:25.239153 10233 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.212435  9935 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.240268  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2935) took 1090 ms. Trace:
I20260709 13:18:25.240945 10136 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.241673  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.212690  9830 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.243327  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:25.177702 10252 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:25.246713  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.216197 10155 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.249665  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.240634  4044 rpcz_store.cc:276] 0709 13:18:24.150243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.365889 (+215646us) service_pool.cc:224] Handling call
0709 13:18:24.372454 (+  6565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:24.885621 (+513167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.885654 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:24.886128 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.186587 (+300459us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:25.186624 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.186691 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.240057 (+ 53366us) raft_consensus.cc:1685] finished
0709 13:18:25.240078 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.240210 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38993,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":13566,"thread_start_us":808933,"threads_started":2,"wal-append.queue_time_us":351847}
I20260709 13:18:25.250409  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.251201  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.251852 10261 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:25.251762  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.265846  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.266016 10195 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.218361 10031 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:18:25.266484  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:25.266906 10263 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:25.248075 10111 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.268024  4648 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:25.268471 10261 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.268980 10261 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:25.209823 10187 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:25.247599  9872 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:25.254666  9864 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:25.256001 10233 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.200904 10081 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.204473  9986 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.226963 10209 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:25.270452  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.261442  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.258620 10136 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:18:25.264541  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.240649  9935 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.272665 10251 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.274984  9950 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.275784  4039 raft_consensus.cc:2410] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:25.277099  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3058) took 1192 ms. Trace:
I20260709 13:18:25.308164  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:25.315577 10136 consensus_queue.cc:1243] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:25.316211 10136 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:25.281567 10131 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.317625  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.264513 10148 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.298930  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.295116 10212 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.299525 10153 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:25.320029 10153 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:25.321133  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59752.3us
I20260709 13:18:25.320968 10153 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.322348 10153 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.322921 10188 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:25.314775  3970 rpcz_store.cc:276] 0709 13:18:24.084441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.864698 (+780257us) service_pool.cc:224] Handling call
0709 13:18:24.865012 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:24.887756 (+ 22744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:24.887787 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:24.900815 (+ 13028us) log.cc:844] Serialized 52 byte log entry
0709 13:18:25.073804 (+172989us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:25.073843 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.073911 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:25.276863 (+202952us) raft_consensus.cc:1685] finished
0709 13:18:25.276886 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.277029 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25152,"raft.queue_time_us":33418,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":2115,"thread_start_us":81815,"threads_started":1,"wal-append.queue_time_us":218974}
I20260709 13:18:25.319741 10232 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:18:25.324631 10239 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:25.300468 10158 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.294482  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:25.294265 10252 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.287279 10070 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:25.326400  4044 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:25.280887 10237 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:25.326920 10237 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.327306 10237 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.327363  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.318163  9986 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.323625 10188 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:18:25.310462  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:25.330780  4678 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:25.306525 10234 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.331321  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3654) took 1378 ms. Trace:
I20260709 13:18:25.331971  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 509) took 1439 ms. Trace:
I20260709 13:18:25.332561  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3662) took 1130 ms. Trace:
I20260709 13:18:25.326436 10070 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:25.319536  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.330782  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 885) took 1389 ms. Trace:
I20260709 13:18:25.319387  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2944) took 1039 ms. Trace:
I20260709 13:18:25.330130  9890 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:25.292974 10048 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.335036  9890 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.335896  9890 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.337268  9890 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.318118 10131 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:25.338500  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.339040 10190 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.332363  4682 rpcz_store.cc:276] 0709 13:18:23.892295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.893450 (+  1155us) service_pool.cc:224] Handling call
0709 13:18:25.331787 (+1438337us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54006801d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.331916 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554514816}
I20260709 13:18:25.340062  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3250) took 1470 ms. Trace:
I20260709 13:18:25.316570 10136 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:25.341650 10136 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.334393  3972 rpcz_store.cc:276] 0709 13:18:23.941838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.845122 (+903284us) service_pool.cc:224] Handling call
0709 13:18:24.845397 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.073374 (+227977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.330573 (+257199us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400397bd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:25.330727 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516685696}
I20260709 13:18:25.332865  4683 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:25.345160  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.345763  3971 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.345898 10217 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:25.346853 10217 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:25.347177 10173 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.334741  4043 rpcz_store.cc:276] 0709 13:18:24.279647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.330551 (+ 50904us) service_pool.cc:224] Handling call
0709 13:18:25.319236 (+988685us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400020dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.319330 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24288128}
I20260709 13:18:25.348269  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.348907  4116 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:25.349347 10239 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.300629  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.350214 10239 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.351245  4045 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:25.351460 10239 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.351881  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.337138  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.353273  4114 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.354096  4047 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:25.334862  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.357549  4042 raft_consensus.cc:2410] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:18:25.356624  4040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 3646) took 1451 ms (client timeout 1866 ms). Trace:
W20260709 13:18:25.358323  4040 rpcz_store.cc:269] 0709 13:18:23.905658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.908796 (+  3138us) service_pool.cc:224] Handling call
0709 13:18:25.356459 (+1447663us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540035cfd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.356567 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2950768384}
I20260709 13:18:25.266127 10236 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.357698  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:25.352659  4683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 493) took 1409 ms. Trace:
I20260709 13:18:25.331682  4046 rpcz_store.cc:276] 0709 13:18:23.953388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.953595 (+   207us) service_pool.cc:224] Handling call
0709 13:18:25.331172 (+1377577us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b54001199d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.331269 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1817094016}
I20260709 13:18:25.312605  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3642) took 1465 ms. Trace:
I20260709 13:18:25.363488  4679 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:25.360015  3963 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:25.332962  4038 rpcz_store.cc:276] 0709 13:18:24.202120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.388012 (+185892us) service_pool.cc:224] Handling call
0709 13:18:24.388279 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.904423 (+516144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.332350 (+427927us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54003dbb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:25.332506 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090423168}
I20260709 13:18:25.326030  4680 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:25.340431  4119 rpcz_store.cc:276] 0709 13:18:23.869735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.944915 (+ 75180us) service_pool.cc:224] Handling call
0709 13:18:24.952110 (+1007195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:24.952425 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:24.952453 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:24.952498 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:24.952527 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:24.952592 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:25.339889 (+387297us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54001446d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.339993 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10775,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":20124,"spinlock_wait_cycles":2236657920}
I20260709 13:18:25.316546  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:18:25.293789  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.318924  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.351958  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.365649  4045 raft_consensus.cc:2410] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:18:25.328461  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.306600  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:25.261435 10155 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:25.371789  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 107299us
I20260709 13:18:25.374459  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.290482  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:25.348723  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.378288  4043 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:25.362969  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:25.279155  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:25.363646  4042 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:25.365911  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:25.342816 10136 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.369547  4676 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 17: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:25.364300  4683 rpcz_store.cc:276] 0709 13:18:23.943013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.943175 (+   162us) service_pool.cc:224] Handling call
0709 13:18:25.332658 (+1389483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.345017 (+ 12359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.352488 (+  7471us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54006801d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:25.352604 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3167768960}
W20260709 13:18:25.396958  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 117900us
I20260709 13:18:25.396283  3870 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:25.399878  4675 raft_consensus.cc:2368] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:25.382956  4681 raft_consensus.cc:2368] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:25.363682  4041 rpcz_store.cc:276] 0709 13:18:23.846936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.848270 (+  1334us) service_pool.cc:224] Handling call
0709 13:18:23.848577 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.013000 (+1164423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.312286 (+299286us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540028cb54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:25.312531 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2669372160}
I20260709 13:18:25.403100  4113 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:18:25.402352  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.403990  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.332754 10234 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.316481 10081 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.405932  9200 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:25.410848  9200 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.347146 10217 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:25.411258  9200 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.407570  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.411598  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.408707  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.412256  3971 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:25.412703  4120 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.413467  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:25.413722  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.347589 10173 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.412124  4112 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:25.369280 10212 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.384518 10251 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.311941 10067 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.282711 10187 consensus_queue.cc:1243] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 19.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:18:25.423691  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.434424  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:25.432093  4681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 447) took 1639 ms (client timeout 1897 ms). Trace:
I20260709 13:18:25.435832  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:25.425079  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50834.3us
I20260709 13:18:25.429064  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.437943  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.298803 10134 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.405139 10148 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:25.429811  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.424662  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.431315  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.432475  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.440737  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.439931  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:25.430135 10262 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:25.433784 10234 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.445609 10233 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:25.445760 10234 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.431406 10251 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.447875 10234 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.448071 10251 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.421104 10031 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 13:18:25.433131  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.448864 10262 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.431833  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.449466 10262 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.451503 10262 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.452996  3970 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:25.458276 10067 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.418670 10033 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:25.429385 10048 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:25.429693  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47802.4us
W20260709 13:18:25.435994  4681 rpcz_store.cc:269] 0709 13:18:23.791840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.791970 (+   130us) service_pool.cc:224] Handling call
0709 13:18:25.290303 (+1498333us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:18:25.431199 (+140896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4929920}
I20260709 13:18:25.470733  3969 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:18:25.437032  4113 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:25.440721  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.440991  3968 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:25.448714  3967 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:18:25.459525  3972 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:25.405061 10236 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:25.463291  4112 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:25.293637  9872 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:25.432240 10081 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:25.468624  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.440076  4680 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:25.474716 10234 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.478783  3970 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:25.461061 10065 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:25.466136  3966 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:25.468339  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.473456  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.334160 10070 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.434362 10210 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:25.474905  4120 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:25.470790  4118 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:25.477193  4013 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:25.484598  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76195.7us
I20260709 13:18:25.433976 10209 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:18:25.510994  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 11 to 17, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 17 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:25.480327 10233 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:25.474823 10236 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:25.461426 10235 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:25.483879  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 257846us
I20260709 13:18:25.484395  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.435339 10212 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:25.554416  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47588.4us
I20260709 13:18:25.557106  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:25.558976  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 81861.1us
I20260709 13:18:25.559667  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:25.562709  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.566112  3972 raft_consensus.cc:2393] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:25.572939  3972 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:25.575166  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.433347 10215 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:18:25.477139  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.515606  3938 leader_election.cc:400] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:25.577728  3972 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 9. (term mismatch)
I20260709 13:18:25.579408  3972 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:18:25.579695  3972 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 18.9
I20260709 13:18:25.484130 10111 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:18:25.514911  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:25.585289  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.588434  4117 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:25.592432  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.593127  3963 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:25.463917  4114 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:25.516193 10233 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.600857 10233 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:25.505329 10234 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.602149 10141 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
W20260709 13:18:25.579651  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 102616us
I20260709 13:18:25.482854 10187 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:25.580242  3938 leader_election.cc:403] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:25.554104 10033 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.459380 10148 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.559542 10235 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.517403  4119 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:25.514863  9950 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:25.576846  9941 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:25.517675 10070 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.474251 10173 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.580607  3972 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:25.608415  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 92939.6us
I20260709 13:18:25.616628 10251 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:25.603597  3870 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 4 to 8, term changed from 8 to 10, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to <none>, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New cstate: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:25.608237  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93418.1us
W20260709 13:18:25.611351  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.729975  9200 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.611888  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.732342  4041 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:25.734382  4043 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:25.735827  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.736632  4045 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
W20260709 13:18:25.577343 10268 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:18:25.612741  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 99034.4us
W20260709 13:18:25.614990  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.475721 10217 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.524745 10210 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:25.603235 10236 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:25.581032 10158 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:25.606662  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 47068.7us
I20260709 13:18:25.747051  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:25.613459 10065 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:25.620476  9896 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:25.631525 10226 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.740970 10116 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:25.619937 10176 raft_consensus.cc:2764] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:18:25.631199 10028 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.617069  9872 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.608896 10096 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:25.609426  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.793754  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.740315 10251 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:25.723445  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:25.799433  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 76073us
I20260709 13:18:25.765692  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:25.516425  9737 consensus_queue.cc:1175] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8c8b10100a146e6a81f308505fe9f46" responder_term: 16 status { last_received { term: 14 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:25.782174 10173 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.771430  4042 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:18:25.721480 10250 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:25.746359 10248 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.110s	user 0.003s	sys 0.000s
I20260709 13:18:25.721094 10117 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.780449  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.723201  9731 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.749539  9830 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.785063  4013 leader_election.cc:400] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:25.787915  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:25.803967 10134 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.744946  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.794487  4114 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 13.
I20260709 13:18:25.796821  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.796214  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.800621  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:25.769731  4044 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:25.830439  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.763986 10217 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.745978 10190 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:25.750061  9941 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:25.750401 10142 consensus_queue.cc:1175] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3fa9d459de485e824f023c55580bc6" responder_term: 19 status { last_received { term: 15 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.10-18.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:25.793092 10116 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.799386 10158 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:25.782702  9200 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:25.821076  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 67147.5us
W20260709 13:18:25.860390  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 59855.5us
I20260709 13:18:25.861483  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.861649  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:18:25.822407  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 354123us
I20260709 13:18:25.862440  4680 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:25.792869 10096 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:25.805459 10251 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:25.831655  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.834658  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:25.837767  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 92912us
I20260709 13:18:25.870828  4046 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:25.839421  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51550.4us
I20260709 13:18:25.872028  9200 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:25.872362  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:18:25.822407  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.872642  4649 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:25.798266 10028 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.858091  4113 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:18:25.862629  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.780606 10033 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.872526  9200 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.822923 10149 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:18:25.842206 10215 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.848150  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.869220 10065 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.824112 10057 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:25.875173 10270 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:18:25.875896 10153 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.001s
I20260709 13:18:25.837947 10148 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.875555  9941 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.876248 10212 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.877095  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.877830  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.899857  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.900559  4114 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:25.901467  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.901998  4114 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:25.842753  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:25.881969  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.826902  9731 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:25.891276  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.823283 10250 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.909549  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:25.856568 10234 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.868908 10096 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:25.895529  9200 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.834218 10210 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.919382 10288 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:25.920264 10288 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:25.920426 10215 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:25.920735 10288 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.878253 10069 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:25.857539 10190 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:25.922626 10136 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.517s	user 0.004s	sys 0.004s
I20260709 13:18:25.922766 10288 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.923244 10136 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:25.923481 10212 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:25.923877 10212 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:25.924930 10116 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:25.903602  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.925846  4044 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:25.921710 10069 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.926718  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:25.927273  4044 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:25.927620 10069 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:25.928680 10237 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.003s
W20260709 13:18:25.913110 10275 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
W20260709 13:18:25.870934 10261 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.004s
I20260709 13:18:25.894779 10287 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:25.904290  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56432.3us
W20260709 13:18:25.877733  9890 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.540s	user 0.007s	sys 0.003s
I20260709 13:18:25.877352 10187 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:25.837720 10117 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.913079 10284 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:25.924578 10212 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.923151 10190 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.909274 10201 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:25.929149 10237 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:25.948927 10235 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:25.907665  4046 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:25.950973 10237 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.951785  4684 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:25.951992  4046 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:25.932390  4043 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:25.935468  4677 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:25.935591  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.956941  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:25.959692  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:25.945150  9830 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:25.960717 10272 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:18:25.960825 10235 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:25.941392 10201 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:25.962313 10201 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.938064 10212 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:25.964880 10270 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:25.965257 10270 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:25.965600 10270 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:25.967713  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:25.968339  4118 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:25.969655  4118 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:25.976645  4114 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
W20260709 13:18:25.948663 10131 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.000s
I20260709 13:18:25.933562 10287 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:25.935973 10159 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.726s	user 0.011s	sys 0.000s
I20260709 13:18:25.937423 10117 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.932160 10261 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.961068 10028 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:25.990273 10234 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:18:25.990937  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:25.991796 10158 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:25.993528  4113 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:25.994302 10236 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.936721 10069 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:18:25.940291 10215 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:25.975025  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:26.069382  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 94431.6us
I20260709 13:18:26.070086  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:25.935874 10262 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:25.937722 10284 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:25.930655 10250 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.083675  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.084443  3968 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:25.999585 10232 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:18:26.003077  4116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.009s	sys 0.005s
W20260709 13:18:26.085145  4116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.009s	sys 0.005s
I20260709 13:18:26.082006  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:26.087792  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:26.003268  4114 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:26.012717  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.012796  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:26.021540  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.089736  4114 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.8-15.8]
I20260709 13:18:26.030735  4120 raft_consensus.cc:2410] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 24 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:18:26.059934  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:26.091006  4114 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:26.092823  4115 raft_consensus.cc:606] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:26.061223  3967 raft_consensus.cc:2410] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 7.
I20260709 13:18:25.933691 10096 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.065831  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:25.957767 10190 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:18:26.074913  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 212351us
I20260709 13:18:26.104048  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.069891  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.104797  4044 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:25.928740 10251 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.062788  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:25.935773 10187 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:26.055742 10141 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:26.094645  4045 raft_consensus.cc:2410] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:18:26.093473  4115 raft_consensus.cc:614] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:18:26.094599  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.002463 10287 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:26.106431  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 234129us
I20260709 13:18:26.107303  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:26.113663  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 241037us
I20260709 13:18:26.070833 10195 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.082855 10070 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:26.127370  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.127632  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.128240  4045 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:26.092267 10232 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:26.153576 10232 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.155109 10232 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:26.159523 10187 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.162127 10096 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.100641 10081 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:26.093420 10234 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.133635  4038 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:26.100304 10214 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.140936  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.100138 10134 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.103269 10250 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:26.104274 10088 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:26.155018  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.129199  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.187364  4045 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:26.188223  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.163870  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.181829  4113 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:26.116983 10254 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.100525 10065 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:18:26.129042 10149 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:26.111445 10253 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:18:26.174620 10235 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:18:26.142508 10070 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.178743  4042 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
W20260709 13:18:26.181151  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 64846.1us
I20260709 13:18:26.208650  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.179032 10081 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.127151 10224 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:18:26.231105  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.182124 10238 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:26.193215 10134 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.250901 10134 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.237708 10069 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.200716 10131 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.119640  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:26.181715 10155 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.776s	user 0.003s	sys 0.009s
I20260709 13:18:26.182152 10116 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:18:26.213258 10070 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:26.227489 10081 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.143927 10031 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:26.183319  3968 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:26.207875  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.182598 10057 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.194756  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.282877 10134 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:26.285279  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3544) took 1320 ms. Trace:
W20260709 13:18:26.285290  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54277.3us
I20260709 13:18:26.317601  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.317847 10048 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.318593 10048 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:26.319831 10309 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:18:26.318490  3965 rpcz_store.cc:276] 0709 13:18:24.964733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.057327 (+ 92594us) service_pool.cc:224] Handling call
0709 13:18:25.066465 (+  9138us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.478436 (+411971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.478466 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.518691 (+ 40225us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.883967 (+365276us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:25.884027 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.884226 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.285010 (+400784us) raft_consensus.cc:1685] finished
0709 13:18:26.285031 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.285219 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13723,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":678437,"threads_started":2,"wal-append.queue_time_us":673662}
I20260709 13:18:26.320866  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.322018  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.322579  3965 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:26.323285  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.325918  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.327211  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.209455 10158 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:26.197392 10149 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:26.337514 10149 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.199074 10136 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:26.277724 10300 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.343688 10300 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.345323 10261 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.346318 10300 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.278720  9986 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:18:26.347616  9986 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:26.202373 10284 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.210934  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:26.212855 10088 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:26.356431  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 145564us
I20260709 13:18:26.302047  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.360694  4042 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:26.262125 10233 consensus_meta.cc:287] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.003s
W20260709 13:18:26.303996 10295 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:18:26.304962 10307 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:18:26.305790 10290 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:18:26.306720 10310 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:18:26.312338 10217 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:18:26.312551  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 192986us
I20260709 13:18:26.368386  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.290316 10234 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.202827  9751 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:18:26.330802  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:26.377519  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46819.1us
I20260709 13:18:26.378330  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.200580 10254 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.331976  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.330772  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:26.331952 10238 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:26.316565 10134 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:26.313719 10057 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.376367 10236 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.296214 10155 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:26.337025 10173 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.002s
I20260709 13:18:26.352694  3968 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:26.472626  4039 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:18:26.473088  4039 pending_rounds.cc:85] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 9
I20260709 13:18:26.473271  4119 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.474256 10155 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.364717  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:26.370308  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.475353  4042 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:26.476318  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.477085  4042 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:26.374815  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:18:26.478355  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 103612us
I20260709 13:18:26.381433 10301 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.381919 10299 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:26.366835 10233 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.376113  9950 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.383160  9751 consensus_queue.cc:1243] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:26.385900 10048 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:26.290395 10131 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.389904  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.355302 10224 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:26.405441  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:18:26.409157  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78456.6us
I20260709 13:18:26.475837 10176 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:26.395231 10235 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:26.397336 10057 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.393730 10215 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.323572 10287 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:26.433660  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.452720  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.457326 10262 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:26.458877 10270 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.410140 10088 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:26.526392  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 73761.2us
I20260709 13:18:26.526998  4085 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.462000 10081 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.527555 10215 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:26.528071  3969 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:26.466858 10273 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.638s	user 0.002s	sys 0.010s
I20260709 13:18:26.528342 10215 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:26.529018 10215 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:26.467406 10134 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.484102  4086 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:26.473310  4039 pending_rounds.cc:107] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:18:26.530642  4039 raft_consensus.cc:2889] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.527544 10270 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:26.531486  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47484.4us
I20260709 13:18:26.531898  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.532656 10057 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:26.532682  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.489424  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.494740  4047 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:26.535804  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.536963  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.539409  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.540136  4042 raft_consensus.cc:2368] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:26.495366  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:26.399267 10251 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:26.504678  4119 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:26.530035 10134 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:26.494437 10299 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:26.540676  3966 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:26.498870 10250 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.563804  4113 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.514662 10235 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.561477  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.567541  4047 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:26.497834 10224 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:26.541149  4086 leader_election.cc:400] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:26.607044  4086 leader_election.cc:403] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:26.508937 10234 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:18:26.521652 10173 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.593788 10131 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.521914 10210 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:26.521288 10065 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.614918  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.599788  4113 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:26.602329 10081 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.608232 10235 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.591276  4040 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:26.604712 10299 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.494328  9950 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.508379 10238 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:18:26.605748 10233 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:26.533288 10057 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.608492  4042 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:26.608937  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67923.2us
I20260709 13:18:26.630681  4086 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:26.628710 10238 consensus_queue.cc:1243] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:18:26.611768 10316 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:26.610005  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.535164 10318 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.604092 10070 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.624024  4044 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 13:18:26.625283  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.626232  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:26.605919 10149 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.636685  4047 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:26.641074  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.641922  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.613760 10173 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.646162  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.646693  4044 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:26.634004 10057 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.636915 10233 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:26.653210 10233 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:26.654206 10233 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.658485 10149 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.649026  9751 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:26.663138 10158 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:26.663650 10158 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.666501 10173 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.673856  4047 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:26.675962  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.676585  3963 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:26.678771  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.619217 10065 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.636194  4042 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:26.684226  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.637485 10176 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:26.685236 10319 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.686050 10176 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.688053 10287 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.692056  3970 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:26.691320 10065 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.694775 10173 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.695312 10173 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.696272 10070 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.700227 10173 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.685930 10319 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.635954 10224 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.701262 10224 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.702358 10319 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.703060  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40680 (request call id 68) took 1856 ms. Trace:
I20260709 13:18:26.703475  4115 rpcz_store.cc:276] 0709 13:18:24.847010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:24.847580 (+   570us) service_pool.cc:224] Handling call
0709 13:18:26.702836 (+1855256us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003d2554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76446853 00007fed7b41460a 00007fed7499a7d4 00007fed7499a762 00007fed7499a691 00007fed7499a60c 00007fed749998c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:26.702957 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798717696}
I20260709 13:18:26.705334 10141 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:26.705866 10141 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.681327 10131 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:26.712806  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.714073  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:26.715070  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.715842  4040 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:18:26.721216  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.758774  9731 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.759434  4042 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:26.753037  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:26.771296  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.771800  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:26.759912  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.756721 10253 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:18:26.760788  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.762635  4681 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:26.765446 10141 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.751541  4040 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:26.757416 10318 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:26.768047  4044 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:26.769035  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:26.788210  4115 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:26.772536  4113 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:26.788805  4044 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:26.781029  4041 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:18:26.792097  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:26.785215 10235 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.786255  9950 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.792444  4041 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:26.781527 10253 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:26.800168 10153 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:26.800555 10253 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.801524 10253 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.790630 10299 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.803876  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2916) took 1060 ms. Trace:
W20260709 13:18:26.807886  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.808183 10318 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.787305  9864 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:26.811309  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.804294  4120 rpcz_store.cc:276] 0709 13:18:25.743444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.903330 (+159886us) service_pool.cc:224] Handling call
0709 13:18:26.803545 (+900215us) spinlock_profiling.cc:243] Waited 93.5 ms on lock 0x7b54003d2554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:26.803803 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215138688}
I20260709 13:18:26.808748 10318 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.810686  9864 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.815430  9864 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:26.823390 10134 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:26.823982 10134 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.825986 10134 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:26.830646  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.831877  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.832532  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.834429 10227 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:26.834743 10287 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:26.796537 10319 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:26.835286  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.809499  4041 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:26.837610  4648 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:26.843472  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:26.844750  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.845350  3969 raft_consensus.cc:2368] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:18:26.846101  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.846493  3969 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:26.847445  4042 pending_rounds.cc:85] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 10
I20260709 13:18:26.847712  4042 pending_rounds.cc:107] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:18:26.847898  4042 raft_consensus.cc:2889] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:26.850930 10227 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.840818 10235 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.851146 10195 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:26.841193 10065 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:26.856092 10065 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.858186 10158 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.796753 10215 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:18:26.842113 10319 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:26.858050 10190 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:26.859614 10319 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:26.859131 10134 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:26.860935 10070 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.861408 10070 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.862020  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2951) took 1130 ms. Trace:
I20260709 13:18:26.862375  4039 rpcz_store.cc:276] 0709 13:18:25.731191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.735181 (+  3990us) service_pool.cc:224] Handling call
0709 13:18:25.735442 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.531137 (+795695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.861784 (+330647us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b540011a8d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:26.861959 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694458624}
I20260709 13:18:26.859211  4044 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:26.866271  4114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:26.867169  4114 raft_consensus.cc:606] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:26.863793  4039 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:26.867549  4114 raft_consensus.cc:614] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:26.863741 10070 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.870976  4039 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:26.882500 10288 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:26.882707  4684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 514) took 1576 ms. Trace:
I20260709 13:18:26.882983 10288 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:26.884136  4684 rpcz_store.cc:276] 0709 13:18:25.306504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.308320 (+  1816us) service_pool.cc:224] Handling call
0709 13:18:25.308693 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.952203 (+643510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.882449 (+930246us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54009fe2d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:26.882646 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478359424}
I20260709 13:18:26.860345 10134 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.889086 10304 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:26.893002  9950 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.892174  3969 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:26.874167  9830 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.894217  9830 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.895448 10254 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.895684  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.896028 10254 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:26.869767  9731 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.859817 10190 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:26.858088 10065 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:26.898233  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.873414 10176 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.898524  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.908881 10318 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.912600  3969 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:26.910506 10151 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:26.902972  9731 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.916460 10190 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.893673  9950 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.922289 10134 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:26.934731 10287 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:26.922477 10274 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.176s	user 0.000s	sys 0.004s
I20260709 13:18:26.940471 10287 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.896210  9830 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.911419 10141 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.883805 10288 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.942246  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3543) took 1977 ms. Trace:
I20260709 13:18:26.942695  3964 rpcz_store.cc:276] 0709 13:18:24.964347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.039311 (+ 74964us) service_pool.cc:224] Handling call
0709 13:18:25.067729 (+ 28418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.210053 (+142324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.210087 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.210930 (+   843us) log.cc:844] Serialized 26 byte log entry
0709 13:18:25.475515 (+264585us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:25.475561 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:25.475635 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:26.921886 (+1446251us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:26.941930 (+ 20044us) raft_consensus.cc:1685] finished
0709 13:18:26.941952 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:26.942182 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12659,"raft.run_cpu_time_us":42,"raft.run_wall_time_us":42,"spinlock_wait_cycles":31719680,"thread_start_us":356854,"threads_started":2,"wal-append.queue_time_us":378310}
I20260709 13:18:26.923594 10158 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.950353 10057 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.942489 10288 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.952932 10287 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:26.924513  4114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:26.925429  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:26.925807  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:26.896592 10254 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.934360  4039 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:26.903264 10293 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.003s	sys 0.014s
I20260709 13:18:26.944541  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.958608  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:26.962200  3964 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.962311  3969 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:26.902518 10319 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:26.966259 10293 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.004s	sys 0.015s
I20260709 13:18:26.974752  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:26.961792 10252 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:26.965216 10190 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:26.988158  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.982005  3969 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:26.976487  9830 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.990958  3964 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:26.932339 10176 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:26.972868 10134 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:26.998723  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:26.993854  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:26.995941  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.001531  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:26.996215  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:26.997551  4085 leader_election.cc:400] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:18:27.007206  4085 leader_election.cc:403] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.007944  3964 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:26.997016  9830 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:26.976572 10065 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:26.985491 10252 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:27.010129 10254 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:27.010982  9830 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:26.992599 10057 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.010918 10134 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.012404  9950 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.013173  9864 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.017416  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.018143  3968 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:27.011159  4680 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16.
I20260709 13:18:27.015805  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.022476 10319 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.031450  3938 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16.
I20260709 13:18:27.035302  3938 leader_election.cc:403] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:27.037637  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.026194  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.039179  3968 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:27.040205  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.041462  3968 raft_consensus.cc:2410] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:18:27.040616  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.010185  9731 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.051229  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.025403 10318 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:18:27.058015  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 2923) took 1268 ms (client timeout 1510 ms). Trace:
W20260709 13:18:27.058439  4119 rpcz_store.cc:269] 0709 13:18:25.789975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.825317 (+ 35342us) service_pool.cc:224] Handling call
0709 13:18:27.057832 (+1232515us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540004d154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:27.057954 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1312260864}
I20260709 13:18:27.050606  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:27.043243  4041 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:27.049774 10057 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.053460  9830 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.054335  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.060909  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.061144  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:27.061444  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.042656 10215 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:27.041647 10224 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.062070  3969 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:27.073103  9731 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:27.073681  9731 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.075341  9986 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:27.075877  9986 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.077855  9986 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.078866  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.079252  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.075877  9731 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.025442 10065 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.026893 10134 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.084892 10065 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.086298  3969 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:27.065318 10057 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.090703 10057 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:27.093115  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.082134  9731 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:27.095235  9731 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.097050  9864 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.097537  9731 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.063616 10254 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:27.104332  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.105304  3968 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:18:27.106151  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.063802  9830 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.111501  4117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3276) took 1704 ms (client timeout 1958 ms). Trace:
I20260709 13:18:27.111946  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:27.111881  4117 rpcz_store.cc:269] 0709 13:18:25.406817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.407035 (+   218us) service_pool.cc:224] Handling call
0709 13:18:27.111300 (+1704265us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400080a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:27.111445 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335844608}
I20260709 13:18:27.114233  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.115000  4039 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:27.011056 10252 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:27.115888  4116 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:27.116119  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:27.116266  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.082599 10215 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:27.120791  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.107383 10233 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:27.122463  4041 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:27.119513  3968 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:27.110556  9830 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.123083  4041 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:18:27.108412 10254 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:27.114959 10176 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:27.118484  9864 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:27.128536 10334 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:27.132550 10311 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.813s	user 0.002s	sys 0.000s
I20260709 13:18:27.134888  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 504) took 1171 ms. Trace:
I20260709 13:18:27.135221  4677 rpcz_store.cc:276] 0709 13:18:25.963663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.963814 (+   151us) service_pool.cc:224] Handling call
0709 13:18:25.964113 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:25.984465 (+ 20352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:25.984501 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:25.985034 (+   533us) log.cc:844] Serialized 26 byte log entry
0709 13:18:26.056170 (+ 71136us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18002cbae0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:18:26.092358 (+ 36188us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:26.092397 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:26.092475 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:27.132066 (+1039591us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:27.134653 (+  2587us) raft_consensus.cc:1685] finished
0709 13:18:27.134672 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.134793 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20003,"raft.queue_time_us":21011,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":27639,"spinlock_wait_cycles":20224512,"thread_start_us":36021,"threads_started":1,"wal-append.queue_time_us":299991}
I20260709 13:18:27.137045  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:27.138326  3968 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:27.124794 10233 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:27.141436  4012 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.958s (SENT) [suppressed 3 similar messages]
I20260709 13:18:27.139763 10215 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.127633 10235 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:27.141602 10233 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:27.136669  9864 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.162490  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:27.162706  3968 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:18:27.160692  3969 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:27.161306  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.164397  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.163105  4679 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:27.168717  3969 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:27.171754 10159 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:27.173843  4679 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 11: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:27.169551  3969 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.175240  3969 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.148538 10235 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:27.163265 10318 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15.
I20260709 13:18:27.186476  3969 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:18:27.187449  3969 pending_rounds.cc:85] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 10
I20260709 13:18:27.172655 10136 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:27.187750  3969 pending_rounds.cc:107] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:18:27.189469  3969 raft_consensus.cc:2889] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:27.192694  3968 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [19.9-19.9]
I20260709 13:18:27.183054 10159 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:27.196302  3969 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:18:27.154060 10254 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.199337  3969 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:27.191031 10136 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.188583 10057 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.011s
W20260709 13:18:27.209965  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.210206  3969 raft_consensus.cc:1275] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:18:27.213784  3971 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:18:27.214221  3971 pending_rounds.cc:85] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 11
I20260709 13:18:27.214440  3971 pending_rounds.cc:107] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:18:27.214663  3971 raft_consensus.cc:2889] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:27.215615  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.219233  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.225189 10159 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.229800  3969 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:18:27.236785  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.238057 10209 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:18:27.238570 10209 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:27.238657 10227 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:27.239682 10209 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:27.244005  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.247246  4011 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:27.248117  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:27.245211 10287 consensus_queue.cc:1048] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 13:18:27.212939 10136 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:27.262882  4121 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:27.246302 10318 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:27.268392  9864 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.274219  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3278) took 1866 ms. Trace:
I20260709 13:18:27.251410 10271 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:18:27.280655 10252 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.289834 10235 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:27.259682 10117 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:18:27.290632  4043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 2954) took 1495 ms (client timeout 1510 ms). Trace:
W20260709 13:18:27.306401  4043 rpcz_store.cc:269] 0709 13:18:25.795487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.795936 (+   449us) service_pool.cc:224] Handling call
0709 13:18:27.290451 (+1494515us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54001121d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:27.290568 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234379136}
I20260709 13:18:27.262347 10209 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.298141  4112 rpcz_store.cc:276] 0709 13:18:25.407492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.475866 (+ 68374us) service_pool.cc:224] Handling call
0709 13:18:25.476177 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:25.721200 (+245023us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:25.749938 (+ 28738us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.801803 (+1051865us) spinlock_profiling.cc:243] Waited 4.47 ms on lock 0x7b1800350bc0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a 00007fed76456a2a
0709 13:18:26.879038 (+ 77235us) log.cc:844] Serialized 14 byte log entry
0709 13:18:26.884664 (+  5626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:26.884724 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:26.884789 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.273128 (+388339us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b1800350bc0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419
0709 13:18:27.273954 (+   826us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540034e754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:27.273999 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:27.274147 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5658,"prepare.queue_time_us":29125,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":8507,"raft.queue_time_us":4974,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":3788,"spinlock_wait_cycles":421822208,"thread_start_us":71483,"threads_started":1,"wal-append.queue_time_us":1172295}
I20260709 13:18:27.262056 10239 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:18:27.321805  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 75103.2us
I20260709 13:18:27.302534 10096 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.291458 10318 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:27.322824  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.325553  3968 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:27.304320 10158 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.333140  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2947) took 1603 ms. Trace:
I20260709 13:18:27.315753 10239 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.321557 10235 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.340062  3963 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:27.340804  3963 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:27.342919  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:27.334013  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:27.344552  4679 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:27.338305  4680 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 10. Current term is 11. Ops: []
I20260709 13:18:27.333555  4038 rpcz_store.cc:276] 0709 13:18:25.730130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.733479 (+  3349us) service_pool.cc:224] Handling call
0709 13:18:25.733721 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.182651 (+448930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.332916 (+1150265us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540041d554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:27.333081 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919279872}
I20260709 13:18:27.321925 10117 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:27.347903  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:27.349910  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:27.351996  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:27.341966  3963 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.354956  3963 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:27.358834  4679 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:18:27.340454 10239 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.364107  3965 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 13:18:27.361250 10151 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
W20260709 13:18:27.365021  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.364521  3965 pending_rounds.cc:85] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 7
I20260709 13:18:27.367802  3965 pending_rounds.cc:107] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.8
W20260709 13:18:27.368062  3967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3078) took 1806 ms (client timeout 2215 ms). Trace:
I20260709 13:18:27.368088  3965 raft_consensus.cc:2889] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:27.368551  3967 rpcz_store.cc:269] 0709 13:18:25.561193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.566869 (+  5676us) service_pool.cc:224] Handling call
0709 13:18:27.363603 (+1796734us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54002c9a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:27.367994 (+  4391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":747232000}
I20260709 13:18:27.355696 10224 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16.
I20260709 13:18:27.328433 10096 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.334885 10158 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.363240  9950 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:27.390427  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.350937 10235 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.356360 10318 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.391794 10188 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.404908 10117 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.407426 10158 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.421064 10096 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.427624  3972 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:27.382951  9950 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:27.388507  3963 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:27.383570  9830 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:27.453478  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 199966us
I20260709 13:18:27.443817  9950 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:27.456130  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:27.457897 10344 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:18:27.463022 10070 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.464519  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:27.463477 10070 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:27.430405 10188 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.442342 10233 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.470031  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:27.445170 10057 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:18:27.470789 10190 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:27.478349  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2925) took 1687 ms. Trace:
I20260709 13:18:27.479326  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3570) took 1144 ms. Trace:
W20260709 13:18:27.481884  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.490975  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:27.491897  3965 rpcz_store.cc:276] 0709 13:18:26.353204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.390874 (+ 37670us) service_pool.cc:224] Handling call
0709 13:18:27.363745 (+972871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.369018 (+  5273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.479138 (+110120us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002c9a50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:27.479268 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236626304}
I20260709 13:18:27.493294  4116 rpcz_store.cc:276] 0709 13:18:25.790421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.095830 (+305409us) service_pool.cc:224] Handling call
0709 13:18:27.112127 (+1016297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.118947 (+  6820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.478117 (+359170us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400080a50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:27.478280 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2336624512}
I20260709 13:18:27.496577  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:27.473387 10070 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.474290 10159 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:27.491006 10224 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:27.491343 10190 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:27.516484  9830 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.504820 10065 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:18:27.505275 10134 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:27.509400 10131 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:18:27.509104 10210 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:27.529908  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.499056  9731 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:27.509995 10201 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:27.552940  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:27.554592  3967 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.514485  9986 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:27.537720 10190 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:27.548441 10210 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.574402  4114 raft_consensus.cc:606] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:27.574951  4114 raft_consensus.cc:614] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:27.585754  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3275) took 2171 ms. Trace:
I20260709 13:18:27.586184  4121 rpcz_store.cc:276] 0709 13:18:25.404804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:25.406196 (+  1392us) service_pool.cc:224] Handling call
0709 13:18:25.406460 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:27.265124 (+1858664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.575918 (+310794us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54003a75d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:27.576107 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4268867456}
I20260709 13:18:27.534531 10159 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.589040  3870 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 15 to 16, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:27.590198 10270 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:27.573639  9986 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:18:27.592199 10235 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.592988 10262 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:27.593874 10262 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:27.594687 10262 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.599395 10117 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.600008 10117 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:27.602265 10117 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:27.603397 10235 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.603904 10235 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:27.605429 10233 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.605943 10235 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:27.606766  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3701) took 1073 ms. Trace:
I20260709 13:18:27.607153  4044 rpcz_store.cc:276] 0709 13:18:26.533014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:26.789672 (+256658us) service_pool.cc:224] Handling call
0709 13:18:26.789937 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:26.868892 (+ 78955us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:27.606517 (+737625us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b540035c5d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:27.606702 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158921472}
I20260709 13:18:27.608275 10270 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:27.571807 10348 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:18:27.617669  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.602432  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.590543  3870 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 8 to 13, term changed from 14 to 16, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to <none>, VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193) evicted. New cstate: current_term: 16 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:27.611124  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98510us
I20260709 13:18:27.612447  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:27.613425  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.620846  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.604207 10299 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.623406  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.624437  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.625311  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:27.636833  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:27.637496  4039 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:27.639282  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.630352  4041 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:27.639307  3937 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:27.571246 10136 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.639986  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:27.645925  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:27.647787  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.648447  4042 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:27.649333  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:27.559955 10201 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.626567  9941 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:27.665174 10057 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:27.665318 10293 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.664733  3967 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:27.676292  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.679586  4039 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:27.641973 10151 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.648046 10254 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.693604  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.694409  3967 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:27.694903  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:27.695326  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.695487  3964 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:27.671352 10065 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:18:27.662165 10233 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.656956 10358 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:27.642189 10096 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:18:27.680411 10209 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.728291  3964 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:27.650043 10141 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:18:27.641917 10299 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.731351  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:27.681743  9941 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:27.690908 10224 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:27.670749  9950 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.755048  4087 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:27.689911 10234 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:18:27.721997 10254 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.758920 10224 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.761152 10299 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.763075  9950 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.806043  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:27.806563  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 51613.4us
I20260709 13:18:27.691893 10151 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.691663 10293 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.691483 10057 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.727708  9731 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:27.767838  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 95609.9us
I20260709 13:18:27.764216 10195 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:27.746387 10233 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.802340  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.749761 10209 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.806674  4121 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:27.816963  4114 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:27.748219 10358 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:27.807368  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:27.788417 10270 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:27.825660  3868 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 230) took 38893 ms (client timeout 15000 ms). Trace:
I20260709 13:18:27.830143 10057 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.789363 10239 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:27.815857 10352 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:18:27.811764 10299 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:27.843243  4121 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:27.843943  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:27.846957  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.844425  4116 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:18:27.847854 10366 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:27.845424  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.814373 10195 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:27.869427  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.869839 10195 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.870820  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:27.871073 10195 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.857307  4117 raft_consensus.cc:2368] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24.
I20260709 13:18:27.849071  4119 raft_consensus.cc:2410] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:18:27.858261  4113 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:27.848709  4112 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:27.849546  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:27.888441  4116 raft_consensus.cc:2368] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:27.860178  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:27.857594  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.889302  4121 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:27.876710  4679 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:27.880074  4114 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:27.893038  4114 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:27.894527  4114 raft_consensus.cc:1217] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 15.11->[17.12-20.14]   Dedup: 18.13->[20.14-20.14]
W20260709 13:18:27.881183  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:27.881201  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.897802  4114 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [17.12-20.14]
I20260709 13:18:27.899238  4117 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:27.902060  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:27.902624  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.903308  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:27.836483 10187 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:27.922443  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.801481  9941 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:27.902709  4047 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:27.917474  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.918385 10190 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:27.834092  3868 rpcz_store.cc:269] 0709 13:17:48.857899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:48.858152 (+   253us) service_pool.cc:224] Handling call
0709 13:18:27.747546 (+38889394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:15.685171 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:15.758605 (+ 73434us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:15.758643 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:15.758660 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:15.760447 (+  1787us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:15.760513 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:15.760540 (+    27us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:18:15.778384 (+ 17844us) tablet.cc:701] Row locks acquired
0709 13:18:15.778405 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:15.778569 (+   164us) write_op.cc:270] Start()
0709 13:18:15.778679 (+   110us) write_op.cc:276] Timestamp: P: 1783603095778517 usec, L: 0
0709 13:18:15.778699 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:15.917463 (+138764us) log.cc:844] Serialized 9069 byte log entry
0709 13:18:17.067404 (+1149941us) op_driver.cc:464] REPLICATION: finished
0709 13:18:17.855765 (+788361us) write_op.cc:301] APPLY: starting
0709 13:18:17.855964 (+   199us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:18.412298 (+556334us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:18.412421 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:18.766946 (+354525us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:18.778013 (+ 11067us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:18:18.778074 (+    61us) write_op.cc:312] APPLY: finished
0709 13:18:18.778644 (+   570us) log.cc:844] Serialized 204 byte log entry
0709 13:18:19.248837 (+470193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:19.336565 (+ 87728us) write_op.cc:454] Released schema lock
0709 13:18:19.336646 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:19.337170 (+   524us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:19.337198 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280026,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":777776,"apply.run_cpu_time_us":84713,"apply.run_wall_time_us":1481501,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100589,"num_ops":23,"prepare.queue_time_us":522765,"prepare.run_cpu_time_us":20030,"prepare.run_wall_time_us":373210,"raft.queue_time_us":538192,"raft.run_cpu_time_us":81522,"raft.run_wall_time_us":814496,"replication_time_us":1273744,"spinlock_wait_cycles":521344,"thread_start_us":1396856,"threads_started":5,"wal-append.queue_time_us":1051309,"wal-append.run_cpu_time_us":50539,"wal-append.run_wall_time_us":2543234}]]}
I20260709 13:18:27.923570  4116 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:27.936022  4119 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:27.927548  4114 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:27.923637  4113 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:27.847812 10136 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:27.925516  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.937326  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:27.938670  4119 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:27.852886 10201 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.941843  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:27.939090  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 81868.9us
I20260709 13:18:27.879518 10366 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.092329  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.085858  4047 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:28.091581  4121 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:27.837733 10210 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.085883  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.118450  4113 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:28.090466  4112 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
W20260709 13:18:28.087405  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:27.934701 10359 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:28.124125  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:28.098717 10368 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:18:27.997171 10355 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:28.134855 10355 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:28.135913 10252 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.828s	user 0.008s	sys 0.001s
I20260709 13:18:28.137077 10357 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.137604 10357 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.139559 10357 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.141260 10355 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.144275 10190 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.922358 10070 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:27.914778 10141 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.196s
I20260709 13:18:28.127913 10366 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.131669  4680 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:28.149330 10141 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:28.149752 10141 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:28.150696  4117 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:28.150820 10366 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.132718 10210 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.000099 10183 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.127s
I20260709 13:18:27.939056 10096 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.180s
I20260709 13:18:28.099229 10201 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:18:28.154775 10233 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:27.997610  9731 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.159353 10065 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:18:28.133344 10270 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:18:27.849789 10358 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.159958 10359 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.150605 10239 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.129290 10364 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.162660 10254 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.133075 10293 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.161337 10209 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.168418 10359 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:28.169212 10364 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.172220 10364 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.175902 10188 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:27.939455 10187 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.178977 10187 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:28.180891 10070 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.172505  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.186580  4120 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
W20260709 13:18:28.240510  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.096861  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 175064us
W20260709 13:18:28.241921  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 315064us
I20260709 13:18:28.246454  3964 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:28.253142  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.254611  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.255622  4040 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:28.127411  4085 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:28.260831  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 133408us
I20260709 13:18:28.128336  9941 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.265035  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.266283  4118 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:28.261755  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.255641  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.267019  4112 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:18:28.281931  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.262224  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:28.267019  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.294010  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.254356  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:28.298580 10319 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.299599  4118 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:18:28.301209  4114 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:28.301021  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:28.298763  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.302971  4120 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:28.304929  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.305873  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.306746  3964 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:28.313263  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.314885  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.315076  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.315936  4119 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:28.316115  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:28.316330  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54389.5us
I20260709 13:18:28.317509  4041 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:28.317696  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.318282  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:28.321472 10288 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:28.321957 10288 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.322348 10288 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:28.322842  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68772.7us
I20260709 13:18:28.323588 10364 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:28.324286 10364 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:28.325738  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.326802  4116 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16.
I20260709 13:18:28.329128  9986 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:28.300509 10363 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:28.333292 10363 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:28.335053 10363 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.332576  3966 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:28.337064  4040 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:18:28.333526  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.337380  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.338013  3963 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:28.338523  3969 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:28.320588  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.340884  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.341722  4113 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.341796  4116 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:28.342263  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.344055  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.349037  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.353477  3972 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:18:28.299821 10319 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.346837  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.315871  4039 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:28.358230 10319 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.370170  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.372089  4117 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:18:28.372872  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.374068  4038 raft_consensus.cc:2410] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
W20260709 13:18:28.376968  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.378476  4116 raft_consensus.cc:2410] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:18:28.381386  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:28.387645  3972 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:28.389812  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.392513  3965 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:28.397176  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:28.398151  4679 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:28.403229 10377 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:28.406029 10379 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:28.406491 10379 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:28.410068  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.411345 10195 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:28.411835 10195 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.412230 10195 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.413879  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.412252 10364 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.416872 10141 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.418673 10141 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:28.407902 10379 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.411443  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.416901  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.428365  4120 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.429190 10361 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:28.411332 10318 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.430045  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.430785  4043 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.417428  4042 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:28.411459  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:28.426091 10379 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.443118 10361 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:28.451855  4114 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:28.444968  4040 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
W20260709 13:18:28.452800  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.445163  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.466625  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.469651  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:28.472051  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 60760.6us
I20260709 13:18:28.473153  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.476348  4120 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:28.491374 10361 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.484455 10151 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.507997  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.509183  4113 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:28.509959  4043 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:28.501982 10288 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.515564 10288 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.517496 10361 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:28.524842  9986 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.525156 10187 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:28.525677  9986 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } attrs { replace: true } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.526939 10187 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:28.527661 10187 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.511888  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.528963 10212 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.530858  9731 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.531556  9731 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.532344  9986 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:28.532905 10253 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.533392 10253 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:28.533808 10253 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.534822  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.535885  4038 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:28.529211  4047 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 11.
I20260709 13:18:28.540082  4039 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:28.544932 10252 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:28.531049 10212 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.545699 10252 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.548071 10252 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.548919 10287 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:28.549821 10287 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.549077 10239 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:28.558027  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:28.558736  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.559267  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.561009 10386 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.561892  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.561709 10386 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.563015  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.563153  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:28.563854  3968 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:28.564229  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:28.564359 10224 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:28.565124 10224 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.565486  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.566174  4114 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20.
I20260709 13:18:28.567334  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:28.567579  3964 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:28.567948  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:28.568845  4677 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:18:28.573065  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 62800.3us
I20260709 13:18:28.576193  4120 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:28.576752  4116 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:18:28.553061  4041 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:28.577128  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.577265 10201 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:18:28.577891  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.578325 10096 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:28.575464  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.567374 10239 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.579135  4113 raft_consensus.cc:1813] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Handling vote request from an unknown peer 1e032f02b0aa450384dda978641ba666
I20260709 13:18:28.579752  4113 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:18:28.580935 10239 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.573060 10262 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.560926  4044 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:18:28.561347  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:28.568080  9731 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.590679  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.595613  3968 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:28.577865  4117 raft_consensus.cc:2376] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20. Re-sending same reply.
I20260709 13:18:28.548018 10212 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.608811  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.611846  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.594906 10239 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:28.614602  3965 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.555310 10287 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.617748  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.622857  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.626322  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.628687  4113 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:28.627729  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.631475  4041 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:28.638062  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 204797us
I20260709 13:18:28.619868 10239 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.638875  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.633455 10379 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.645210 10362 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.645915 10362 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.646294 10215 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:28.647020 10215 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.654063 10215 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.631505 10386 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.657531  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.640790 10239 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.670156  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.671151  4113 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:28.674027  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.676347  4039 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:28.677767  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.681978  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.683133  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.685930 10159 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.690009  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.697551  3965 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:28.656193 10379 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:28.707036  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 117924us
I20260709 13:18:28.705752 10224 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.720489  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.720674 10365 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:18:28.721206 10365 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.721540 10365 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:28.723400  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.724927  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 3598) took 1173 ms. Trace:
I20260709 13:18:28.724097  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:28.725409  3970 rpcz_store.cc:276] 0709 13:18:27.530878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.531024 (+   146us) service_pool.cc:224] Handling call
0709 13:18:27.531365 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.553357 (+1021992us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b1800410e60. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed76444060 00007fed76444bfb 00007fed7644f64b
0709 13:18:28.573348 (+ 19991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.573373 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.573902 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.616787 (+ 42885us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:28.616819 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.616882 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.690078 (+ 73196us) raft_consensus.cc:1685] finished
0709 13:18:28.690098 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.704433 (+ 14335us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11102,"raft.queue_time_us":45120,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":28640,"spinlock_wait_cycles":15881472,"thread_start_us":130696,"threads_started":2,"wal-append.queue_time_us":69628}
I20260709 13:18:28.727433  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.728996 10319 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:28.729677 10319 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:28.730794 10319 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.731688  4041 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:28.730789  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.734277  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:28.734357  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.734989  4042 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:28.736522 10362 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.734339  4039 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:28.737709  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:28.738260 10378 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.417s	user 0.000s	sys 0.005s
I20260709 13:18:28.738611  4040 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:28.739089  3971 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:28.745589  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.746680  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.747169  4039 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:28.747397  3971 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:28.748531  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:28.749040  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.754662  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.663679 10253 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:28.763105  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53836.9us
I20260709 13:18:28.760293  3971 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:28.768900  4043 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:28.770011  4042 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:28.700985 10288 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.704818 10386 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.776417 10227 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:28.776904 10227 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.777287 10227 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:28.765353 10362 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:28.782169 10362 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:28.782609 10362 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:28.765360 10187 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.789826  4038 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:28.768070  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.777077  4039 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:28.808924  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:28.812374  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.821409  3964 raft_consensus.cc:2410] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:28.817489  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.803248 10318 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.824579  3966 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:28.836243  4114 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:18:28.838789  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.793795 10288 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.797078 10386 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.846364  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.857336  4117 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:28.857478  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:28.857379  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.856786 10217 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.864986  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:28.865789  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.841976 10318 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.864804 10217 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.870000 10374 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:28.871587 10390 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:18:28.872205 10318 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:28.872728 10217 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.859328 10141 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:18:28.874706  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.871266 10374 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.873972 10159 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.878126 10141 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:28.887038  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.888640  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 2992) took 1083 ms. Trace:
I20260709 13:18:28.890218  4046 rpcz_store.cc:276] 0709 13:18:27.792005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:28.330830 (+538825us) service_pool.cc:224] Handling call
0709 13:18:28.331351 (+   521us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:28.331975 (+   624us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:28.332001 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:28.332609 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:18:28.592281 (+259672us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:18:28.592324 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:28.592396 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:28.875097 (+282701us) raft_consensus.cc:1685] finished
0709 13:18:28.875119 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:28.875272 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3490,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":183,"thread_start_us":214277,"threads_started":1,"wal-append.queue_time_us":306791}
I20260709 13:18:28.894483  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.899467 10386 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.889353 10141 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:28.878265 10195 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.899857  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:28.904052  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.880911 10319 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:18:28.879343  9986 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:28.900315 10386 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:28.906857  4112 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:28.912140  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:28.903923  3969 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:28.897686 10227 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.913910  4114 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:28.918283 10374 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.919078 10227 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:28.886782 10159 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.914045 10239 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:28.928125  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:28.933357 10393 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:18:28.937819 10318 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:28.941443  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:28.922641 10379 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:28.947191  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:28.927989 10386 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:28.955982  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:28.940099 10262 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:28.958312  4680 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:18:28.964793  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 144997us
I20260709 13:18:28.967614  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:28.969129  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:28.972656 10386 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.969645 10318 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.972923  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:28.977414  4045 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:28.975536 10318 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:28.962731 10262 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:28.983520 10262 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:28.995998  4115 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:28.998191 10270 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:28.976310  9731 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:29.033710  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 60281.7us
I20260709 13:18:29.038725  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.035288  9731 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:29.042701 10361 consensus_meta.cc:287] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.524s	user 0.014s	sys 0.000s
I20260709 13:18:29.043031  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.043661  3963 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:29.044369  3968 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:29.046756  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.047894 10227 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:29.048262 10227 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:29.048671  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.048597 10227 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:29.048568  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:29.048907 10363 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.033725 10362 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.080590  3963 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
W20260709 13:18:29.084610  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48099.2us
I20260709 13:18:29.087051  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.088986  9830 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:29.091652 10227 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.095695  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.096297  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:29.097064  4038 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:29.097761  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.099818 10227 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:29.101322 10363 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:29.101955 10363 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.104064 10363 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:29.106909  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.108346  3964 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
W20260709 13:18:29.108530  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 110914us
I20260709 13:18:29.109588  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.081574  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.052874  9731 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.115769  4039 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:29.119544  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.117295  3964 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:29.042752 10141 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.121868  3972 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:29.116993 10227 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:18:29.115069 10195 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.129285  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.130385 10227 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:29.135829 10365 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.137127  4679 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:29.136870 10227 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.138057  4648 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.138744 10288 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:29.139001 10319 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:29.139343  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.140053  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.144325  3971 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:18:29.144416  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.145125  3966 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.155443  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.156213  3963 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:18:29.161216  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.168542  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.170441  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:29.172024  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.172667  4114 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 11.
I20260709 13:18:29.174348  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.174499  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.175258  4116 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:29.177897  3972 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:29.178383  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.179204  4113 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:29.183138  4117 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:29.189150  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet 237eb348003645f7abcc1c18bd324690 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:36870
I20260709 13:18:29.190706  3964 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:29.201036  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.204160 10365 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.206626 10417 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:29.206739  3938 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.206427 10262 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:29.206162  3964 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 13:18:29.201064  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.210224  4119 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
W20260709 13:18:29.214337  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.214190  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.217284  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.221323  3963 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:29.224164  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.223526  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.228994  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.210609 10262 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:29.230691  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.231520  4118 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:29.234141  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.234663  4114 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:29.232574  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.237665 10262 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.239180 10262 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:29.241055  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.241411 10288 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.235771  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.245028  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.242461  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.225817 10361 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.248935  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.248384  4117 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:29.248152 10224 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:29.258379 10224 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.259018  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:29.260138 10239 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:29.260277  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:29.260664 10224 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.260972 10288 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:18:29.258384  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49365.7us
I20260709 13:18:29.262331  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.263468 10318 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:29.266865  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.258625  4118 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:29.273208  3964 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:29.257481  3966 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:29.272162  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.262459 10288 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:29.280565 10318 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.281101  4680 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
W20260709 13:18:29.285090  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3309) took 1425 ms (client timeout 1659 ms). Trace:
I20260709 13:18:29.285511  4119 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:18:29.285529  4115 rpcz_store.cc:269] 0709 13:18:27.859605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:27.870570 (+ 10965us) service_pool.cc:224] Handling call
0709 13:18:29.284838 (+1414268us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b540034dd54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:29.285006 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2262750592}
I20260709 13:18:29.283069 10262 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:18:29.289274 10364 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:29.289494 10288 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:29.290907 10288 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.292850 10364 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:29.293771 10364 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.295915  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:29.297194 10159 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:29.298306 10187 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:29.298731 10187 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.305172 10187 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.306430 10224 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:29.307180 10224 consensus_queue.cc:1243] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 16.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:29.308943 10361 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:29.303463  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:29.310074  4120 raft_consensus.cc:2376] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15. Re-sending same reply.
I20260709 13:18:29.306609  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.286617  4012 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.313337 10224 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:29.315941 10224 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:29.299461  9986 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:29.319535 10224 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.327252  9830 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:29.341281  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.341876  9941 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.342429  9941 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.342696  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.343204  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:29.343865  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.345767  4043 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:18:29.346463  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.347234  4038 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:29.339563 10318 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:29.348155 10318 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:29.349175  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:29.349043 10318 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.350306 10318 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:29.331115 10201 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.354490 10253 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.343920  4045 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:29.358170  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:29.358613  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:29.358736  4043 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:29.359035  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.359537  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.331034 10224 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.369231  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:29.369381  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.381260  4681 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 12: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:29.369848  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.373202 10374 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:29.333539 10262 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:29.382709  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:29.390027  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.391490  4042 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:29.391860  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:29.401046  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 114589us
I20260709 13:18:29.401433 10141 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.404712  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.405057  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.405722  3965 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.412746  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:29.414278  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.419176 10227 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:29.421530  4042 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:29.405469 10362 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.428853  4011 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:29.430766 10195 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:29.431313 10195 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:29.381577  9941 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.436378  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:29.444501  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 138005us
I20260709 13:18:29.442746  3965 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
W20260709 13:18:29.460676  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 72088.1us
I20260709 13:18:29.465936 10201 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:29.465744 10188 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:29.468580  4043 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
W20260709 13:18:29.477082  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 251559us
I20260709 13:18:29.480752 10363 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:29.432360 10195 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.498277  3937 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16.
W20260709 13:18:29.503995  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 221804us
I20260709 13:18:29.504180  4046 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:29.512071  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet 237eb348003645f7abcc1c18bd324690 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
W20260709 13:18:29.512284  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:29.514845 10365 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.516067 10365 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.516866  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.521219 10365 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.523674  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:29.501828 10239 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.538511  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.542907 10187 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.545794 10239 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.547511  4046 raft_consensus.cc:2410] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:18:29.547988 10239 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:29.531517 10386 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:29.549116  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:29.549762  4681 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:29.551031  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:29.551870 10239 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:29.552487 10239 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.553232 10239 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.557360  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.558718  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.560957 10270 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:29.561658 10270 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:29.562565 10363 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.566908 10239 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.560717  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.608850 10433 raft_consensus.cc:2764] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:18:29.608656  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 76749.1us
I20260709 13:18:29.608469  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:29.610399  4681 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.612553 10288 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:29.604434 10239 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:29.622401 10187 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:29.623569  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:29.624866 10270 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.552093  9731 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.627671  9731 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.627915  4681 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:29.629814  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:29.623523 10435 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:18:29.630854  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:29.608582 10438 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.640916  4012 leader_election.cc:400] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:29.641248  4012 leader_election.cc:403] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.642427  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.642719  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:29.643002  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:29.634056 10187 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:18:29.643810  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 95166us
I20260709 13:18:29.635501 10188 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:29.645202  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:29.648411  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:29.648548  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:29.649009  4119 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:18:29.649356  4120 raft_consensus.cc:2376] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20. Re-sending same reply.
I20260709 13:18:29.650156 10446 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:29.650940 10215 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.651361 10187 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:29.652465 10187 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.647042 10239 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
W20260709 13:18:29.654343  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 93714.2us
I20260709 13:18:29.655254  3937 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20.
I20260709 13:18:29.655555  3937 leader_election.cc:403] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:29.656273  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:29.656937  4115 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.655774  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.658548  3964 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.666672 10446 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:29.644017 10438 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.667694 10446 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.669013 10438 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.671113  4046 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:29.675817  3964 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:29.676735  3963 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:29.678447  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.679081  3965 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:29.650033 10188 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:29.679855  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.660399  9731 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20.
I20260709 13:18:29.679471  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:29.682086 10227 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:29.683748 10188 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.686580 10442 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:18:29.691109  4115 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:29.691887  4119 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:29.697760 10445 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:18:29.699049 10441 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:18:29.700318 10227 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:29.700732 10227 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:29.679512 10215 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:18:29.696398 10239 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:29.704916 10239 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:29.710210  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 69985us
I20260709 13:18:29.711020  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.712519 10440 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:29.712956 10440 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:29.713312 10440 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.720157  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.736572  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.741799  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:29.722280 10318 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:29.705874 10239 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.719138 10151 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:18:29.734480  9731 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.759061  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:29.759859 10117 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:29.719638 10441 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:18:29.748562  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.710336 10288 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:29.724325 10445 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:29.724285 10438 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:18:29.761765 10188 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.701668 10227 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.747736 10159 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:29.760329 10117 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.774514 10117 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.760485 10141 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:29.743813 10215 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:29.773842 10443 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:29.772229 10288 consensus_queue.cc:1243] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:29.788285 10187 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:29.806124 10364 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
W20260709 13:18:29.787407 10365 consensus_queue.cc:1175] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e032f02b0aa450384dda978641ba666" responder_term: 15 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:29.796728 10159 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:29.816263 10159 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:29.816913 10159 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.794238 10227 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:29.775931 10188 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.830317  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:29.827409 10215 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:29.838234  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 84064.8us
I20260709 13:18:29.838747 10215 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:29.839313 10215 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.839663  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.861644  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:29.856254  9731 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:29.850972 10215 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.866331 10215 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:29.864733  9731 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:29.869524  9731 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.874001 10188 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:29.876408  4146 heartbeater.cc:646] Failed to heartbeat to 127.2.200.254:44439 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.2.200.254:44439 timed out after 15.000s (SENT)
I20260709 13:18:29.882076  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.883019 10117 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.883939 10270 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:29.888020  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 97472us
I20260709 13:18:29.896064  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:29.896677  3966 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:29.896071  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 84240.3us
I20260709 13:18:29.900040  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.900969 10151 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:29.901360  4012 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.903004  9941 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.903185  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.903457 10096 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:29.904001 10096 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.904624  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.906898  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.907472 10201 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:29.907963 10201 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.909102 10117 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.910101 10201 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.910481 10117 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:29.911202 10117 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:29.911720 10201 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:29.913628 10318 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:29.914047 10318 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:29.914920 10318 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.916175 10318 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:29.917280  4012 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.924726  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:29.930917  3966 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
W20260709 13:18:29.917189  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 122556us
I20260709 13:18:29.940173  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.901696 10379 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:29.936874  9731 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.942457  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.945108  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.907085 10096 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:29.951064  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.946600  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.953620  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.954344  3970 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: [20.9-20.9]
W20260709 13:18:29.947252 10447 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:18:29.961361  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 212881us
I20260709 13:18:29.948313 10239 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:29.967063 10159 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:29.967564 10239 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:29.967962 10239 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:29.970955 10433 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:29.971334 10433 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:29.950124 10362 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:29.972961  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48329.4us
I20260709 13:18:29.974906  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.975770 10386 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:29.976132 10386 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:29.976497 10386 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:29.977037  3967 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:29.962774  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:29.962880  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:29.950227 10188 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:18:29.953333 10262 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:29.996989  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50473.2us
I20260709 13:18:29.944706 10270 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:18:29.997737  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:29.967063  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:29.972169 10433 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:29.995680  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:29.967890 10159 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:29.962875 10096 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.017184 10441 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:30.013124 10159 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:30.030335  9731 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.030853 10159 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.032089 10159 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:30.017280 10141 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:30.033226 10141 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:30.024130 10239 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.002938 10379 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:30.035851  3968 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:30.038722 10141 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.016553 10288 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:18:30.037194 10441 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.037086 10379 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:30.045154 10440 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.046366 10379 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 19.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.063220 10440 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.071434  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:30.066524  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68864.1us
I20260709 13:18:30.073529  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:30.098664  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.099535  4119 raft_consensus.cc:2376] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22. Re-sending same reply.
I20260709 13:18:30.111904  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.123162  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:30.111582  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.135982  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:30.097442 10195 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:18:30.137068  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.138379  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:30.138552  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67205us
I20260709 13:18:30.140861  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.147874  4115 raft_consensus.cc:2376] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22. Re-sending same reply.
W20260709 13:18:30.167124  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 168989us
I20260709 13:18:30.167910  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.111171 10456 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.167843  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.174245  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.177973  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.177168  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.184284  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:30.183913  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:30.146960 10253 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:30.146632 10441 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.186889  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.187443  4118 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:30.187387  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:30.189872  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49141.5us
I20260709 13:18:30.193326  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.171247 10455 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:30.184201  9986 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:30.173707 10195 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:30.200745  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.188997 10253 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:30.204182  4119 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.211813  3963 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:30.213105  4681 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:30.215952  4121 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:30.195410 10445 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:30.222955  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:30.223551  3963 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:18:30.224258  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.228356  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.176926 10456 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:30.231895  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.212708  9731 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.216197 10253 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:30.232525  4116 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:30.256053  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.265115  4119 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:30.219029 10151 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:18:30.257095  9941 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.219108 10457 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:18:30.221822 10438 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:18:30.283563  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.288254  4116 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:30.290663  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61492.7us
I20260709 13:18:30.292128  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:30.297235  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.300895 10195 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:30.302767  9941 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.305003  9941 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.320046  4118 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
W20260709 13:18:30.323174  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 148710us
I20260709 13:18:30.328745  3963 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:30.330946  4011 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:30.286559 10239 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:30.336350  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 124092us
I20260709 13:18:30.345141  9941 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:30.350170  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.336958 10141 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:30.336663 10433 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:30.367942 10141 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:30.370246 10141 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.366032 10288 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.373867 10456 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:30.362020  9941 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:30.376572  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:30.376843  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52920.8us
I20260709 13:18:30.377199  9941 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.381953  4120 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:30.368852  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.379016 10386 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:30.379952  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 87905.9us
I20260709 13:18:30.381786  4113 raft_consensus.cc:2410] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 9.
I20260709 13:18:30.377580  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:30.392422  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:30.393388 10117 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.394896  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:30.395951 10117 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:30.405495  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.401974 10470 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:30.417162 10262 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.403770 10479 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:30.418804  4680 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:18:30.419929  4680 pending_rounds.cc:85] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 11
I20260709 13:18:30.420205  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.429054 10433 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:30.411980 10470 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:30.431469 10470 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:30.434320 10141 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.434825 10141 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.420188  4680 pending_rounds.cc:107] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:18:30.445349  4680 raft_consensus.cc:2889] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:30.456992  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44600.9us
I20260709 13:18:30.458626  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.410804 10318 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:18:30.444491 10141 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.470851  9830 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:30.475831  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:30.463460 10159 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:30.486830  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:30.494290  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:30.495720  3966 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 8. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:30.497751  3963 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:18:30.497267  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77153.3us
I20260709 13:18:30.502107  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.503381 10467 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:30.503953 10467 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:30.504895 10467 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.507803  4042 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:30.510181  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:30.484750 10270 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.428977 10479 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.515980  3965 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:30.502040  3968 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:30.518880  4046 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 13:18:30.465752 10262 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:18:30.464455 10117 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:30.523180  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.528575  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.529350  4118 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:30.529639  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.533159  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.536790  4114 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:30.542321 10386 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.543684  4118 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:30.545816  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:30.547333  4042 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:30.547760  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:30.549196  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.544847 10460 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:30.557734  4119 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:30.555724  4040 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:30.575033  4038 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:18:30.628166  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 105057us
W20260709 13:18:30.677675  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48599.7us
W20260709 13:18:30.702421  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 143889us
I20260709 13:18:30.569190 10460 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:30.665114 10270 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:30.704013 10096 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.704535  9941 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.723106  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.726449  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.728058  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:30.729439  4119 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 12: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:30.729465  4118 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:30.732491 10479 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.737756  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:30.738278 10485 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:18:30.738591  4039 raft_consensus.cc:2410] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:18:30.738799 10482 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:30.712265 10386 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:30.739377 10482 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.719727 10253 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.741726 10482 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.742663 10253 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:30.743321  9941 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.745416  9941 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:30.746867 10471 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.489s	user 0.004s	sys 0.005s
I20260709 13:18:30.739396  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:30.747645  4042 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:30.700836 10262 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:30.753592  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:30.754871  4040 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:18:30.757114  4042 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:30.759193  4041 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:30.759738  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:30.760351  3965 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:30.760563  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:30.762036  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:30.716480 10188 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:18:30.767951 10482 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:30.768312  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:30.768862 10438 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:30.769183  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:30.769269 10438 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:30.770712 10438 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.771960 10438 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:30.777949  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:30.786909  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:30.789464 10217 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:30.790535 10460 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.791884 10460 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:30.795853 10470 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:30.797434 10484 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:18:30.804140  4042 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:30.807438  3970 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:30.813761  4047 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:30.749476 10096 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:30.820546  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 118395us
I20260709 13:18:30.766983 10479 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:18:30.777148 10253 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:18:30.821782  4040 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:30.827713 10270 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:18:30.827932 10386 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:18:30.836000 10386 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:30.836345 10386 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:30.837198 10386 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:30.838320 10386 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:30.839306  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:30.841387 10488 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:18:30.843948 10470 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:30.847299 10096 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:30.779500 10467 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:18:30.853331  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99824.4us
I20260709 13:18:30.859629  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:30.862771 10217 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:18:30.864693 10467 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:30.898543  3964 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:30.901043  3968 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:30.902518  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:30.903249  4681 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:30.899655  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:30.904654  3964 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:30.925343  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:30.907822 10358 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:30.953490  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:30.903466 10187 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:30.959184  4117 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: [18.11-21.12]
I20260709 13:18:30.956943  4116 pending_rounds.cc:85] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 8
I20260709 13:18:30.962772  4116 pending_rounds.cc:107] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 13:18:30.963047  4116 raft_consensus.cc:2889] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:30.964951  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.966048  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:30.966589  4119 raft_consensus.cc:2376] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15. Re-sending same reply.
I20260709 13:18:30.968384  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:30.969982  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.965862  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:30.972223  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.973110  4118 raft_consensus.cc:2410] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:18:30.968631  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:30.982429  4121 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:31.016479  4117 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:30.902554 10467 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.022377  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.066201  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:31.073619  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 136472us
W20260709 13:18:31.075028  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.077250  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.077847  4118 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:30.969480 10358 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:30.983284 10117 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:31.014428 10262 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.981309 10500 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.085446  4121 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:31.089476  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.090574  4117 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:31.090368  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 123929us
I20260709 13:18:31.073812 10457 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:30.971238 10187 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.103312  4118 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:31.108866  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:31.109848 10504 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:18:31.110245  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.111518  9731 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:31.112200  9731 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:31.086596 10151 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:18:31.109109  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.118739  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:31.076696 10462 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:31.121980  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.090477 10500 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:31.131949  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:31.138825  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 170530us
I20260709 13:18:31.139653  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.112327  9986 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.093397 10262 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:31.129594 10117 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.145731  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.154223  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.155647  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.100594 10457 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:31.126914 10500 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.171761  4117 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:31.136893 10462 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:31.154261  4121 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:31.175671  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.177717  4117 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:31.179098  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.146955 10117 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.157317 10438 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.161005 10470 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:31.160591 10495 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.185549  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.187283 10498 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:18:31.187956 10497 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:18:31.179728 10096 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:18:31.216821 10096 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:31.217242 10096 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:31.218004 10096 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.219220 10096 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.224128  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:31.188227 10262 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:31.185935  9731 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:31.187606 10505 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:31.176321 10270 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:18:31.201429  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.236837  4117 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:31.189985 10493 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:18:31.177759  9986 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:18:31.255733 10500 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.258011 10500 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.211557 10467 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.212558 10187 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.156805 10358 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:31.230425  4047 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
W20260709 13:18:31.226579  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47179.5us
I20260709 13:18:31.185456 10117 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:31.234138  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75069us
I20260709 13:18:31.234849  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.253501 10457 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:31.267868  4117 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:31.295840  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.297214  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:31.297832  4117 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:31.299785  4117 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:31.230211 10215 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.275076  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 118637us
I20260709 13:18:31.275074  4115 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:31.286867  4119 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:31.236326  9830 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.295814  4121 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:31.294595  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.304359  3971 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:31.304819  3967 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:31.309486  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:31.313737  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:31.316926  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:31.317502  3972 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.317677  4043 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:31.319478  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:31.320258  4043 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:31.318590 10151 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:31.315665 10517 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:31.356206  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61671us
I20260709 13:18:31.363931  4012 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.377450  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.311378 10215 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.400066  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.336719 10498 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:31.345319 10517 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:31.403858 10379 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:18:31.416602  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88713.2us
I20260709 13:18:31.378180 10151 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:31.424810  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:31.422922 10096 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:31.445402 10527 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:31.445931 10527 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:31.446012 10215 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:31.446350 10527 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.448015 10517 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.452395  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:31.434731 10498 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:18:31.430325 10151 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:31.465699 10151 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.461582  3972 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:31.487409 10498 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:31.493671 10117 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:31.497450  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:31.497924  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:31.498175  3972 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.498507  4681 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:31.506708  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 106707us
I20260709 13:18:31.508538  4681 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:31.509686  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.513753  3972 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:31.520583  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.507200 10117 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:31.523967 10379 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:31.526131 10508 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:31.522704 10462 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.521461 10365 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:18:31.520540 10498 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:31.533687 10495 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:31.545249  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98410.9us
I20260709 13:18:31.548451  3968 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
I20260709 13:18:31.541234 10462 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:31.534271 10498 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.542620 10379 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:18:31.541249 10201 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:18:31.554355 10151 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.555531 10517 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.566712 10517 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.545990 10495 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.575742 10462 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.576407 10495 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.578295 10517 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.573920  4044 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:31.583927  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3350) took 1428 ms (client timeout 1849 ms). Trace:
W20260709 13:18:31.584357  4113 rpcz_store.cc:269] 0709 13:18:30.155752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.203836 (+ 48084us) service_pool.cc:224] Handling call
0709 13:18:31.583726 (+1379890us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400096354. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:31.583868 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360196864}
I20260709 13:18:31.586087 10498 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.588626 10374 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:31.589279 10374 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:31.592500 10460 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.593057 10460 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.595978 10195 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:31.596158 10500 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:31.599005 10270 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:31.599398 10270 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:31.599794 10525 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:18:31.602656 10096 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:31.603121 10096 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.603724  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:31.605082 10440 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:31.605562 10440 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:31.565972 10151 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.606439 10440 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.600245 10270 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.608090 10151 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.608271 10270 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.609774  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:31.610163  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:31.611948  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.618125  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.561555 10527 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.622257 10527 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.610476  4045 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:31.623847  4114 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:18:31.624264  4114 pending_rounds.cc:85] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 11
I20260709 13:18:31.624471  4114 pending_rounds.cc:107] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:31.624686  4114 raft_consensus.cc:2889] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:31.622988  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3338) took 1525 ms (client timeout 1752 ms). Trace:
I20260709 13:18:31.625932  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:31.628387  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:31.625236  4120 rpcz_store.cc:269] 0709 13:18:30.097778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.098100 (+   322us) service_pool.cc:224] Handling call
0709 13:18:31.622807 (+1524707us) spinlock_profiling.cc:243] Waited 247 ms on lock 0x7b54002ac6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:31.622934 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567513856}
I20260709 13:18:31.626617  3968 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:31.639441  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:31.629011  4044 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:31.649611  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:31.640120  3965 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:31.651803  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:31.652824  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:31.599491 10374 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:31.702847  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50234.7us
W20260709 13:18:31.704914  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54823us
I20260709 13:18:31.662941  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:31.705729  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54031.7us
I20260709 13:18:31.665649  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:31.706487  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:31.658548 10217 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:18:31.628844 10227 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.707201  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:31.707677  4038 raft_consensus.cc:2410] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 22 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:31.720976  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:31.724156 10460 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:31.662289 10201 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.732002 10500 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:31.720649 10479 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.742964  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.744092  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.746043  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.746610  4117 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.736524  4086 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.719578 10467 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:31.740502  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:31.748298  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.758461  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.707870 10187 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:18:31.758535  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.760571  4119 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:31.761495  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.762617  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.763008 10508 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:31.763420 10508 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:31.763863  4113 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:31.765000 10508 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:31.764885 10159 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:31.763612  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:31.766819  4116 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:31.767776  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.767839  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.764940  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.769148  4113 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:31.765082  9830 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:31.775590 10538 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:18:31.776371  4117 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:31.772742  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:31.773996 10535 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:18:31.739516  9731 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:31.784696  9830 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:31.788715  9830 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:31.792128  9830 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:18:31.795816  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:31.798728  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:31.770658 10318 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:31.805895  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.782743 10187 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:31.739045 10201 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.798266  9731 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.817922  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 7 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:31.756922 10479 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.821439  4047 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:31.820086  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.825382  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:31.818537 10253 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:31.816049 10364 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:18:31.820154 10495 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:31.821012 10159 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:31.822479  9731 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:31.830681 10445 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:31.848362 10539 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:18:31.855516 10519 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.424s	user 0.002s	sys 0.002s
I20260709 13:18:31.833390 10442 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:18:31.840225 10495 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:31.869611 10495 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:31.870297 10442 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:31.870844 10442 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.857278 10545 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:18:31.859180 10479 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.837764 10253 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:31.860113 10532 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:18:31.863634  4119 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:31.856344 10508 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:31.856426 10537 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:18:31.877360 10364 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:31.856885 10546 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:18:31.856583 10541 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:31.880168 10201 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.883219  4047 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:31.884019 10096 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.890954 10495 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:31.905328 10442 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:31.908650 10494 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:31.840117  9830 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:31.939436  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 230533us
W20260709 13:18:31.941349  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 157148us
I20260709 13:18:32.040539  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:31.961591 10364 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:31.966193 10510 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.804s	user 0.004s	sys 0.000s
I20260709 13:18:31.969344 10253 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.971848  9731 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:31.978987  4039 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:31.987614 10096 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:31.984170 10494 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:31.993184  3972 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:31.994568 10508 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.000500  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 2979) took 1045 ms. Trace:
I20260709 13:18:31.973791 10467 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:32.061367  4114 rpcz_store.cc:276] 0709 13:18:30.955504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.955629 (+   125us) service_pool.cc:224] Handling call
0709 13:18:31.623469 (+667840us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:31.649067 (+ 25598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.000245 (+351178us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54002ac6d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:32.000402 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493641088}
I20260709 13:18:32.006546 10495 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:32.007668  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:32.045418 10517 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:32.018433 10556 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:32.027383 10523 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:31.944592  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 171933us
I20260709 13:18:32.054538 10524 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:32.071609  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:32.043911  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.047640  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:32.056542  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.057830  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.059582  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:32.060473  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 261809us
W20260709 13:18:32.064693  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.065845  3972 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.013535  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3354) took 1856 ms. Trace:
I20260709 13:18:32.074281  3971 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:32.074604  3972 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:32.075024  3969 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:18:32.041760  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 215092us
I20260709 13:18:32.072751  3970 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:32.083148 10523 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.085424 10523 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.086306 10253 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.087257 10364 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.088855 10556 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:32.079149 10536 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.488s	user 0.003s	sys 0.004s
I20260709 13:18:32.090765 10500 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.091238 10500 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:32.091626  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3199) took 1196 ms. Trace:
I20260709 13:18:32.092345  4013 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:32.079708 10096 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:18:32.066149 10499 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:18:32.096699  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:32.097498 10541 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.097900 10541 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.103147  3938 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:32.098279 10215 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:18:32.107257  4044 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:32.108203  4679 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:32.091953  3966 rpcz_store.cc:276] 0709 13:18:30.895274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.895411 (+   137us) service_pool.cc:224] Handling call
0709 13:18:30.895709 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:30.912512 (+ 16803us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:18:30.912553 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:30.913072 (+   519us) log.cc:844] Serialized 52 byte log entry
0709 13:18:31.076800 (+163728us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:18:31.076845 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:31.076920 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:31.934244 (+857324us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:32.091319 (+157075us) raft_consensus.cc:1685] finished
0709 13:18:32.091343 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.091567 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22801,"raft.queue_time_us":30015,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":28130,"spinlock_wait_cycles":2716928,"thread_start_us":104206,"threads_started":1,"wal-append.queue_time_us":168278}
I20260709 13:18:32.110034  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:32.110205  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.110630  4115 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.110770  3966 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:32.113463  4113 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:32.073767  4112 rpcz_store.cc:276] 0709 13:18:30.156796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:30.295394 (+138598us) service_pool.cc:224] Handling call
0709 13:18:30.295679 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:31.294091 (+998412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:31.294123 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:31.296224 (+  2101us) log.cc:844] Serialized 26 byte log entry
0709 13:18:31.384369 (+ 88145us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:31.421981 (+ 37612us) log.cc:844] Serialized 14 byte log entry
0709 13:18:31.422187 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.007022 (+584835us) spinlock_profiling.cc:243] Waited 5.96 ms on lock 0x7b18004bcfa0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:32.013167 (+  6145us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400096854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:32.013227 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:32.013274 (+    47us) raft_consensus.cc:1685] finished
0709 13:18:32.013291 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:32.013442 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28,"prepare.queue_time_us":35695,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3753,"raft.queue_time_us":1947,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":136,"spinlock_wait_cycles":2308825344,"thread_start_us":62047,"threads_started":1,"wal-append.queue_time_us":111188}
I20260709 13:18:32.115880  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:32.116041  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.117100  4045 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:18:32.093895 10509 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:32.072062 10524 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.121181  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:32.121959  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50422.8us
I20260709 13:18:32.125458 10362 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:32.129755  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53394.6us
I20260709 13:18:32.098227 10541 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.158934  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:32.160020  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:32.107934 10386 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:32.070946 10517 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.171442  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.136152  9731 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.096517 10467 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.176067 10270 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:32.178342 10495 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:32.178922 10495 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:32.168262 10442 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:32.185165 10442 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:32.185268  4038 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260709 13:18:32.185635  4038 pending_rounds.cc:85] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 12
I20260709 13:18:32.185845  4038 pending_rounds.cc:107] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:18:32.186096 10442 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.187315 10442 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.137722 10524 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:32.125485 10565 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:18:32.189775 10565 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:32.190183 10565 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:32.191331 10565 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.170593  9830 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:18:32.175879 10533 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:32.192655  3967 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:32.179922 10495 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.186074  4038 raft_consensus.cc:2889] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:32.092792 10557 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:18:32.209859  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.213167  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:32.216938  4117 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:32.218466  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:32.219486  4118 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 13:18:32.229207  4115 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:32.206691 10557 consensus_queue.cc:1243] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 13:18:32.233424 10568 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:18:32.201480 10318 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.199347 10555 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:32.172477 10509 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:32.199450 10460 consensus_queue.cc:1175] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b8c8b10100a146e6a81f308505fe9f46" responder_term: 20 status { last_received { term: 17 index: 10 } last_committed_idx: 10 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:32.218788 10386 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:32.157090 10462 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:18:32.235580  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:32.195977  9830 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:32.257899  9830 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:32.245398 10318 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.259022  9830 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.7, Last appended by leader: 7, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.259645 10318 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.262034  9830 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.265812 10470 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:32.234838 10517 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.266492 10470 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:32.246696 10533 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:18:32.267520 10470 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.268515 10470 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.219393 10498 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:32.280656 10494 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.247620 10555 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.283413 10555 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:32.254647 10509 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.247969 10552 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:18:32.235891 10364 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:32.244129  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:32.219956 10565 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.256040 10541 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.276849  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:32.237628  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 69972us
I20260709 13:18:32.285921  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.286850  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:32.282125 10494 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.299435  4116 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:32.300634  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:32.308911  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:32.265671 10556 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.320436  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:32.322448  4038 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:32.324038  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:32.322121  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:32.325546  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.325680  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.328804  4045 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:32.330713  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.332842  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.294282 10555 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.339421  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.335335  4042 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.338797  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.342839  4045 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:32.319123 10498 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:32.341439  4046 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:32.349062  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.353770  4046 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:32.335937 10545 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:32.334951 10215 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:30.866747  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:32.356210  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.334779 10523 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:32.345902 10555 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.344631 10386 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:18:32.342538 10445 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.357146  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.385558  4042 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:32.339165 10443 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:32.394670 10443 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.395766 10473 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:32.338774 10365 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.363271 10551 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:32.359185 10158 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:32.380559 10570 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:18:32.356153 10545 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:32.361285  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:18:32.408900  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 70048.6us
I20260709 13:18:32.393648  4038 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:32.395493 10445 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.376143 10559 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:32.416579  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55376.6us
I20260709 13:18:32.361444 10560 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:18:32.415350  4118 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:32.407627 10365 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:32.444770 10524 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.447103 10524 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.447867  4113 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:18:32.418064 10545 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:32.384938 10215 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.439023  9830 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:32.455690  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:32.443878 10365 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:32.461398  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 99760.4us
I20260709 13:18:32.473915  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:32.454344 10560 consensus_queue.cc:1243] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer b8c8b10100a146e6a81f308505fe9f46 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:32.413045 10158 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.462225  9830 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:32.484010  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:32.491676 10445 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.493142 10318 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.495373 10318 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.496343 10541 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.437963 10551 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.497848 10443 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.498025 10215 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.500667 10158 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:32.501374 10471 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.301s	user 0.004s	sys 0.000s
W20260709 13:18:32.502148 10571 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
W20260709 13:18:32.503564  3870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 98) took 17470 ms (client timeout 15000 ms). Trace:
I20260709 13:18:32.439112 10473 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.506628 10473 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.508692 10555 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.513876 10500 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.516268  4114 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:32.520653  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.522166  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:32.522789  4046 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:18:32.526363  3965 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:32.522359  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.531229  4119 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:32.541082  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:32.541965  4042 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:32.546077  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.547562  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.546693  3963 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:32.485460  9830 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:32.549662  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.516729 10500 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:32.569164  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85231us
I20260709 13:18:32.566941  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.570438  4042 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:32.571575  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.572192  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:32.577678  3965 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:32.544472 10318 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:32.677860 10593 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.678427 10593 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.679157 10462 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:32.680555 10593 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:32.675369  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 103248us
W20260709 13:18:32.503926  3870 rpcz_store.cc:269] 0709 13:18:15.033151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:15.033425 (+   274us) service_pool.cc:224] Handling call
0709 13:18:32.503336 (+17469911us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:27.819238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:27.851618 (+ 32380us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:27.851676 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:18:27.851711 (+    35us) tablet.cc:662] Decoding operations
0709 13:18:28.098517 (+246806us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:28.140241 (+ 41724us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:28.140276 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:18:28.141113 (+   837us) tablet.cc:701] Row locks acquired
0709 13:18:28.141165 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:18:28.141339 (+   174us) write_op.cc:270] Start()
0709 13:18:28.141491 (+   152us) write_op.cc:276] Timestamp: P: 1783603108141264 usec, L: 0
0709 13:18:28.141520 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:18:28.142218 (+   698us) log.cc:844] Serialized 3596 byte log entry
0709 13:18:28.420350 (+278132us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54000abca0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c1dbe 00007fed763cc930 00007fed763cc8d8 00007fed763cc858 00007fed763cc813 00007fed763cba9c 00007fed7c2b7626 00007fed7c2b1dd8 00007fed764087cb 00007fed7640b2c0
0709 13:18:28.842166 (+421816us) op_driver.cc:464] REPLICATION: finished
0709 13:18:29.238349 (+396183us) spinlock_profiling.cc:243] Waited 978 us on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed733420ac 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed79e82ef0
0709 13:18:29.360124 (+121775us) write_op.cc:301] APPLY: starting
0709 13:18:29.390911 (+ 30787us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:29.395298 (+  4387us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644932a 00007fed763cef14 00007fed763ceec3 00007fed763cee38 00007fed763cedf3 00007fed763ce0dc 00007fed763f7e16 00007fed763dfcbb 00007fed763ca39d 00007fed763cdd75
0709 13:18:29.669197 (+273899us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:29.669239 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:29.976922 (+307683us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:29.977238 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:18:29.977295 (+    57us) write_op.cc:312] APPLY: finished
0709 13:18:29.977693 (+   398us) log.cc:844] Serialized 89 byte log entry
0709 13:18:30.202427 (+224734us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:30.231324 (+ 28897us) write_op.cc:454] Released schema lock
0709 13:18:30.257451 (+ 26127us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:30.297411 (+ 39960us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:30.297448 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7535449,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":450338,"apply.run_cpu_time_us":65452,"apply.run_wall_time_us":979544,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41873,"num_ops":9,"prepare.queue_time_us":144049,"prepare.run_cpu_time_us":46392,"prepare.run_wall_time_us":591382,"raft.queue_time_us":335966,"raft.run_cpu_time_us":25505,"raft.run_wall_time_us":623124,"replication_time_us":659102,"spinlock_wait_cycles":58974720,"thread_start_us":1028094,"threads_started":5,"wal-append.queue_time_us":521536,"wal-append.run_cpu_time_us":17008,"wal-append.run_wall_time_us":2344275}]]}
I20260709 13:18:32.687721 10457 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:18:32.721239 10442 consensus_meta.cc:287] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
I20260709 13:18:32.730082 10457 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:32.772842  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 195490us
I20260709 13:18:32.748113 10545 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.771396 10457 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:32.779109  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95384.2us
I20260709 13:18:32.801082 10460 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:32.801714 10460 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.806972 10559 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:32.805289 10545 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.811985  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:32.819852  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:32.820143  4113 raft_consensus.cc:1217] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Deduplicated request from leader. Original: 15.11->[17.12-22.15]   Dedup: 18.13->[20.14-22.15]
I20260709 13:18:32.820673  4113 pending_rounds.cc:85] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 13
I20260709 13:18:32.820910  4113 pending_rounds.cc:107] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:18:32.821133  4113 raft_consensus.cc:2889] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:32.824889 10545 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:32.829432  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:32.838557 10365 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.840786 10365 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.849272  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:18:32.839265 10573 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 13:18:32.821404 10559 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:32.844640  9830 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.857904 10559 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.868211  9830 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.856928 10457 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:32.877210  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 462020us
I20260709 13:18:32.878423  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:32.872195 10511 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:32.888789  4046 pending_rounds.cc:85] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 11
I20260709 13:18:32.889107  4046 pending_rounds.cc:107] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:18:32.889371  4046 raft_consensus.cc:2889] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:32.890362 10533 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:32.890724 10551 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:32.894131 10533 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:32.874923 10460 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.897171 10556 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:32.897697 10556 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.899636 10556 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.900738 10552 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.901207 10552 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.902652 10559 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:32.908233 10556 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:32.911000  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:32.912957 10470 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:32.913160  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:32.913497 10470 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:32.913996  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:32.914301 10587 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.427s	user 0.000s	sys 0.002s
I20260709 13:18:32.915063  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.915764  4118 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:32.914372  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.920662  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.927318  4116 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:18:32.980144  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44714.3us
I20260709 13:18:32.979437  4039 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:32.986289 10498 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:32.990187 10498 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:32.990403  4038 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:32.992334  4039 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:32.991367  4118 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:32.895105 10533 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.006480  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:32.917624 10499 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:18:32.998715  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.003862  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:33.005192  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:33.013182  4044 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:33.013463  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:33.005692  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:32.945118 10262 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:32.903189 10552 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:32.995508  4085 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:32.945433 10386 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:33.007149  4045 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:33.011700  4116 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 13:18:33.021230  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:33.014214  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 236631us
I20260709 13:18:33.022775  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:33.016242  3964 raft_consensus.cc:2393] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:33.016901  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.023721  4119 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:33.031152  3969 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:33.017982 10262 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:33.036363 10262 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:33.040210  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 130432us
I20260709 13:18:33.042343  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:32.987983 10560 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:18:33.044847  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.046890  4681 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:33.031394 10215 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:33.056962  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.060436  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:33.061764  3965 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:33.035465 10583 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.019855 10117 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:18:33.075716  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:33.077445  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.067800 10215 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:33.080912 10215 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.065248 10442 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:33.060664 10460 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.064510 10551 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.085345  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:33.090255  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.058508 10556 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:33.055702 10467 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:18:33.095403  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.070240 10117 consensus_queue.cc:1243] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 20.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:18:33.105710  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.111231  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:33.111450  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.106487  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.084720 10593 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:18:33.113040  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:33.123018  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.124979  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:33.066390 10555 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:18:33.089439 10188 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.122151  9830 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:33.117453 10595 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 13:18:33.108378 10579 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:18:33.136835  3866 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.139464  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.089308 10591 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:18:33.142620  4112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:33.142848  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:33.145188 10524 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:33.146467 10445 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:33.074143 10583 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.162374  4115 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:33.162887  4112 raft_consensus.cc:606] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:33.166143  4117 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:33.167680  4118 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:18:33.169891  3866 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.170766  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.172798  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:33.179046 10466 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:33.180071 10445 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:33.181470 10582 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.674s	user 0.007s	sys 0.000s
I20260709 13:18:33.181355 10445 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.182960 10541 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:33.183346 10541 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:33.185359 10583 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.187083 10591 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:33.187218 10565 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:33.187508 10591 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:33.163725 10524 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.189126 10524 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.161037 10457 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:33.180006 10579 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.196794 10579 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.198732 10579 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.184134 10541 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:33.217456  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44750.1us
W20260709 13:18:33.179927 10608 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:18:33.179149 10606 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.104s	user 0.000s	sys 0.005s
I20260709 13:18:33.179083 10364 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:33.168619 10595 consensus_queue.cc:1243] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:33.227104 10479 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:33.232221  3866 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 15 to 19, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:33.242676  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 206518us
I20260709 13:18:33.244639  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:33.245249  4046 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.246016  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:33.244997  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:33.250047  4115 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:33.248492 10552 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:18:33.253288  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:33.240675 10556 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.234853 10364 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:33.264623 10262 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.265518 10364 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.266489 10364 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:33.267071  3965 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.258024 10467 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:18:33.240947  3918 placement_policy_util.cc:248] tablet b68b34d0f4bd480da49284d88135af8b: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:18:33.254145  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.276577  4043 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:18:33.259804  3970 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:33.261037 10603 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 13:18:33.264052 10509 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:33.285392  3972 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:33.280551  3965 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:33.188390 10591 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.290508  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:33.294219  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.247440 10541 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:33.301901  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:33.254207  9986 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:33.303788  4112 raft_consensus.cc:2368] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:33.309365  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.313031  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:33.313685  4121 raft_consensus.cc:606] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.314035  4121 raft_consensus.cc:614] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.316610  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.319682  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:33.326182  3918 placement_policy_util.cc:248] tablet 2e7bedca9d544f8992960c04a55f9233: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:18:33.301769 10533 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:33.333890  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:33.266682 10262 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.340535  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.305963  9986 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:33.310212 10467 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.344317  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:33.345788  9986 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.318969 10555 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:33.281687 10556 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.306432 10552 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:18:33.362598 10615 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.372386 10615 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:33.373440 10613 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:18:33.365175 10586 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.671s	user 0.007s	sys 0.001s
I20260709 13:18:33.377041  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:33.381053  4117 raft_consensus.cc:606] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:33.381323  4117 raft_consensus.cc:614] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:33.382440  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.386896  4046 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:33.374727 10615 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.318878 10253 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:18:33.396122  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.396114  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:33.397746  4121 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:33.400118  3866 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 13 to 14, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 14 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.405943  3967 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:33.407053  3866 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 16 to 17, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 17 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.404285 10442 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:33.416065  3970 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:33.360211 10467 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.375968 10555 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.423789 10467 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.412262 10445 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.421808 10556 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.426802  3866 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.428174  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.431710  3866 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 10 to 12, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.433586  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.436081  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.437919  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.441943  3866 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 11 to 15, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.445106  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 3773) took 1110 ms. Trace:
I20260709 13:18:33.445509  4041 rpcz_store.cc:276] 0709 13:18:32.332487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:32.333388 (+   901us) service_pool.cc:224] Handling call
0709 13:18:32.347891 (+ 14503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:32.412054 (+ 64163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:32.412084 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:32.437283 (+ 25199us) log.cc:844] Serialized 26 byte log entry
0709 13:18:32.566616 (+129333us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:18:32.684436 (+117820us) log.cc:844] Serialized 14 byte log entry
0709 13:18:32.782257 (+ 97821us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b1800104f80. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:32.982431 (+200174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:32.982507 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:33.283367 (+300860us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:33.442691 (+159324us) raft_consensus.cc:1685] finished
0709 13:18:33.442715 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:33.442864 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":311400,"prepare.queue_time_us":122544,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":324692,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":3086,"spinlock_wait_cycles":21631744,"thread_start_us":163294,"threads_started":2,"wal-append.queue_time_us":250349}
I20260709 13:18:33.429637 10442 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:33.507372  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet b68b34d0f4bd480da49284d88135af8b with delete_type TABLET_DATA_TOMBSTONED (TS 1e032f02b0aa450384dda978641ba666 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:60872
I20260709 13:18:33.508678  3962 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e7bedca9d544f8992960c04a55f9233 with delete_type TABLET_DATA_TOMBSTONED (TS 1e032f02b0aa450384dda978641ba666 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:60872
I20260709 13:18:33.428330 10445 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.629825 10596 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:33.662478 10620 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:18:33.644899 10318 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:33.671151  4116 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
W20260709 13:18:33.677001 10617 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:18:33.677371 10604 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:33.677767 10604 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:33.660729 10556 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.674005  3866 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.681273  3970 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:18:33.686290  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.676172 10555 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:33.673384 10318 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.667019 10596 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.689090 10494 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:18:33.685983 10556 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.714929 10533 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.685555 10442 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.721864  3866 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 9 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 12 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:33.724895 10494 consensus_queue.cc:1243] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:33.723886 10318 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:33.713160 10604 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.726531 10467 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.733376 10615 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.733161 10555 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.735850 10565 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.751185  4680 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:33.747958  3866 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 11 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.726666 10533 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.751520  4680 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:33.745375 10318 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:33.761181 10318 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.763962 10318 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:33.763370  9986 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.767911  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:33.747313 10604 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:33.754150 10524 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.565s	user 0.010s	sys 0.000s
I20260709 13:18:33.754678  4680 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.755774  3866 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 10 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 13 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:33.779291  4680 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:33.780339  3866 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 8 to 10, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.783721 10445 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:33.746260 10467 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.786552  3866 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:33.789259  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.791041  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:33.770081  9986 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.752262 10615 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.753736 10555 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.781401 10626 tablet_replica.cc:333] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:18:33.755115 10565 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:33.797549  3866 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 7 to 14, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 14 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:33.793249  9731 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:33.780045 10524 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.804574  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.803139  3970 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:33.805655  4118 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:33.801635 10445 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.812810 10467 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:33.806361 10625 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:18:33.815949 10555 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:33.803280 10556 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.821194  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.804183  9731 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:33.829085  4118 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:33.809482 10596 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.834484  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:33.832859 10548 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:18:33.837165  9731 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.836521 10626 raft_consensus.cc:2243] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:33.839977  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:33.840871  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:33.841924 10565 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:33.831907 10581 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
W20260709 13:18:33.838599 10622 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.187s	user 0.005s	sys 0.000s
I20260709 13:18:33.855404  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.857172  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.857963  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.853966  4684 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:33.859899  4113 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:18:33.862344  4677 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:33.860406  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.864712  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.866343  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:33.867077  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:33.873767  4046 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:33.871488  4116 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:33.884358  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:33.882756  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:33.827641 10445 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.899444  4677 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:33.891467 10217 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:33.921720  4680 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:33.925417  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:33.904817 10626 raft_consensus.cc:2272] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:33.903769 10559 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:33.926777  4087 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:33.919193 10217 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:33.929236  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46572.7us
I20260709 13:18:33.917366 10594 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:33.927822 10364 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:33.929538 10217 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.931368 10555 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:33.931475 10559 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.934365 10594 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.942852 10594 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.924733 10509 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:18:33.936514 10524 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:33.928603 10632 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:33.963861 10445 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:33.939455 10555 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:33.983379  4039 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:33.985090  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.950101 10626 ts_tablet_manager.cc:1916] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:33.969169 10632 consensus_queue.cc:1243] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:18:33.976707 10470 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.986104  4113 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:33.987339  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:33.988741  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:33.991580  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:33.992288  4038 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:33.993557 10581 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:33.994103 10581 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:33.996240 10581 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:33.997542  9731 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:33.986584 10555 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:33.999697 10598 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:18:34.005268 10615 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:34.006392 10591 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:34.008852  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:34.011341  4118 pending_rounds.cc:85] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 8
I20260709 13:18:34.011673  4118 pending_rounds.cc:107] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 20.9
I20260709 13:18:34.011919  4118 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:34.012336  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:34.015364  4113 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:34.006268 10559 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:34.030179  4038 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
W20260709 13:18:34.017452 10630 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:18:34.059549  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.061614  3969 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:18:34.069667  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.070026  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.070887  3964 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:34.084708  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:34.088056  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:34.064361 10541 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.756s	user 0.009s	sys 0.004s
I20260709 13:18:34.089591  4113 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:34.089857  4047 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:34.091262  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:34.062273 10598 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.098664  4040 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:34.102555  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.066154 10379 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:34.104382  4119 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:18:34.104796  4119 pending_rounds.cc:85] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 11
I20260709 13:18:34.105031  4119 pending_rounds.cc:107] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:18:34.105269  4119 raft_consensus.cc:2889] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:34.085386  4043 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:34.106382  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:34.106377  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:34.055694 10253 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:18:34.109236  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:34.056701 10217 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:34.122043  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:34.122979  9731 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:34.124444  9731 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:34.126534  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:34.125351  9731 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.123688 10445 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.128685 10637 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:34.129168 10637 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.129498 10637 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.118850 10262 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:18:34.141319 10217 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.142164  4679 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:34.143157  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:34.143821  3970 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.145000  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:34.149232  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 67420.7us
I20260709 13:18:34.151153  3937 leader_election.cc:400] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:34.151473  3937 leader_election.cc:403] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.162457  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:34.163158  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.113847 10379 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.107511 10598 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:34.166357  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.174288 10379 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.178443 10598 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.146027 10583 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.182464  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:34.185858  4120 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
W20260709 13:18:34.150390 10633 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:18:34.191874  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.188071  3970 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:34.190609  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.192031  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.187424  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.194829  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:34.195014  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.193140  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.196425  3968 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:34.197683  3969 raft_consensus.cc:2368] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:34.198724  3967 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:18:34.200747  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.166584 10470 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:18:34.206121 10467 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:34.206558 10467 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.206256  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.207547  3963 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:34.206835  4684 pending_rounds.cc:85] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 11
I20260709 13:18:34.211122  4684 pending_rounds.cc:107] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:18:34.211400  4684 raft_consensus.cc:2889] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:34.179407 10629 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.186137  9986 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:34.229163  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.204833 10556 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:34.206929 10467 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:34.251539  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.225982 10533 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.253566  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.236502 10364 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.238705 10556 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:34.259752  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:34.248224  9986 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:34.265446  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.270506 10253 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:18:34.262269 10591 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.266865 10556 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.269747 10581 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:34.265286 10262 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:18:34.283826  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.260663 10270 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:18:34.266367 10364 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.305003 10364 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:34.306226  4011 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.307317 10555 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:34.307956 10547 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:34.308679 10648 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:18:34.309095 10637 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.279570 10552 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:34.282961 10253 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:34.306303 10580 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:34.334690  4114 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
W20260709 13:18:34.335314  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 79067.3us
I20260709 13:18:34.336242  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.336531  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.345412  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.331749 10379 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:18:34.346297 10457 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.346711 10457 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:34.347097 10457 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:34.345497 10653 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:18:34.317912 10552 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.354619 10552 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:34.355258 10457 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.356645  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.357959 10364 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:34.358532 10637 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:34.360309  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.360801 10555 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:34.361101 10637 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:34.361469 10637 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.361824 10637 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:34.368927 10524 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.370472 10637 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.373507  4085 leader_election.cc:400] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:34.318297 10591 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:18:34.373986  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:34.373716 10541 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:34.338634 10253 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:34.374215 10591 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:34.372593 10637 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:34.374577  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.375317 10253 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:34.394573 10253 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:34.375411  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.398770 10637 raft_consensus.cc:993] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:34.402873  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.402237  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:34.399264 10649 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:34.414189  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:34.421948  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:34.424068  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:34.426916  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:34.429055  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:34.431910  3964 raft_consensus.cc:2368] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:34.433275  4679 raft_consensus.cc:2368] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:34.394701 10559 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:34.434798  3971 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:34.437393  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:34.437518  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:34.436939  3964 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:34.479590  4115 raft_consensus.cc:606] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:34.480008  4115 raft_consensus.cc:614] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:34.416148 10253 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:34.436900  4085 leader_election.cc:400] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:34.481213  4085 leader_election.cc:403] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:18:34.441299  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:34.390774 10614 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:34.624140  3964 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:34.625612  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 147650us
I20260709 13:18:34.429423 10523 raft_consensus.cc:1081] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
W20260709 13:18:34.627924  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 191199us
I20260709 13:18:34.393234 10457 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:34.696393 10644 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.489s	user 0.005s	sys 0.007s
I20260709 13:18:34.657784 10635 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:34.659875 10655 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.655615 10614 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.711899 10598 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:34.734340  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 46124.5us
I20260709 13:18:34.687307 10552 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.751917 10201 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:34.784312  3967 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:18:34.754294 10630 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.411s	user 0.003s	sys 0.007s
I20260709 13:18:34.762462 10217 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:34.770692  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:34.783286 10201 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:34.737104 10467 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.783998 10604 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:34.804687  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 65918.2us
I20260709 13:18:34.724609 10655 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.777737 10262 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.829412  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:34.830516  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:34.785004 10555 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:34.742697 10598 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:34.833616  4042 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:34.833004  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:34.853268  3969 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:34.852558  4038 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:18:34.792193 10556 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:34.858029  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet 50aca70be0884ed09aa97127d571282f: Illegal state: Replica 1e032f02b0aa450384dda978641ba666 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:34.843580 10665 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:34.821169 10217 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:34.842715 10604 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.861102 10533 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:34.882542  3965 raft_consensus.cc:1217] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[13.8-16.10]   Dedup: 13.8->[14.9-16.10]
I20260709 13:18:34.884943  3965 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [13.8-16.10]
I20260709 13:18:34.886461  4042 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:34.887395  4046 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:18:34.890787  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:34.892031  4046 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:34.895955  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.850309 10262 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.853516 10555 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.903795  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.891906 10632 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:34.911936 10523 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:34.912354 10386 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:18:34.912976 10659 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.069s	user 0.000s	sys 0.002s
I20260709 13:18:34.913689 10467 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.890502 10665 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:34.904871 10364 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:34.863142 10201 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.917488  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:34.923358 10386 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.925616  4117 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:34.926456 10217 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.919147 10637 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:18:34.918833 10270 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:18:34.935667 10364 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:34.935801 10593 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:18:34.929127  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet e1f289732f2a4c498b8d722dbadc5721: Illegal state: Replica 1e032f02b0aa450384dda978641ba666 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:34.927826 10604 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.891278 10533 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.937568 10556 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.938635 10533 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:34.924062 10658 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.102s	user 0.001s	sys 0.001s
I20260709 13:18:34.938915 10442 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:18:34.917735 10660 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:18:34.935905 10637 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:34.954068 10598 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.955192  4117 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:34.956346 10655 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:34.958237 10614 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.958350 10262 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.959139 10665 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:34.944494 10552 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.949875 10637 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:34.966539 10637 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:34.973716 10637 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:34.974519  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 199707us
I20260709 13:18:34.943974 10386 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:34.975221  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:34.977007  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet 9b8eecd98f04495f9ed7470925ed9487: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:34.973223  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:34.978281  4046 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:34.973045  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:34.983033  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.012080 10364 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:35.015453  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.016681  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.019889  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:35.016669  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.016989  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.017300  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.022186  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.017973  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.024504  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:34.977483 10663 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 13:18:34.943746 10626 ts_tablet_manager.cc:1929] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:18:35.026600  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.026870  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.028102  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:35.033903  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 243186us
I20260709 13:18:35.018488 10598 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:34.920468 10632 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.043365 10626 log.cc:1199] T b68b34d0f4bd480da49284d88135af8b P 1e032f02b0aa450384dda978641ba666: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/wals/b68b34d0f4bd480da49284d88135af8b
W20260709 13:18:35.043865 10668 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:18:35.045123  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 58230.6us
I20260709 13:18:35.044494  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.034466 10665 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:35.054034  4118 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:18:35.032498 10666 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.030107 10364 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.046811 10598 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:35.071830  4040 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:35.077237  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:35.060066 10665 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.083477 10626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60872 (request call id 0) took 1654 ms. Trace:
I20260709 13:18:35.085709 10548 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.086277 10548 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.083911 10626 rpcz_store.cc:276] 0709 13:18:33.442962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.507048 (+ 64086us) service_pool.cc:224] Handling call
0709 13:18:33.751062 (+244014us) ts_tablet_manager.cc:1151] Deleting tablet b68b34d0f4bd480da49284d88135af8b
0709 13:18:33.752136 (+  1074us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:34.310106 (+557970us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:34.943609 (+633503us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:35.083369 (+139760us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":236677,"thread_start_us":181010,"threads_started":1}
I20260709 13:18:35.077574 10598 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.093847  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.081207 10556 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:35.096923  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.097916  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.087343 10665 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.100013  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.065927 10666 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:35.104424 10666 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:35.104923  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet b68b34d0f4bd480da49284d88135af8b (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:35.105327 10626 tablet_replica.cc:333] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:18:35.105754  4039 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:35.106338 10626 raft_consensus.cc:2243] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:35.107403 10626 raft_consensus.cc:2272] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:35.110597 10362 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 21.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:35.107226  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:35.111533 10362 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:35.112133 10362 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:35.112366 10201 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.115459  4119 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:35.118381  9941 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:35.119148  9941 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:18:35.120031  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.121372 10253 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.122516 10635 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:35.107647 10548 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.123473 10253 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.124413 10555 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:35.127269  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.127887  3965 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:35.134263  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.147684  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:35.140092  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.166852  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:35.152981 10494 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.176101  3966 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:35.177314  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.180197 10364 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:35.181753  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.145915 10556 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:35.186771  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 68953us
I20260709 13:18:35.187131  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:35.186090  4120 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:18:35.187986  4120 pending_rounds.cc:85] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 12
I20260709 13:18:35.188089  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.188287  4120 pending_rounds.cc:107] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:18:35.189230  4120 raft_consensus.cc:2889] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:35.193497  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.193888 10635 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:18:35.205778  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.206432  4117 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:35.206776  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.210036  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.213588  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:35.216675  4087 leader_election.cc:400] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:35.220101 10626 ts_tablet_manager.cc:1916] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:35.222069 10632 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.193740 10638 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:18:35.225487 10556 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.208396 10598 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:35.226019  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.223901  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.227206 10442 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:35.227767 10442 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.178422 10646 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:35.231926  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.230640  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.234747  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.245363  4114 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 16: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:35.238122  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet 685b92d286284315bf0bfd731587b546: Illegal state: Replica 1e032f02b0aa450384dda978641ba666 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:35.241077  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.249665  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.255527  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.256203  4112 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:35.257922  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.258160 10552 raft_consensus.cc:2764] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:35.258934 10632 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.227686 10598 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.220033 10655 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:35.260478  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.238505 10541 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:18:35.240952 10666 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.267959  4117 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
W20260709 13:18:35.269240  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57373.1us
I20260709 13:18:35.242341  3965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:18:35.273406  3965 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:35.273825  3965 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.274369  4679 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:35.244585 10646 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.279348  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.286018 10442 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:35.287249 10365 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:35.277784 10666 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.290714 10666 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.295003  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.295676  3966 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:35.296111  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.296983  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:35.178982 10362 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:35.300887  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 266391us
I20260709 13:18:35.306910  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.306824  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.308946  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.293514 10646 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.278504 10655 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:35.268797 10614 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:18:35.293708 10541 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:35.298851 10362 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.387444 10541 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:35.388487 10660 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:18:35.312660 10533 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.309684 10552 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:35.376485  3965 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.381522 10548 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:35.414978  3965 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.307880 10188 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 13:18:35.418970 10188 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:35.419358 10188 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:35.419963 10614 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:35.421028  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 109510us
I20260709 13:18:35.422587  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:35.432687  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 159845us
I20260709 13:18:35.436113  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.442868  3964 raft_consensus.cc:1217] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[13.8-16.10]   Dedup: 13.8->[14.9-16.10]
I20260709 13:18:35.443514  3964 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [13.8-16.10]
I20260709 13:18:35.448446  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.418231 10548 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.452433  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.448575 10552 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:35.420198 10188 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:35.452076 10614 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:35.451706 10533 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:35.475533  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.456748 10556 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.500831  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.457719 10548 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:35.458362 10655 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.508365 10445 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:35.511909 10628 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:35.525501 10628 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:35.526365 10628 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:35.476504  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.527829  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.523438  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 138337us
I20260709 13:18:35.474408 10614 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:35.454332 10201 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:18:35.529767  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:35.534001  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71162.5us
I20260709 13:18:35.538295  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.461401 10665 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:35.519728 10188 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.534255 10614 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.552423 10470 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.553143 10470 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.555510 10470 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.556118 10665 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.556850 10262 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:35.519141 10552 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:18:35.560134  4677 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:35.562497  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.563086  4113 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:35.563637  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.564868  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.561089  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.567111  4046 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.563403  4113 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:35.542985 10201 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:18:35.573829  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 99114.8us
I20260709 13:18:35.569756  4113 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.575376  4113 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:35.582935  4046 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:35.566514 10253 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:35.585987 10523 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.592665  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:35.593437  4120 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.599519 10594 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:35.602021 10594 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:35.602381 10594 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:35.613164  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:35.624665  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.631246  4113 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:35.653579 10541 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:35.654178 10541 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:35.654551 10541 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.707688  4120 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
W20260709 13:18:35.708397  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 131773us
W20260709 13:18:35.710666  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51475.4us
I20260709 13:18:35.722002  4120 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:35.724488  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.719691  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:35.730793  3968 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:18:35.733426  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:35.729350 10687 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:35.730051 10217 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:18:35.768491 10665 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:35.739035 10632 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:35.770924 10632 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:35.771823 10632 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.776235  4113 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:35.778429  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:35.785648  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.799434 10628 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:35.784792 10695 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:35.787377 10262 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:35.780999 10687 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:18:35.816603  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:35.821959  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:35.827529 10594 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.786163 10614 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.806314 10695 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:18:35.844584  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 343982us
W20260709 13:18:35.848115 10705 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:18:35.841297 10594 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.845371  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.858326  4118 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:35.860112  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.860810  3964 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:35.839287 10548 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.838322 10704 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:18:35.854410 10445 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:35.866761 10364 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:35.895396 10364 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.901197 10364 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:35.896106  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:35.903707  4121 raft_consensus.cc:606] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:35.904151  4121 raft_consensus.cc:614] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:35.896207  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:35.906559 10523 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:35.906934 10523 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:35.907255  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:35.907287 10523 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:35.909256  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:35.902980  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:35.916015 10646 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260709 13:18:35.932832  4045 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:18:35.904078 10707 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:18:35.938553  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:35.942708  3965 raft_consensus.cc:2410] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:18:35.935966 10697 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:35.950129 10697 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.952158 10697 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:35.949492  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68082.8us
I20260709 13:18:35.916532 10646 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.959139  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.972409 10364 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:35.972966 10364 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:35.962155 10703 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.215s	user 0.002s	sys 0.000s
I20260709 13:18:35.966832  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:35.981980  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:35.982445  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.983126  4046 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:35.983868  4038 raft_consensus.cc:2368] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:35.985083 10364 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:35.987746 10555 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:35.990226  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:35.976223 10556 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:18:35.992610 10614 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:35.869164 10695 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.993934 10695 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:35.993738 10523 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:35.995954 10523 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:35.998941  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:35.978024 10637 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.009231 10637 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.011360 10637 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:36.024642  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.025427  4119 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:18:36.027472  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.028846 10556 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:36.029908  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:35.878737 10687 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:36.035490  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.035764  3970 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:18:36.035897  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.033991  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.048178  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.053404 10637 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:36.054972  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:36.050357  3968 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:36.058341  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.059484 10635 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:36.063411 10635 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:36.066238 10253 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:36.046476 10364 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.049264 10699 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:18:36.085722 10626 ts_tablet_manager.cc:1929] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:18:36.086243 10626 log.cc:1199] T 2e7bedca9d544f8992960c04a55f9233 P 1e032f02b0aa450384dda978641ba666: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/wals/2e7bedca9d544f8992960c04a55f9233
I20260709 13:18:36.087332 10626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60872 (request call id 1) took 2580 ms. Trace:
I20260709 13:18:36.087692 10626 rpcz_store.cc:276] 0709 13:18:33.506662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.508407 (+  1745us) service_pool.cc:224] Handling call
0709 13:18:35.104999 (+1596592us) ts_tablet_manager.cc:1151] Deleting tablet 2e7bedca9d544f8992960c04a55f9233
0709 13:18:35.105056 (+    57us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:18:35.498060 (+393004us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.074139 (+576079us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:36.087253 (+ 13114us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1595764}
I20260709 13:18:36.103597  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet 2e7bedca9d544f8992960c04a55f9233 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:36.107638 10692 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.108402 10692 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.116914  4086 leader_election.cc:400] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20.
I20260709 13:18:36.122833  4115 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
W20260709 13:18:36.124173  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 396383us
I20260709 13:18:36.064371 10635 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.143023  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.145114  3968 raft_consensus.cc:1217] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[13.8-16.10]   Dedup: 13.8->[14.9-16.10]
I20260709 13:18:36.145726  3968 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: [13.8-16.10]
I20260709 13:18:36.152091  3972 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:18:36.153687  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:36.156916 10386 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:36.163056 10555 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.163748 10555 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.186089  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.198500  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:36.200307  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.202952  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:36.203578  3968 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:36.208586 10646 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.181779 10548 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.187330 10637 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.226151  3968 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:36.216114  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.147492 10541 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:36.235922  3967 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:36.202816 10386 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:36.214095 10555 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:36.240859  4039 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:36.246989  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.266511 10386 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.265257 10555 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:36.268163 10719 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:36.217965 10518 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:18:36.270465  4044 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:36.231983 10637 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:36.282616  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:36.288292 10239 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:36.305821 10239 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:36.306701 10239 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.276535 10545 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:18:36.309325 10545 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:36.309705 10545 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:36.310534 10545 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.311738 10545 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:36.314040 10541 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:36.315209  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:36.286885 10692 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:36.360939 10726 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:18:36.361894 10637 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:36.381067  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:36.395406  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:36.398497  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:36.401403  4118 raft_consensus.cc:2410] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:36.405118  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:36.406831  4117 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:36.409221  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:36.410005  4115 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
W20260709 13:18:36.397431 10721 log.cc:927] Time spent T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:18:36.442456  4039 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:36.452983  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.481201  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.455515 10727 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 13:18:36.496822 10722 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.226s	user 0.004s	sys 0.000s
I20260709 13:18:36.486068 10701 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.500542 10442 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.501142 10442 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:36.512230 10442 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:36.513373 10692 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.513975 10692 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.520112  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.521131  4044 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:36.528712  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.523401  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:36.529469  3967 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:36.529652 10524 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:36.534142  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:36.536875  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:36.540246  4112 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:18:36.540370  4677 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:36.530061 10524 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.542690 10524 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:36.541570 10117 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:36.543323 10117 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.543658 10117 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.545018 10262 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:36.561309 10524 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:36.565255 10524 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:36.580704  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:36.582340  4679 raft_consensus.cc:2393] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:36.582510  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:36.613251 10117 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.615722 10117 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.616958  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:36.621308  3964 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.620379  4044 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:36.623463  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:36.623838  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:36.624890  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:36.624704  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:36.631693  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:36.635958 10655 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:36.636588 10655 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:36.637477 10655 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:36.641592  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:36.652418  3964 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:18:36.654663  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:36.642830 10581 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:36.635393 10253 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:36.647143 10518 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:36.664781  4120 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:36.656419 10604 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.677662  4039 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:36.658833 10253 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.681841  3918 placement_policy_util.cc:248] tablet b68b34d0f4bd480da49284d88135af8b: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:18:36.669363 10581 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:36.687031 10581 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:36.687898 10581 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.689402  3963 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:36.691537 10442 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:36.692365 10442 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:36.692708 10442 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:36.693521 10442 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.694722 10442 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:36.697921 10598 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:36.680521 10604 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.703438 10604 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.705194  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:36.706024  4118 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:36.725412  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.731433 10598 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:36.680531 10253 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.745590  3918 placement_policy_util.cc:248] tablet 2e7bedca9d544f8992960c04a55f9233: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:18:36.755929 10692 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.761119 10524 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:36.761713 10524 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.765168  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.770056  3970 raft_consensus.cc:2368] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23.
I20260709 13:18:36.746306 10655 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.773165  4085 leader_election.cc:400] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23.
I20260709 13:18:36.773573  4085 leader_election.cc:403] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.772137 10364 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.780447 10524 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:36.781721 10555 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.784314  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.780179 10364 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.790326 10364 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:36.791268  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.791829  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.792593  3970 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 23 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:18:36.793684  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:36.762709  3864 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 9 to 15, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 15 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:36.795710 10635 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:36.795249 10655 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.816890  3962 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e7bedca9d544f8992960c04a55f9233 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:60872
I20260709 13:18:36.815665  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet b68b34d0f4bd480da49284d88135af8b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:60872
I20260709 13:18:36.818341  3864 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.824785  3864 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 13 to 16, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.825809 10552 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:36.826399 10552 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.826686  3864 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.828462 10552 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.829368  3864 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:36.833374  3864 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.831454  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:36.826807 10555 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23.
W20260709 13:18:36.842679  3866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 234) took 39637 ms (client timeout 15000 ms). Trace:
I20260709 13:18:36.844792 10655 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:36.846626  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.848321  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:36.850584  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:36.856710  4046 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:36.858031  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:36.856657  4118 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:36.843842  3864 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:36.861459  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:36.851558  3866 rpcz_store.cc:269] 0709 13:17:57.214580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:17:57.231229 (+ 16649us) service_pool.cc:224] Handling call
0709 13:17:58.553294 (+1322065us) spinlock_profiling.cc:243] Waited 89.2 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b6090 00007fed76454f3a 00007fed7c20b1cc 00007fed7c30937e 00007fed7a7ca2a4 00007fed7a7ca232 00007fed7a7ca161 00007fed7a7ca0dc 00007fed7a7c9392 00007fed7478748c 00007fed747868c6
0709 13:18:36.842583 (+38289289us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:33.960963 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:33.965620 (+  4657us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:33.966909 (+  1289us) write_op.cc:435] Acquired schema lock
0709 13:18:33.966938 (+    29us) tablet.cc:662] Decoding operations
0709 13:18:34.179109 (+212171us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:34.204655 (+ 25546us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:34.211178 (+  6523us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:18:34.331027 (+119849us) tablet.cc:701] Row locks acquired
0709 13:18:34.331086 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:18:34.331253 (+   167us) write_op.cc:270] Start()
0709 13:18:34.331398 (+   145us) write_op.cc:276] Timestamp: P: 1783603114331188 usec, L: 0
0709 13:18:34.331418 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:34.359364 (+ 27946us) log.cc:844] Serialized 5970 byte log entry
0709 13:18:35.015528 (+656164us) op_driver.cc:464] REPLICATION: finished
0709 13:18:35.171347 (+155819us) write_op.cc:301] APPLY: starting
0709 13:18:35.185460 (+ 14113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:35.606484 (+421024us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:35.606581 (+    97us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:36.075353 (+468772us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:36.115778 (+ 40425us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:18:36.115826 (+    48us) write_op.cc:312] APPLY: finished
0709 13:18:36.116192 (+   366us) log.cc:844] Serialized 139 byte log entry
0709 13:18:36.269292 (+153100us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.275752 (+  6460us) write_op.cc:454] Released schema lock
0709 13:18:36.277606 (+  1854us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:36.312651 (+ 35045us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:36.312686 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":55,"spinlock_wait_cycles":205156608,"child_traces":[["op",{"apply.queue_time_us":130158,"apply.run_cpu_time_us":41432,"apply.run_wall_time_us":1124219,"cfile_cache_hit":62,"cfile_cache_hit_bytes":67037,"num_ops":15,"prepare.queue_time_us":80360,"prepare.run_cpu_time_us":92675,"prepare.run_wall_time_us":804376,"raft.queue_time_us":58060,"raft.run_cpu_time_us":23844,"raft.run_wall_time_us":55927,"replication_time_us":683952,"thread_start_us":651256,"threads_started":5,"wal-append.queue_time_us":603294,"wal-append.run_cpu_time_us":23687,"wal-append.run_wall_time_us":1216440}]]}
I20260709 13:18:36.870115 10253 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.863422 10364 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:36.881239  4119 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:18:36.891247  4119 pending_rounds.cc:85] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 11
I20260709 13:18:36.891547  4119 pending_rounds.cc:107] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:18:36.891778  4119 raft_consensus.cc:2889] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:36.893031 10470 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:36.895529 10547 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:36.892779 10364 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.898149 10364 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:36.895640 10470 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:36.902803 10470 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:36.907335  4044 raft_consensus.cc:2368] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21.
I20260709 13:18:36.910586  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:36.915741  3937 leader_election.cc:400] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21.
I20260709 13:18:36.916157  3937 leader_election.cc:403] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:36.920471 10604 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.925549  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet 2e7bedca9d544f8992960c04a55f9233 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:36.926286  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet b68b34d0f4bd480da49284d88135af8b (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:36.940536  3970 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:36.943622 10692 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:36.957679 10253 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:36.961889  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:36.962555  4113 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:36.963284  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:36.973491  4113 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:36.976815  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:36.981743 10548 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:36.991200 10470 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:36.990150 10548 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:36.997727 10548 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.000972 10604 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21.
I20260709 13:18:36.969434  3864 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:37.009819  3864 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.018203 10364 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.021399 10364 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:37.022051  3963 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
W20260709 13:18:37.022065  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet 1be06cbb19234936aabe0a7128358755: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.025161  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:37.025764  4039 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:37.029167  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet d99c13fc3b7f4e2687824e0a5911512a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:37.022373  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:37.033954 10470 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:37.035022  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:37.037019  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet b34dfd1b29be4147bfda87c498945aeb: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.039841  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:37.049206  4119 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:37.052289  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet 53a55b3994714eaca86c1f4d5e9a466e: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.041663  4039 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:37.057731  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:37.059099  4119 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:37.060962 10442 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:37.061450  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:37.062219 10470 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:37.061481 10442 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:37.062737 10470 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:37.063439 10470 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.068456 10442 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.089154  4119 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:37.090703  4113 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:37.091521 10533 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:37.092116 10253 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:37.102908  4039 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:37.104637 10533 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:37.150976 10533 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:37.151535 10533 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.154898  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:37.155725  4044 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:18:37.161275 10533 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:37.169064  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:37.170622  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:37.172552 10604 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:37.181619  4679 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:37.185238 10442 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:37.194173  3968 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 13:18:37.204495 10548 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:18:37.239378  4044 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:37.241402 10701 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:37.256999 10655 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:37.257573 10655 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.261687 10655 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:37.263036  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:37.263716  4039 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:37.265053  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:37.265869 10442 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:37.266283 10442 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:37.266669 10442 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:37.270845  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:37.272294  3970 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:37.277927 10442 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.280193 10442 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:37.280915  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:37.281141  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:37.283877  3968 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:37.290433  4039 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:37.291711  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:37.292814 10701 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:37.293313 10701 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:37.294122 10701 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.294901  3864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 99) took 5304 ms. Trace:
I20260709 13:18:37.306648 10548 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:37.307845 10548 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.295269  3864 rpcz_store.cc:276] 0709 13:18:31.990661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:31.990910 (+   249us) service_pool.cc:224] Handling call
0709 13:18:37.294817 (+5303907us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:37.097865 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:37.098463 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:37.098492 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:18:37.098508 (+    16us) tablet.cc:662] Decoding operations
0709 13:18:37.099397 (+   889us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:37.099451 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:37.099476 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:18:37.100137 (+   661us) tablet.cc:701] Row locks acquired
0709 13:18:37.100157 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:18:37.100289 (+   132us) write_op.cc:270] Start()
0709 13:18:37.100391 (+   102us) write_op.cc:276] Timestamp: P: 1783603117100239 usec, L: 0
0709 13:18:37.100412 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:37.101023 (+   611us) log.cc:844] Serialized 3597 byte log entry
0709 13:18:37.144019 (+ 42996us) op_driver.cc:464] REPLICATION: finished
0709 13:18:37.157521 (+ 13502us) write_op.cc:301] APPLY: starting
0709 13:18:37.157605 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:37.182946 (+ 25341us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:37.183035 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:37.239836 (+ 56801us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:37.240098 (+   262us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:18:37.240142 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:37.240393 (+   251us) log.cc:844] Serialized 89 byte log entry
0709 13:18:37.264646 (+ 24253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.264795 (+   149us) write_op.cc:454] Released schema lock
0709 13:18:37.264839 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:37.289375 (+ 24536us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.289405 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":398675,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":13219,"apply.run_cpu_time_us":14829,"apply.run_wall_time_us":131819,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41873,"num_ops":9,"prepare.queue_time_us":51993,"prepare.run_cpu_time_us":3461,"prepare.run_wall_time_us":5841,"replication_time_us":43430,"thread_start_us":24419,"threads_started":2}]]}
I20260709 13:18:37.316043  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:37.314465 10548 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:37.319157  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:37.319903  4113 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23.
I20260709 13:18:37.328294  4012 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23.
I20260709 13:18:37.328629  4012 leader_election.cc:403] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:37.330330 10580 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:18:37.330628  3867 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 17, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.332239  3867 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.334273  3867 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 17. New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.338313  3867 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.340864  3867 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.344548  3867 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.348492 10580 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23.
I20260709 13:18:37.356288  3867 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 17, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.361918  3867 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.363765  3867 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.365453  3867 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.367122  3867 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.369280  3867 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.381685  3867 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 14 to 15, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.383530  3867 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 14 to 15, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 15 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.384837  3867 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 14 to 17, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.386963  3867 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 17, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 17 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.388844  3867 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 11 to 12, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.394484  3867 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 14, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.396786  3867 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 14 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.447201  3963 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:37.448745 10580 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:37.494418  4113 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:18:37.500362 10548 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:37.522326  4046 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:37.523764 10533 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:37.559559  4119 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:37.561339 10533 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:37.580375  3968 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:37.598289  3968 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:37.607221 10442 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:37.611758 10533 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:37.612639 10533 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.632835  4039 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:18:37.635229 10442 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:37.637229 10533 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:37.649959  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:37.650735  4119 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:37.653504  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:37.654268  4038 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:37.658593  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:37.659720 10386 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:37.660166 10386 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:37.660562 10386 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:37.669162 10386 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.671738 10386 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:37.682796  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:37.683792  4045 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:37.687383  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:37.697108  4046 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:37.710059 10555 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:37.724643  3864 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 18 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:37.727290  3864 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 17 to 21, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 21 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:37.729148  3864 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.741868  4119 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:37.754041  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:37.754855 10386 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:37.755362 10386 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:37.756161 10386 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:37.756088  3864 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 16 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:37.757851  3864 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 17 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 19 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.759485  3864 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 10 to 12, leader changed from <none> to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 12 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:37.761356  3864 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 12 to 18, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 18 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:37.776219  3963 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:37.790611 10555 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:18:37.791280 10555 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer 1e032f02b0aa450384dda978641ba666 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:18:37.794016  3963 raft_consensus.cc:1217] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.7->[13.8-17.11]   Dedup: 13.8->[14.9-17.11]
I20260709 13:18:37.794665  3963 pending_rounds.cc:85] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 8
I20260709 13:18:37.794931  3963 pending_rounds.cc:107] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:18:37.795205  3963 raft_consensus.cc:2889] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:18:37.882890  3867 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 231) took 23590 ms (client timeout 15000 ms). Trace:
W20260709 13:18:37.884753 10770 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:18:37.883314  3867 rpcz_store.cc:269] 0709 13:18:14.293011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:14.296907 (+  3896us) service_pool.cc:224] Handling call
0709 13:18:37.882778 (+23585871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:37.413031 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:37.413526 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:37.413564 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:18:37.413581 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:37.415272 (+  1691us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:37.415331 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:37.415358 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:18:37.416599 (+  1241us) tablet.cc:701] Row locks acquired
0709 13:18:37.416618 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:18:37.416788 (+   170us) write_op.cc:270] Start()
0709 13:18:37.416890 (+   102us) write_op.cc:276] Timestamp: P: 1783603117416711 usec, L: 0
0709 13:18:37.416909 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:37.417662 (+   753us) log.cc:844] Serialized 7521 byte log entry
0709 13:18:37.421545 (+  3883us) op_driver.cc:464] REPLICATION: finished
0709 13:18:37.422959 (+  1414us) write_op.cc:301] APPLY: starting
0709 13:18:37.423059 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:37.476847 (+ 53788us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:37.492724 (+ 15877us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:37.688474 (+195750us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:37.688851 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:18:37.688901 (+    50us) write_op.cc:312] APPLY: finished
0709 13:18:37.689284 (+   383us) log.cc:844] Serialized 172 byte log entry
0709 13:18:37.690137 (+   853us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.690319 (+   182us) write_op.cc:454] Released schema lock
0709 13:18:37.690378 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:37.698508 (+  8130us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:37.698561 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":1147,"apply.run_cpu_time_us":24856,"apply.run_wall_time_us":268120,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79686,"num_ops":19,"prepare.queue_time_us":792,"prepare.run_cpu_time_us":4850,"prepare.run_wall_time_us":8381,"replication_time_us":4472}]]}
I20260709 13:18:37.912797  3869 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 15 to 16, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:37.938377  3869 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:37.947908  3869 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.953735  3869 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 9 to 13, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:37.965582  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:38.004742  3869 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.026688  3869 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 16 to 18, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 18 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.047856  3869 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 10 to 12, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 12 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.049304  3869 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 13, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.198118  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:38.198619  4119 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:38.198868  4119 raft_consensus.cc:614] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.214723  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:38.215322  4119 raft_consensus.cc:606] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:38.215690  4119 raft_consensus.cc:614] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.229544  3868 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 17 to 20, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.231619  3868 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 16 to 18, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 18 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.233290  3868 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 17 to 20, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 20 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.251228  3868 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.252573  3868 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 16 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.261840  4046 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:38.263296 10386 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:38.268641  4118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:38.269284  4118 raft_consensus.cc:606] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:38.274303  3868 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 19, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.275622  4118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:38.276105  4118 raft_consensus.cc:606] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:38.276568  4118 raft_consensus.cc:614] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.276597  3868 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 19 to 22, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 22 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.285035  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:38.285657  4046 raft_consensus.cc:606] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:38.285959  4046 raft_consensus.cc:614] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:38.289311  3868 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.290881  3868 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 15, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.292235  3868 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 18, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 18 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.293933  3868 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 13 to 16, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.295351  3868 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 20, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 20 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.296325  3868 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 20, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.297298  3868 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:38.299278  3869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 240) took 37979 ms (client timeout 15000 ms). Trace:
W20260709 13:18:38.299705  3869 rpcz_store.cc:269] 0709 13:18:00.320339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:00.323228 (+  2889us) service_pool.cc:224] Handling call
0709 13:18:38.299178 (+37975950us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.076687 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.077236 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.077271 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:38.077292 (+    21us) tablet.cc:662] Decoding operations
0709 13:18:38.078106 (+   814us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.078158 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.078195 (+    37us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:18:38.078801 (+   606us) tablet.cc:701] Row locks acquired
0709 13:18:38.078822 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:18:38.078974 (+   152us) write_op.cc:270] Start()
0709 13:18:38.079076 (+   102us) write_op.cc:276] Timestamp: P: 1783603118078936 usec, L: 0
0709 13:18:38.079095 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.079684 (+   589us) log.cc:844] Serialized 3258 byte log entry
0709 13:18:38.083948 (+  4264us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.084411 (+   463us) write_op.cc:301] APPLY: starting
0709 13:18:38.084483 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.088334 (+  3851us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.088432 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.126619 (+ 38187us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.126820 (+   201us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:18:38.126864 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:38.127127 (+   263us) log.cc:844] Serialized 81 byte log entry
0709 13:18:38.127985 (+   858us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.128105 (+   120us) write_op.cc:454] Released schema lock
0709 13:18:38.128147 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.128513 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.128541 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4548,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":256,"apply.run_cpu_time_us":10420,"apply.run_wall_time_us":44052,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33552,"num_ops":8,"prepare.queue_time_us":97,"prepare.run_cpu_time_us":3300,"prepare.run_wall_time_us":35673,"replication_time_us":4744}]]}
I20260709 13:18:38.304039  3868 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 21, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.305749  3868 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 10 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.307490  3868 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 13 to 16, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:38.309067  3868 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.310485  3868 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 11 to 15, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.317875  4119 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:38.318523  4119 raft_consensus.cc:606] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:38.322094  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:18:38.323786 10364 raft_consensus.cc:993] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:38.323933  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:38.324342 10555 raft_consensus.cc:1081] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:38.328805  3968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:18:38.329339  3968 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.329701  3968 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.336670  3968 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:38.346808  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet 8cb75fd2816c4878a8cdd7b7595c52f3: Illegal state: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.358788  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:38.359457  4046 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.363220  4120 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:38.360201  3968 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:38.388120  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:38.388742  4118 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:38.389086  4118 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:38.390326  4046 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:38.391733  4119 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:38.389863  4118 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:38.393361  4118 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:38.396100  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:38.403121  4118 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:38.408092 10533 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:38.413259 10533 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:38.414497 10533 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:38.428162  4087 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9b8eecd98f04495f9ed7470925ed9487. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:38.431180  4046 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:38.432649 10555 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:38.437775  3963 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:18:38.441179 10555 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:18:38.437742 10774 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:18:38.521812  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54653.8us
W20260709 13:18:38.581377  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 170822us
W20260709 13:18:38.628893  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 96818.4us
I20260709 13:18:38.635879  3971 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:38.661748  4046 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
W20260709 13:18:38.652608  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53455.9us
I20260709 13:18:38.632478 10555 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:38.737025 10364 raft_consensus.cc:993] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
W20260709 13:18:38.737505  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89301.9us
I20260709 13:18:38.742117 10655 raft_consensus.cc:1081] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:38.765084  3971 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:18:38.765973  3971 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:38.766779  3971 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.788370  3870 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 22. New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.794605  3870 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 24. New cstate: current_term: 24 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.797936  3870 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 23, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.872699  3971 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:38.875185  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 74561us
I20260709 13:18:38.800585  3870 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 19 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:38.902251  3918 auto_rebalancer.cc:629] Failed to schedule move for tablet b759a28e523c491c941636a30d249939: Illegal state: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.885818  3971 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:38.908937  4045 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:38.916936  3870 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.963115  3870 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 14, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 14 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.964720  4113 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:38.966115  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:38.966868  4039 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.967461  3870 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 17, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.969537  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:38.970745  4113 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:38.971043  4113 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:38.971977  4113 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:38.973379  4113 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:38.973984  3870 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 17, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.976302  3870 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 13 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.983328  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 241) took 9420 ms. Trace:
I20260709 13:18:38.984678  3868 rpcz_store.cc:276] 0709 13:18:29.562967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:29.563181 (+   214us) service_pool.cc:224] Handling call
0709 13:18:38.983131 (+9419950us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:38.317898 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:38.318405 (+   507us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:38.318432 (+    27us) write_op.cc:435] Acquired schema lock
0709 13:18:38.318449 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:38.319835 (+  1386us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:38.319890 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:38.319914 (+    24us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:18:38.323714 (+  3800us) tablet.cc:701] Row locks acquired
0709 13:18:38.323729 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:18:38.323861 (+   132us) write_op.cc:270] Start()
0709 13:18:38.323961 (+   100us) write_op.cc:276] Timestamp: P: 1783603118323818 usec, L: 0
0709 13:18:38.323976 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:18:38.332785 (+  8809us) log.cc:844] Serialized 7526 byte log entry
0709 13:18:38.338721 (+  5936us) op_driver.cc:464] REPLICATION: finished
0709 13:18:38.339164 (+   443us) write_op.cc:301] APPLY: starting
0709 13:18:38.339242 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:38.363793 (+ 24551us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:38.363881 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:38.459268 (+ 95387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:38.459534 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:18:38.459588 (+    54us) write_op.cc:312] APPLY: finished
0709 13:18:38.459959 (+   371us) log.cc:844] Serialized 172 byte log entry
0709 13:18:38.460118 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.460286 (+   168us) write_op.cc:454] Released schema lock
0709 13:18:38.460337 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:38.460685 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:38.460712 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42096,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":22787,"apply.run_wall_time_us":121463,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79686,"num_ops":19,"prepare.queue_time_us":113,"prepare.run_cpu_time_us":4591,"prepare.run_wall_time_us":17323,"replication_time_us":14611}]]}
I20260709 13:18:38.977996  3870 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 22 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.989830  3870 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.992050  3870 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:38.993592  3870 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:38.996030  4039 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:38.998396  3870 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 15 to 23. New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:39.000181  4013 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2c6116be669b48d88215ae1f69b092a1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:39.000135  3870 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.002045  3870 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 10 to 18, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 18 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.005636  3971 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:39.007620 10784 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:39.017724  3870 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 18, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.026405 10792 ts_tablet_manager.cc:933] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:39.033284  4113 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:39.040176 10781 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:39.045934  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:39.048880 10781 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:39.048833  4121 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:39.049505  3870 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.050400 10781 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:39.052009  3870 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 15 to 18, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 18 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.052392 10781 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:39.052414 10784 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:39.055995  3870 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.074313 10792 tablet_copy_client.cc:323] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:18:39.076896  4130 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet 9b8eecd98f04495f9ed7470925ed9487 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:18:39.077549  4130 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet 9b8eecd98f04495f9ed7470925ed9487 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-9b8eecd98f04495f9ed7470925ed9487
I20260709 13:18:39.094383 10789 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:39.098959  3971 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:39.113076  4130 tablet_copy_source_session.cc:215] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:39.130913  4045 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:39.137709 10386 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:18:39.144536 10792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b8eecd98f04495f9ed7470925ed9487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:39.175592  4120 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:39.261373 10792 tablet_copy_client.cc:806] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:39.262223 10792 tablet_copy_client.cc:670] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:39.279160 10792 tablet_copy_client.cc:538] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:39.309687 10792 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:18:39.327226  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:39.392513 10805 ts_tablet_manager.cc:933] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:39.399396 10805 tablet_copy_client.cc:323] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.194:33461
I20260709 13:18:39.402657  4057 tablet_copy_service.cc:140] P b8c8b10100a146e6a81f308505fe9f46: Received BeginTabletCopySession request for tablet 2c6116be669b48d88215ae1f69b092a1 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:41202)
I20260709 13:18:39.403265  4057 tablet_copy_service.cc:161] P b8c8b10100a146e6a81f308505fe9f46: Beginning new tablet copy session on tablet 2c6116be669b48d88215ae1f69b092a1 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:41202: session id = 293c0ff21e6f4e9f93555aaba177566b-2c6116be669b48d88215ae1f69b092a1
I20260709 13:18:39.424650  4057 tablet_copy_source_session.cc:215] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:39.428644 10805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c6116be669b48d88215ae1f69b092a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:39.449077 10792 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:39.451078  4118 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:39.453960 10792 tablet_bootstrap.cc:492] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:18:39.455219 10774 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:39.455171 10792 ts_tablet_manager.cc:1403] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.146s	user 0.046s	sys 0.007s
I20260709 13:18:39.465992  4045 raft_consensus.cc:1275] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:18:39.468037 10386 consensus_queue.cc:1048] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:39.466411 10792 raft_consensus.cc:359] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:39.480310 10792 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:18:39.492810 10792 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:39.489217 10805 tablet_copy_client.cc:806] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:39.497713 10805 tablet_copy_client.cc:670] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:39.516942 10805 tablet_copy_client.cc:538] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:39.528018  4679 raft_consensus.cc:1217] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:18:39.506533 10792 ts_tablet_manager.cc:1434] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:18:39.540349  4130 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-9b8eecd98f04495f9ed7470925ed9487 received from {username='slave'} at 127.0.0.1:51850
I20260709 13:18:39.540953  4130 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-9b8eecd98f04495f9ed7470925ed9487 on tablet 9b8eecd98f04495f9ed7470925ed9487 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:39.578171  3867 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index -1 to 13, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:39.601567 10805 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:18:39.618287  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 232) took 6475 ms. Trace:
I20260709 13:18:39.618829  3870 rpcz_store.cc:276] 0709 13:18:33.142757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:33.143601 (+   844us) service_pool.cc:224] Handling call
0709 13:18:39.618183 (+6474582us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:39.258827 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:39.259496 (+   669us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:39.259540 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:18:39.259557 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:39.282337 (+ 22780us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:39.282429 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:39.282453 (+    24us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:18:39.283965 (+  1512us) tablet.cc:701] Row locks acquired
0709 13:18:39.284008 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:18:39.284171 (+   163us) write_op.cc:270] Start()
0709 13:18:39.284312 (+   141us) write_op.cc:276] Timestamp: P: 1783603119284110 usec, L: 0
0709 13:18:39.284337 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.285134 (+   797us) log.cc:844] Serialized 7910 byte log entry
0709 13:18:39.370619 (+ 85485us) op_driver.cc:464] REPLICATION: finished
0709 13:18:39.380835 (+ 10216us) write_op.cc:301] APPLY: starting
0709 13:18:39.380948 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:39.445438 (+ 64490us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:39.445565 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.561720 (+116155us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.562129 (+   409us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:18:39.562171 (+    42us) write_op.cc:312] APPLY: finished
0709 13:18:39.562631 (+   460us) log.cc:844] Serialized 180 byte log entry
0709 13:18:39.562820 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.563004 (+   184us) write_op.cc:454] Released schema lock
0709 13:18:39.563070 (+    66us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":82776,"reported_tablets":55,"child_traces":[["op",{"apply.queue_time_us":9939,"apply.run_cpu_time_us":27692,"apply.run_wall_time_us":243385,"cfile_cache_hit":82,"cfile_cache_hit_bytes":88007,"num_ops":20,"prepare.queue_time_us":104728,"prepare.run_cpu_time_us":5642,"prepare.run_wall_time_us":26734,"replication_time_us":86077,"spinlock_wait_cycles":2816,"thread_start_us":87959,"threads_started":2}]]}
I20260709 13:18:39.645328  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:18:39.647141  4121 raft_consensus.cc:606] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Received request to transfer leadership
I20260709 13:18:39.651870  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:18:39.652474  4121 raft_consensus.cc:606] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:18:39.653694  3856 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 9b8eecd98f04495f9ed7470925ed9487 already in progress [suppressed 20 similar messages]
I20260709 13:18:39.663420  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:18:39.667024  4121 raft_consensus.cc:606] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Received request to transfer leadership
W20260709 13:18:39.681851  3918 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:18:39.682263  3918 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 9b8eecd98f04495f9ed7470925ed9487 already in progress
W20260709 13:18:39.682528  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 9b8eecd98f04495f9ed7470925ed9487 already in progress
I20260709 13:18:39.703348  3865 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 10 to 13, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 13 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.789552  3868 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 20 to 21, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 21 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.791338  3868 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 18 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.801198  3868 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 14 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 19 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.803141  3868 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.818324  3868 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 21 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 22 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.820008  3868 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 16 to 23, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 23 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.821643  3868 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 23 to 24, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 24 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.823355  3868 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 17 to 23, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 23 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.835090  3956 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e7bedca9d544f8992960c04a55f9233 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 13)) from {username='slave'} at 127.0.0.1:60872
I20260709 13:18:39.835098  3962 tablet_service.cc:1558] Processing DeleteTablet for tablet b68b34d0f4bd480da49284d88135af8b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:60872
I20260709 13:18:39.833417  3868 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:39.840282  3868 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.842309  3868 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.843789  3868 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 12 to 16, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.845382  3868 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 17 to 21, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 21 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.848358  3868 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 16 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:39.858165  3865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 235) took 15984 ms (client timeout 15000 ms). Trace:
I20260709 13:18:39.859848  3868 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 14 to 18. New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.861300  3868 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 15 to 16, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 16 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:39.863548  3868 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 18 to 20, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 20 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.864833  3868 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:39.866178  3868 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:18:39.858682  3865 rpcz_store.cc:269] 0709 13:18:23.873402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:23.873828 (+   426us) service_pool.cc:224] Handling call
0709 13:18:39.858058 (+15984230us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:39.732174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:39.732709 (+   535us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:39.732744 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:39.732780 (+    36us) tablet.cc:662] Decoding operations
0709 13:18:39.733101 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:39.733152 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:39.733182 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:39.733352 (+   170us) tablet.cc:701] Row locks acquired
0709 13:18:39.733369 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:39.733506 (+   137us) write_op.cc:270] Start()
0709 13:18:39.733619 (+   113us) write_op.cc:276] Timestamp: P: 1783603119733459 usec, L: 0
0709 13:18:39.733639 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:39.734998 (+  1359us) log.cc:844] Serialized 541 byte log entry
0709 13:18:39.737051 (+  2053us) op_driver.cc:464] REPLICATION: finished
0709 13:18:39.737498 (+   447us) write_op.cc:301] APPLY: starting
0709 13:18:39.737588 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:39.738355 (+   767us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:39.738447 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:39.739098 (+   651us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:39.739257 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:39.739300 (+    43us) write_op.cc:312] APPLY: finished
0709 13:18:39.739469 (+   169us) log.cc:844] Serialized 25 byte log entry
0709 13:18:39.739641 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.739738 (+    97us) write_op.cc:454] Released schema lock
0709 13:18:39.739776 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:39.740981 (+  1205us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:39.741014 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":294739,"reported_tablets":55,"spinlock_wait_cycles":15104,"child_traces":[["op",{"apply.queue_time_us":249,"apply.run_cpu_time_us":2608,"apply.run_wall_time_us":2607,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4194,"num_ops":1,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2488,"prepare.run_wall_time_us":3119,"replication_time_us":3263}]]}
I20260709 13:18:39.896137  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet 2e7bedca9d544f8992960c04a55f9233 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:39.909623  3855 catalog_manager.cc:5028] TS 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): tablet b68b34d0f4bd480da49284d88135af8b (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:39.933413 10364 raft_consensus.cc:1064] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:18:39.933928 10364 raft_consensus.cc:1068] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Service unavailable: leader transfer in progress
I20260709 13:18:39.938987 10805 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:39.939970 10805 tablet_bootstrap.cc:492] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:18:39.940653 10805 ts_tablet_manager.cc:1403] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.339s	user 0.046s	sys 0.004s
I20260709 13:18:39.957031 10805 raft_consensus.cc:359] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:39.957985 10805 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:18:39.958678 10805 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:39.973356 10805 ts_tablet_manager.cc:1434] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:18:39.976998  4057 tablet_copy_service.cc:342] P b8c8b10100a146e6a81f308505fe9f46: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-2c6116be669b48d88215ae1f69b092a1 received from {username='slave'} at 127.0.0.1:41202
I20260709 13:18:39.977481  4057 tablet_copy_service.cc:434] P b8c8b10100a146e6a81f308505fe9f46: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-2c6116be669b48d88215ae1f69b092a1 on tablet 2c6116be669b48d88215ae1f69b092a1 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:39.977849  3870 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 16, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:39.989038 10786 raft_consensus.cc:993] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:18:39.989845 10786 raft_consensus.cc:1081] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:18:39.995290  3870 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 22 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:18:40.002566  4045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:18:40.003170  4045 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.003492  4045 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.045138  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:18:40.045804  4042 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Received request to transfer leadership
I20260709 13:18:40.078511  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:18:40.079070  4042 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Received request to transfer leadership
I20260709 13:18:40.108564  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:18:40.109333  4042 raft_consensus.cc:606] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Received request to transfer leadership
I20260709 13:18:40.129889 10784 raft_consensus.cc:993] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:40.144748 10784 raft_consensus.cc:1081] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:40.149994  4121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
W20260709 13:18:40.150717  3918 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:18:40.152670  3918 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2c6116be669b48d88215ae1f69b092a1 already in progress
W20260709 13:18:40.153160  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2c6116be669b48d88215ae1f69b092a1 already in progress
I20260709 13:18:40.160303  4121 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.161293  4121 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.123888  4045 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:40.187675  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:40.188287  3968 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.196208  3968 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:40.198001  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:40.199887 10253 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:40.200404 10253 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:40.201354 10253 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:40.203702  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:40.204324  4120 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:40.204654  4120 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:40.205416  4120 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:40.208835  4120 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:40.204236  4045 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:40.231218  4120 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:40.261694  3869 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.290889  4121 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:40.294130  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:40.294726  3968 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.336704  3968 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:40.338153  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:40.339125 10701 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:40.340289 10701 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:40.341250 10701 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:40.440917  3869 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 23, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.458405  4121 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:40.468916  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:40.469528  4045 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:40.469847  4045 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:40.470579  4045 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:40.472085  4045 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:40.492910  4045 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:40.560305  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:40.638164  4679 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEARNER]: Advancing to term 19
I20260709 13:18:40.646369  4679 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:40.648351 10692 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:40.703343  4045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:40.703941  4045 raft_consensus.cc:606] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:40.704293 10253 raft_consensus.cc:1064] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:18:40.704785 10253 raft_consensus.cc:1068] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:18:40.747516 10580 raft_consensus.cc:993] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:40.748013 10580 raft_consensus.cc:1081] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:40.754474  4121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
I20260709 13:18:40.755069  4121 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:40.755424  4121 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.766532  4121 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:40.770632  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:40.771270  4039 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:40.771566  4039 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:40.772286  4039 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:40.773447  4039 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.775154  4121 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:40.775696  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:40.776269  4679 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:40.776583  3964 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:40.778107 10253 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:40.784225  4679 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:40.785786  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:40.786695 10701 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:40.787180 10701 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:40.788034 10701 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:40.784226  4039 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:40.811695  3869 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 17, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:40.820398  4121 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:40.821996 10547 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:18:40.823082  3968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:18:40.823700  3968 raft_consensus.cc:606] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:40.826790  3968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:18:40.827316  3968 raft_consensus.cc:606] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:40.830366  3968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b759a28e523c491c941636a30d249939"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:18:40.830896  3968 raft_consensus.cc:606] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:40.840361  4042 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:40.841723  4677 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEARNER]: Advancing to term 23
I20260709 13:18:40.849510  4045 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:40.850241  4045 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:40.852667 10555 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:40.853292  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:40.855154  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:40.863078  4677 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:40.897878 10827 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 13:18:40.964519  3971 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:40.967337 10701 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:40.970090 10692 raft_consensus.cc:1064] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:18:40.972498 10692 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:40.983682  4677 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:40.984709  3968 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:40.985351 10692 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:40.986426 10580 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:41.025903 10547 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.036108  3968 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.057610  4677 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.067817  4113 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:18:41.084728  3868 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 13 to 15, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.106880 10253 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:41.125895  4118 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 13 to 15, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.136920  4045 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:41.153429  4677 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:18:41.158828  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50944us
I20260709 13:18:41.159284 10547 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:41.159984  3971 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:18:41.166762 10692 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:41.183399 10781 raft_consensus.cc:993] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.183962 10781 raft_consensus.cc:1081] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.184528 10253 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.188587  3971 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.191321 10701 raft_consensus.cc:1064] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:18:41.195119 10780 raft_consensus.cc:993] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.195811 10780 raft_consensus.cc:1081] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.200279  4680 raft_consensus.cc:2955] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 15 to 16, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.203042 10701 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 16, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:41.229220  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9b8eecd98f04495f9ed7470925ed9487 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:41.232038  4045 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:41.234441  4118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:18:41.235003  4118 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:41.235383  4118 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.237301  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b759a28e523c491c941636a30d249939"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:18:41.237877  4113 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:41.238212  4113 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.240970 10831 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:41.251353 10692 raft_consensus.cc:993] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.251876 10547 raft_consensus.cc:1081] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.253304  4113 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.255191  4677 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:41.255885  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:41.256456  3971 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:41.256732  3971 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:41.257236 10831 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:18:41.267030  3968 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:41.269392 10701 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:18:41.273042  3971 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.274328  3971 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.281541  4113 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:41.284830  4118 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:41.293706  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46249.1us
I20260709 13:18:41.292052  3868 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index 15 to 16, VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) evicted. New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:41.297371  4118 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:41.295899  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
W20260709 13:18:41.296456  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 48933.2us
I20260709 13:18:41.298413  4113 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:41.299619  4113 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.309055  3971 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:41.310732  4085 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:41.334569  4113 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:41.333873 10831 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:41.337770 10831 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:41.339004 10836 raft_consensus.cc:993] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.338721 10831 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.339493 10836 raft_consensus.cc:1081] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:41.353876  4039 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:41.360002  3968 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 16 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.353160  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:41.362502  3966 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:41.362803  3966 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:41.365847  3966 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.363045 10826 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 16 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.398774  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:41.399487  4040 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.402657  3966 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.404414  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:41.402100  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:41.419215  3964 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.419384  4042 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:41.423116  4040 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:41.428702  4113 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:41.433847  4042 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:41.461324  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:41.462010  4680 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.475020  4680 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:41.435973 10825 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:18:41.475724  4677 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:18:41.475813  4111 tablet_service.cc:1558] Processing DeleteTablet for tablet 9b8eecd98f04495f9ed7470925ed9487 with delete_type TABLET_DATA_TOMBSTONED (TS 0f3fa9d459de485e824f023c55580bc6 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:36870
W20260709 13:18:41.496560  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 85088.9us
I20260709 13:18:41.497499  3870 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index 16 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:41.503154  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 47704us
I20260709 13:18:41.504701  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:41.505321  4042 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:41.505625  4042 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:41.508513  4042 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:41.510177  4042 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:41.521477  4042 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:41.522382  3964 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:41.523118  4045 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 16 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.532261  3966 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:41.534251  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:41.525230 10555 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
W20260709 13:18:41.552981  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:41.559422  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:41.569885 10828 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:41.570523 10828 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:41.571381 10828 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.581609  4086 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:41.589228  4680 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 16 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:41.587383  3964 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:41.594934 10849 tablet_replica.cc:333] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:18:41.596076 10849 raft_consensus.cc:2243] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:41.604938  3868 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 22, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:18:41.612787  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 321383us
I20260709 13:18:41.717763 10848 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:41.718400 10848 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:41.718954  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 99486.3us
I20260709 13:18:41.716080 10849 raft_consensus.cc:2272] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:18:41.714953  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 122596us
W20260709 13:18:41.718031  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100983us
I20260709 13:18:41.719354 10848 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:41.739784  4121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43c0a60eab684a2386715908ca218355"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:18:41.740365  4121 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:41.740815  4121 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:41.771014  4121 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.773051  4118 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25. Ops: []
I20260709 13:18:41.786953  4121 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:41.787971  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:41.788586  3968 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:41.788938  3968 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:41.810446 10849 ts_tablet_manager.cc:1916] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:41.825048  3968 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.834846  3968 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:41.856194  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:41.880177  3938 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 42df9a30a23e4bd581e33127f2204a0b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:41.898264  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 270400us
W20260709 13:18:41.909408  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 133691us
I20260709 13:18:41.915983  3966 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:41.918727  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:41.919322  4039 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:41.924252  4040 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:18:41.925593  4039 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:18:41.932287  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:41.933002 10827 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:41.933561 10846 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:41.934139 10846 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:41.934996 10846 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:41.936510 10847 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:18:41.947494  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 109818us
I20260709 13:18:41.954519  3968 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
W20260709 13:18:41.996146  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 154220us
W20260709 13:18:42.026329  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 65853.8us
W20260709 13:18:42.060891  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 112524us
W20260709 13:18:42.066097  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:42.075624  4042 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:42.077106 10849 ts_tablet_manager.cc:1929] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 13:18:42.079351 10849 log.cc:1199] T 9b8eecd98f04495f9ed7470925ed9487 P 0f3fa9d459de485e824f023c55580bc6: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/wals/9b8eecd98f04495f9ed7470925ed9487
I20260709 13:18:42.091761  4115 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:18:42.063522  3868 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 19 to 20, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.096300  3868 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 22, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.100134  3856 catalog_manager.cc:5028] TS 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): tablet 9b8eecd98f04495f9ed7470925ed9487 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:42.132205 10781 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:42.172477  4115 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:42.173087  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103490us
I20260709 13:18:42.192533  3971 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:42.200896 10781 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:18:42.205442  3964 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:18:42.247979 10846 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:42.254151  3869 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 24 to 25, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 25 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:42.254029 10837 raft_consensus.cc:2955] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:42.258759 10862 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:18:42.262996  4677 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:18:42.267874  4042 raft_consensus.cc:2955] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:42.272444  3971 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:42.291160  4046 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:42.297680  4046 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:42.303215 10846 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:18:42.305289  4121 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:42.306377  3869 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index -1 to 10, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:42.306071 10837 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:18:42.327373  4042 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:42.306936 10848 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 13:18:42.330416  4680 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:42.331187 10848 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:42.354694 10781 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
W20260709 13:18:42.359391 10875 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:18:42.344146 10828 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
W20260709 13:18:42.406716 10835 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:18:42.418366  3938 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 03c57dfd62654a78a41a253899d8f909. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:18:42.418826  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 114969us
I20260709 13:18:42.424906  3964 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:42.433022 10862 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:18:42.488211 10877 ts_tablet_manager.cc:933] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
W20260709 13:18:42.509099  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53715.8us
I20260709 13:18:42.512177  3968 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Committing config change with OpId 23.19: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:42.533222 10825 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Committing config change with OpId 23.19: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:42.580440  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79643us
W20260709 13:18:42.585417  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89091.4us
W20260709 13:18:42.645506 10883 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:42.669654 10877 tablet_copy_client.cc:323] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.193:44737
I20260709 13:18:42.676807  3968 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:18:42.682312  3868 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 reported cstate change: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:42.700265  3982 tablet_copy_service.cc:140] P 1e032f02b0aa450384dda978641ba666: Received BeginTabletCopySession request for tablet 42df9a30a23e4bd581e33127f2204a0b from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:34862)
I20260709 13:18:42.700973  3982 tablet_copy_service.cc:161] P 1e032f02b0aa450384dda978641ba666: Beginning new tablet copy session on tablet 42df9a30a23e4bd581e33127f2204a0b from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:34862: session id = 293c0ff21e6f4e9f93555aaba177566b-42df9a30a23e4bd581e33127f2204a0b
I20260709 13:18:42.697965 10826 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:18:42.719358  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2c6116be669b48d88215ae1f69b092a1 with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:18:42.720736  4677 raft_consensus.cc:2955] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Committing config change with OpId 23.19: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:42.764655  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 133920us
I20260709 13:18:42.869046  3982 tablet_copy_source_session.cc:215] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:42.919891 10893 raft_consensus.cc:2955] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:42.923925  4046 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:18:42.929744 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42df9a30a23e4bd581e33127f2204a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:42.943403  4040 raft_consensus.cc:2955] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:42.956188 10900 ts_tablet_manager.cc:933] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:18:42.962910  4115 raft_consensus.cc:2955] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index -1 to 10, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:42.960368  4117 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:42.966159  4120 raft_consensus.cc:2955] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Committing config change with OpId 23.14: config changed from index -1 to 14, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:42.987656  3868 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: config changed from index -1 to 14, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 23 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.023936 10877 tablet_copy_client.cc:806] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.025503 10877 tablet_copy_client.cc:670] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.040967  3968 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:18:43.044274  4087 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50aca70be0884ed09aa97127d571282f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:43.047102 10891 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:43.051882  4042 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:18:43.054430 10848 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:43.068748 10877 tablet_copy_client.cc:538] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.073145 10900 tablet_copy_client.cc:323] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.193:44737
I20260709 13:18:43.085151  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet 2c6116be669b48d88215ae1f69b092a1 with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:49084
I20260709 13:18:43.085978 10848 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:18:43.097517  3982 tablet_copy_service.cc:140] P 1e032f02b0aa450384dda978641ba666: Received BeginTabletCopySession request for tablet 03c57dfd62654a78a41a253899d8f909 from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:34862)
I20260709 13:18:43.098073  3982 tablet_copy_service.cc:161] P 1e032f02b0aa450384dda978641ba666: Beginning new tablet copy session on tablet 03c57dfd62654a78a41a253899d8f909 from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:34862: session id = 293c0ff21e6f4e9f93555aaba177566b-03c57dfd62654a78a41a253899d8f909
I20260709 13:18:43.107656 10906 tablet_replica.cc:333] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:18:43.110065 10906 raft_consensus.cc:2243] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:18:43.135756 10826 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.156944  3971 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.162509 10906 raft_consensus.cc:2272] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:18:43.187927  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:43.221686  3982 tablet_copy_source_session.cc:215] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:43.234483 10900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03c57dfd62654a78a41a253899d8f909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.241267 10877 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:18:43.251391  4039 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Committing config change with OpId 23.17: config changed from index -1 to 17, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.267406  3868 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 17, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:43.281440 10906 ts_tablet_manager.cc:1916] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:18:43.281919  3964 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:18:43.323899  3938 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 -> Peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407): Couldn't send request to peer 293c0ff21e6f4e9f93555aaba177566b. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d99c13fc3b7f4e2687824e0a5911512a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:18:43.346709  4120 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:43.346917  4042 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:18:43.350996 10780 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:43.372521 10780 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:43.407671 10877 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:43.409631 10877 tablet_bootstrap.cc:492] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:18:43.410439 10877 ts_tablet_manager.cc:1403] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.020s
I20260709 13:18:43.416319  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:43.416947  4120 raft_consensus.cc:606] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:43.421932 10906 ts_tablet_manager.cc:1929] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 23.18
I20260709 13:18:43.422356 10906 log.cc:1199] T 2c6116be669b48d88215ae1f69b092a1 P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/2c6116be669b48d88215ae1f69b092a1
I20260709 13:18:43.416947 10900 tablet_copy_client.cc:806] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.423659 10900 tablet_copy_client.cc:670] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.424431  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet 2c6116be669b48d88215ae1f69b092a1 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:18:43.424401  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:43.426955  4042 raft_consensus.cc:606] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:43.443291 10900 tablet_copy_client.cc:538] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:43.444053 10893 raft_consensus.cc:2955] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.446619  4117 raft_consensus.cc:2955] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.448086  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:43.451269  4042 raft_consensus.cc:606] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:43.456228  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:43.456386 10900 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:18:43.456925  4042 raft_consensus.cc:606] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:43.458359  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:43.461504 10877 raft_consensus.cc:359] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:43.462430 10877 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:18:43.463078 10877 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:43.464639  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:43.472178  4039 raft_consensus.cc:2955] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index -1 to 15, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.473742 10877 ts_tablet_manager.cc:1434] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 13:18:43.479218  3982 tablet_copy_service.cc:342] P 1e032f02b0aa450384dda978641ba666: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-42df9a30a23e4bd581e33127f2204a0b received from {username='slave'} at 127.0.0.1:34862
I20260709 13:18:43.479666  3982 tablet_copy_service.cc:434] P 1e032f02b0aa450384dda978641ba666: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-42df9a30a23e4bd581e33127f2204a0b on tablet 42df9a30a23e4bd581e33127f2204a0b with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:43.498747 10913 ts_tablet_manager.cc:933] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:43.499675  3868 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index -1 to 15, NON_VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) added. New cstate: current_term: 22 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:43.505446 10895 raft_consensus.cc:993] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:43.514254 10868 raft_consensus.cc:993] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:43.514741 10868 raft_consensus.cc:1081] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:43.517629  4120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
I20260709 13:18:43.518270  4120 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.518628  4120 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.516635 10901 raft_consensus.cc:1081] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:43.524822  4113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36886
I20260709 13:18:43.525483  4113 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.525836  4113 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.533273 10913 tablet_copy_client.cc:323] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.195:41513
I20260709 13:18:43.533309  4120 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:43.536336  4120 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:43.537560  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:43.538086  4042 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:43.538458  4042 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:43.539039  4042 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:43.538221  4130 tablet_copy_service.cc:140] P 0f3fa9d459de485e824f023c55580bc6: Received BeginTabletCopySession request for tablet 50aca70be0884ed09aa97127d571282f from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:51850)
I20260709 13:18:43.541618  4130 tablet_copy_service.cc:161] P 0f3fa9d459de485e824f023c55580bc6: Beginning new tablet copy session on tablet 50aca70be0884ed09aa97127d571282f from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:51850: session id = 293c0ff21e6f4e9f93555aaba177566b-50aca70be0884ed09aa97127d571282f
I20260709 13:18:43.543200  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:43.543761  3964 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.554016  4113 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:43.552482  3964 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:43.560061  4130 tablet_copy_source_session.cc:215] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:43.653743  4042 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:43.662039  4113 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:43.688469  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:43.689216  4679 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.696183  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:43.696841  4046 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:43.697121  4046 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:43.697795  4046 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:43.698896  4046 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:43.701197 10913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50aca70be0884ed09aa97127d571282f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:43.707020  4046 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:43.709077  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:43.710318 10826 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:43.710983 10826 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:43.712062 10826 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:43.718225  4679 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:43.759624  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:43.760958 10901 raft_consensus.cc:993] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:43.776916 10547 raft_consensus.cc:1081] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:43.798846  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45602
I20260709 13:18:43.799484  3964 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:43.799782  3964 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:43.799189  4042 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:43.784458 10891 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:18:43.827841  3964 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:43.853588  3964 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:43.855621  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64662.9us
I20260709 13:18:43.857466  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:43.863021  4042 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:43.862661 10891 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:43.863668  4042 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:43.864425  4042 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:43.865718  4042 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:43.868577  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67470.8us
I20260709 13:18:43.872233 10913 tablet_copy_client.cc:806] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:43.872869 10913 tablet_copy_client.cc:670] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:43.883847  4042 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:43.885269  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:43.897372 10893 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:43.897925 10893 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:43.898777 10893 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:43.906900 10826 raft_consensus.cc:993] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:43.907657 10826 raft_consensus.cc:1081] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:43.870012  3867 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 21, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:18:43.944782 10891 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:43.951206  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 168821us
I20260709 13:18:43.966017 10877 ts_tablet_manager.cc:933] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
I20260709 13:18:43.990674  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:43.991454  4119 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:44.050164 10913 tablet_copy_client.cc:538] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:18:44.058740  4119 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
W20260709 13:18:44.063059  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54666.8us
W20260709 13:18:44.062758  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49442.5us
W20260709 13:18:44.072824  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 111519us
I20260709 13:18:44.145639  3867 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 12 to 13, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 13 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:44.151854  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51816.2us
W20260709 13:18:44.164469  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61663us
W20260709 13:18:44.212718  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 47110us
I20260709 13:18:44.218050 10913 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:18:44.225207 10877 tablet_copy_client.cc:323] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Beginning tablet copy session from remote peer at address 127.2.200.193:44737
I20260709 13:18:44.473233  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:45.259186  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08003b3560 after lost signal to thread 2854
I20260709 13:18:45.916222 10918 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.137387 10918 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.139825 10918 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.136050 10935 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:46.237223 10935 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.322461 10935 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:46.328197 10935 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.330772 10918 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.602887 10918 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.605297 10918 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:46.605918 10918 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.606467 10918 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.609107 10918 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:46.617340 10935 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.619788 10935 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.578817 10848 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.677165 10848 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.679585 10848 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.786082 10935 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.786294 10916 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.786674 10935 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.788321 10935 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.788805 10916 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.790201 10936 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.790660 10918 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.790731 10936 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.791241 10918 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:46.790295 10916 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.792784 10848 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:46.793118 10916 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.788676 10935 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.793855 10918 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.793614 10916 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.794703 10918 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.794144 10935 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.795248 10918 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.796976 10935 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.798359 10935 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.798890 10935 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.799207 10916 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.799830 10916 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.793396 10848 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.800874 10935 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.801777 10848 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:46.797274 10918 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.802686 10916 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.804978 10916 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.810878 10938 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:46.811520 10938 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.864586 10923 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:46.978061 10923 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:46.979103 10938 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.979571 10938 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:46.979894 10938 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.980360 10923 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:46.986553 10942 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:46.987761 10942 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.989707 10938 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:46.989874 10942 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:46.805481 10937 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:46.990618 10942 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:46.991003 10937 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.991150 10942 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.995319 10942 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:46.991129 10938 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:46.997323 10938 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:46.999377 10938 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.010893 10936 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.012912 10931 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.013754 10931 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.015725 10931 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.012647 10923 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.016830 10923 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.018986 10923 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.021108 10940 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.016153 10931 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.023461 10547 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.036125 10547 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.044231 10937 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.048985 10547 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.099960 10944 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.047515 10939 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.044178 10940 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.115195 10943 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.120539 10939 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.121136 10943 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.044060 10931 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.079787 10895 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.122747 10939 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.080489 10923 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.136350 10943 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.048489 10844 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.130548 10944 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.138828 10944 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.139359 10944 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.132385 10781 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.122380 10941 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.175552 10941 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.175628 10781 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.177989 10547 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.178529 10547 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.156392 10942 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.159724 10880 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.161012  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:18:47.137115 10895 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.131248 10940 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.135627 10923 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.174201 10943 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.178273 10781 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.193375 10547 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.190281 10826 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.197568 10547 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.197743 10826 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.198161 10547 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.199021 10918 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.199597 10918 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.200141 10547 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.195056 10916 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.200908 10848 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.172991 10844 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.184105 10942 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.179747 10944 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.186475 10880 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.250576  3971 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:18:47.414183  3901 debug-util.cc:398] Leaking SignalData structure 0x7b080038bbe0 after lost signal to thread 3904
I20260709 13:18:47.414013 10547 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.416359 10547 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:47.333012 10900 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:18:47.407021  3867 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 22 to 23, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 23 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:47.421336 10954 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.190514 10939 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.464614 10547 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.466545 10547 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.468047  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.468581  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.467142 10547 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.199081 10921 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.194159 10931 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.196403 10781 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.186036 10941 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.363473 10936 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.481274  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.270889 10895 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.403653 10924 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.332305 10938 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.196591 10943 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.364955 10918 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.200174 10826 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.485520  3968 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:47.263015 10889 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.478225 10939 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.201078 10916 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.269670 10917 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.261549 10947 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.261343 10949 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.208055 10935 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.463958  3982 tablet_copy_service.cc:140] P 1e032f02b0aa450384dda978641ba666: Received BeginTabletCopySession request for tablet d99c13fc3b7f4e2687824e0a5911512a from peer 293c0ff21e6f4e9f93555aaba177566b ({username='slave'} at 127.0.0.1:34862)
I20260709 13:18:47.262938 10923 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.514206  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.517376  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.517715  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.516649  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.515007 10547 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.547596  4115 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:47.517060  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.529392  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.270442 10891 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.513708 10922 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.457929 10951 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.512940 10925 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.464278 10954 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.518494 10950 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.475363 10848 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.549194  4118 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:47.552438 10939 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.518711 10944 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.519927 10942 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.510113 10958 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.535032  4679 raft_consensus.cc:1217] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEARNER]: Deduplicated request from leader. Original: 17.9->[17.10-17.10]   Dedup: 17.10->[]
I20260709 13:18:47.518002 10880 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.518739 10953 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.547395  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:47.493230 10936 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.598431  4679 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:47.553997 10916 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.585625  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:47.600562  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53243us
I20260709 13:18:47.541160 10918 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.541229 10826 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.486503 10781 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.538152 10889 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.584434  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.580843  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.483248 10921 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.525406 10938 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.598554 10958 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.615784 10958 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.578266  3982 tablet_copy_service.cc:161] P 1e032f02b0aa450384dda978641ba666: Beginning new tablet copy session on tablet d99c13fc3b7f4e2687824e0a5911512a from peer 293c0ff21e6f4e9f93555aaba177566b at {username='slave'} at 127.0.0.1:34862: session id = 293c0ff21e6f4e9f93555aaba177566b-d99c13fc3b7f4e2687824e0a5911512a
I20260709 13:18:47.603410  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.607031  4677 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:47.606770  3970 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:47.546289 10935 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.611809 10959 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.586391 10922 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:47.612207 10848 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.589067 10925 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.728754 10963 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.729328 10963 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.730250 10948 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.730753 10948 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.613397 10889 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.731470 10963 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.613897  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.732435  3963 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:47.733238 10901 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.733829  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.540411 10924 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.734581 10922 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.736438 10924 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.611336  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.737114 10921 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.541291 10917 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.737944  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.738569  3972 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:47.681017  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.600015 10923 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.739375  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.739840 10923 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.542964 10949 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.600616 10939 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.582506 10891 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.740804 10939 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:47.741268  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800035460 after lost signal to thread 3996
W20260709 13:18:47.741773  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800035440 after lost signal to thread 3997
I20260709 13:18:47.742707 10939 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.683046 10936 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.599879 10953 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:47.744904 10953 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.684240 10844 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.745652  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.746076  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.746659  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.746811  4682 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:47.605187 10895 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.747257  3966 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:47.742751 10891 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:47.747987  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08003b7b80 after lost signal to thread 4071
W20260709 13:18:47.685534 10913 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:47.747501 10895 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:47.749346  3901 debug-util.cc:398] Leaking SignalData structure 0x7b0800161420 after lost signal to thread 4145
I20260709 13:18:47.750291 10895 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:47.750805  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0d20 after lost signal to thread 4709
W20260709 13:18:47.751292  3901 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb360 after lost signal to thread 10877
I20260709 13:18:47.740420  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.613771 10781 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.586444 10951 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.609083 10918 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.542531 10947 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.690097 10943 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.698541  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.613758  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:47.732002 10963 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.780243  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.597450 10944 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.727684  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.727839  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.733759 10901 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.742859  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.593981 10950 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.799608 10901 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.799856 10950 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.610154 10826 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.801827 10935 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.802192 10826 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.803478  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.686368 10954 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.804530  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:47.751708  3901 debug-util.cc:398] Leaking SignalData structure 0x7b080030f9e0 after lost signal to thread 10902
I20260709 13:18:47.805557  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.734678  3963 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:47.806964  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.748279  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:47.769161  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 168304us
I20260709 13:18:47.770875  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.752941  4648 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:47.775069  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:47.809087  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56234.9us
I20260709 13:18:47.809443 10957 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:47.809834 10957 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.810164 10957 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.606741 10940 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:47.732710 10948 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.811244 10940 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.811652 10940 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:18:47.775804  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 219895us
I20260709 13:18:47.784732  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.785404  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.813220  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:47.787912  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.813647  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.788362  4113 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:47.814550  3969 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:47.788039 10944 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.749706 10925 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.791106  4047 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:18:47.815367  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.792699  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.815985  3972 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:47.793380  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.794903  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.816709 10944 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.813695  4046 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:47.751325 10949 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.819756 10938 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.820302 10938 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:47.780599 10880 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:47.822271  4682 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:47.824564 10880 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.825007 10880 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.796672  3964 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:47.825856  3964 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:47.789479 10947 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.837350  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.798151 10923 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.775166 10781 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.807168  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.808450  3966 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:47.812518 10918 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.814926  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:47.829917  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.820524 10951 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.838486  3964 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.841243  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.849824  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.842391  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.849916  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.838016  4119 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:47.845122  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.846891  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.797703 10917 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:47.851122  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.853053  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.850443  4041 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:47.852283  4039 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:47.851162  4043 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:47.856415  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.863044  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.863212  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.863675  4042 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:47.864508  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.865517  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.866624  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.867643  3982 tablet_copy_source_session.cc:215] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:18:47.868234  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.862957  3965 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:47.865454 10938 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:47.869117 10938 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.869944 10938 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:47.848985 10781 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.871205  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.853847  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.875702  4047 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:47.877048 10547 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.863826  4112 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:47.877532 10547 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.871420  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:47.878894  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:47.867592  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.882377  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.885782 10955 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.886107 10965 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.886626 10965 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.890414  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.891830  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.893026  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.893582  4114 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:47.888615 10965 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.894438 10965 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.895221 10547 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.894910 10965 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:47.895673 10547 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.896317 10547 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.897369  4085 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:47.897217 10955 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:47.898284 10547 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.898697 10925 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:47.899072 10925 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.899462 10955 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.861321 10901 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:47.899410 10925 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:47.900624 10901 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:47.900002 10955 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.899925 10781 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.903559 10955 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:47.877213  3938 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:47.905649 10955 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.896772 10951 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:47.906406  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.903121  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.898713 10547 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.884630 10917 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:47.912985  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.914224  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.915225  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.916250  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.916798  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.894528 10956 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:47.917708 10956 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.918622  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.919719 10956 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.919842  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:47.921030  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.921602  4044 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:47.909066 10547 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.924091  4041 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:18:47.906364 10951 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.927173 10951 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:47.928488 10970 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:47.929016 10970 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.931126 10970 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:47.931774  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.833043 10963 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.768616 10959 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.934883  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.946326  3964 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.899735 10916 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:18:47.935482  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 58353us
I20260709 13:18:47.945936  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.935547  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:47.946451 10901 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.953946 10968 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.954466 10968 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.956122 10938 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.945842 10966 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:47.957104  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45588 (request call id 3941) took 3715 ms. Trace:
I20260709 13:18:47.957564  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.957695 10917 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:47.958209  4046 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:47.928396 10880 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:47.956583 10968 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.959254  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.906122 10955 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.953848 10916 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:47.961143 10951 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:47.966343 10959 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.014025 10916 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.016319 10880 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.967162 10939 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.016846 10940 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.017480 10951 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.017247 10939 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.018316  4684 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:47.971946  4047 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:47.949661  4114 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:47.971802  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.019719  4041 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:48.020517  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.021508  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.022018  4041 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:47.950018  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:47.951828  4113 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:18:47.991372  4039 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:48.024008  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.025014  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.025233  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.992616  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:47.995177  4677 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:47.991077  3964 rpcz_store.cc:276] 0709 13:18:44.235582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:47.160879 (+2925297us) service_pool.cc:224] Handling call
0709 13:18:47.930695 (+769816us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54001568d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed76443a3d 00007fed7b413cd0 00007fed74998254 00007fed749981e2 00007fed74998111 00007fed7499808c 00007fed74997342 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:47.950441 (+ 19746us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410736512}
I20260709 13:18:47.998057 10938 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:47.999003 10925 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.004146 10913 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=0 applied=17 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:48.004846  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.006732  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.995008 10956 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:47.990849 10966 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.067414 10956 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.051236  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:48.068670  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:48.043804  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.069442  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:48.070123  4681 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:18:48.027068  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.042361  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.010021  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.011070  4682 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.011714 10547 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.013484  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:47.929026 10965 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.014171  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.014844  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.017968 10955 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.018836 10940 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:47.995780  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 143917us
I20260709 13:18:48.072547 10913 tablet_bootstrap.cc:492] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:18:48.129168  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.152061  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.139065  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:48.153177  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 143241us
I20260709 13:18:48.081334  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:48.154193  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:48.024319  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74389us
I20260709 13:18:48.156558  4044 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:48.025781  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.075129  4086 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:48.143872  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 291572us
W20260709 13:18:48.061949  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46233.7us
I20260709 13:18:48.071225 10925 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.022708  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.079223  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.177963 10826 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:48.178047  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.178552  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.179230  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.072613 10956 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.066252 10957 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.181915  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.182597  4680 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.183197 10957 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.131019 10900 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:48.157725  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.184161  4046 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:48.184445 10900 tablet_bootstrap.cc:492] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:18:48.161844 10877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99c13fc3b7f4e2687824e0a5911512a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:18:48.185256 10900 ts_tablet_manager.cc:1403] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 4.729s	user 0.066s	sys 0.052s
I20260709 13:18:48.186517 10941 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:48.129370 10916 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.162012  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.162868 10913 ts_tablet_manager.cc:1403] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 3.945s	user 0.077s	sys 0.063s
I20260709 13:18:48.163391  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.035977 10951 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:48.195605  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:48.068053 10939 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.089821 10781 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260709 13:18:48.161676 10918 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.155113  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.158258  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:48.190313  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 115259us
I20260709 13:18:48.192198  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:48.194818  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.164018 10935 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:48.196576  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.210724  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.210767  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.195936  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.196800  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.189150  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.201463  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:48.202733  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:48.204329  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:48.205156  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.214359  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:48.024570 10923 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.199386 10547 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.004s
W20260709 13:18:48.206956  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 46976.9us
I20260709 13:18:48.152616 10966 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:48.209465  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.212601  4113 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
W20260709 13:18:48.209821  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51644us
I20260709 13:18:48.219784  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.214548  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:48.038892 10963 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.218616  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.221136  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.221621  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:48.221079  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.223505  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.224568  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.225431  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.225598  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.225986  4115 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:48.226595  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.227962  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.229079  4117 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.229681  3967 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:48.229980  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.232198  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.233278  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.233778  4116 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:48.234174 10953 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:48.206904 10959 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:18:48.234542 10953 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:48.235085 10953 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:48.235929 10913 raft_consensus.cc:359] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:48.230661  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.238692 10547 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:48.209414 10918 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.209029 10965 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:48.198304 10951 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.198506 10955 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.349160  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.350214  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.350337  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.239826  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.353585 10547 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:48.219604 10938 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.209928 10935 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:48.403077  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 49139.8us
I20260709 13:18:48.351869 10949 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:18:48.413656  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 174297us
I20260709 13:18:48.230273 10925 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:48.415738  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.417809  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.437738  3964 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
W20260709 13:18:48.418952  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48750.4us
I20260709 13:18:48.419168  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.249444 10939 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:18:48.205744 10956 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.144s
I20260709 13:18:48.420892 10918 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.439241 10949 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.443471 10826 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:48.444614 10949 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.444864 10826 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.445298 10826 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:48.445725 10952 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:48.446125 10952 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:48.446990 10952 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.451475 10916 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.279213 10913 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:18:48.435683 10935 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:48.453737 10913 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:48.456684  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.458750  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.411324  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.428737  4121 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:48.429121 10547 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.431835  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.237869 10923 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.433197  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.434186  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.440689  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.425019 10965 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.429415 10951 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:48.491691  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 259510us
I20260709 13:18:48.473789  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:18:48.464614  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53673us
I20260709 13:18:48.496414  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.502049 10917 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:48.502166 10941 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:48.502556 10941 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:48.503454  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.503322 10941 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:48.494149  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 273057us
I20260709 13:18:48.505254  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.438709 10925 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.507227  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.508224  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.504527 10917 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:48.469810 10947 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.469547 10969 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:48.520434  3971 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:48.505637  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:48.491873 10965 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:48.522153  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.517305 10925 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:48.551690  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.519214 10891 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:48.520085 10917 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:48.505198 10916 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:48.526537 10969 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:48.504576 10941 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:48.576874 10976 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:48.555352 10891 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:48.561774 10917 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:18:48.587728  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 82159.9us
I20260709 13:18:48.593339  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.562906 10895 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:48.597645  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.597261  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:48.601583  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.604957 10901 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:48.585031 10949 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.586254 10969 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.609730 10900 raft_consensus.cc:359] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:48.646407 10900 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:18:48.647331 10900 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:48.650177 10949 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.650807  4677 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.651593  4681 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:48.653033 10547 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:48.653033 10956 consensus_queue.cc:1175] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "293c0ff21e6f4e9f93555aaba177566b" responder_term: 20 status { last_received { term: 19 index: 15 } last_committed_idx: 15 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:18:48.657945  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.658143  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.658497  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.657588  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.659523  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.659901  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.660092  4117 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:48.669639 10966 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.670717 10948 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:18:48.671135 10948 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:48.672324 10966 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.674018  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:48.610718 10954 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:48.678303 10954 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.678738 10954 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.611164 10913 ts_tablet_manager.cc:1434] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.414s	user 0.008s	sys 0.000s
I20260709 13:18:48.612665 10923 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.681945 10923 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.682444 10923 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.658064 10956 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:18:48.688058 10948 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.688491  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.689158  4113 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:18:48.692451 10948 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:48.699448 10900 ts_tablet_manager.cc:1434] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.514s	user 0.007s	sys 0.001s
W20260709 13:18:48.699843 10900 ts_tablet_manager.cc:1467] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Tablet startup took 514ms
I20260709 13:18:48.703938 10935 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.706301 10935 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.706907  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.707834  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.708046  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.708432  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.705951 10951 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.709153  4117 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:18:48.709501  4118 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:48.710711 10951 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.713035  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.692438 10923 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.714684 10901 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:48.714885 10923 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.715557 10923 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:48.615119  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:48.618796  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 111662us
I20260709 13:18:48.619262  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:48.595855 10891 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:48.622076 10952 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.595531 10979 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.625387 10826 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.629103 10965 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.631914 10953 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:48.742601  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.632718 10968 raft_consensus.cc:1064] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:18:48.750106  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.751729 10968 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.637547  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:48.753381  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 115908us
I20260709 13:18:48.640856 10895 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:48.754655 10895 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:48.755146 10895 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:48.755503 10895 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:48.642328  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 259) took 4422 ms. Trace:
I20260709 13:18:48.758507 10826 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.732923 10781 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.759557 10781 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.760207 10917 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.760962  4113 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:48.753862 10954 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.762475 10917 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.762663 10954 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:48.718894  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103839us
I20260709 13:18:48.730271  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:48.763746  4677 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:48.734979  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.764570  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:48.765784 10923 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.769121  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.770272  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.771205 10877 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53318 (request call id 498) took 4816 ms. Trace:
I20260709 13:18:48.771433  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.772435  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.775835 10948 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:48.776332 10948 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.776800 10948 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.736414  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.737071  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.741171 10979 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.779351 10979 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.779659  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.779764  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.730902  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.780725  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.780858  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.781738  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.778769  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.783497 10901 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:48.783888 10901 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:48.784247 10901 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.740568  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.744124  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:48.700174 10900 ts_tablet_manager.cc:1469] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Trace:
0709 13:18:42.914661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:42.914805 (+   144us) service_pool.cc:224] Handling call
0709 13:18:43.005810 (+ 91005us) ts_tablet_manager.cc:934] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
0709 13:18:43.223881 (+218071us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:43.358891 (+135010us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:43.359049 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:43.403644 (+ 44595us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:43.403925 (+   281us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:43.414901 (+ 10976us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:43.414964 (+    63us) inbound_call.cc:177] Queueing success response
0709 13:18:43.455932 (+ 40968us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:18:48.185586 (+4729654us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:18:48.461956 (+276370us) tablet_replica.cc:261] Starting instrumentation
0709 13:18:48.462528 (+   572us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":272,"raft.queue_time_us":2580,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"tablet-copy.queue_time_us":40926,"tablet-download-pool.queue_time_us":10453,"tablet-download-pool.run_cpu_time_us":1149,"tablet-download-pool.run_wall_time_us":8498,"thread_start_us":112241,"threads_started":2}
I20260709 13:18:48.746057  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.746395  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:48.732846 10918 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.789821  4120 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:48.790645 10918 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.763619  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:48.791458  4112 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:48.756968  3867 rpcz_store.cc:276] 0709 13:18:44.220135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:46.679820 (+2459685us) service_pool.cc:224] Handling call
0709 13:18:48.642261 (+1962441us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:47.551514 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:47.552060 (+   546us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:47.552095 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:18:47.552112 (+    17us) tablet.cc:662] Decoding operations
0709 13:18:47.552457 (+   345us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:47.552527 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:47.552558 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:47.552752 (+   194us) tablet.cc:701] Row locks acquired
0709 13:18:47.552784 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:18:47.552917 (+   133us) write_op.cc:270] Start()
0709 13:18:47.553022 (+   105us) write_op.cc:276] Timestamp: P: 1783603127552870 usec, L: 0
0709 13:18:47.553042 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:18:47.553720 (+   678us) log.cc:844] Serialized 541 byte log entry
0709 13:18:48.173648 (+619928us) op_driver.cc:464] REPLICATION: finished
0709 13:18:48.543507 (+369859us) write_op.cc:301] APPLY: starting
0709 13:18:48.548528 (+  5021us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:48.579214 (+ 30686us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:48.579331 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:48.580035 (+   704us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:48.580239 (+   204us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:48.580277 (+    38us) write_op.cc:312] APPLY: finished
0709 13:18:48.580458 (+   181us) log.cc:844] Serialized 25 byte log entry
0709 13:18:48.580661 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:48.580741 (+    80us) write_op.cc:454] Released schema lock
0709 13:18:48.585972 (+  5231us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:48.594327 (+  8355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:48.594355 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":335146,"apply.run_cpu_time_us":3469,"apply.run_wall_time_us":69768,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8321,"num_ops":1,"prepare.queue_time_us":123603,"prepare.run_cpu_time_us":13706,"prepare.run_wall_time_us":217687,"raft.queue_time_us":302430,"raft.run_cpu_time_us":171720,"raft.run_wall_time_us":257033,"replication_time_us":620289,"thread_start_us":831563,"threads_started":4,"wal-append.queue_time_us":307302}]]}
I20260709 13:18:48.796409 10954 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:48.759967 10781 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.740201 10925 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.797964  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:48.781527  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50763.9us
I20260709 13:18:48.788156  3970 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:48.734058 10547 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:18:48.802631  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:48.804369  3982 tablet_copy_service.cc:342] P 1e032f02b0aa450384dda978641ba666: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-03c57dfd62654a78a41a253899d8f909 received from {username='slave'} at 127.0.0.1:34862
I20260709 13:18:48.804899  3982 tablet_copy_service.cc:434] P 1e032f02b0aa450384dda978641ba666: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-03c57dfd62654a78a41a253899d8f909 on tablet 03c57dfd62654a78a41a253899d8f909 with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.770220 10953 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:48.739538  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 230976us
I20260709 13:18:48.806250  4681 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 20: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:48.797035  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.808692  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.818742  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:48.826362  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:48.828600  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:48.828922  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:48.829352  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:48.768253 10969 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.832376  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.826408 10547 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:48.849053 10547 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:48.839097  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:48.851230  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 54256.9us
I20260709 13:18:48.851996  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:48.854120  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:48.855273  4040 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 14: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:48.855376  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.855872  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:48.857616 10781 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.859304  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.860152 10954 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:48.862017 10971 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:48.862255  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:48.860260  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.865003 10547 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.866880 10781 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.869256  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.869942  4038 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:48.823531 10931 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:48.871479  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:48.823496 10937 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:48.872422  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:48.873973  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.860611 10954 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.876960  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:48.831512 10940 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:48.863070 10971 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:48.868913 10930 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:48.863696 10966 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:48.864923 10917 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:48.854988 10935 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:18:48.775889 10951 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:18:48.865732 10916 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:48.894625 10547 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.884829 10962 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.872445 10976 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:48.870442 10957 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:48.863788 10923 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.904359 10901 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.912159 10891 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.877177 10939 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:48.881052 10954 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:48.914413 10901 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.914628 10891 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.886900  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:48.896296 10916 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:48.916368 10916 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.895349 10953 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:48.917263 10953 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:48.917636 10953 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:48.906793 10976 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:48.919248 10976 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.874933 10943 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:18:48.920696 10943 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:48.921100 10943 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:48.921927 10943 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.923245 10943 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:48.899883 10977 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:48.924975 10977 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:48.925773 10965 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:48.925961 10977 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.778476 10877 rpcz_store.cc:276] 0709 13:18:43.954202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:43.954343 (+   141us) service_pool.cc:224] Handling call
0709 13:18:43.971397 (+ 17054us) ts_tablet_manager.cc:934] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Initiating tablet copy from peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737)
0709 13:18:48.160543 (+4189146us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:18:48.701715 (+541172us) tablet_metadata.cc:665] Metadata flushed
0709 13:18:48.701854 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:18:48.770392 (+ 68538us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:18:48.770672 (+   280us) tablet_replica.cc:206] Creating consensus instance
0709 13:18:48.770984 (+   312us) ts_tablet_manager.cc:989] Replica registered.
0709 13:18:48.771039 (+    55us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":57386,"tablet-copy.queue_time_us":123,"thread_start_us":97813,"threads_started":1}
I20260709 13:18:48.901371 10931 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:48.888559 10942 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:48.885540 10971 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:48.930172 10942 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:48.930564 10971 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.931200 10942 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:48.931864 10971 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.932972 10877 tablet_copy_client.cc:806] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 0 data blocks...
I20260709 13:18:48.933590 10877 tablet_copy_client.cc:670] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Starting download of 1 WAL segments...
I20260709 13:18:48.934636 10969 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.909684 10925 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:48.889635 10966 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:48.936329 10966 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:48.924908 10895 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.940346 10895 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.940881 10977 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:48.945919 10954 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.950814 10979 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:48.951438 10954 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.952924 10979 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:48.955821 10966 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:48.999416  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 145304us
I20260709 13:18:49.001317  3969 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 24. Current term is 25. Ops: []
W20260709 13:18:49.001775  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 119458us
I20260709 13:18:49.003283  3965 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:49.004011  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.007097  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.010198  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.017786  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.021944  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.023166  3966 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:49.025029  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.026047  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:49.026355  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 143772us
W20260709 13:18:49.028837  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 151936us
I20260709 13:18:49.019632  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:49.079743  4039 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:49.092141 10895 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:48.960518 10976 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:49.096367 10976 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:49.063791  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 176796us
I20260709 13:18:49.065339  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:49.065584  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:49.093384 10895 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:48.929740 10931 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.101146 10940 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:49.102041  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.110003 10948 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.113090 10955 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.115427 10966 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.041028  3969 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:49.047391  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:49.126021  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 106601us
I20260709 13:18:49.128342  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.108604 10941 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.134312 10901 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:18:49.135438 10877 tablet_copy_client.cc:538] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:18:49.136430  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50960.9us
I20260709 13:18:49.137771  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.139333 10976 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.125883 10954 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:49.134729  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61018.6us
I20260709 13:18:49.143401 10954 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:49.139492  4085 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.143934 10954 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.144735  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.145241  4682 raft_consensus.cc:1217] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Deduplicated request from leader. Original: 23.16->[23.17-23.17]   Dedup: 23.17->[]
I20260709 13:18:49.145524  4679 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:49.146595  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.148500 10891 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:49.148939 10891 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:49.149324 10891 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.155540 10826 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:49.156860  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.165323 10976 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.149232 10977 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:49.159678 10948 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.167189  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.168748  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.161077 10984 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:49.168992 10977 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.177800 10984 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:49.156002  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.180199 10976 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:49.181543 10901 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:49.182039 10901 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:49.183300 10901 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.178323 10984 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:49.190017  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.190665  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.190930  4112 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:49.178390 10990 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:18:49.191963  4047 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:49.193596 10966 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:18:49.176344  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46102us
I20260709 13:18:49.194828 10931 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.196235 10990 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:49.196671 10990 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:49.196529  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.193758  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.205121  3963 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:49.208575  4682 raft_consensus.cc:1217] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Deduplicated request from leader. Original: 23.13->[23.14-23.14]   Dedup: 23.14->[]
I20260709 13:18:49.170697 10953 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:49.219208  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50614.3us
I20260709 13:18:49.220283  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.221095 10918 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.224264 10976 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:49.224437 10990 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.225716 10977 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:18:49.226106 10977 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:49.226806  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 202032us
I20260709 13:18:49.227402 10977 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.227806  4012 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.229940 10977 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:49.233327  4085 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.239689 10891 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.240144 10976 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.226204 10990 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.241103  4649 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.242033 10891 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:49.240545  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.245131 10957 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.245941 10957 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:49.246976 10957 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.226087 10916 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.250206 10953 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:49.236990  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.253041 10916 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:49.253499  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:49.253856 10877 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap starting.
I20260709 13:18:49.257853 10969 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:49.259267 10969 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:49.260700 10969 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.266950  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.222136 10984 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.270358  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.271790 10954 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.274329 10901 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.255160 10940 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:49.275450  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.271826  3965 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:49.280963  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.282665  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.283843  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.284821  4112 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:49.285342  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.286067  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.286283 10984 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:49.286787  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.278273 10931 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.290757 10989 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:18:49.293102  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.294155 10895 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:49.295466  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.298254 10953 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.265432 10948 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.306350  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.314910 10895 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.315140  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.315492 10990 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:49.314949 10989 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:49.315958 10990 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:49.316434 10990 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.316833 10989 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:49.316705  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 79837.8us
I20260709 13:18:49.318643  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.320178  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.322353  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.323572  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.323887  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.324944 10990 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.327014 10990 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:49.327319  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52033.4us
I20260709 13:18:49.328217  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.324958 10826 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:49.329347 10990 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:49.331199  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.333149 10895 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:49.334041  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.331996 10990 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:49.334858  4038 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:49.335414  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:49.329620 10826 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.337620  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.338399  4040 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.340274  4120 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:49.341180  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.341897  3868 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 19 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 20 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:49.345400  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.350334  3968 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:49.350733  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.351643 10826 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:49.351998 10826 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:49.352344 10826 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.353902  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:49.354689 10971 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.358129  4121 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:49.359545  4116 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:49.360091  4119 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:49.360877  4115 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:49.361615  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.357647  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.362854  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.372869  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.374203  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.377293  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.377862 10954 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.378722  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.338501 10995 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:49.385767  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.387038  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:49.388144  4682 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:49.388964 10916 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:49.389763 10916 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:49.390107 10916 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:49.390455 10916 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.393275  3968 raft_consensus.cc:1240] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:49.394515  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.395866 10938 consensus_queue.cc:1059] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:49.396281  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.397509 10937 raft_consensus.cc:3055] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:49.397565  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.397969 10937 raft_consensus.cc:740] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:49.398274  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.398746  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.398953 10937 consensus_queue.cc:260] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.399410  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.400409 10937 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:49.401157 10826 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.402292  4118 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:18:49.404803  4114 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:49.398165  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.409021  4042 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:49.410172  4039 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:49.418150  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.419274  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.422643  4042 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:49.426908 10939 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.432742  4040 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:49.436002  4042 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:49.447451  4046 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:49.449748 10901 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:18:49.455045  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:49.459396  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 46662us
I20260709 13:18:49.465492 10925 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:18:49.461228 10953 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:18:49.457325 10939 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:49.468839  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 90296us
I20260709 13:18:49.473745  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:49.475121  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 77082.9us
I20260709 13:18:49.474587  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.483372  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.487406  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.495201  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.497381  4038 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:49.498152  4117 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:49.499238  4042 raft_consensus.cc:1240] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:49.466735 10939 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.502357 10939 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.502959 10976 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:49.503371 10976 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:49.506356 10943 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:49.506749 10943 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:49.507566 10943 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:49.509783  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.510963  4038 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:18:49.469259 10916 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.513679  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:49.516173  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.517807  4043 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:49.518122  4041 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:18:49.509984 10943 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.523655  4113 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:49.509223 10977 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:49.525353 10826 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:49.526261 10916 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:49.504226 10976 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.532290 10989 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:18:49.542802  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.533803  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.534523  4041 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:49.548540 10939 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:49.548910  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.550280  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.531576  4114 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:18:49.550848 10939 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.551613  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.538178  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.553531 10977 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:49.554297 10939 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:49.554541 10916 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:49.551038 10901 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.536935 10976 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:49.554755 10939 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:49.557257 10939 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:49.557557 10969 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:49.557976 10969 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:49.557978  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.541203  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.559343 10954 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:49.558979 10969 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.559903 10954 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:49.537534 10999 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:49.560972 10954 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.565546  4046 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:49.567142  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.568048 10931 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.568608 10931 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.569567 10931 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:49.554728  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62995.8us
I20260709 13:18:49.574455  3870 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 18 to 19, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.577375  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.560554 10969 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:49.581559  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.577440  4113 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:49.582418  4114 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 17: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:49.567082  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.579174 10940 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:49.585170 10940 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:49.585602  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.586620  4038 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:49.586886  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.588201 10989 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.585623 10940 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:49.589308 10939 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:49.591954 10939 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.592463  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.596822 10984 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.597417 10984 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.598440 10984 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.602137  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.602895  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.604315  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.604743  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.605072  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.605568  4046 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:18:49.605930  4039 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260709 13:18:49.606645  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.607954  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.608707  4045 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 20: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:49.610159  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.611562  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.611697 10901 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:49.612323 10995 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:49.612778 10995 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:49.613312 10995 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.616200  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.590205 10940 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.617658 10940 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:49.618340  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.622932  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.625108  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.629623 10941 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:49.630963  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.630774 10941 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.632987 10941 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:49.633940 10966 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:49.634521 10966 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.636472 10966 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.638530  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.642771  4117 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:49.646591  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:49.655049  4114 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:49.663307 10995 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.664275 10943 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:49.664512  3965 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 14. Current term is 15. Ops: []
I20260709 13:18:49.664969 10943 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.665596  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.667520  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:49.669277  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56468us
I20260709 13:18:49.669855  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.671770  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.646665  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.677856  4039 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:49.683166  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.683962  4043 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
W20260709 13:18:49.694595  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98977.3us
I20260709 13:18:49.696620  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:49.695372  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.672120 10943 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.669263 10995 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.707985 10941 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:49.693204 10939 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:18:49.722035  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50376.4us
I20260709 13:18:49.715372 10939 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:49.723784 10939 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.725553  4130 tablet_copy_service.cc:342] P 0f3fa9d459de485e824f023c55580bc6: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-50aca70be0884ed09aa97127d571282f received from {username='slave'} at 127.0.0.1:51850
I20260709 13:18:49.726131  4130 tablet_copy_service.cc:434] P 0f3fa9d459de485e824f023c55580bc6: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-50aca70be0884ed09aa97127d571282f on tablet 50aca70be0884ed09aa97127d571282f with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.731232  3964 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:49.714658 10966 consensus_queue.cc:1059] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:18:49.723073 10989 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:18:49.737138 10989 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:49.737525 10989 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:49.738950 10989 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.740437 10989 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.741226 10939 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.742280  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:49.742962  4117 raft_consensus.cc:606] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.697929 10977 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:18:49.745246  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:49.750487  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.725682 10979 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:49.724536 10976 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:49.760910  4043 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:18:49.743407 10991 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.008s
I20260709 13:18:49.766733  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.743549 10939 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:49.784883 10976 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.773880 10979 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.786343 10979 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.787159 10976 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:49.787957 10931 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:49.788331  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:49.794948 10826 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:18:49.774426 10943 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:18:49.777177 10983 raft_consensus.cc:1064] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:18:49.797899 10984 raft_consensus.cc:3055] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:49.788473 10931 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.797891  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.776458 10941 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.824509  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.805064 10966 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:49.792532 10954 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:18:49.805145 10826 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:49.831984  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52362.5us
I20260709 13:18:49.812507 10976 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.840302  4677 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:18:49.842119  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.811312 10984 raft_consensus.cc:740] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.845307 10931 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.845332  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:49.847415 10941 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.831952 10939 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:49.850363  4117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b759a28e523c491c941636a30d249939"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:49.848408 10953 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:18:49.851676  4117 raft_consensus.cc:606] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:49.852314  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.828805 10966 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.842612 10937 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 13:18:49.868904 11011 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:49.865599  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:49.869127 10966 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:49.870533  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:49.871999 10977 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:49.872398 10977 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:49.873368 10977 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.860570 10826 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.875283 10977 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:49.877461  3968 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:49.875344 10826 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:49.882403 10901 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:49.882872 10901 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:49.883747 10901 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:49.884006 10983 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:49.886402  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.895895  3963 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:49.863696 10931 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:49.900718 10901 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:49.903052 11019 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:18:49.903398  3966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:18:49.904085  3966 raft_consensus.cc:606] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:49.905306  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.907361  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.908197  4113 raft_consensus.cc:2410] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:18:49.916213  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.917883  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.846124 10984 consensus_queue.cc:260] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:49.921280  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 160882us
W20260709 13:18:49.931023  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71649us
I20260709 13:18:49.915120  3867 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 22 to 23, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 23 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:49.923533  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58017.4us
I20260709 13:18:49.939265  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.941197  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.938102  3867 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 19 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:49.956266  3963 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:18:49.954727  3968 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:49.958513  4043 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:18:49.961580  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:49.962038  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:49.962952  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.959021  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:49.964530  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.965804 10953 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:49.943992 11014 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:49.979307  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:49.980149  4121 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:49.958318 11011 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.988822  3968 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:18:49.990691  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:49.991460  4119 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:49.988484 10891 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:50.002161  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 62988.4us
I20260709 13:18:50.002929  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:50.005420  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43938.6us
I20260709 13:18:50.006877  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:50.007658  4119 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:49.991616 10984 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:49.990936 11014 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:49.989521 10979 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.025287  4121 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 13. Current term is 14. Ops: []
I20260709 13:18:50.024019  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.031292  4043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
new_leader_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:59188
I20260709 13:18:50.032635  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.040663  4043 raft_consensus.cc:606] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Received request to transfer leadership to TS 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.041215  4043 raft_consensus.cc:614] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:50.042488  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.036538 10976 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:50.033761 10953 raft_consensus.cc:993] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:18:50.047509  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.031536 11026 raft_consensus.cc:2764] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:18:50.049230 11015 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:18:50.049464 11026 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.050182 11026 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:18:50.051465 11026 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:18:50.051870  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.049227  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.013605 11014 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.053211  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.013077 10931 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:50.054914  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:50.009280 11024 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:18:50.063612 11015 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.063666 10954 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:50.082793  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.051810 11026 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.064227 10931 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.076443 10953 raft_consensus.cc:1081] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:18:50.076288 10976 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.092633  3870 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 19 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 20 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.045650 10957 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:18:50.099673  3870 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 15 to 16, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:50.085372 10979 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.074167 10940 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:18:50.029563 11011 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.079770 10969 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:18:50.110404  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:50.125852  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71049us
I20260709 13:18:50.154194  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.126417 11026 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.129315  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:18:50.158753  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:18:50.129763 10931 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:50.131628 11022 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:50.136994 10877 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:18:50.106575 10977 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:18:50.162406  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85814.1us
I20260709 13:18:50.164258  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.168097  4682 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:50.170123 10966 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.170873 10966 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:50.171315  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.171793 10966 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:50.172139 10966 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.172925 10984 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.173137 10966 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:50.175081 10966 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:50.176630 10931 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.177356 10995 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.180337 10877 tablet_bootstrap.cc:492] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Bootstrap complete.
I20260709 13:18:50.181128 10877 ts_tablet_manager.cc:1403] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Time spent bootstrapping tablet: real 0.928s	user 0.053s	sys 0.020s
W20260709 13:18:50.190521  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80195.9us
I20260709 13:18:50.191457  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:50.192493 10995 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:18:50.198328  4012 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:50.199738  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.201741  3968 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:50.210830  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.201401 10977 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:50.214016 10901 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.220294 10826 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:50.221145 10826 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:50.221467 10826 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:50.222270 10826 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.223608 10826 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:50.206876 10939 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.219079  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.229328 10943 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.231084 10891 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.231406  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.216789 10954 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.232913  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.209254 11021 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 13:18:50.237372 10976 raft_consensus.cc:993] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:50.237782 10976 raft_consensus.cc:1081] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Signalling peer 1e032f02b0aa450384dda978641ba666 to start an election
I20260709 13:18:50.239030 10969 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:18:50.296293  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50712us
I20260709 13:18:50.297408  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:50.298561  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 65734.1us
I20260709 13:18:50.299950  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.302253  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:50.303480 11034 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:18:50.232550 11020 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.205312 11014 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:18:50.308507  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.313236  3968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b759a28e523c491c941636a30d249939"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
 from {username='slave'} at 127.0.0.1:45588
I20260709 13:18:50.314055  3968 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.314381  3968 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:50.315413 11028 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:50.316124 11028 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:50.240691 10979 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
I20260709 13:18:50.323664  3968 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.326179  3968 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:50.312680 10976 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.300889 11021 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.331625 11014 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:50.345531 11014 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.346565 11014 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.348065 11014 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:50.334030 10877 raft_consensus.cc:359] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:50.349002 10877 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Initialized, Role: LEARNER
I20260709 13:18:50.349668 10877 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:50.352097 10877 ts_tablet_manager.cc:1434] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.000s
I20260709 13:18:50.334669 11015 raft_consensus.cc:1064] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:18:50.335124 10931 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:50.353237 10931 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.338949 11026 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.343253  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.373117 10901 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:50.373683  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.374743 10901 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.375332  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.376323 10901 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:50.355775  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53613.3us
I20260709 13:18:50.354125 10931 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:50.358127 10977 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:18:50.382275  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.383064 10977 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.383962 10901 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:50.395710  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 187843us
I20260709 13:18:50.398183 11041 consensus_queue.cc:1059] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:18:50.384194  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.402101  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:50.416607 11043 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:50.423058 10939 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:50.417944 11043 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:50.418293 10943 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.426306 11043 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.427783 11043 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.428516 11012 raft_consensus.cc:3055] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:50.429673  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.429109 11012 raft_consensus.cc:740] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.437085 11041 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:50.429628 11011 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:18:50.440279 11011 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:50.440680 11011 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.441675 11011 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:50.442512  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.457350 11011 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.459276  3982 tablet_copy_service.cc:342] P 1e032f02b0aa450384dda978641ba666: Request end of tablet copy session 293c0ff21e6f4e9f93555aaba177566b-d99c13fc3b7f4e2687824e0a5911512a received from {username='slave'} at 127.0.0.1:34862
I20260709 13:18:50.459893 10931 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.459893  3982 tablet_copy_service.cc:434] P 1e032f02b0aa450384dda978641ba666: ending tablet copy session 293c0ff21e6f4e9f93555aaba177566b-d99c13fc3b7f4e2687824e0a5911512a on tablet d99c13fc3b7f4e2687824e0a5911512a with peer 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:50.469116 10943 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:18:50.469549 10943 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:50.470374 10943 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.471704 10943 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:18:50.479442 11046 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:18:50.487092  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 241515us
W20260709 13:18:50.488404  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 104285us
I20260709 13:18:50.489174  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.489841 10891 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:18:50.490553 10891 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:18:50.491170 10891 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:50.445106 11041 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:18:50.446929 10966 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:50.494668 10966 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:50.495085 10966 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.495332  4119 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:50.496037 10966 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.497839 10966 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.498111 10977 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:50.498520 10977 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:50.499387 10977 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.448339  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.438920 11043 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.491480  4121 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:18:50.502007  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53742.7us
I20260709 13:18:50.443786 11012 consensus_queue.cc:260] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.511227 11041 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:50.512959  4044 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:18:50.514694  4040 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:18:50.518046  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.518208  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.518646  4047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:18:50.519164  4047 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:50.519488  4047 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:50.519544  4041 raft_consensus.cc:1240] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:50.522236  4045 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:50.522572  4043 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:50.523092  4044 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:50.523396  4045 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:50.520503  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:50.524209  4041 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:50.523500  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.524995  4046 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:50.502679 10977 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:50.526341 10989 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:50.529783 11012 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.531458 11038 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:50.531921 11038 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:50.532814 11038 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.533578 10901 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.534271 11038 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:50.534152 10901 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.536638 10901 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:50.537007 11045 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:18:50.538626 10989 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:18:50.545166  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.523221  4040 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:50.553326  4117 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:50.554282  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:50.554700  4120 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:50.555070  4119 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:50.555783  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:50.556377  4114 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:50.556967  4113 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:18:50.561497  4116 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:18:50.562915  4112 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.554589  4115 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:50.564550  3966 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:50.568830  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:50.572088  4119 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:18:50.573776  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:50.574594 11026 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:50.512980 11041 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.575698  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.577445  4114 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:18:50.578408  4047 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.586666  4038 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:50.588318  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.589414 10943 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:50.596690 10979 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:50.619480  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:50.569581 11020 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
W20260709 13:18:50.627650 11048 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:18:50.657397  4118 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:50.636915  4047 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:50.637684 10957 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.585875 11014 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:18:50.596889 11044 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:18:50.643344 11015 raft_consensus.cc:1068] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Replica 1e032f02b0aa450384dda978641ba666 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:18:50.615501 10943 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.665167  3966 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:50.666013  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 51286.3us
W20260709 13:18:50.666802  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55925.5us
I20260709 13:18:50.666891  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:50.667423 10984 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:50.668043 11019 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:50.643182  4112 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:50.595677 11026 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.663673 10957 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:50.681720  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:50.681319  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:50.693289  4119 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:50.680213 10943 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.598423 11041 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.693616  4119 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:50.704134 11015 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:18:50.709913  4119 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.719601  4119 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:50.674073 10979 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:18:50.680486 10931 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:18:50.704833 11017 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:50.733444 10989 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:50.704293 10954 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:50.733969 11017 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:50.734469 11017 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:50.734138 10989 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.737711  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:50.738308  4118 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:18:50.738374 11026 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:50.739079  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.739966  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:50.740468  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:50.741305 11038 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:50.741636 10957 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:50.745347  3966 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:50.749053  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.749940  3968 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:50.751026  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.746448 10989 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:50.741672 11038 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.752723  3964 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:50.753038 11038 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.725203 10966 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:18:50.766814 11054 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:50.768023  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:50.773607 10957 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:50.773996 10957 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:50.774305 10957 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:50.778329 10941 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:50.778754 10941 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:50.746874 10954 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.785380 10826 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.785917 10826 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.786710  3965 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:18:50.786932 11020 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.787410 11020 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.794162  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.794819  3963 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:50.810145  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:50.796058  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:50.817060 10891 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:50.817490 10891 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.817847 10891 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:50.828895 10826 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:50.829756 10943 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.830546 11038 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.833163 10943 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:50.833861  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:50.834098  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:50.834533  3963 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.838030  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.834651  3966 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.832944 10941 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.845377  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:50.798233  3965 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:50.734318 11025 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:18:50.840948 10939 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.859297 10939 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.862541 10954 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:50.861497 10939 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:50.863893  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:50.864591  4681 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:50.865214 11054 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.865908 11020 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:50.868593  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.869256  3964 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:50.871754  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.872709  4046 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:50.847362  4120 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:50.865690 11054 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.866051  4040 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:50.871199  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:50.852237  3966 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:18:50.876555  3963 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:50.840489  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:50.896260  4112 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.839818 11028 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:50.858594 10941 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:50.886159  4681 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:18:50.903188  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 195451us
I20260709 13:18:50.900593  3938 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:50.904107  3938 leader_election.cc:403] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:50.887250  4648 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:50.897912  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:50.832681 11038 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:50.900873  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.895289 10977 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:50.891462 10901 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.845923 11053 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:50.914356  3968 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:50.914825  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:18:50.916662  4119 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:18:50.962095  4112 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
W20260709 13:18:50.925349  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 54366.5us
W20260709 13:18:50.947129  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49298.1us
I20260709 13:18:50.930353  4039 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Committing config change with OpId 23.18: config changed from index 17 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:18:50.969763  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:50.970346 11054 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:50.971603 11044 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:50.972397 11057 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:50.963363 10957 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:50.975821 11037 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:50.977380  4040 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:18:50.917342  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:50.916242 10977 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.989770  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:50.928473 11012 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:50.993368  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:50.995091  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:50.891585 11017 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:50.995585  4119 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:50.994494  4044 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:18:51.008285  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:51.009227  4120 raft_consensus.cc:2368] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:50.995342  4121 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:50.979280 11028 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:50.983023 10940 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:50.947872 10954 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:18:50.942797 11011 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:18:50.916216 11043 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:18:50.997510 11057 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:51.034224  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 151589us
I20260709 13:18:51.003340 10977 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:51.031502 11021 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.031296 11060 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:51.054023  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:50.985136 10901 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.061374 11057 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.064271 11061 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:50.994372 11053 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.043133  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:51.033108 11015 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:18:51.024916 10940 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:51.100003  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 56961.2us
W20260709 13:18:51.109676 11059 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:18:51.047693 10966 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:18:51.146010  3937 leader_election.cc:400] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18.
I20260709 13:18:51.112655 10976 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:51.157089  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:51.157667  3968 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.157804  4045 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:51.166625  4047 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:18:51.067373 11021 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.167315 11036 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:51.150530 10953 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.151141 11037 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:51.113444 10891 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.156581 10976 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.166220 11060 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:51.186436  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:51.153975 11043 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:18:51.201516  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 62741us
I20260709 13:18:51.112941 11061 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.210901  3968 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:51.210485  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:51.177067 10957 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:51.216741  4113 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:51.177019 11067 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:51.239867 11070 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:18:51.240923 11067 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.184347 10966 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:18:51.132998 11028 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.247546 11063 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:51.249223 11073 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.183288 10953 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.289109  4117 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:51.290128  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:51.290789  4117 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:51.249902 10969 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:51.250057 11017 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.327381 11067 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:51.328560 11021 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:51.282454 10957 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.332792  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:51.338197  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 127631us
I20260709 13:18:51.338667  3968 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:51.333863  4113 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:18:51.351563  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:51.329728 11065 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.359599  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:51.362882 11075 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:18:51.364686 11061 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.341511 10901 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.309739 11073 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.295110 11037 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.369325 10940 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.343761 10957 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.285972 11063 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.417724  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:51.423674  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 264223us
I20260709 13:18:51.427274  4682 raft_consensus.cc:2368] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:51.428639  4648 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:51.414670  3968 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:51.419894  4681 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:51.435448  4045 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:51.437417  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:51.438313 11043 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:51.438828 11043 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:18:51.440088  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 86154.3us
I20260709 13:18:51.439760 11043 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.441849 11024 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:51.442315  4013 leader_election.cc:400] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:51.442616  4013 leader_election.cc:403] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:51.443704 11021 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.442351 11024 raft_consensus.cc:697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:51.445057 11024 consensus_queue.cc:237] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:51.446748 10941 consensus_meta.cc:287] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.000s
I20260709 13:18:51.428597 10891 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:51.444610 11077 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:18:51.450641 10953 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:51.450971 10976 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:51.451871  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:51.453320  3968 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:51.378624 11060 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.454948 10977 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.406213 11053 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:51.372596 11065 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.461725  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:51.462685  4118 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:51.465009  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:51.465728  4117 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:51.481612  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:51.481793  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:51.482410  4118 raft_consensus.cc:2393] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:51.482319  4682 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
W20260709 13:18:51.478904 11079 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:18:51.478881 11067 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:18:51.452579 11063 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.508745  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:51.509406  4682 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:51.511721 11089 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.512288 11089 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.507839  4087 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:51.514313 11089 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:51.444203 11021 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.550993 10977 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:51.562103 11065 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.517693 10957 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.545641 10976 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:51.564028 10976 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.564357 10976 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.588665 11021 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:51.590046 11073 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.599751 10976 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.601958 10976 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:51.607146  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 153042us
I20260709 13:18:51.609972  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:51.610273  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:51.618326  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:51.618646  3965 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:51.619230  4117 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:51.620236  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:51.624843  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:51.625556  3965 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:51.626354  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:51.579288 11067 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
W20260709 13:18:51.643193 11078 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:18:51.656742  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:51.663033 10976 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:18:51.671036 10976 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:51.672111 10976 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.660071 10954 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:18:51.661019  4085 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:51.675652 11076 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:51.676148 11076 raft_consensus.cc:697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:51.677014 11076 consensus_queue.cc:237] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.680714  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:51.681653  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:51.683727  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:51.684291  3964 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.684922 11021 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:51.685290 11021 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.685658 11021 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:18:51.686024 11081 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:18:51.691478  3964 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:18:51.762324 10983 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.762996 10983 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:51.656237  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 175897us
I20260709 13:18:51.692735  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:51.765136  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:51.766386  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 73730.5us
I20260709 13:18:51.770499  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:51.771174  4677 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:18:51.762282 11080 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:51.693064  3867 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 17 to 18, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:51.713701 11015 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.708360 10995 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:51.783860 10977 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:51.843879 11015 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:51.896417  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:51.898000  3964 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:51.901103  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:51.779374 11021 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.890870 11057 raft_consensus.cc:476] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Not starting pre-election -- already a leader
I20260709 13:18:51.902366 10977 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:51.929003 10977 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.934986 10983 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:51.935657 10943 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:51.922681 11092 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:51.945768 11069 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.924208 11020 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:51.841491 11080 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.926540 11011 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.893453 10995 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:51.937130 10931 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:51.936302 10943 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:51.950724 11092 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:51.952266 11020 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.005954 10995 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:51.974071 10983 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:51.976001 11020 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:51.972445 11092 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:51.963414 11011 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:51.965741 10931 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.014273 11091 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.014698 11103 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:18:51.954954 11069 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.023176 10943 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.023769 10943 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.024250 10943 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:52.026012 11015 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.026579 11015 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.027391 11015 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:52.012480 11082 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:52.035493 11102 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
I20260709 13:18:52.012344 10983 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.081331  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.082612  3971 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:18:52.085834  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 265184us
I20260709 13:18:52.105206  4677 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:18:52.081964 11063 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.065236 10995 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.065536 11041 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.089627 11015 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.031278 11091 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.084923 10901 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:52.104287 11021 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.079886 10941 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:52.151384 11105 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:18:52.065369 11082 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.158839 11074 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:52.167853 11074 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.168612 11021 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.169147 11021 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.170064 11074 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:52.171437 11109 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:18:52.171741 11021 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.172729 11021 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.173228 11021 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.175534 10826 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:52.176100 10826 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.138983 11063 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.143016 10995 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.180958  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.182947  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.183776  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.170267  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:52.176811 11021 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.171324  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4054) took 1059 ms. Trace:
I20260709 13:18:52.144816 11041 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.154670 10901 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:52.163384  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77615.7us
W20260709 13:18:52.318886 11101 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.648s	user 0.003s	sys 0.000s
W20260709 13:18:52.320026 11110 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.283s	user 0.000s	sys 0.002s
I20260709 13:18:52.319021 10943 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.320631 10943 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:52.321327 10943 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.323385 10943 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:52.217553  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 113069us
I20260709 13:18:52.324738  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.324520  3968 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:52.224255  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:52.236176  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:52.330876  4045 raft_consensus.cc:2393] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:52.334338  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.326157  4041 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:52.335022  4044 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:52.345052  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.347214  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.349172  3971 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:52.369235  3968 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:52.156579 11012 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:52.379995  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.380074  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.380753  4039 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:52.380879  4042 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:52.384394  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:52.217243 11065 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.190039 10826 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.209410 11074 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.317667 10940 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.388123  4042 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:18:52.219187 11011 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.339681 11123 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.225853 11036 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:52.265818 10931 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.325153  3963 rpcz_store.cc:276] 0709 13:18:51.111779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.111930 (+   151us) service_pool.cc:224] Handling call
0709 13:18:51.112219 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.201128 (+ 88909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:51.201159 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:51.201198 (+    39us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:51.201232 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.171038 (+969806us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b54003985d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:52.171092 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.171230 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171621120}
I20260709 13:18:52.393124  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.393565 11118 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:52.395064 11121 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:52.395555 10826 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:52.157495 10941 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.397399 11132 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.397753 10925 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.397924 11074 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.397329 10940 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.399827 11065 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.404590 11120 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:18:52.405687  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:52.351109 11024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.009s	sys 0.010s
I20260709 13:18:52.412436  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.362514 11057 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.413967  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.411993  4042 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:52.418262  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.419910  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.346158 11073 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:18:52.422792  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.425904  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.545406  4047 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:52.545447  4677 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:52.391424 11012 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:52.548285  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 88011.6us
W20260709 13:18:52.548188 11024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.010s	sys 0.029s
I20260709 13:18:52.550488 11130 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:52.550957  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.551651 10940 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.552014  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.426694 11121 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.507051  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.420504 10826 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.557024 11121 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.558928 10826 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.559521 10826 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.559999 10826 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:52.557730 11126 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.561322 11126 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.563998 11126 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.565953  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.485978  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.461086  3965 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:52.558887  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:52.552592  4045 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:52.568050  4119 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:52.567802  4046 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:52.544456  4044 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:52.546314  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.551038 11130 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.543574 11057 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.573030  4120 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:52.571952  4115 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:52.549482 11082 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.558753 10995 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.572249 10931 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:52.557628 11074 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.423600 11080 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.575649  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.425400 10943 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:52.617763  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 157977us
I20260709 13:18:52.420217 11036 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.577246 10940 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.582953 10931 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.580610 11021 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.626525  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:52.625548  4085 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:52.420462 11118 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.589793 11133 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.642773 11133 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.423345 11132 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.643759 11036 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.644822 11133 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.645428 11132 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.646641 11012 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.647071 11132 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:18:52.426425 10925 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.646672 11021 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:18:52.648133 11139 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:18:52.649178 11041 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.649933 10901 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.651156 10941 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.654502 11057 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.415683 11123 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.591275 10995 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.639827  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3450) took 1645 ms. Trace:
I20260709 13:18:52.627734 10943 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.656337 11130 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.660164  4040 rpcz_store.cc:276] 0709 13:18:50.982847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.992683 (+  9836us) service_pool.cc:224] Handling call
0709 13:18:50.993905 (+  1222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.628039 (+1634134us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b2c001267f8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed746fc291 00007fed747170ca 00007fed764454ad 00007fed7644be1b 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:52.628130 (+    91us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.628153 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:52.628191 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:52.628221 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.628284 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:52.628396 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3590912}
I20260709 13:18:52.638845 11138 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.638411 11137 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.632194 11074 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.674876  3966 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
W20260709 13:18:52.645457 11020 consensus_meta.cc:287] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 13:18:52.641229 10931 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:52.666957 11143 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.667418 11012 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:52.667640  4681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 697) took 1337 ms. Trace:
I20260709 13:18:52.656714 10940 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:52.656540 11092 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.639s	user 0.004s	sys 0.002s
I20260709 13:18:52.660516 11063 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.680163  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.670687 11126 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.669445 10925 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:52.697790 11140 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:18:52.698153 11129 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.696115 11012 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:52.687247  4681 rpcz_store.cc:276] 0709 13:18:51.330518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.330856 (+   338us) service_pool.cc:224] Handling call
0709 13:18:52.667429 (+1336573us) spinlock_profiling.cc:243] Waited 67.7 ms on lock 0x7b54008da254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:52.667550 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155671936}
I20260709 13:18:52.673934 11065 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:52.697383  4649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.876s (SENT) [suppressed 1 similar messages]
W20260709 13:18:52.727322  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 101471us
I20260709 13:18:52.687269  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.680052 11132 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:52.678520 11137 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.669785 10995 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.711349 11130 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:52.718844 11063 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.678579 11020 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.747323 11137 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.747917 11020 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.734320 11012 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:52.749133 11134 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.749784 11134 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.752480 11134 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:52.753543 11086 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.298s	user 0.004s	sys 0.016s
I20260709 13:18:52.733263 11133 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.757717 11133 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.759166 11130 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.735703 11148 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:52.717387 10901 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.743857 11132 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.745811 11151 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.746150  4115 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:52.761284  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.760319  4040 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:52.786715  4119 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:52.767891 11133 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.680145 11138 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.769035  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:52.770038 10943 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.770728 10983 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.733636 11129 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.687575 11074 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.774775  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:52.747274 11094 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.292s	user 0.000s	sys 0.002s
W20260709 13:18:52.773454 11043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.036s	sys 0.024s
I20260709 13:18:52.755196 10995 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.715144 11092 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.696805 11143 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.796379  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:52.814384  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.810034  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.805068  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 3422) took 1691 ms. Trace:
I20260709 13:18:52.725865 11126 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:52.815171  4113 rpcz_store.cc:276] 0709 13:18:51.113206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:51.113327 (+   121us) service_pool.cc:224] Handling call
0709 13:18:51.151159 (+ 37832us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:51.339683 (+188524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.804839 (+1465156us) spinlock_profiling.cc:243] Waited 65.5 ms on lock 0x7b540026acd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:52.804992 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150536064}
I20260709 13:18:52.804987  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:52.813879  4115 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:52.797314 11145 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:52.826103  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.825973  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:52.805223 11043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.357s	user 0.039s	sys 0.032s
I20260709 13:18:52.830073  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.832267  4117 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:52.819211 11145 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:52.804402 10969 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:52.802188 11129 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.802300 11138 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.807605 11130 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.775106 11063 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.789850 10901 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.808326 10931 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:52.785741 11148 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.838860  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:52.992966  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 295590us
I20260709 13:18:52.926618  4045 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:18:52.989114  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.968279  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.943042  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.982465  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.926123  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.976272  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:18:52.948457  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.912395  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.970279  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.970057 10826 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.971336  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:52.965368  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.962594  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:52.966917  4039 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:53.002374  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.974475  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.970503  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:52.794313 11151 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:52.887167 11111 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.889s	user 0.004s	sys 0.002s
I20260709 13:18:53.817021  4046 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 14.
I20260709 13:18:53.032644  3969 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:18:53.756352  4119 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.001s	sys 0.017s
W20260709 13:18:53.689002  4121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.013s
W20260709 13:18:53.818153  4119 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.003s	sys 0.018s
I20260709 13:18:53.819339  4044 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:18:53.818643  4121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.020s
I20260709 13:18:53.817569  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 3478) took 1137 ms. Trace:
I20260709 13:18:53.400017  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3914) took 1631 ms. Trace:
I20260709 13:18:53.822072  4047 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:53.213619  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.068486  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.824393  4045 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:53.824957  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 3477) took 1146 ms. Trace:
I20260709 13:18:53.174839  3972 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:18:53.034358  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:53.818482  3966 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:53.199004 10925 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.819082  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.817404  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 3481) took 1093 ms. Trace:
I20260709 13:18:53.820492  4046 rpcz_store.cc:276] 0709 13:18:52.680611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.942738 (+262127us) service_pool.cc:224] Handling call
0709 13:18:53.817517 (+874779us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.888563 11092 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:52.884267 10940 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.936004 11074 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:53.886816  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:52.932296 11091 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:53.893286  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:52.970613 11116 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:53.854565  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.174813  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.872350  4116 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
W20260709 13:18:53.820308  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 848994us
I20260709 13:18:53.894443  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4193) took 1179 ms. Trace:
I20260709 13:18:53.083004  4042 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:53.871560  4038 rpcz_store.cc:276] 0709 13:18:52.724337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.962242 (+237905us) service_pool.cc:224] Handling call
0709 13:18:53.817343 (+855101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.855046  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:53.894459  3964 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:53.874791  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.875322  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4194) took 1147 ms. Trace:
I20260709 13:18:53.821954  4118 rpcz_store.cc:276] 0709 13:18:51.768431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.805293 (+1036862us) service_pool.cc:224] Handling call
0709 13:18:52.805585 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.154810 (+349225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:53.154845 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:53.154888 (+    43us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:53.154927 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:53.399756 (+244829us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400081e54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:53.399807 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.399949 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802586880}
I20260709 13:18:53.821415  3963 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
W20260709 13:18:53.837354  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 803010us
I20260709 13:18:53.893929  3969 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:53.813736  3868 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:53.825327  4045 rpcz_store.cc:276] 0709 13:18:52.679011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.068218 (+389207us) service_pool.cc:224] Handling call
0709 13:18:53.824893 (+756675us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:52.882449 11143 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:52.958559 11118 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.882793 11123 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:53.127708 11076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.009s	sys 0.029s
W20260709 13:18:53.756263 11113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.748s	user 0.018s	sys 0.020s
W20260709 13:18:53.175673 11158 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:18:53.831374  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 3474) took 1202 ms. Trace:
W20260709 13:18:53.193718 11157 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:18:53.305626 11025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.009s	sys 0.017s
I20260709 13:18:53.925840  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:53.926559  4045 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:18:52.872120 10969 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:52.836575 11145 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:53.885578 11060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.428s	user 0.047s	sys 0.086s
I20260709 13:18:53.887630  3970 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:53.874085  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4198) took 1082 ms. Trace:
I20260709 13:18:53.817931  4679 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:53.897539  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1209) took 1012 ms. Trace:
I20260709 13:18:53.198441 10931 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:52.911453 11012 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:53.934757  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.936017 11012 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:53.127422 11138 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:53.898880 11143 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:53.910646  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.911105  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.894737  3967 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:53.911501  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.913386  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.943235  4038 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:53.913740  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.910827 11135 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:53.913359  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:53.944218  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4199) took 1126 ms. Trace:
I20260709 13:18:53.944586  4038 rpcz_store.cc:276] 0709 13:18:52.817458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.910715 (+1093257us) service_pool.cc:224] Handling call
0709 13:18:53.944166 (+ 33451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.942334  4046 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:18:53.945513  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 741) took 1177 ms. Trace:
I20260709 13:18:53.945866  4046 rpcz_store.cc:276] 0709 13:18:52.767729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.910868 (+1143139us) service_pool.cc:224] Handling call
0709 13:18:53.945452 (+ 34584us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.918591 11123 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.895498  4044 rpcz_store.cc:276] 0709 13:18:52.715092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.948133 (+233041us) service_pool.cc:224] Handling call
0709 13:18:53.894382 (+946249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.897204  4047 rpcz_store.cc:276] 0709 13:18:52.727761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.965069 (+237308us) service_pool.cc:224] Handling call
0709 13:18:53.875264 (+910195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:53.899111  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44293.7us
I20260709 13:18:53.913524  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:53.916795  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:53.877302 11093 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:53.654665 11154 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:53.811532 11126 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:53.854478 11080 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:53.953712 11080 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:53.955958 11080 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:53.918478  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.920344  4041 rpcz_store.cc:276] 0709 13:18:52.629259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.925854 (+296595us) service_pool.cc:224] Handling call
0709 13:18:53.831300 (+905446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.956691  4118 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:53.957330  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.949256 11143 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:53.958473 11154 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:53.960307 11143 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:53.958053  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.961336  4118 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:53.892462  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.930716  3963 rpcz_store.cc:276] 0709 13:18:52.884878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.912009 (+ 27131us) service_pool.cc:224] Handling call
0709 13:18:53.897476 (+985467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.898775 11074 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:53.929736  4043 rpcz_store.cc:276] 0709 13:18:52.791666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.213304 (+421638us) service_pool.cc:224] Handling call
0709 13:18:53.874002 (+660698us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:53.917389 11076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.237s	user 0.033s	sys 0.079s
W20260709 13:18:53.921860 11113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.911s	user 0.019s	sys 0.021s
I20260709 13:18:53.972402  3967 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:18:53.894773 11148 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:53.900472 10940 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:53.966269  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:53.925881 11025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.922s	user 0.009s	sys 0.030s
I20260709 13:18:53.915247 11091 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:53.910622  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:53.941058  4113 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:53.943419  3964 raft_consensus.cc:2410] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:18:53.944696  4116 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 14: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:53.884372 10925 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:53.927580 10901 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:53.943868  3972 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 13.
I20260709 13:18:53.951748  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:53.937384 11060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.477s	user 0.047s	sys 0.087s
I20260709 13:18:53.984604  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.984797 11060 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:53.985102  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.949872  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1203) took 1319 ms. Trace:
I20260709 13:18:53.985447  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.963210  4112 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:18:53.964567  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.971153  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:53.960722 11154 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:53.938699  3966 raft_consensus.cc:2368] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:53.937546 11147 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:53.975809  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.987541  4046 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:53.986215  4116 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:53.958178  4041 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
I20260709 13:18:53.979997  4680 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:53.981228  3969 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:53.981323  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:53.983965  4045 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:53.917893 11116 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:53.974875 11021 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:53.991338  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:53.944268 11138 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:53.982336 11091 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:53.997905  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:53.986447 11080 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:53.977819 11074 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:53.952685 11093 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:53.986840  4043 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 14.
I20260709 13:18:54.029250  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.029932  4043 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:18:54.030763  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.031347  4043 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:53.989533  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4202) took 1081 ms. Trace:
I20260709 13:18:53.986500  4038 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:54.032383  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4203) took 1036 ms. Trace:
I20260709 13:18:54.032738  4038 rpcz_store.cc:276] 0709 13:18:52.995494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.984860 (+989366us) service_pool.cc:224] Handling call
0709 13:18:54.032314 (+ 47454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.988610  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 742) took 1220 ms. Trace:
I20260709 13:18:53.988185  3963 raft_consensus.cc:2368] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24.
I20260709 13:18:54.032112  4045 rpcz_store.cc:276] 0709 13:18:52.910571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.912109 (+1001538us) service_pool.cc:224] Handling call
0709 13:18:53.989473 (+ 77364us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:53.970074 11135 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.034438  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.035812  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.985644  3971 rpcz_store.cc:276] 0709 13:18:52.630767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.630976 (+   209us) service_pool.cc:224] Handling call
0709 13:18:52.639327 (+  8351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.639535 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.639557 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.662528 (+ 22971us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.775336 (+112808us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:52.775375 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.775445 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:53.949676 (+1174231us) raft_consensus.cc:1685] finished
0709 13:18:53.949696 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:53.949815 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":78923,"threads_started":1,"wal-append.queue_time_us":164823}
I20260709 13:18:53.999117  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.038261  3969 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:53.991441  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:53.978802  4087 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:54.039412  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 60713.7us
I20260709 13:18:54.040114  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.965159 11123 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.024405  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.025327 11092 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:53.985301 11060 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.026019  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:54.041478  4041 rpcz_store.cc:276] 0709 13:18:52.767981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.956994 (+1189013us) service_pool.cc:224] Handling call
0709 13:18:53.988554 (+ 31560us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.042304 10826 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:54.052353 10826 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.052737 10826 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:54.045074  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3472) took 1642 ms. Trace:
I20260709 13:18:54.042716  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.049270  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:53.991817 10901 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.013609 11076 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:53.984211 11143 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.031s
I20260709 13:18:54.058897  4118 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:53.997014 11154 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:54.053162  4045 rpcz_store.cc:276] 0709 13:18:52.402852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.044363 (+1641511us) service_pool.cc:224] Handling call
0709 13:18:54.044618 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.044790 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.044813 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.044850 (+    37us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:54.044890 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.044942 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.045025 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.016393 11080 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.055303  4041 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:54.055970  3963 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:53.983139 10940 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.014801 11091 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.047231 11092 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.076896  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:54.092437  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3475) took 1462 ms. Trace:
I20260709 13:18:54.096891  4041 rpcz_store.cc:276] 0709 13:18:52.636697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.052385 (+1415688us) service_pool.cc:224] Handling call
0709 13:18:54.052664 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.092150 (+ 39486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.092383 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.056936 11113 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:54.100808  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.059084 11076 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.099116  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:54.106201  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.089783 11154 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.090029 10969 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.048331 11093 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.093990 11080 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.102487 11092 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.134289 10826 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.133361  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4191) took 1944 ms. Trace:
I20260709 13:18:54.102844 11113 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.135581  4039 rpcz_store.cc:276] 0709 13:18:52.189204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.387691 (+198487us) service_pool.cc:224] Handling call
0709 13:18:52.966367 (+578676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.822908 (+856541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.133187 (+310279us) spinlock_profiling.cc:243] Waited 566 ms on lock 0x7b54000b8e50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:54.133303 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1300678016}
I20260709 13:18:54.136575  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:54.124854 11169 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:18:54.138217  4085 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:54.138474 11171 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:18:54.138923  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:54.139222 11167 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:18:54.141855 11060 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.146559 10940 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.147603 11116 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.149807  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.181306  3969 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:54.154343  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.125489 11154 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.156286  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.183583  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 3440) took 1397 ms. Trace:
I20260709 13:18:54.158723  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.159929 11069 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.161547 11123 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.104481 10954 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:18:54.110741 11076 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.073740 10901 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.164738  3972 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 12.
I20260709 13:18:54.170410  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 3435) took 1442 ms. Trace:
I20260709 13:18:54.137032  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 735) took 1415 ms. Trace:
I20260709 13:18:54.190858  4045 rpcz_store.cc:276] 0709 13:18:52.717827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.105902 (+1388075us) service_pool.cc:224] Handling call
0709 13:18:54.132285 (+ 26383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.132472 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.132498 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.132540 (+    42us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:18:54.132577 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.132627 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.132737 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:54.126464 11161 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:18:54.121884 11151 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.180408 10940 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:18:54.176720 10826 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:54.113577 10931 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:54.178184  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.176290  3963 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:54.182111  4047 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:54.183691  3967 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:54.181730 11087 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:18:54.169579 11113 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.184513  3970 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:54.194904 11126 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:54.157793  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.192085  4114 rpcz_store.cc:276] 0709 13:18:52.728354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.728476 (+   122us) service_pool.cc:224] Handling call
0709 13:18:52.742789 (+ 14313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.742995 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:52.908810 (+165815us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.167863 (+1259053us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b18003233e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec23a
0709 13:18:54.170085 (+  2222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.170134 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.170188 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.170252 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.170357 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56290,"prepare.queue_time_us":412053,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":60,"raft.queue_time_us":13475,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":13249792,"thread_start_us":381769,"threads_started":2,"wal-append.queue_time_us":1086557}
I20260709 13:18:54.210243  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.213254  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.184381  4119 rpcz_store.cc:276] 0709 13:18:52.786371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.787353 (+   982us) service_pool.cc:224] Handling call
0709 13:18:52.787639 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:52.787842 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:53.819077 (+1031235us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.182573 (+363496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.182620 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.182669 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.183423 (+   754us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.183529 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6226,"prepare.queue_time_us":654641,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"thread_start_us":1360544,"threads_started":2}
I20260709 13:18:54.182907 11060 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:54.269098 11060 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:54.269832 11060 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.245671  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:54.273548  4047 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:18:54.203657  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.203588  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.181691 11093 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.193039 10925 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.198596 10931 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.245625 11135 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.193976 11123 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.298386 10931 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:54.202090 11087 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.305169 11087 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:54.253798  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:54.309114  4039 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.256479  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1207) took 1556 ms. Trace:
I20260709 13:18:54.256865 11138 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.257148  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.313665 11138 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.313395 11123 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.314481 11138 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.316479 11123 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.189924 10954 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:54.320428 10954 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:18:54.322678 11145 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.323846  4040 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:18:54.324924 11060 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:54.325835  4040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4200) took 1488 ms (client timeout 1596 ms). Trace:
W20260709 13:18:54.326257  4040 rpcz_store.cc:269] 0709 13:18:52.837465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.967981 (+130516us) service_pool.cc:224] Handling call
0709 13:18:54.325643 (+1357662us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54000df054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:54.325748 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162970880}
I20260709 13:18:54.327162 11060 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:54.327806  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 736) took 1600 ms. Trace:
I20260709 13:18:54.264423 10901 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.299528  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.312987  3968 rpcz_store.cc:276] 0709 13:18:52.699922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.700216 (+   294us) service_pool.cc:224] Handling call
0709 13:18:52.700571 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:52.700930 (+   359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:52.700959 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:52.715859 (+ 14900us) log.cc:844] Serialized 26 byte log entry
0709 13:18:52.833306 (+117447us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:52.833344 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:52.833412 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:54.256260 (+1422848us) raft_consensus.cc:1685] finished
0709 13:18:54.256278 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.256419 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":528,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":5430,"thread_start_us":61817,"threads_started":1,"wal-append.queue_time_us":1125068}
I20260709 13:18:54.258220 11074 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:54.316666 11138 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.313362  4045 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:18:54.328181  4040 rpcz_store.cc:276] 0709 13:18:52.727288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.327017 (+1599729us) service_pool.cc:224] Handling call
0709 13:18:54.327322 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.327503 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.327527 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.327569 (+    42us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:18:54.327605 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.327653 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.327756 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.201010 11151 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.318598 11092 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.334887  4039 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:54.331905  4047 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:54.304219 11076 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.338078  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 738) took 1601 ms. Trace:
I20260709 13:18:54.338442  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4195) took 1600 ms. Trace:
I20260709 13:18:54.337102  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 737) took 1606 ms. Trace:
I20260709 13:18:54.297390 11175 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.356616  4040 rpcz_store.cc:276] 0709 13:18:52.730420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.336040 (+1605620us) service_pool.cc:224] Handling call
0709 13:18:54.336517 (+   477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.336706 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.336821 (+   115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.336870 (+    49us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.336910 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.336964 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.337053 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.355973  4039 rpcz_store.cc:276] 0709 13:18:52.737164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.337257 (+1600093us) service_pool.cc:224] Handling call
0709 13:18:54.337575 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.337799 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.337821 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.337856 (+    35us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.337884 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.337932 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.338016 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.374802  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4196) took 1630 ms. Trace:
I20260709 13:18:54.355933  4047 rpcz_store.cc:276] 0709 13:18:52.737821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.337743 (+1599922us) service_pool.cc:224] Handling call
0709 13:18:54.337988 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.338154 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.338178 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.338216 (+    38us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:18:54.338252 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.338300 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.338389 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.376538  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 740) took 1609 ms. Trace:
I20260709 13:18:54.381809  4040 rpcz_store.cc:276] 0709 13:18:52.767424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.375759 (+1608335us) service_pool.cc:224] Handling call
0709 13:18:54.376067 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.376242 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.376266 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.376306 (+    40us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:54.376336 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.376393 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.376481 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:54.389633  4011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.012s	sys 0.028s
W20260709 13:18:54.391851  4011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.012s	sys 0.028s
W20260709 13:18:54.407337  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.005s
W20260709 13:18:54.408555  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.006s	sys 0.005s
I20260709 13:18:54.340215 11145 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.419072  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:54.408980  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 508697us
I20260709 13:18:54.421579  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:54.422420  4115 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.024s	sys 0.023s
I20260709 13:18:54.420954  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:54.436228  4115 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.010s	user 0.024s	sys 0.023s
I20260709 13:18:54.436509  3970 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:18:54.438489  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.440975  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 743) took 1672 ms. Trace:
I20260709 13:18:54.441390  4047 rpcz_store.cc:276] 0709 13:18:52.768217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.381605 (+1613388us) service_pool.cc:224] Handling call
0709 13:18:54.440421 (+ 58816us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.440610 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.440637 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.440679 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.440720 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.440790 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.440916 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.439105  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 744) took 1670 ms. Trace:
I20260709 13:18:54.442741  4040 rpcz_store.cc:276] 0709 13:18:52.768451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.383964 (+1615513us) service_pool.cc:224] Handling call
0709 13:18:54.438448 (+ 54484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.438764 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.438792 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.438836 (+    44us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:54.438886 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.438941 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.439045 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.444640  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.448555  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.436391  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:54.312074 11154 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:54.456540  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.457757  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.459051  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.460980  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:54.457229  3970 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:54.433933 11060 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:54.433477 11074 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.433722 10901 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.342615 11151 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.462224  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.451174 11174 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:54.466892  4013 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.044s	sys 0.017s
I20260709 13:18:54.359707 11175 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.390908 11091 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.471973  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4197) took 1684 ms. Trace:
I20260709 13:18:54.478717  4047 rpcz_store.cc:276] 0709 13:18:52.787856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.463851 (+1675995us) service_pool.cc:224] Handling call
0709 13:18:54.471461 (+  7610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.471644 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.471668 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.471706 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.471741 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.471792 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.471911 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:18:54.475046  4013 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.045s	sys 0.018s
I20260709 13:18:54.459847 10925 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:54.475304  4648 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.004s	sys 0.011s
W20260709 13:18:54.485313  4648 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.004s	sys 0.012s
I20260709 13:18:54.465699  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:54.488562  3968 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
W20260709 13:18:54.511101  4084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.012s
W20260709 13:18:54.511555  4084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.012s
I20260709 13:18:54.513087  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4201) took 1635 ms. Trace:
I20260709 13:18:54.513549  4047 rpcz_store.cc:276] 0709 13:18:52.877762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.479668 (+1601906us) service_pool.cc:224] Handling call
0709 13:18:54.512523 (+ 32855us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.512720 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.512746 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.512815 (+    69us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:18:54.512857 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.512908 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.513014 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:54.514796  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.515813  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:54.517426 11176 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260709 13:18:54.518460  4042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 3480) took 1801 ms (client timeout 1625 ms). Trace:
W20260709 13:18:54.518862  4042 rpcz_store.cc:269] 0709 13:18:52.717041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.825848 (+108807us) service_pool.cc:224] Handling call
0709 13:18:54.518281 (+1692433us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540035c5d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:54.518383 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588817792}
I20260709 13:18:54.504079  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 3448) took 1495 ms. Trace:
W20260709 13:18:54.475630  4649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.015s
W20260709 13:18:54.526088  4649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.000s	sys 0.015s
W20260709 13:18:54.526418  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 628256us
I20260709 13:18:54.469663 11074 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.521289  4121 rpcz_store.cc:276] 0709 13:18:53.008281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.008421 (+   140us) service_pool.cc:224] Handling call
0709 13:18:53.125982 (+117561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.126227 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:18:54.148798 (+1022571us) spinlock_profiling.cc:243] Waited 34.6 ms on lock 0x7b18004338a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed75ff44bc 00007fed7334248b 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335c455 00007fed79e443c7 00007fed764569a7 00007fed764660bf
0709 13:18:54.148987 (+   189us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.503703 (+354716us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.503765 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.503814 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.503894 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.504023 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28882,"prepare.queue_time_us":316416,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5125,"raft.queue_time_us":19634,"spinlock_wait_cycles":79499136,"thread_start_us":982223,"threads_started":2}
W20260709 13:18:54.536595  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 398411us
W20260709 13:18:54.538371  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72741.8us
I20260709 13:18:54.539177  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:54.536168  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:54.469143 11060 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:54.472981 10901 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:54.542137  3868 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.000s	sys 0.018s
I20260709 13:18:54.540253  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:18:54.555528  3868 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.000s	sys 0.018s
I20260709 13:18:54.536213 11145 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.478363 11174 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:54.573621  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 46598.3us
I20260709 13:18:54.547936 11155 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.547330 10969 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:54.577026  4650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.015s
I20260709 13:18:54.553821 10891 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:18:54.578706  4650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.003s	sys 0.015s
W20260709 13:18:54.569533  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 373296us
I20260709 13:18:54.581983  3938 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:54.583441  3938 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:54.584460  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.565069 11143 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:54.586644  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.586880  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.587359 10826 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:54.585120  4682 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:54.591836  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:54.595177 10826 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.587266  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 3449) took 1431 ms. Trace:
I20260709 13:18:54.566663 11138 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.601234  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.602011  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.604012  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.604300  4677 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:18:54.607683  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:54.604511  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.614914  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.615536  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:54.616070  4679 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:54.576655 11135 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:54.615770  4121 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:18:54.615227  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:54.547111 11113 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:54.620504  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.580936 10891 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.585654 11092 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:54.593873 11123 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.640472  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.638499  3971 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:18:54.638940 10826 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.637948  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3470) took 2235 ms. Trace:
I20260709 13:18:54.599776 11126 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:54.641546 11126 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.641319  4116 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:18:54.640630  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.642606  4043 rpcz_store.cc:276] 0709 13:18:52.402407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.043291 (+1640884us) service_pool.cc:224] Handling call
0709 13:18:54.043568 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.043758 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:18:54.434144 (+390386us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.637375 (+203231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.637480 (+   105us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.637556 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.637668 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.637865 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":197049,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":1819,"thread_start_us":565305,"threads_started":2}
I20260709 13:18:54.644183  4120 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:54.645002  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.616410 11180 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.648191  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.646508  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3471) took 2243 ms. Trace:
I20260709 13:18:54.620337 11096 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.649880 10826 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:18:54.661880 10826 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.662222 10826 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.585757 11155 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.592752 10969 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.622812 11135 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.593849 11116 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:18:54.679284  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.681455  4681 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:54.621348 11170 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:54.635937 10891 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:54.663434  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55832us
I20260709 13:18:54.625666 11063 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.637205 11147 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:18:54.702313  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87122.8us
I20260709 13:18:54.659648  4038 rpcz_store.cc:276] 0709 13:18:52.402628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.046537 (+1643909us) service_pool.cc:224] Handling call
0709 13:18:54.068366 (+ 21829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.068628 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:54.552644 (+484016us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.646143 (+ 93499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.646203 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:54.646261 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.646331 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.646447 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":172362,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":541760,"threads_started":2}
I20260709 13:18:54.674772  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.676712  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.658264 11126 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:18:54.678323  4113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 3444) took 1852 ms (client timeout 1586 ms). Trace:
W20260709 13:18:54.704248  4113 rpcz_store.cc:269] 0709 13:18:52.825601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.825708 (+   107us) service_pool.cc:224] Handling call
0709 13:18:54.678092 (+1852384us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002ac6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:54.678221 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2562020224}
I20260709 13:18:54.641152 11123 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:54.679939 10969 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:54.684935  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 13:18:54.697716  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.700668  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:54.705240 11123 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.706733  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:54.720077  4112 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 25: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:54.721237  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:54.722386  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:54.717381  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.623237 11138 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.648962 11148 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:54.723960  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:54.725059  4013 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:54.731513  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:54.661680 11096 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.725061  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.741581  4681 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:18:54.664044 11154 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.744890  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.680893 11135 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:54.719127 11185 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:18:54.752454  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.716974 11147 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:18:54.729442  4649 connection.cc:256] RPC call timeout handler was delayed by -1.2697689850001552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 13:18:54.701697 11076 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.761905  3969 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:18:54.755824  3967 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:54.729795 10969 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.766259 10826 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.730585 11151 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:54.777868  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4074) took 1804 ms. Trace:
I20260709 13:18:54.729142 11092 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:54.740504 11179 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.748248 11091 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.730858 11148 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.747855 11096 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.785249  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3716) took 1746 ms. Trace:
I20260709 13:18:54.784585  4679 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:54.772871  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:54.747721 11132 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:54.664937 11180 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.778285  3965 rpcz_store.cc:276] 0709 13:18:52.973736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.977786 (+  4050us) service_pool.cc:224] Handling call
0709 13:18:52.978152 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.026480 (+1048328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.026515 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.026557 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:54.026596 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.777638 (+751042us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001c9654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:54.777684 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.777808 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2410414848}
I20260709 13:18:54.756574 11184 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:54.744746 11069 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.793249  3968 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
W20260709 13:18:54.795888  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 185464us
I20260709 13:18:54.824747  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:54.797165  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 281412us
I20260709 13:18:54.774812 11143 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:54.808998  3966 rpcz_store.cc:276] 0709 13:18:53.038635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.874523 (+835888us) service_pool.cc:224] Handling call
0709 13:18:54.785035 (+910512us) spinlock_profiling.cc:243] Waited 41.5 ms on lock 0x7b5400408dd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:54.785190 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95479552}
I20260709 13:18:54.829561  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:54.827162  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 230941us
I20260709 13:18:54.815570  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:54.830147  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 111891us
I20260709 13:18:54.768836 11195 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:54.817961  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45271.6us
I20260709 13:18:54.833971  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:54.769348 10969 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:54.832243  4011 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:18:54.821116  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 87121us
I20260709 13:18:54.786402 11131 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.759549 11154 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:54.814054 11132 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:54.824234  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:54.813038 10826 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.828018  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.823551 11184 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.766268 11175 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.830147  3966 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:54.831606  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.828405  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:54.778899 11186 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:18:54.845067  3965 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:54.808652 11148 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:54.843757 10969 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.824846 11113 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.868783  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:54.869422  3971 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:54.849107  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:54.833495 11190 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:18:54.853929  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:54.856805  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:54.843686 11116 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:54.810807 11179 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:54.848428 11087 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:18:54.861692  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:54.827206 11138 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.847543 11093 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:54.863530 10826 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:54.847473 11132 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:54.853061 11074 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.827101 11069 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.886570  3966 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:54.885455  3968 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:54.850448 11184 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:54.861588 11025 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:18:54.890290  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46909.3us
I20260709 13:18:54.859977 10901 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:54.871765 11080 consensus_meta.cc:287] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
I20260709 13:18:54.870321 11118 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:54.895817 11209 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:54.912966 11192 log.cc:927] Time spent T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:18:54.908874  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:54.888628 11181 raft_consensus.cc:2764] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:18:54.894076 11151 raft_consensus.cc:2764] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:54.890793 11116 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:54.949399 11116 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:54.950805 11179 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.848073 11131 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.954418 11131 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:54.846028 11195 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:54.957340  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.958122  4113 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:54.907042 11197 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:18:54.879719 11143 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.919907  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:54.902884 11174 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.916524 11155 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:54.916663 10931 consensus_meta.cc:287] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.003s
I20260709 13:18:54.380342  4039 rpcz_store.cc:276] 0709 13:18:52.744984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.373738 (+1628754us) service_pool.cc:224] Handling call
0709 13:18:54.374092 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.374444 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.374474 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.374519 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:54.374550 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.374607 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.374740 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101}
I20260709 13:18:54.931752  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.932260  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.933241  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:54.912431 11025 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:54.937754  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:54.938817 11212 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:54.896437  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62541.3us
I20260709 13:18:54.940233  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.941598  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.942907  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:54.956779 11195 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:54.918257 11170 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:54.966354  4011 leader_election.cc:400] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24.
I20260709 13:18:54.969811  4675 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:18:54.970863  3971 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
W20260709 13:18:54.963408 11201 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:18:54.907486 11138 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:54.903134 11087 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:54.972257  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.099929  4038 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:54.924578 11080 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.301597  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.302614  4118 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
W20260709 13:18:54.930388 11198 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
W20260709 13:18:55.080031  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58791.4us
I20260709 13:18:55.100857  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.100790  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:54.949417 11199 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:55.142771  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4097) took 1096 ms. Trace:
I20260709 13:18:55.303092  4011 leader_election.cc:403] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.106081  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.101282  4044 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 21: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:55.303473  4047 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:55.213501  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 321837us
I20260709 13:18:55.329015  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.308936  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.002425 11123 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.304141 11170 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:55.333334  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3482) took 2606 ms. Trace:
I20260709 13:18:54.974629 11135 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.333761  4045 rpcz_store.cc:276] 0709 13:18:52.727455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.335276 (+1607821us) service_pool.cc:224] Handling call
0709 13:18:54.343066 (+  7790us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.343289 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.343314 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.359461 (+ 16147us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.686450 (+326989us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:54.686490 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.686558 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.333122 (+646564us) raft_consensus.cc:1685] finished
0709 13:18:55.333142 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.333276 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":235937,"threads_started":1,"wal-append.queue_time_us":405916}
I20260709 13:18:55.101266 11087 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:55.098708 11203 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:18:55.335877  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.327250 11025 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:55.338207  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.334143  3969 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.334012 11123 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:55.338256  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.341061  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.342123 11087 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.343544  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3486) took 1223 ms. Trace:
I20260709 13:18:55.343079  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.343966  4040 rpcz_store.cc:276] 0709 13:18:54.120228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.517839 (+397611us) service_pool.cc:224] Handling call
0709 13:18:54.518145 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.593195 (+ 75050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.593225 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.593264 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.593318 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.343330 (+750012us) spinlock_profiling.cc:243] Waited 74.8 ms on lock 0x7b540041c154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:55.343377 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.343494 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172131200}
W20260709 13:18:55.003675 11210 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 13:18:55.334949  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 376418us
I20260709 13:18:55.345211  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.345989  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:55.341630  4038 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
W20260709 13:18:55.328951 11215 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:18:55.346196  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3473) took 2717 ms. Trace:
I20260709 13:18:55.347492  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.348201  4038 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:18:55.347352  4046 rpcz_store.cc:276] 0709 13:18:52.628997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.039534 (+1410537us) service_pool.cc:224] Handling call
0709 13:18:54.667014 (+627480us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:54.667203 (+   189us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.667535 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.667562 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.668010 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.787213 (+119203us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:18:54.787263 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.787329 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.345917 (+558588us) raft_consensus.cc:1685] finished
0709 13:18:55.345938 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.346141 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50317,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":16559,"spinlock_wait_cycles":5238656,"thread_start_us":106915,"threads_started":1,"wal-append.queue_time_us":160488}
I20260709 13:18:55.349980  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:18:55.351506 10891 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.000s
I20260709 13:18:55.351918 10891 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.353016  4013 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.328275 10931 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.353871 11063 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:55.354058  3963 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:55.354390 11063 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:55.354821 11063 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:55.355679 10931 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.596325  4115 rpcz_store.cc:276] 0709 13:18:53.156197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:53.156856 (+   659us) service_pool.cc:224] Handling call
0709 13:18:53.157465 (+   609us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:53.157743 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:54.436650 (+1278907us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.586817 (+150167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.586895 (+    78us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:54.586976 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.587093 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:54.587214 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157781,"prepare.queue_time_us":306130,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":6689,"thread_start_us":1159848,"threads_started":2}
I20260709 13:18:55.341593 11080 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:55.364966  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.365688  3969 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:55.366381  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.362548 11063 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.367873 11060 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:55.376150  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.376803  4684 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:55.376847  3970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:18:55.377602  3970 raft_consensus.cc:606] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Received request to transfer leadership to TS 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:55.211107 10969 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.367434  4045 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:55.381541 11060 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:55.387209 11116 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.009692 11180 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:55.380067 11138 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24.
I20260709 13:18:55.345021 11135 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:55.341411  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 235391us
I20260709 13:18:55.380797  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:55.445402  4115 raft_consensus.cc:606] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.445796  4115 raft_consensus.cc:614] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:18:54.969173 11151 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.367s
I20260709 13:18:55.387655 11060 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:55.345261  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:55.333467 11170 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:55.388402  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3488) took 1255 ms. Trace:
W20260709 13:18:55.388727 11096 consensus_meta.cc:287] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
W20260709 13:18:55.361271 11126 consensus_meta.cc:287] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.000s
I20260709 13:18:55.393953  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:55.394318 10969 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:55.395498 11063 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:55.369630  4038 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:18:55.399547  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:55.481407  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.481921  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:55.402172 11025 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.402103  4684 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:55.404981  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.408738  4045 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:18:55.482465  3971 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:55.409302  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.409528  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:55.408447  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:55.455556 11213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.028s	sys 0.000s
I20260709 13:18:55.411461  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.411928  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:55.410879  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.497324  4681 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:55.415632 10891 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:55.417707  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.418831  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.499367  4114 raft_consensus.cc:2393] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:55.419549  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.381981  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:55.419602  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:55.422374 11147 consensus_meta.cc:287] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.001s
I20260709 13:18:55.508071 11147 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.508946  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.377920 11184 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.427126 11132 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.427471  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:55.428697  4043 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:55.471647 11131 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:55.432291  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:55.433980  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.435883  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.316946  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.525588  4039 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:55.440033  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.526430  4116 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.440692  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.448359  4041 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
W20260709 13:18:55.147302 11145 consensus_meta.cc:287] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.001s
W20260709 13:18:55.138741 10954 consensus_meta.cc:287] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.003s
I20260709 13:18:55.531760 10954 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.532886  3963 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:55.528398  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.537063  4039 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:55.538754 10954 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:55.539397 11145 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:55.540057  4046 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.440073  3964 rpcz_store.cc:276] 0709 13:18:54.046333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.046482 (+   149us) service_pool.cc:224] Handling call
0709 13:18:54.046768 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:54.046982 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:54.047004 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:54.050402 (+  3398us) log.cc:844] Serialized 26 byte log entry
0709 13:18:54.557455 (+507053us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:54.557495 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:54.557556 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:55.142538 (+584982us) raft_consensus.cc:1685] finished
0709 13:18:55.142562 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.142707 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":445960,"threads_started":1,"wal-append.queue_time_us":535057}
I20260709 13:18:55.458225  4040 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:55.458573  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.542271  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.543438  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.544585  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:55.383729 11148 consensus_meta.cc:287] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.000s
I20260709 13:18:55.545694 11148 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.547747 11148 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:55.142155 11202 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:18:55.548774  4121 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:55.475291  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:18:55.549743  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 74540.7us
I20260709 13:18:55.550604  4046 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:55.537379  4041 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.148525 11069 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:54.958906 11118 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.472908  4042 rpcz_store.cc:276] 0709 13:18:54.133055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.519660 (+386605us) service_pool.cc:224] Handling call
0709 13:18:54.519927 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:54.575478 (+ 55551us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:54.577319 (+  1841us) log.cc:844] Serialized 14 byte log entry
0709 13:18:54.793719 (+216400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:54.793777 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:54.793836 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.387223 (+593387us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b180005e2a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7332d2a6 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419
0709 13:18:55.388209 (+   986us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54000cab54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:55.388254 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:55.388352 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4200,"prepare.queue_time_us":1949,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6311,"raft.queue_time_us":2830,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":17319,"spinlock_wait_cycles":144135424,"thread_start_us":213248,"threads_started":1,"wal-append.queue_time_us":324032}
W20260709 13:18:55.401679  3937 connection.cc:256] RPC call timeout handler was delayed by -1.2054490719999649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:18:55.554167  3937 connection.cc:256] RPC call timeout handler was delayed by -1.1478490720000991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16890000000000002s for a response
I20260709 13:18:55.410885  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:55.555210 11135 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:55.555430  3969 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 22.
I20260709 13:18:55.488375  4679 raft_consensus.cc:1240] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:55.548523  3963 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 15.
I20260709 13:18:55.481937  4038 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:55.490140  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85234.6us
I20260709 13:18:55.500344  4113 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:18:55.500844  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.499703 10901 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:55.505985  4119 raft_consensus.cc:2393] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:55.507423  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.565901  4114 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 15.
I20260709 13:18:55.545192  4115 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:55.559741  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.566857  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:55.515978  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 134056us
I20260709 13:18:55.568131  4044 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:55.516796  3971 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:55.520732  4676 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:18:55.471472 11060 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:55.522089  4648 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:55.471894 10977 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:55.527724 10969 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:18:55.576475 10977 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.576982 10969 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:55.577805 10969 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:55.578787 10977 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:55.521169 11063 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:18:55.523986  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 96628.7us
I20260709 13:18:55.430949  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:55.528532  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:55.586009  4043 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:55.527081  4117 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:18:55.498193 11213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.029s	sys 0.000s
I20260709 13:18:55.489244  4013 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.505545  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.312485 11212 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.564438  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.564863  4681 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:55.567770  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.568490  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:55.569767  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54802.3us
I20260709 13:18:55.570829  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.592825  4114 raft_consensus.cc:2368] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:55.571852  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.573246  4038 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:55.575047  4041 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:18:55.594656  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.590178  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.597369  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.597996  4118 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:55.598970 11212 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:55.599568 11074 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:55.600047  4118 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:18:55.601452  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:55.602005 11132 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:55.602567  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:18:55.603853  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:55.605185  4115 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:55.606312  4114 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: []
I20260709 13:18:55.606935  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:55.597481  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 108312us
I20260709 13:18:55.481045 11096 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.619285 11096 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:55.620110  4682 raft_consensus.cc:2368] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:55.491385 11126 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.600049 11074 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:55.623325 11126 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:55.623006 11074 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.624007  3972 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:18:55.602890 11151 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:18:55.614416  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.626221  4114 raft_consensus.cc:2368] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20.
I20260709 13:18:55.603998 11063 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:18:55.621187 11145 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:55.561443 11131 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.527527 11147 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:55.629757  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:55.562945 11135 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:55.633073  4043 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:55.590879 11069 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.565461 10901 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:55.653031  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.637554  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.630582  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:55.652115  4114 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
W20260709 13:18:55.653151  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 58605.7us
I20260709 13:18:55.649097  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:55.639430  4118 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:55.656260  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.626230 11132 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:55.635980 11063 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:55.636220 11145 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:55.667022  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.634552 11151 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:55.663370  4117 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:18:55.674109  3870 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 19 to 20, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.654287 11135 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:55.645807 11174 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:55.657914 10901 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:55.672000  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:55.663887 11175 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:55.671084  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:55.679513  3870 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 16 to 17, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.683691  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.643793 11186 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:55.683033  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.687060  3870 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 24 to 25, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 25 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.689744  3870 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 14 to 15, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 15 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:18:55.716619  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45615.6us
I20260709 13:18:55.692030  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.717674  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.805233  4118 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:18:55.779548  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.677249 11151 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:55.681493 10925 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:55.677409 11145 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:55.671398 11063 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:55.784551  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3928) took 1196 ms. Trace:
I20260709 13:18:55.812395  4121 rpcz_store.cc:276] 0709 13:18:54.587836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.629575 (+ 41739us) service_pool.cc:224] Handling call
0709 13:18:55.784310 (+1154735us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b5400081954. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:55.784476 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045232384}
I20260709 13:18:55.715490 11143 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:18:55.785240  4113 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:18:55.785444  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51352 (request call id 708) took 1062 ms. Trace:
I20260709 13:18:55.787838  3869 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.717093 10891 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:55.682169 11132 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.791005 11080 consensus_queue.cc:1059] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:18:55.797559  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 264) took 4905 ms. Trace:
I20260709 13:18:55.798321  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 270) took 2972 ms. Trace:
I20260709 13:18:55.677085 10977 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:55.806196  4117 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:55.806231  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.821666  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.822083  4114 raft_consensus.cc:2410] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:55.808133 11177 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:55.814394  4682 rpcz_store.cc:276] 0709 13:18:54.723520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.723713 (+   193us) service_pool.cc:224] Handling call
0709 13:18:55.785254 (+1061541us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54008da254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:55.785389 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2043796352}
I20260709 13:18:55.815632 11180 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:55.813617 10925 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:55.781069 11186 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:55.833896  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.816615  3869 catalog_manager.cc:5697] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:18:55.820220 10891 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:55.685065 11174 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.828346  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.860220  4118 raft_consensus.cc:2368] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24.
W20260709 13:18:55.830670  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 275990us
W20260709 13:18:55.814936  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 122983us
I20260709 13:18:55.861696  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.782402  3870 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 19 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.865007  3870 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 16 to 17, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 17 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:18:55.869568  4013 leader_election.cc:400] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:55.870501  4013 leader_election.cc:403] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:18:55.822938 11025 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:55.831780 11212 raft_consensus.cc:3055] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:55.832360 11116 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:55.881623  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.881866  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:55.864307  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.871361  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:55.879899  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.884841  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.825690 11177 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:55.881265  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:55.883268  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 270113us
I20260709 13:18:55.841987 11186 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:55.841749 10925 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:55.882936  4118 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:55.856185 11184 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:55.889127  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.818162  3867 rpcz_store.cc:276] 0709 13:18:50.891855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:50.892123 (+   268us) service_pool.cc:224] Handling call
0709 13:18:55.797469 (+4905346us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:52.041262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:52.157395 (+116133us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:52.159355 (+  1960us) write_op.cc:435] Acquired schema lock
0709 13:18:52.161251 (+  1896us) tablet.cc:662] Decoding operations
0709 13:18:52.291924 (+130673us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:52.296230 (+  4306us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:52.322556 (+ 26326us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:52.322784 (+   228us) tablet.cc:701] Row locks acquired
0709 13:18:52.322801 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:18:52.322945 (+   144us) write_op.cc:270] Start()
0709 13:18:52.323058 (+   113us) write_op.cc:276] Timestamp: P: 1783603132322896 usec, L: 0
0709 13:18:52.323079 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:18:52.323768 (+   689us) log.cc:844] Serialized 599 byte log entry
0709 13:18:54.049892 (+1726124us) op_driver.cc:464] REPLICATION: finished
0709 13:18:54.798241 (+748349us) write_op.cc:301] APPLY: starting
0709 13:18:54.810316 (+ 12075us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:54.973475 (+163159us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:54.973565 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:54.974368 (+   803us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:54.974561 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:54.974618 (+    57us) write_op.cc:312] APPLY: finished
0709 13:18:54.974809 (+   191us) log.cc:844] Serialized 25 byte log entry
0709 13:18:55.339477 (+364668us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b54000ab754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644932a 00007fed763cef14 00007fed763ceec3 00007fed763cee38 00007fed763cedf3 00007fed763ce0dc 00007fed763f7e16 00007fed763dfcbb 00007fed763ca39d 00007fed763cdd75
0709 13:18:55.480884 (+141407us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.501239 (+ 20355us) write_op.cc:454] Released schema lock
0709 13:18:55.516802 (+ 15563us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:55.614737 (+ 97935us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.626676 (+ 11939us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":236671,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":703258,"apply.run_cpu_time_us":65768,"apply.run_wall_time_us":787721,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8321,"num_ops":1,"prepare.queue_time_us":128525,"prepare.run_cpu_time_us":29172,"prepare.run_wall_time_us":370081,"raft.queue_time_us":1215299,"raft.run_cpu_time_us":23670,"raft.run_wall_time_us":1350936,"replication_time_us":1689930,"spinlock_wait_cycles":9336064,"thread_start_us":1308091,"threads_started":5,"wal-append.queue_time_us":930778,"wal-append.run_cpu_time_us":32159,"wal-append.run_wall_time_us":1464496}]]}
I20260709 13:18:55.901132 11089 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:18:55.906441 11089 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:55.878276 11180 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:55.878039 11212 raft_consensus.cc:740] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:55.907886 11089 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.907965 11212 consensus_queue.cc:260] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.891428  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.891065  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.818348  3868 rpcz_store.cc:276] 0709 13:18:52.825673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.832021 (+  6348us) service_pool.cc:224] Handling call
0709 13:18:55.798228 (+2966207us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:54.745122 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:54.863899 (+118777us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:54.868191 (+  4292us) write_op.cc:435] Acquired schema lock
0709 13:18:54.872815 (+  4624us) tablet.cc:662] Decoding operations
0709 13:18:54.915510 (+ 42695us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:54.918219 (+  2709us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:54.923340 (+  5121us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:18:54.975596 (+ 52256us) tablet.cc:701] Row locks acquired
0709 13:18:55.001672 (+ 26076us) write_op.cc:260] PREPARE: finished
0709 13:18:55.079449 (+ 77777us) write_op.cc:270] Start()
0709 13:18:55.130529 (+ 51080us) write_op.cc:276] Timestamp: P: 1783603135038542 usec, L: 0
0709 13:18:55.134837 (+  4308us) op_driver.cc:348] REPLICATION: starting
0709 13:18:55.268168 (+133331us) log.cc:844] Serialized 541 byte log entry
0709 13:18:55.786444 (+518276us) op_driver.cc:464] REPLICATION: finished
0709 13:18:55.792982 (+  6538us) write_op.cc:301] APPLY: starting
0709 13:18:55.793177 (+   195us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:55.794066 (+   889us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:55.794160 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:55.794831 (+   671us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:55.794998 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:18:55.795042 (+    44us) write_op.cc:312] APPLY: finished
0709 13:18:55.795231 (+   189us) log.cc:844] Serialized 25 byte log entry
0709 13:18:55.795400 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.795475 (+    75us) write_op.cc:454] Released schema lock
0709 13:18:55.795511 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:55.795875 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:55.795901 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":6311,"apply.run_cpu_time_us":2876,"apply.run_wall_time_us":2875,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4194,"num_ops":1,"prepare.queue_time_us":737014,"prepare.run_cpu_time_us":4549,"prepare.run_wall_time_us":566905,"replication_time_us":651459,"thread_start_us":628177,"threads_started":1}]]}
I20260709 13:18:55.918251  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.919018  4118 raft_consensus.cc:2368] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:18:55.896337  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:55.903708  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:55.920197  3964 raft_consensus.cc:2393] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:55.913193 10891 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:55.922199  4116 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:18:55.922801  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.922411  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.923987  4117 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:55.900151 11177 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:55.861186 11060 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:55.888746 11126 raft_consensus.cc:2764] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
W20260709 13:18:55.945749  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 289541us
I20260709 13:18:55.899089 11175 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407) with higher term. Message: Invalid argument: T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:55.953105  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:55.874882 11223 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:18:55.901240 11025 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:55.933668 11116 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:55.938359  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.932780 11148 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:55.946974 11138 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:55.999440  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:55.986814 11131 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:55.998102 11155 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.010878  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:55.998620 11116 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:56.015995  4117 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:56.004940 11213 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.008697 11175 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:18:56.028407  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 132162us
I20260709 13:18:56.031486  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.037360  4085 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:56.035415  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 254271us
I20260709 13:18:56.019431 11184 raft_consensus.cc:2764] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:18:56.060345  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:56.036829 11232 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:18:56.030670 11180 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.007913 11186 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.030903 11132 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:56.035718 11118 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.084208  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:56.085402  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48117.3us
I20260709 13:18:56.105656  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.080545 11155 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.113718  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.029307 11213 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.117934  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 183568us
I20260709 13:18:56.034957 11175 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.037580 11089 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.077s
I20260709 13:18:56.149861  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:18:56.129323  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 119171us
I20260709 13:18:56.160380  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4117) took 1196 ms. Trace:
I20260709 13:18:56.160823  3966 rpcz_store.cc:276] 0709 13:18:54.964044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.391172 (+427128us) service_pool.cc:224] Handling call
0709 13:18:55.391460 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.391832 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.391867 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.392291 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:18:55.666039 (+273748us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:18:55.666080 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:55.666156 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.160171 (+494015us) raft_consensus.cc:1685] finished
0709 13:18:56.160190 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:56.160320 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32612,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":129,"thread_start_us":273364,"threads_started":1,"wal-append.queue_time_us":457139}
I20260709 13:18:56.116101 11132 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:56.165575  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:56.160202  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.115868 11216 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:56.164091  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50447.1us
I20260709 13:18:56.115336 11174 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.147480 11155 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:56.159544 11060 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.174177  4682 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 13:18:56.172937  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 67367.2us
I20260709 13:18:56.163877 11025 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:56.190493 11252 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:18:56.192229 11252 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:56.193500 11236 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 13:18:56.195505 11239 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:18:56.196179 11253 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:56.196913 11253 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.197835 11253 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.117502 11116 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:56.241926  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:56.207891 11118 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:56.176532 11216 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.213732 11131 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:18:56.253181 11074 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.176889 11180 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.185674 11241 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:18:56.188279 11260 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:18:56.261497  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 93135.2us
I20260709 13:18:56.275309  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:56.278632  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 107285us
I20260709 13:18:56.281090  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.281742  4047 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:56.255673 11132 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:18:56.287065  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 333995us
I20260709 13:18:56.255797 11118 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:56.294677  4682 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:18:56.295212  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:56.290004  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78645.7us
I20260709 13:18:56.252295 11174 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.293895  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.300027  4011 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
W20260709 13:18:56.300833  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 123662us
I20260709 13:18:56.303431  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.305390  4044 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:18:56.308548  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.278334 11145 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.308537  4047 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:56.299214 11118 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:56.258077 11250 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:18:56.301445 11131 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:56.324970  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 155447us
I20260709 13:18:56.326189  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.300645  4011 leader_election.cc:403] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:18:56.341698  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46937.3us
I20260709 13:18:56.342693  4011 leader_election.cc:400] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:56.343022  4011 leader_election.cc:403] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:18:56.344061  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.288146 11074 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:56.312704 11251 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 13:18:56.349484  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:56.349512 10901 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.005s
I20260709 13:18:56.328307 11155 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:18:56.356822  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.305702 11174 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.288705 11025 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.316148 11260 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.357064  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.371773 11178 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.011s
W20260709 13:18:56.384114 10969 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.806s	user 0.013s	sys 0.000s
I20260709 13:18:56.383738 11260 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.384548 10969 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.386600 10969 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:56.387449  4115 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
W20260709 13:18:56.395900  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49512.4us
W20260709 13:18:56.400101  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 85980.3us
I20260709 13:18:56.346923 11175 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.347398 11258 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:18:56.351920 10901 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.415016  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51863.9us
I20260709 13:18:56.419683  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.389722 11241 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737) with higher term. Message: Invalid argument: T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
W20260709 13:18:56.425217 11246 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:18:56.426461 11216 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:56.427501 11063 consensus_meta.cc:287] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.000s
I20260709 13:18:56.427910 11063 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:56.435632 10925 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260709 13:18:56.436105 10925 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.411653 11249 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:18:56.381640 11132 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.439499 11261 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:18:56.411042 11175 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:18:56.377508 11263 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.066s
W20260709 13:18:56.443267  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45579.9us
W20260709 13:18:56.447547  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 46768.6us
I20260709 13:18:56.454610  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.442943 10901 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.449795 11155 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.473381  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.475365  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.476526  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.477277  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.442585 11255 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:56.473018  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.483503  3966 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:56.483858  3963 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:18:56.486065  4649 leader_election.cc:336] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.876s (SENT)
I20260709 13:18:56.470584 11145 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.470469 11126 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:56.471155 11265 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:56.491612 11170 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 1.008s	user 0.002s	sys 0.010s
W20260709 13:18:56.498847 11151 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.004s
I20260709 13:18:56.509374  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.492849 11244 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:56.502497 11177 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.004s
I20260709 13:18:56.510661  3972 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 26 because replica has last-logged OpId of term: 25 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 19.
W20260709 13:18:56.504323 11135 consensus_meta.cc:287] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.813s	user 0.011s	sys 0.001s
W20260709 13:18:56.518981  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56585.2us
I20260709 13:18:56.505524 10977 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.501780 11138 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:56.502650  3963 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:18:56.531476  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 202480us
I20260709 13:18:56.492262 11255 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.505827 11126 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.552244 11213 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.518265 11151 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.554255 11151 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.555151 11212 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.556100 11074 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.554100 11216 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:56.524780 11135 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.551860 11270 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:18:56.557843  3938 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:56.550983 11276 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:18:56.524451 10977 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.504997 11170 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.559053  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 62471.3us
I20260709 13:18:56.530402 11138 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.507006 11265 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:56.578733  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 130305us
I20260709 13:18:56.580140  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.580253  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.520823 11177 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.560729 11174 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.560612 11216 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:56.593305 11126 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.593950 11126 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:56.594360 11126 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:56.594223 11216 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.595377 11216 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.579263 11280 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:56.597369 11280 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:56.597865 11280 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:56.586798 11257 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.579337 10977 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.599416 11257 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.569644 11069 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:56.602388 11135 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:56.585287 11267 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.542444 11155 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.582353 11063 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.595327 11126 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:56.609447 11177 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.609982 11253 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:56.610391 11253 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.611158 11253 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.612358 11069 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.569109 10925 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:56.593199 11265 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.589830 11170 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.623966  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:56.630321  4115 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.625234  3963 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:56.587498  4087 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.628510  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.631489  3968 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.633682  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:56.636118  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 292117us
W20260709 13:18:56.637133  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 50941us
W20260709 13:18:56.637652  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59794.1us
I20260709 13:18:56.639039  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.640167  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.641072  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.641234  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.642475  3963 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:56.644476  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.646584  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.647450  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.649681  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.650794  3972 raft_consensus.cc:2410] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:18:56.651000  4649 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.644129  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.652277  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.654832  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.655256  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.656107  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.656498  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.656673  4043 raft_consensus.cc:2376] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20. Re-sending same reply.
I20260709 13:18:56.656848  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.657469  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.658514  4038 raft_consensus.cc:2376] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20. Re-sending same reply.
I20260709 13:18:56.655361  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.663314  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.660130  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.660343  4041 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:56.661095  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.660468  4115 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:56.664539  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.652995  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:56.660593  4043 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:56.671177  4012 leader_election.cc:400] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:18:56.671906  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.672058  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.672694  4039 raft_consensus.cc:2393] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:56.672173  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.673802  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.674152  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.674497  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.632257 11253 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.677030  4040 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:18:56.676892  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.678972  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.675781  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.682762  3970 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:56.670397  4085 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:18:56.680881  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.686515  3963 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:56.685804  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.662714 11135 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:18:56.701663  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.702391  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.703545  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.704538  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.705217  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.700384  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:56.700977  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:56.705879  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.705083  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.707502  4046 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:56.662458 11177 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:56.672958 11063 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:56.705024  3968 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:18:56.708170  4012 leader_election.cc:400] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24.
I20260709 13:18:56.708271  3963 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:18:56.709451  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.659032 11290 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:18:56.715641  4112 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:56.720376  3967 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:56.708981  4116 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:56.675387 11263 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:18:56.675346 11184 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:56.675570 11174 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:18:56.683969 11151 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.719595  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.724167  3965 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:56.729470  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.730167 11291 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:18:56.694386 11269 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:18:56.736416  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.736975 11269 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.737304  4040 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:56.737437 11269 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:56.738108 11255 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.716689  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:56.694787 11175 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.713106 11258 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.733318 11151 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:56.728989  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74098.6us
I20260709 13:18:56.733057 11135 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.743783  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.748226 11069 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.749384 11135 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.754089 11151 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:18:56.757031 11256 log.cc:927] Time spent T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.440s	user 0.000s	sys 0.005s
I20260709 13:18:56.758164 11268 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:56.758636 11268 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.759502 11268 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.760972 11268 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:56.714979 11288 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:18:56.776022 11118 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.776504 11257 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:56.778184 11118 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.726617 11184 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.778862 11184 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:56.746565 11175 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.726150 11263 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:56.783211  4046 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:18:56.714227 11279 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 13:18:56.783984 11279 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:18:56.784418 11279 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:56.785236 11279 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.786314 11279 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:18:56.745402 11258 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.778918  3970 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:56.795039  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:56.819639  4679 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
W20260709 13:18:56.818514  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 157509us
W20260709 13:18:56.822423  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78702.1us
I20260709 13:18:56.822580  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.823177  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:56.824635  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 244568us
I20260709 13:18:56.826936  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.746495 11063 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:56.835335  4112 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:18:56.722571 11177 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:56.836663  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.746918 11291 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:56.799932 11263 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:18:56.848205  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53543.8us
I20260709 13:18:56.839313  4012 leader_election.cc:400] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:18:56.841199  4046 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:56.867103  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.821560 11258 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.826184 11145 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.834514 10901 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:18:56.833817 11060 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:56.825373  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:56.832083 11147 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:56.862864 11292 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:18:56.917475  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78352.7us
I20260709 13:18:56.843261 11174 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:18:56.936688  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 111389us
I20260709 13:18:56.915306 11288 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:18:56.953995  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.954584  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.956377  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.910884 11241 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:56.959012 11241 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.960032  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.961170 11241 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.942060  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:56.942610 11305 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:56.961874 11305 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:56.947506 10977 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.912955 11138 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.956931  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.962327  4043 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260709 13:18:56.957201  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.962647  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.963183  4041 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:56.962280  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.962283 11305 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:56.964962  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.965749 11138 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:56.957304  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.966620  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.958245  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.967358  4039 raft_consensus.cc:2368] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
W20260709 13:18:56.936945  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 94842.5us
I20260709 13:18:56.969539 11269 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:56.970280  4119 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:56.966871  4046 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:56.971762  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:56.973100  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.973770  4112 raft_consensus.cc:2376] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21. Re-sending same reply.
I20260709 13:18:56.964183  4120 raft_consensus.cc:2393] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:56.972489  4039 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.976583  4117 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:18:56.974375  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:56.979051  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.980834  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.982097  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.979135  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.978363  4043 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:18:56.983410  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.986236  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:56.987984  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:56.990545  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:57.002938  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:57.005945  4039 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:57.006683  4045 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:56.935232 11060 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:57.007795 11060 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:56.937970 11069 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.012158  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.939028 11299 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:18:57.006814  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 305446us
I20260709 13:18:57.021492  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:57.023172  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:57.024065  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:57.024396  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:57.026732  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:57.027997  4086 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:57.017849  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75866.1us
I20260709 13:18:57.029413  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:57.030514  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:57.031157  4039 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:18:56.985078 10977 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:57.001331 11288 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:56.997061 11257 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:57.040428  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:56.939254 11145 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:57.047325  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:57.047706  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:57.038689  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:57.025869 10940 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:18:57.033595 11299 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:57.036489 11177 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:57.047766  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:57.036230 11138 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.025532 10901 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:57.050976  4046 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:57.051623  4039 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:18:57.052976  4680 raft_consensus.cc:2393] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 15: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:57.034560 10969 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:57.058780  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:57.037828 11288 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:57.064985  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:57.061053 10901 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:57.057598 11306 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:57.035943 11182 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 13:18:57.052711 11069 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:57.088752  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:57.091881  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:57.054225 11268 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:18:56.963181 11291 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:57.098575  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:18:57.099972  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 249856us
I20260709 13:18:57.059480 11241 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:57.106783  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:57.109256  4679 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:57.107944  4013 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:57.108362  4681 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEARNER]: Advancing to term 24
I20260709 13:18:57.110817  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:57.081316 11138 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:18:57.091544 10901 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.091928 10940 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:57.120754  4681 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 24 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:18:57.064456 11089 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 13:18:57.113638 11303 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:18:57.050750 11257 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:57.120309  4680 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:18:57.114077 11292 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:18:57.102634 10969 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:57.112583  4011 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:57.112250 11175 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:57.103335 11177 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:18:57.121318 11241 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:57.103509 11184 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:57.166337 11080 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:57.167860 11299 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:57.132858 11258 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:57.168958 11252 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:18:57.169950 11296 log.cc:927] Time spent T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:18:57.118669 11186 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:18:57.185105 11224 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:18:57.126922 11138 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:57.186082 11241 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:57.171245 11308 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:18:57.313851  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 187673us
I20260709 13:18:57.105338 11288 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:57.126991 10940 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:57.313508 11177 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:18:57.164108 11180 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.136s
W20260709 13:18:57.317875 11212 consensus_meta.cc:287] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.762s	user 0.015s	sys 0.009s
W20260709 13:18:57.312856  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 214335us
I20260709 13:18:57.323069  4038 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:18:57.130399 11213 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.185s
I20260709 13:18:57.324615  4043 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:57.332646  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:18:57.318007  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 347554us
I20260709 13:18:57.315675 11281 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:57.385690  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4182809359999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1583s for a response
I20260709 13:18:57.339476  3965 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:57.387066  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:57.390761  3964 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:57.391176  3966 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:18:57.324528 11279 consensus_meta.cc:287] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.012s
W20260709 13:18:57.393348  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4155809359999694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
I20260709 13:18:57.384871 11145 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:57.329871 11151 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.004s
W20260709 13:18:57.391186 11248 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.101s	user 0.010s	sys 0.000s
W20260709 13:18:57.427896 11280 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.007s
W20260709 13:18:57.429358  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3840809359999184s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:18:57.393939  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 281394us
I20260709 13:18:57.316941 11080 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:57.431785  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 44785.7us
I20260709 13:18:57.324186 11060 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:57.330045 11241 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:57.437300 11279 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:18:57.466432 11263 consensus_meta.cc:287] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.552s	user 0.009s	sys 0.000s
W20260709 13:18:57.504155  3937 connection.cc:256] RPC call timeout handler was delayed by -1.3786809359999097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:18:57.431262 11310 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:18:57.510831  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:57.434876 11175 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:57.330572 10969 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:57.514215  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:57.504877  4118 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:18:57.532641 11184 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:57.523974  4680 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:57.569413 11257 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.074041 11177 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:18:57.792213 10901 consensus_meta.cc:287] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.663s	user 0.005s	sys 0.002s
I20260709 13:18:57.574489 11186 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:57.520648 11280 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:58.014943 11292 consensus_meta.cc:287] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.881s	user 0.003s	sys 0.006s
I20260709 13:18:57.533705 10940 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:18:58.072734  3937 connection.cc:256] RPC call timeout handler was delayed by -1.1734809360000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
W20260709 13:18:57.861300  4086 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.001s	sys 0.010s
W20260709 13:18:58.077531  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 572299us
I20260709 13:18:58.074326  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3953) took 2237 ms. Trace:
I20260709 13:18:58.077443 11322 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:18:57.564961 11273 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 1.053s	user 0.003s	sys 0.001s
W20260709 13:18:58.074513  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 563729us
I20260709 13:18:57.467461 11151 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.089237  4682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 680) took 1415 ms. Trace:
W20260709 13:18:57.533668 11315 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:18:57.515601 11131 raft_consensus.cc:993] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
W20260709 13:18:57.940874 11305 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.938s	user 0.011s	sys 0.000s
W20260709 13:18:58.097088  4086 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.001s	sys 0.010s
I20260709 13:18:58.097481  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:58.097493  4114 rpcz_store.cc:276] 0709 13:18:55.837229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.837386 (+   157us) service_pool.cc:224] Handling call
0709 13:18:55.837763 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:55.838001 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:55.838028 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:55.849258 (+ 11230us) log.cc:844] Serialized 26 byte log entry
0709 13:18:56.103604 (+254346us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:56.103649 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.103717 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:57.119554 (+1015837us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:18:57.574350 (+454796us) raft_consensus.cc:1685] finished
0709 13:18:57.574377 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.074243 (+499866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8924032,"thread_start_us":214909,"threads_started":1,"wal-append.queue_time_us":363881}
I20260709 13:18:57.516104 11080 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.075163 11060 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:18:58.059257 11308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.003s	sys 0.028s
W20260709 13:18:58.111326  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 996791us
I20260709 13:18:58.106109  4012 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:58.072145 11258 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.089534 11177 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:58.105607  4682 rpcz_store.cc:276] 0709 13:18:56.667504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.667646 (+   142us) service_pool.cc:224] Handling call
0709 13:18:56.667931 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:56.867093 (+199162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.867122 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:56.911511 (+ 44389us) log.cc:844] Serialized 26 byte log entry
0709 13:18:57.036341 (+124830us) raft_consensus.cc:1645] Marking committed up to 20
0709 13:18:57.235259 (+198918us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.314280 (+ 79021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:57.314361 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:58.082989 (+768628us) raft_consensus.cc:1685] finished
0709 13:18:58.083013 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:58.083165 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16307,"prepare.queue_time_us":388507,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":73219,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":7578,"thread_start_us":466872,"threads_started":3,"wal-append.queue_time_us":193598}
I20260709 13:18:58.117975  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:58.118423  4012 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:58.118695  3967 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 25. Current term is 26. Ops: []
I20260709 13:18:58.120433  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:58.096489 11257 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:58.076956 11263 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.122908  4042 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
W20260709 13:18:58.112890 11308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.003s	sys 0.029s
I20260709 13:18:58.107014 11292 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:18:58.122331 11060 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.133939  4011 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:58.212637 11060 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:18:58.214285 11326 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:18:58.121460 11177 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.095486 10901 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.089720 11175 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:58.230011  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36870 (request call id 96) took 1537 ms. Trace:
I20260709 13:18:58.125077 11322 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:18:58.104789 11186 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.114369 11329 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.230953  4115 rpcz_store.cc:276] 0709 13:18:56.700466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.700954 (+   488us) service_pool.cc:224] Handling call
0709 13:18:58.208363 (+1507409us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400394a20. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c9520 00007fed76452b42 00007fed76451800 00007fed7644a9fa 00007fed7b4124c9 00007fed7498ec54 00007fed7498ebe2 00007fed7498eb11 00007fed7498ea8c 00007fed7498dd42
0709 13:18:58.225453 (+ 17090us) inbound_call.cc:177] Queueing failure response
Metrics: {"spinlock_wait_cycles":320666368}
W20260709 13:18:58.246330  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 112479us
W20260709 13:18:58.247224  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:58.124917 11279 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:18:58.265496  4012 connection.cc:256] RPC call timeout handler was delayed by -1.2768711459998485s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1637s for a response
I20260709 13:18:58.208298 11184 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:58.266469  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 151597us
I20260709 13:18:58.130034 11308 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:58.115051 11305 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.267174  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:58.217782 11258 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:18:58.271495  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 162824us
I20260709 13:18:58.232149 11280 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.345083  3971 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:58.129473 11257 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.357512 11337 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:58.270541 11329 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.358151 11337 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.350360 11080 raft_consensus.cc:1081] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
W20260709 13:18:58.361340  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 91900.4us
I20260709 13:18:58.362080  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:18:58.362537  4012 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.637s (SENT) [suppressed 22 similar messages]
I20260709 13:18:58.349514 11322 raft_consensus.cc:697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:58.393153 11325 consensus_queue.cc:1059] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:18:58.357560 11151 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.383837 11258 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.385444 11184 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:18:58.403578  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 59768.1us
I20260709 13:18:58.410684 11184 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.412781 11184 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.413337 11343 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:58.413516 11263 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.414031 11343 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.416314 11343 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.418401 11280 raft_consensus.cc:993] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: : Instructing follower 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:58.418891 11280 raft_consensus.cc:1081] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Signalling peer 0f3fa9d459de485e824f023c55580bc6 to start an election
I20260709 13:18:58.388414 11060 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:18:58.420240 11060 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:58.420416 11258 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.420924 11074 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:58.421440 11074 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.422629 11258 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.424229 11329 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.424507 11074 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.425668 10901 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.426245 11060 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:58.426322 11308 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.428102  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:58.429478  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4148) took 1095 ms. Trace:
I20260709 13:18:58.444772  3971 rpcz_store.cc:276] 0709 13:18:57.333950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.334951 (+  1001us) service_pool.cc:224] Handling call
0709 13:18:57.335218 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.346867 (+1011649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:58.429231 (+ 82364us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400398ad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:58.429417 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322015616}
I20260709 13:18:58.453938  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:58.455648 10891 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:58.435211 11305 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.434285 11257 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.457201 10891 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:58.458213 10891 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.458648 11347 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.400221 11292 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 23.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
W20260709 13:18:58.432211 11333 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 13:18:58.460942 11292 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:58.461323 11292 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:58.461663 11174 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:18:58.462028 11174 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:58.435142 11337 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.462149 11292 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.455654 11340 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:18:58.462843 11174 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.435632 11151 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:18:58.465169 11340 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:58.465524 11340 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:58.465756 11241 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.414170 11263 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:58.463841 11174 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:18:58.468591  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 132) took 5544 ms. Trace:
I20260709 13:18:58.469914  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:58.480342  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:58.481577  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:58.484115  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:18:58.487811  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 92740.4us
I20260709 13:18:58.493163  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.493834  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.494688  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.494853  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.493464  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.495843  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.496704  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.497095  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.497783  3964 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:58.498728  3964 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:58.499588  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.499754  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.501102  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.427559 11186 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.466292 11340 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.459378 11347 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.493146  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.472587 11175 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.474123 11305 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:18:58.509799  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:58.512380  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.485558 11280 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:18:58.485767 11257 raft_consensus.cc:2764] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:18:58.503859 10925 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.518642  3968 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:58.520960  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e32744704d014399851a0661c8929ded"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:58.521670  4115 raft_consensus.cc:606] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:58.522066 11324 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:58.472527  3869 rpcz_store.cc:276] 0709 13:18:52.923987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:52.926358 (+  2371us) service_pool.cc:224] Handling call
0709 13:18:58.468520 (+5542162us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:56.295428 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:56.415045 (+119617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:56.418970 (+  3925us) write_op.cc:435] Acquired schema lock
0709 13:18:56.421487 (+  2517us) tablet.cc:662] Decoding operations
0709 13:18:56.433442 (+ 11955us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:56.433493 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:56.433538 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:18:56.433857 (+   319us) tablet.cc:701] Row locks acquired
0709 13:18:56.433870 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:18:56.434045 (+   175us) write_op.cc:270] Start()
0709 13:18:56.434176 (+   131us) write_op.cc:276] Timestamp: P: 1783603136433994 usec, L: 0
0709 13:18:56.434200 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:18:56.434851 (+   651us) log.cc:844] Serialized 919 byte log entry
0709 13:18:57.079742 (+644891us) op_driver.cc:464] REPLICATION: finished
0709 13:18:57.434141 (+354399us) write_op.cc:301] APPLY: starting
0709 13:18:57.468979 (+ 34838us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:57.536858 (+ 67879us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:57.537145 (+   287us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:57.538943 (+  1798us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:57.539213 (+   270us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:18:57.539264 (+    51us) write_op.cc:312] APPLY: finished
0709 13:18:57.539542 (+   278us) log.cc:844] Serialized 33 byte log entry
0709 13:18:57.865280 (+325738us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.887998 (+ 22718us) write_op.cc:454] Released schema lock
0709 13:18:57.889326 (+  1328us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:57.966767 (+ 77441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:57.969874 (+  3107us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":302554,"apply.run_cpu_time_us":6213,"apply.run_wall_time_us":533767,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12515,"num_ops":2,"prepare.queue_time_us":369113,"prepare.run_cpu_time_us":3413,"prepare.run_wall_time_us":160967,"replication_time_us":623290,"spinlock_wait_cycles":4864,"thread_start_us":314452,"threads_started":2}]]}
I20260709 13:18:58.522611 11324 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.515338 11342 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:58.524168 11342 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:58.524509 11342 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:58.427140 11060 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.455972 11322 consensus_queue.cc:237] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.577339  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:58.618010  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:58.619076  3972 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:58.540798  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:58.552814  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:58.564543  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:58.580556  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:58.476368 11263 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.513255 10901 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.647797  4119 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:18:58.626372  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:58.635174 11336 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:58.518275 11308 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.625387  4112 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:58.627472  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:58.645157 11350 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.515407 11074 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:18:58.519692 11175 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.640612 11354 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:58.641988 11241 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.639601 11347 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.528024 11060 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:58.524881 11334 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.524745 11324 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.624707  4117 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:58.646615 11263 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.616500 10925 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.654975  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:58.701138  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:58.890542  4040 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:58.891156 11260 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.891851 11241 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:58.892421  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:58.892510 11241 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.891778 11260 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:58.516613 11345 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:58.893816 11345 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.529925 11329 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:18:58.820705  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 172019us
W20260709 13:18:58.588425  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.765542  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 498382us
W20260709 13:18:58.897552  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:18:58.818953  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 332636us
I20260709 13:18:58.895808  4041 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 12. Current term is 13. Ops: []
I20260709 13:18:58.668286  4046 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 20. Current term is 21. Ops: []
I20260709 13:18:58.777220  4112 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:18:58.900635  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:58.899588  4117 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:58.890775  4121 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:58.894812 11260 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.519447 11258 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.934762  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:58.944149  4046 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
W20260709 13:18:58.656003  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 293460us
I20260709 13:18:58.944566  4046 pending_rounds.cc:85] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 12
I20260709 13:18:58.690032 11177 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.932197  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:58.941100  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:58.946632  4041 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:58.947647  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:58.653661 11325 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.949326  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:58.528298 11286 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:58.952967  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:18:58.944938  4046 pending_rounds.cc:107] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:18:58.528144 11338 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:58.868290 11306 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:18:58.526952 11267 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:58.956835  4046 raft_consensus.cc:2889] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:18:58.722997 11349 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:58.894846 10925 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.519517 11186 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:18:58.960327  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 56491.7us
I20260709 13:18:58.965224  4117 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:58.895069 11241 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:58.717581 11336 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.975677  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:58.911979 11354 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.654577 10901 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.978494  3968 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 22.
I20260709 13:18:58.748637 11342 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.982154  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:58.893307 11074 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.666808 11308 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.983131  4041 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:18:58.911705 11257 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:18:58.961318 11306 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:58.981956  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:58.763897 11352 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.252s
I20260709 13:18:58.991394  4046 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:18:58.891304 11175 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:58.955924 11258 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:18:59.008527  4649 leader_election.cc:336] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 2.050s (SENT)
I20260709 13:18:59.026319  4120 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:58.944010 11334 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.027608  4113 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:58.958043 11325 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:58.944168 11350 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.029858 11370 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.030488 11350 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.030402 11370 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:18:59.032229 11325 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:59.032562  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 87553.1us
I20260709 13:18:59.032779 11325 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:18:59.033269 11325 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.033907  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:59.042857  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:59.034680 11350 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:18:58.980157 11186 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:58.972711 11346 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 13:18:59.039547 11329 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:18:59.098875 11354 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.100109 11308 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.097901 11177 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.101490 11342 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:59.102998 11357 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:18:58.980674 11349 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.104970 11186 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:58.963811 11267 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.025764 11345 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.095122  4112 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.160956 11175 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.162452 11258 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.163082 11267 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.091348  4121 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:59.104913  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3522) took 2066 ms. Trace:
I20260709 13:18:59.110652  4114 raft_consensus.cc:1275] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:18:59.105759  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3510) took 2126 ms. Trace:
I20260709 13:18:59.164194  4038 rpcz_store.cc:276] 0709 13:18:56.979600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.979714 (+   114us) service_pool.cc:224] Handling call
0709 13:18:56.980026 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.385507 (+405481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.105528 (+1720021us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b540028c154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.105680 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":788349824}
W20260709 13:18:59.096899 11287 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:18:59.176877  3970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3766) took 2476 ms (client timeout 1888 ms). Trace:
I20260709 13:18:59.163590  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.177899  3969 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:18:59.166311  4047 rpcz_store.cc:276] 0709 13:18:57.038134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.038375 (+   241us) service_pool.cc:224] Handling call
0709 13:18:57.038648 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.088102 (+ 49454us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:18:57.116261 (+ 28159us) log.cc:844] Serialized 14 byte log entry
0709 13:18:57.177517 (+ 61256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:57.177588 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:18:57.177641 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.104674 (+1927033us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b540011a8d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.104720 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.104855 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44984,"prepare.queue_time_us":16056,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":45484,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":27541,"spinlock_wait_cycles":62223616,"thread_start_us":15814,"threads_started":1,"wal-append.queue_time_us":213819,"wal-append.run_cpu_time_us":17203,"wal-append.run_wall_time_us":1779600}
I20260709 13:18:59.079979 11336 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:58.978363 11338 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.108012 11074 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:18:59.107811  4118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3962) took 3170 ms (client timeout 1637 ms). Trace:
I20260709 13:18:59.081298 11348 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:58.972674 11286 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.072177  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.050217  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:18:59.083710 11174 consensus_meta.cc:287] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.005s
I20260709 13:18:59.102912 11305 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:18:59.128350  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:59.105772 10901 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:59.145103 11269 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.141573 11361 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:18:59.147369 11349 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.343941  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:59.165465  4112 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:59.165509  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.345396  4038 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:59.345577  3964 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:59.168169  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.155479  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3511) took 2175 ms. Trace:
I20260709 13:18:59.344605  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:59.169656  4682 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:59.346431  4121 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 21.
I20260709 13:18:59.178143  4113 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:59.075354  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:59.178840  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.286422 11175 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.187472  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:59.347663  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:59.347913  4681 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
W20260709 13:18:59.323419  4118 rpcz_store.cc:269] 0709 13:18:55.937708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:55.938029 (+   321us) service_pool.cc:224] Handling call
0709 13:18:59.107625 (+3169596us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540004e554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.107741 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3225101568}
I20260709 13:18:59.346376  4042 rpcz_store.cc:276] 0709 13:18:56.980469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.980591 (+   122us) service_pool.cc:224] Handling call
0709 13:18:56.980898 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.130559 (+1149661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.155210 (+1024651us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b540011add4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.155410 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2623688448}
I20260709 13:18:59.180044  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4253) took 2824 ms. Trace:
W20260709 13:18:59.305539  4011 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.001s	sys 0.026s
W20260709 13:18:59.177351  3970 rpcz_store.cc:269] 0709 13:18:56.700558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.700684 (+   126us) service_pool.cc:224] Handling call
0709 13:18:59.176592 (+2475908us) spinlock_profiling.cc:243] Waited 72.4 ms on lock 0x7b54004074d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.176754 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166480640}
W20260709 13:18:59.351536  4011 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.002s	sys 0.027s
W20260709 13:18:59.351863  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 576959us
I20260709 13:18:59.352124  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:59.328136  4041 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:18:59.349426  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:59.328997  3966 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:18:59.333786  4675 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:18:59.340126  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.353420  4113 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.354368 10977 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:18:59.357501 11186 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:18:59.360248  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 235044us
I20260709 13:18:59.360987 11330 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.349493  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.361547 11330 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.342397  3965 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:59.363250 11373 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:59.363668 11373 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:59.118538 11306 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.364468 10977 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:18:59.364987 11306 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.365502  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.366119  4041 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:59.367964 10977 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:18:59.368299 10977 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:59.369051 10977 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.369724 11155 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:59.370158 10977 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:59.336772 11323 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.371168 11323 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.321697 11281 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.370126 11155 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:59.372905 11155 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:18:59.372582 11281 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.373241 11323 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.373813 11345 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:18:59.342232  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:18:59.330541  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 202237us
I20260709 13:18:59.375798  4047 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:18:59.376719  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.376933  4047 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:18:59.166074 11329 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:18:59.361927  4042 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:18:59.370110 11338 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.391974  4115 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.392242 11175 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.393965 11334 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.394341 11175 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.352706  3970 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:18:59.286674 11258 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:59.341477 11361 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:59.400714 11378 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:18:59.401185 11378 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.401281 11361 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.388634  4042 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:59.402371 11361 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.402864 11212 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:18:59.371116  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:59.375835 11292 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.403990  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.405846 11347 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:18:59.391043  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.406998  3965 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 16: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:59.390848  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:59.391379 11365 consensus_queue.cc:1175] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1e032f02b0aa450384dda978641ba666" responder_term: 20 status { last_received { term: 20 index: 17 } last_committed_idx: 17 last_received_current_leader { term: 20 index: 17 } }
W20260709 13:18:59.378515  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 303218us
I20260709 13:18:59.349737  4044 rpcz_store.cc:276] 0709 13:18:56.355153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.355290 (+   137us) service_pool.cc:224] Handling call
0709 13:18:56.355591 (+   301us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:18:56.454360 (+ 98769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:56.454393 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:18:56.469984 (+ 15591us) log.cc:844] Serialized 52 byte log entry
0709 13:18:56.548378 (+ 78394us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:18:56.674662 (+126284us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.678231 (+  3569us) log.cc:844] Serialized 14 byte log entry
0709 13:18:56.678421 (+   190us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:56.678487 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:56.767164 (+ 88677us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b18003fd7e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:58.417503 (+1650339us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b18003fd7e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f522 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:58.980086 (+562583us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b18003fd7e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:18:59.179808 (+199722us) raft_consensus.cc:1685] finished
0709 13:18:59.179831 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.179980 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":306656,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":54,"raft.queue_time_us":63166,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":26651,"spinlock_wait_cycles":66037632,"thread_start_us":219924,"threads_started":3,"wal-append.queue_time_us":186517}
W20260709 13:18:59.344377  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 302460us
I20260709 13:18:59.391073  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:18:59.409052  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.391492  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.410260  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.411204  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.392141  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:18:59.395282 11329 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:59.401814  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3514) took 2416 ms. Trace:
I20260709 13:18:59.416559  4043 rpcz_store.cc:276] 0709 13:18:56.985541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:56.985860 (+   319us) service_pool.cc:224] Handling call
0709 13:18:56.986142 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:57.388447 (+402305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.401594 (+2013147us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b540041c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.401759 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777950080}
I20260709 13:18:59.417299  4047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:18:59.417824  4047 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:18:59.418166  4047 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.414521  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:59.418833  4681 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:59.398026  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.420241  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:18:59.316488 11238 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:59.415513  4038 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:59.411465  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.420753  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:59.422176  4114 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:59.423120  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.412566  3964 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:18:59.424412  4043 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:18:59.425953  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.427806  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:59.430276  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:59.431272  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:18:59.432329  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.433293  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.434665  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.435189  4113 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:18:59.426617  3964 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 15.
I20260709 13:18:59.437273  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.426097  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:18:59.436376  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.441175  3964 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:18:59.446038  3966 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:59.439668  4114 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:18:59.454092  4012 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:18:59.424741 11175 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:18:59.481737  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:40680
I20260709 13:18:59.487545  4121 raft_consensus.cc:606] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:18:59.488729  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.489168 11268 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.489585 11268 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.490025 11268 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.415270 11378 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:59.494884  4114 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:18:59.415378 11269 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.489534  4121 raft_consensus.cc:2393] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 20: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:18:59.485006  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:18:59.463253  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.437577 11334 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:18:59.457357 11174 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:18:59.496424 11313 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:18:59.496238 11368 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:18:59.463780 11279 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:59.524617 11330 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:59.353189 11348 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.519685 11313 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:59.523964 11288 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.364497 11373 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.532428 11392 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:18:59.543045 11392 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:18:59.503250 11345 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:18:59.543478 11392 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:18:59.544232 11348 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:59.536648 11368 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:18:59.546473 11368 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:18:59.503546 11329 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.534468 11271 raft_consensus.cc:993] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:18:59.515307 11174 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.538017 11216 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:18:59.425184 11258 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.438346 11238 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.511442 11175 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:18:59.542115 11279 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.510331 11334 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:18:59.535305 11378 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.543490 11373 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:59.551530 11271 raft_consensus.cc:1081] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:18:59.553447 11329 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:18:59.558848 11279 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.511077 11269 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.561892 11286 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.564742 11370 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.565294 11325 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.565680 11354 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:18:59.566077 11354 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:18:59.566871 11354 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.568046 11354 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:18:59.574000 11378 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.555421 11334 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:59.559147 11313 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.577761 11392 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.579857 11392 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:18:59.585547 11334 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.493553  4047 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.501966  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:59.435117  3963 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 16.
I20260709 13:18:59.660426  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4142) took 2328 ms. Trace:
I20260709 13:18:59.679330  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3989) took 1089 ms. Trace:
I20260709 13:18:59.655254  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4146) took 2321 ms. Trace:
I20260709 13:18:59.722258  4114 rpcz_store.cc:276] 0709 13:18:58.590086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.454620 (+864534us) service_pool.cc:224] Handling call
0709 13:18:59.454996 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.497441 (+ 42445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.678576 (+181135us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b54001b1f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.679047 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87156992}
I20260709 13:18:59.630430  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:18:59.652254  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3780) took 1159 ms. Trace:
W20260709 13:18:59.656575  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.682857  4112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3992) took 1091 ms. Trace:
I20260709 13:18:59.736605 11361 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:18:59.660063  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.650264  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.653617  3971 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:18:59.553483 11175 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:18:59.619653  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.722064  3967 rpcz_store.cc:276] 0709 13:18:57.332025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.332146 (+   121us) service_pool.cc:224] Handling call
0709 13:18:57.332453 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:58.119081 (+786628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.659747 (+1540666us) spinlock_profiling.cc:243] Waited 786 ms on lock 0x7b540044b6d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.660232 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1807722368}
I20260709 13:18:59.658347  4038 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:18:59.733232  3972 rpcz_store.cc:276] 0709 13:18:58.498799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.499547 (+   748us) service_pool.cc:224] Handling call
0709 13:18:59.651818 (+1152271us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400279f54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.652049 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273028480}
I20260709 13:18:59.722539  3969 rpcz_store.cc:276] 0709 13:18:57.333329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.333463 (+   134us) service_pool.cc:224] Handling call
0709 13:18:59.177717 (+1844254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.178279 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.654805 (+476526us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54004074d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.655043 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4107274112}
W20260709 13:18:59.742427  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:18:59.657722  4046 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:18:59.635747  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.634838  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.663147  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.744972  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.634065  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.648947  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:59.550268 11216 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:18:59.626214  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 198297us
I20260709 13:18:59.665906  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.739027  4112 rpcz_store.cc:276] 0709 13:18:58.590804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.900406 (+309602us) service_pool.cc:224] Handling call
0709 13:18:59.682333 (+781927us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b54003a8ed4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.682597 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445224704}
I20260709 13:18:59.750778  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.759690  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.761289  3967 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:18:59.762622  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3985) took 1185 ms (client timeout 1526 ms). Trace:
I20260709 13:18:59.762920  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.765309 11281 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.766438 11370 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:18:59.767035  4676 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:18:59.768090  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 685) took 2327 ms. Trace:
I20260709 13:18:59.770022 11269 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.771751  4042 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:18:59.482442  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:18:59.781888 11258 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:59.785497  4118 raft_consensus.cc:2393] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 21: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:18:59.787006  3965 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:18:59.553504 11174 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:18:59.789036  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.789417  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.790089  3965 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:18:59.791337  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.791572  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.793112  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:59.793954  4114 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:59.794844 11216 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.757844  4680 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:18:59.768507  4676 rpcz_store.cc:276] 0709 13:18:57.440831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:57.440972 (+   141us) service_pool.cc:224] Handling call
0709 13:18:59.323155 (+1882183us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:59.765751 (+442596us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed73327a5b 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:59.766265 (+   514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.767639 (+  1374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.767941 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17165824}
I20260709 13:18:59.797719  4045 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:18:59.752533 11361 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:18:59.773427  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:18:59.802426  4038 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:18:59.802522 11080 raft_consensus.cc:3055] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:18:59.802987 11080 raft_consensus.cc:740] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:18:59.805024  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:18:59.805904  4121 raft_consensus.cc:2376] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18. Re-sending same reply.
I20260709 13:18:59.799320  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.807713  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.796613  4043 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:18:59.811264  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:18:59.763167  4120 rpcz_store.cc:269] 0709 13:18:58.576922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.580188 (+  3266us) service_pool.cc:224] Handling call
0709 13:18:59.762140 (+1181952us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54003a84d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.762410 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922212096}
I20260709 13:18:59.809746  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.813230  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:59.815078  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 166624us
I20260709 13:18:59.817049  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:18:59.814842  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 764) took 1149 ms. Trace:
I20260709 13:18:59.814277  3967 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:18:59.820480  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:18:59.589309 11368 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:18:59.804327 11080 consensus_queue.cc:260] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:18:59.761323 11325 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.170s
I20260709 13:18:59.890635  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:00.038808  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 251427us
I20260709 13:18:59.873135 11155 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.209498 11368 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:18:59.818974  4045 rpcz_store.cc:276] 0709 13:18:58.662181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.662730 (+   549us) service_pool.cc:224] Handling call
0709 13:18:59.659608 (+996878us) spinlock_profiling.cc:243] Waited 6.25 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:18:59.811328 (+151720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14379776}
I20260709 13:18:59.864923  4039 raft_consensus.cc:2393] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:00.062422  4038 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:00.030349  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3980) took 1491 ms. Trace:
I20260709 13:18:59.890188  3966 raft_consensus.cc:2410] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:19:00.213814  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:18:59.896147  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 80148.5us
W20260709 13:19:00.214638  3970 consensus_meta.cc:287] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.808s	user 0.015s	sys 0.004s
I20260709 13:19:00.215356  3970 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
W20260709 13:19:00.216845  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.205847  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3991) took 1615 ms. Trace:
I20260709 13:19:00.216490  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.822710  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 3986) took 1233 ms. Trace:
W20260709 13:19:00.204438  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 722481us
I20260709 13:18:59.849583  4120 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:18:59.823776  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3988) took 1233 ms. Trace:
I20260709 13:18:59.930837  4680 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 26.
I20260709 13:19:00.207314  3964 raft_consensus.cc:2410] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 25 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260709 13:18:59.873627  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:00.235417  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:18:59.886212  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:00.205796  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4277) took 1248 ms. Trace:
I20260709 13:18:59.822125  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:00.214694  3966 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:00.240664  3969 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: []
W20260709 13:19:00.010804  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 316261us
I20260709 13:18:59.871409 11216 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:18:59.873864  4115 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:00.237360  4117 rpcz_store.cc:276] 0709 13:18:58.589847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.892156 (+302309us) service_pool.cc:224] Handling call
0709 13:18:59.823278 (+931122us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b540026b1d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:18:59.823531 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14818688}
I20260709 13:19:00.243088  4121 rpcz_store.cc:276] 0709 13:18:58.590579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.872418 (+1281839us) service_pool.cc:224] Handling call
0709 13:19:00.205113 (+332695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.205498 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.205525 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.205594 (+    69us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:00.205634 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.205695 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.205779 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:18:59.890816 10891 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:18:59.950007 11074 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:18:59.874449  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:00.236966  4039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41202 (request call id 760) took 1582 ms (client timeout 2050 ms). Trace:
I20260709 13:18:59.932003  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:18:59.827934 11269 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:18:59.823360 11356 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:00.212625  4119 rpcz_store.cc:276] 0709 13:18:58.539144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.540507 (+  1363us) service_pool.cc:224] Handling call
0709 13:19:00.029668 (+1489161us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b54003d2554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.030029 (+   361us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54079872}
W20260709 13:19:00.246340  4039 rpcz_store.cc:269] 0709 13:18:58.654218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.654415 (+   197us) service_pool.cc:224] Handling call
0709 13:18:59.665510 (+1011095us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:19:00.236897 (+571387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13945216}
I20260709 13:19:00.236657  4116 rpcz_store.cc:276] 0709 13:18:58.589311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.589446 (+   135us) service_pool.cc:224] Handling call
0709 13:18:58.589787 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.322736 (+732949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.322767 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:18:59.322809 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:18:59.322841 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.822178 (+499337us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b5400080a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:18:59.822263 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:18:59.822505 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1685153152}
I20260709 13:18:59.821322 11238 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.210035 11155 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:00.251622  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.245815  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:00.255124  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.254312  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:00.258945  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.246151 10891 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:00.247918 11269 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.249789 11356 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.261009  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:00.253417 11393 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.231s	user 0.006s	sys 0.000s
W20260709 13:19:00.273460  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.260778 10891 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:00.272279  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:00.263404 11269 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:18:59.891747 11361 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.265815 11356 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:00.265249 11080 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:00.239463  4044 rpcz_store.cc:276] 0709 13:18:58.957358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.408531 (+451173us) service_pool.cc:224] Handling call
0709 13:18:59.408848 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.415903 (+  7055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.415933 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.430135 (+ 14202us) log.cc:844] Serialized 26 byte log entry
0709 13:18:59.889936 (+459801us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:18:59.890187 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:18:59.890320 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:18:59.890366 (+    46us) raft_consensus.cc:1685] finished
0709 13:18:59.890380 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.205617 (+315237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43337,"raft.queue_time_us":15136,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":24603,"thread_start_us":88881,"threads_started":1,"wal-append.queue_time_us":344249}
W20260709 13:19:00.281500  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.285611 11334 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:00.288890 11350 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:00.270936 11238 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:00.295822  3964 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:00.296540  3965 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:19:00.299012 11289 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:00.292873  4675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:00.300666  4675 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:00.309579  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:00.295037 11323 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:00.311419  4047 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:00.322463  3963 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:00.333673  3968 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 26: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:19:00.334504  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55954.1us
I20260709 13:19:00.337430  3967 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 24 index: 14. (term mismatch)
W20260709 13:19:00.340004  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 475034us
I20260709 13:19:00.337882  3967 pending_rounds.cc:85] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 13
W20260709 13:19:00.342474  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 520695us
I20260709 13:19:00.321489 11238 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.341288  3967 pending_rounds.cc:107] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260709 13:19:00.340811  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:49112 (request call id 4270) took 1389 ms. Trace:
I20260709 13:19:00.346652  4047 rpcz_store.cc:276] 0709 13:18:58.941010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.377579 (+436569us) service_pool.cc:224] Handling call
0709 13:19:00.326753 (+949174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15104}
W20260709 13:19:00.351172  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.346453  3967 raft_consensus.cc:2889] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:00.358889  4114 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.005s
I20260709 13:19:00.359236  4114 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:00.355646  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:00.366225  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 149252us
I20260709 13:19:00.365624  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:00.365048  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:00.373838  3966 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:00.379544  3966 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:00.390870  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:00.394507 11288 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.816s	user 0.003s	sys 0.014s
I20260709 13:19:00.394492 11131 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:00.401233 11131 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.406334  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:00.407678  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.407094  4116 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.402093 11323 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:00.405516 11250 consensus_queue.cc:1059] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
I20260709 13:19:00.416221 11329 raft_consensus.cc:1064] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:19:00.407438 11131 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:00.415288  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:00.412117  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:00.413599 11359 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:00.428552  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.429458  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75820.8us
I20260709 13:19:00.430310 11359 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.417637  3966 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:00.422099 11329 raft_consensus.cc:1068] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:00.435369 11370 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:00.438886  4043 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.440259  3966 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:00.442369  4047 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:00.442449  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.447754  4038 raft_consensus.cc:1240] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:00.448190 11329 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.448642 11329 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.438244 11370 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.456387  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:00.466215  4044 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:00.451789 11155 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:00.446743 11238 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.451938 11370 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:00.489274  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3996) took 1157 ms. Trace:
I20260709 13:19:00.512252  3964 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:00.504674  4113 rpcz_store.cc:276] 0709 13:18:59.331280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.347442 (+ 16162us) service_pool.cc:224] Handling call
0709 13:19:00.455005 (+1107563us) spinlock_profiling.cc:243] Waited 5.11 ms on lock 0x7b540004d154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.489010 (+ 34005us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11763584}
W20260709 13:19:00.518329  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45248.8us
I20260709 13:19:00.471217 11288 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.517745 11080 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.525381 11080 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.526713 11329 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.527415 11080 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:00.528054 11080 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:19:00.502305 11268 consensus_meta.cc:287] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.927s	user 0.017s	sys 0.003s
I20260709 13:19:00.520946  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.533095 11340 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:00.492965 11250 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:00.515862 11155 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.549746 11155 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:00.569638  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.547326 11250 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:00.587534  4044 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:19:00.572395  4683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:00.598728  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:00.599396  4682 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:00.600373  3963 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:00.601604  3963 raft_consensus.cc:1240] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
W20260709 13:19:00.607681  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 3990) took 2017 ms (client timeout 1626 ms). Trace:
W20260709 13:19:00.608110  4115 rpcz_store.cc:269] 0709 13:18:58.590324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.623755 (+ 33431us) service_pool.cc:224] Handling call
0709 13:19:00.607445 (+1983690us) spinlock_profiling.cc:243] Waited 737 ms on lock 0x7b54001b2454. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.607586 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1694408960}
I20260709 13:19:00.573514 11288 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.549854 11268 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.610939 11288 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:00.611449 11268 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:00.614871  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:00.612653  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 263) took 5872 ms. Trace:
I20260709 13:19:00.608897  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:00.617610  4684 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:00.622711  4682 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:00.626215  4678 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.616781  3870 rpcz_store.cc:276] 0709 13:18:54.740155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:54.740711 (+   556us) service_pool.cc:224] Handling call
0709 13:19:00.612406 (+5871695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:18:56.435285 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:18:56.435759 (+   474us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:18:56.435791 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:18:56.435806 (+    15us) tablet.cc:662] Decoding operations
0709 13:18:56.436498 (+   692us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:18:56.436554 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:18:56.436578 (+    24us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:18:56.501389 (+ 64811us) tablet.cc:701] Row locks acquired
0709 13:18:56.503377 (+  1988us) write_op.cc:260] PREPARE: finished
0709 13:18:56.511224 (+  7847us) write_op.cc:270] Start()
0709 13:18:56.522505 (+ 11281us) write_op.cc:276] Timestamp: P: 1783603136509548 usec, L: 0
0709 13:18:56.524639 (+  2134us) op_driver.cc:348] REPLICATION: starting
0709 13:18:57.000198 (+475559us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b54000abca0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c9520 00007fed76452b42 00007fed76447f67 00007fed76447da4 00007fed79e82581 00007fed79e81d58 00007fed79e869f1 00007fed79e869a9 00007fed79e86939 00007fed79e86901
0709 13:18:57.042968 (+ 42770us) log.cc:844] Serialized 2482 byte log entry
0709 13:18:58.646449 (+1603481us) op_driver.cc:464] REPLICATION: finished
0709 13:18:58.970744 (+324295us) write_op.cc:301] APPLY: starting
0709 13:18:58.979233 (+  8489us) tablet.cc:1367] starting BulkCheckPresence
0709 13:18:59.115858 (+136625us) tablet.cc:1370] finished BulkCheckPresence
0709 13:18:59.115883 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:18:59.358390 (+242507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:18:59.358635 (+   245us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:18:59.358684 (+    49us) write_op.cc:312] APPLY: finished
0709 13:18:59.358921 (+   237us) log.cc:844] Serialized 65 byte log entry
0709 13:18:59.515010 (+156089us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.519062 (+  4052us) write_op.cc:454] Released schema lock
0709 13:18:59.521566 (+  2504us) write_op.cc:341] FINISH: Updating metrics
0709 13:18:59.521934 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:18:59.521961 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":308785,"apply.run_cpu_time_us":26933,"apply.run_wall_time_us":560873,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29291,"num_ops":6,"prepare.queue_time_us":499195,"prepare.run_cpu_time_us":10269,"prepare.run_wall_time_us":607946,"replication_time_us":2121646,"spinlock_wait_cycles":34756480,"thread_start_us":382818,"threads_started":2,"wal-append.queue_time_us":186011,"wal-append.run_cpu_time_us":1170,"wal-append.run_wall_time_us":1007191}]]}
I20260709 13:19:00.591636 11074 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:00.634778  4684 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:00.590759 11250 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.645862  4047 raft_consensus.cc:2410] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:19:00.650132  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:00.652061  4684 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:00.655812  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.665715  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.669420  4114 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:00.671521  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:00.671766  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:00.672851 11268 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:00.673322 11268 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:00.673691 11268 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:00.674621  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4184) took 1013 ms. Trace:
I20260709 13:19:00.675007  3967 rpcz_store.cc:276] 0709 13:18:59.661319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.376310 (+714991us) service_pool.cc:224] Handling call
0709 13:19:00.395385 (+ 19075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.426547 (+ 31162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.426581 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.446606 (+ 20025us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.584836 (+138230us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:19:00.584879 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.584947 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.674423 (+ 89476us) raft_consensus.cc:1685] finished
0709 13:19:00.674443 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.674563 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10507,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":4143,"thread_start_us":91680,"threads_started":1,"wal-append.queue_time_us":176519}
W20260709 13:19:00.677167  3937 connection.cc:256] RPC call timeout handler was delayed by -2.090839527000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 13:19:00.677603  3937 connection.cc:256] RPC call timeout handler was delayed by -2.0746395270000448s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1524s for a response
W20260709 13:19:00.677913  3937 connection.cc:256] RPC call timeout handler was delayed by -2.0521395270000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:19:00.678181  3937 connection.cc:256] RPC call timeout handler was delayed by -1.9828395269998964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260709 13:19:00.678435  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8928395269999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:19:00.678690  3937 connection.cc:256] RPC call timeout handler was delayed by -1.8190395270000863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
W20260709 13:19:00.678960  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6831395270000939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:19:00.679219  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6768395270000838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1966s for a response
W20260709 13:19:00.679471  3937 connection.cc:256] RPC call timeout handler was delayed by -1.6309395270000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2017s for a response
W20260709 13:19:00.679734  3937 connection.cc:256] RPC call timeout handler was delayed by -1.5913395269999455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2061s for a response
W20260709 13:19:00.679999  3937 connection.cc:256] RPC call timeout handler was delayed by -1.4941395270000157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 13:19:00.681733 11356 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.641981 11131 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:00.680667  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:00.691992  4684 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:00.693926  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:00.694128  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:00.695585  4121 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.695889  4117 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.696805  4121 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:00.696467 11269 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.698580 11269 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:00.699016  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.705629  4113 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25. Ops: []
W20260709 13:19:00.699716 11402 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.400s	user 0.000s	sys 0.006s
W20260709 13:19:00.709054 11410 log.cc:927] Time spent T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:19:00.701041  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:00.710037  4679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 694) took 1483 ms. Trace:
I20260709 13:19:00.710425  4679 rpcz_store.cc:276] 0709 13:18:59.226361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.226577 (+   216us) service_pool.cc:224] Handling call
0709 13:18:59.769429 (+542852us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:59.769847 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.770577 (+   730us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:18:59.770616 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.892073 (+121457us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b2c00012ea8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed74d45a11 00007fed74d55372 00007fed76487a01 00007fed7644c43a 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2
0709 13:18:59.904923 (+ 12850us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.249096 (+344173us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:00.249134 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.249194 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.597580 (+348386us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b18004a1160. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:19:00.699236 (+101656us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b24003499b8. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed731e59c4 00007fed731e3acb 00007fed7339edc9 00007fed7339ea55 00007fed7339e09d 00007fed75fd010e 00007fed75fe788c 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221
0709 13:19:00.709652 (+ 10416us) raft_consensus.cc:1685] finished
0709 13:19:00.709676 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.709839 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3398,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":7418,"spinlock_wait_cycles":50224000,"thread_start_us":231424,"threads_started":1,"wal-append.queue_time_us":342525}
I20260709 13:19:00.716115 11323 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:00.717124  4118 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:00.717805 11334 raft_consensus.cc:3055] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:00.718171 11334 raft_consensus.cc:740] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:00.718632 11131 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:00.719388  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 279237us
I20260709 13:19:00.719116 11334 consensus_queue.cc:260] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.723273  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 765) took 1950 ms. Trace:
I20260709 13:19:00.720515 11334 raft_consensus.cc:3060] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:00.710877  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.727962  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.729367  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.731952  3966 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:00.732447  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4182) took 1092 ms. Trace:
I20260709 13:19:00.733438  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:00.733650  4044 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.732661  3966 rpcz_store.cc:276] 0709 13:18:59.640388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.352848 (+712460us) service_pool.cc:224] Handling call
0709 13:19:00.362355 (+  9507us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.732249 (+369894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.732393 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:00.738782  4045 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:00.739223  4038 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.739660  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:00.740057  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 430660us
I20260709 13:19:00.739354  4121 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.736176  4119 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:00.741243  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:00.739935 11063 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:19:00.746430  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 394510us
I20260709 13:19:00.748162  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4180) took 1108 ms. Trace:
I20260709 13:19:00.752532  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:00.751843  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:00.733346 11174 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.723646  4040 rpcz_store.cc:276] 0709 13:18:58.772349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:58.892558 (+120209us) service_pool.cc:224] Handling call
0709 13:18:59.664504 (+771946us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b58001d1698. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:18:59.673933 (+  9429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:18:59.674497 (+   564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:18:59.674550 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:18:59.759214 (+ 84664us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.221949 (+462735us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:00.262320 (+ 40371us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.722651 (+460331us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b180020dca0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed76444060 00007fed76456716 00007fed76467287 00007fed76467208
0709 13:19:00.722859 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.722931 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:00.722974 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:00.722985 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.723103 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1052,"prepare.queue_time_us":20109,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":4238,"raft.queue_time_us":460434,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":13486336,"thread_start_us":348499,"threads_started":1,"wal-append.queue_time_us":451472}
I20260709 13:19:00.755925  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4164) took 1122 ms. Trace:
I20260709 13:19:00.757454  3970 rpcz_store.cc:276] 0709 13:18:59.633921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.251930 (+618009us) service_pool.cc:224] Handling call
0709 13:19:00.277636 (+ 25706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.333018 (+ 55382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.333053 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.333109 (+    56us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:19:00.333179 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.755712 (+422533us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b54001559d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:00.755759 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.755871 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78135168}
I20260709 13:19:00.750808 11280 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:00.759802 11060 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.758834 11258 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:00.762485 11175 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.763046  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.754779 11289 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.755002 11356 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.745393  4114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:19:00.788479 11289 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.768191 11350 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:00.767800  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3783) took 1369 ms. Trace:
I20260709 13:19:00.768705  4121 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:00.773475  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:00.778066  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4288) took 1492 ms. Trace:
I20260709 13:19:00.766506 11258 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:00.779124  4680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 534) took 1448 ms (client timeout 1783 ms). Trace:
I20260709 13:19:00.779585  4677 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:00.769083 11174 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.786571  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:00.771948 11359 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:00.791960 11269 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.768122 11175 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.766027 11063 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:00.768930 11060 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:00.794193  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.771533  4120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 796) took 1287 ms. Trace:
I20260709 13:19:00.793079 11313 consensus_queue.cc:1048] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:00.801704  4012 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:00.802716  4112 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:00.804229 11250 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.805214  4040 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:00.774941 10901 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:00.848572  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.811335 11268 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.813036  4113 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:00.816114  4684 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:00.820901  4114 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:00.826669  4121 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.825209  3969 rpcz_store.cc:276] 0709 13:18:59.396891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.887935 (+491044us) service_pool.cc:224] Handling call
0709 13:19:00.236490 (+348555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.242899 (+  6409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.766023 (+523124us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54004079d0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.766163 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37172224}
I20260709 13:19:00.838114  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:00.839669  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:00.844697  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:00.846125  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:00.847240  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 45657.5us
I20260709 13:19:00.850454  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 790) took 1729 ms. Trace:
I20260709 13:19:00.824797  4119 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260709 13:19:00.826793  4647 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.845281  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:00.865803  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.847559  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:00.866976  3964 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
W20260709 13:19:00.824040  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 143525us
I20260709 13:19:00.827010  4676 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
W20260709 13:19:00.827472  4680 rpcz_store.cc:269] 0709 13:18:59.330223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.331152 (+   929us) service_pool.cc:224] Handling call
0709 13:19:00.778900 (+1447748us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400a8a554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.779039 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891777280}
I20260709 13:19:00.870002  4114 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:00.816148 11216 consensus_meta.cc:287] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.005s
I20260709 13:19:00.814625 11155 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.889539  4115 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:00.889575  4682 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEARNER]: Advancing to term 25
I20260709 13:19:00.891256  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 699) took 1002 ms. Trace:
I20260709 13:19:00.827171  4042 rpcz_store.cc:276] 0709 13:18:59.285841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.458774 (+172933us) service_pool.cc:224] Handling call
0709 13:18:59.487689 (+ 28915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.772227 (+284538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.777787 (+1005560us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540035cfd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:00.778003 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622317440}
W20260709 13:19:00.895419  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 249378us
I20260709 13:19:00.896870  3966 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:00.897125  4677 rpcz_store.cc:276] 0709 13:18:59.888995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.889443 (+   448us) service_pool.cc:224] Handling call
0709 13:19:00.779264 (+889821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.827687 (+ 48423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.891084 (+ 63397us) spinlock_profiling.cc:243] Waited 537 ms on lock 0x7b5400a8a550. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.891199 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1235265152}
I20260709 13:19:00.898458  4117 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 23. Ops: []
I20260709 13:19:00.830299 11174 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.899420 11383 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:00.887295  4114 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:00.900985  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 180747us
I20260709 13:19:00.849210 11313 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.902822  4682 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 25 LEARNER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:19:00.840888 10891 consensus_meta.cc:287] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 13:19:00.817353 11074 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:00.822729 11289 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.843590 11063 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.873152  4113 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:00.914655 11250 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:00.847823 11356 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:00.844092 11175 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:00.844846  4120 rpcz_store.cc:276] 0709 13:18:59.483698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.254569 (+770871us) service_pool.cc:224] Handling call
0709 13:19:00.290108 (+ 35539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.367284 (+ 77176us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:00.456129 (+ 88845us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.624892 (+168763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.633038 (+  8146us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:00.633082 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.771302 (+138220us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b54003d2a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:00.771345 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.771456 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155396,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":93,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":3257,"spinlock_wait_cycles":106984192,"thread_start_us":226365,"threads_started":2,"wal-append.queue_time_us":192896}
I20260709 13:19:00.832386  4649 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:00.919662 11074 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.920962 11216 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:00.922473 11174 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.922791 11416 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:00.923187 11174 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.823290 11370 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.876268  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:00.878839  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4152) took 1538 ms. Trace:
I20260709 13:19:00.825169 11350 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:00.880666  4676 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51360 (request call id 697) took 1005 ms. Trace:
I20260709 13:19:00.927162  4676 rpcz_store.cc:276] 0709 13:18:59.888147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.929926 (+ 41779us) service_pool.cc:224] Handling call
0709 13:19:00.773324 (+843398us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:19:00.869580 (+ 96256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512576}
I20260709 13:19:00.827386 11258 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:00.881395  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:00.926308  3971 rpcz_store.cc:276] 0709 13:18:59.339927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.340032 (+   105us) service_pool.cc:224] Handling call
0709 13:18:59.652584 (+312552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:18:59.739507 (+ 86923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.878635 (+1139128us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400279f50. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:00.878756 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652974848}
I20260709 13:19:00.881224 10901 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.932394 11174 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.923529 11087 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.021s
I20260709 13:19:00.933115 10901 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.882085 11346 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.933789 11346 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.935309 11370 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:00.935849 11346 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.834760 11269 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.938222 11269 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:00.844554 11060 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:00.933660 11087 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:00.891408 11155 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:00.907624  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 55876.4us
I20260709 13:19:00.906399  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:00.912521  4114 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:00.906580 11340 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:00.912459  3938 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:00.748534  3968 rpcz_store.cc:276] 0709 13:18:59.639787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.336419 (+696632us) service_pool.cc:224] Handling call
0709 13:19:00.350237 (+ 13818us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.368175 (+ 17938us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:00.569962 (+201787us) log.cc:844] Serialized 14 byte log entry
0709 13:19:00.747845 (+177883us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:00.747897 (+    52us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:00.747940 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.748002 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:00.748107 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":237157,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":49,"raft.queue_time_us":12463,"thread_start_us":279284,"threads_started":2}
I20260709 13:19:00.900959 11131 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:19:00.920480  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88253.3us
I20260709 13:19:00.923452 11416 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.918911  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:00.952358  4679 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:19:00.929216 11350 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:00.953701 11340 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:00.954383 11340 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:00.955709  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.957084  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.931308 11289 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:00.957895  4041 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:00.929729 11175 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:00.958743 11271 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:19:00.959151 11269 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:00.958941 11175 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.959712 11271 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:00.960071 11271 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:00.960319 11416 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.865368  4118 rpcz_store.cc:276] 0709 13:18:59.120927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.030507 (+909580us) service_pool.cc:224] Handling call
0709 13:19:00.436659 (+406152us) spinlock_profiling.cc:243] Waited 6.1 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:19:00.441245 (+  4586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:00.717484 (+276239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.850239 (+132755us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b5400456fd4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:00.850399 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647990912}
I20260709 13:19:00.884218  4648 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:00.960891 11346 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:00.961460 11346 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:00.939116  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:00.957466  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:00.962546  4682 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:00.922467 11074 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.949162  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:00.951574  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 49389.9us
I20260709 13:19:00.965727  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.967422  4042 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:00.945246 11087 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:00.966450  4040 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 21.
W20260709 13:19:00.973773  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 97588.9us
W20260709 13:19:00.975291  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 91179.3us
W20260709 13:19:00.975761  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 76332.4us
I20260709 13:19:00.978089 11175 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:00.979085  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 77305.2us
I20260709 13:19:00.977020  4087 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:00.911414 10891 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.978832 11347 raft_consensus.cc:2804] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:00.975945 11216 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:00.975020 11269 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:00.988919 11268 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:01.003500 11269 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.004191 11087 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.005638 11087 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:01.006889  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.008092  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.008791  3970 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:19:00.984042  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:01.009928  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.005652 11269 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:00.990006  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:00.984752 11289 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:19:00.994810  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:00.995656 11359 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:00.995977 11325 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:00.960928 11271 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:00.997567  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:00.998667  3937 leader_election.cc:400] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:19:01.032603  3937 leader_election.cc:403] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:19:00.998694 11347 raft_consensus.cc:697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:01.001401  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.034301 11347 consensus_queue.cc:237] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.032316  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.037107 11337 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:01.037384 11325 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.003094 11216 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:01.009321 11340 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.036641  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.038520 11216 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:01.039798 11337 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:01.041452 11340 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.026855  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.027627  4112 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:01.038112  4013 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.043848 11060 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:01.044360 11060 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:01.045313 11060 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.029970 11359 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:01.047770 11359 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:01.023963 11155 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.007s
I20260709 13:19:01.049285 11155 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:01.038072  4042 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:19:01.049691 11155 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.050700  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:01.050565 11155 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.051749 11155 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:01.052263 11288 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:01.031646 11074 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:01.033334 11116 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 14. Current term is 15.
I20260709 13:19:01.018328  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.048660  3964 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:01.009796  4649 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:01.053858  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.025069  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.048682 11359 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.054523  3969 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:01.052686 11288 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.055135 11359 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:01.033497  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44997.6us
I20260709 13:19:01.056028  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:01.056874 11116 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:01.049403 11325 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.057266 11116 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:01.057763  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 45312.7us
I20260709 13:19:01.053090 11074 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.058473 11074 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.058768  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:01.027837  3966 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:01.042137  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.062166  4012 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.063102 11416 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:01.063396 11069 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:01.055425 11288 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.063898 11069 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.057840 11116 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:01.064473 11069 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.063540 11416 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.066267 11416 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:01.068899  3972 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:19:01.063133  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53414.7us
I20260709 13:19:01.073005 11334 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:01.073472 11334 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.073796 11334 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.075325  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.076022 11416 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:01.063601 11414 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:01.077904 11414 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:01.079080 11414 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.080941  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:01.081578  4679 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.011440 11346 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.041903  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:01.085687  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43961.1us
I20260709 13:19:01.086273 11337 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:01.097503 11337 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.098104 11289 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:19:01.089293  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 51303.7us
I20260709 13:19:01.101946 11258 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.103924 11258 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.105674  4679 raft_consensus.cc:2468] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
W20260709 13:19:01.106901 11412 log.cc:927] Time spent T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.193s	user 0.002s	sys 0.000s
I20260709 13:19:01.109428  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:01.138748  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 110771us
I20260709 13:19:01.110013 11334 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.112890 11216 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.098608 11337 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:00.964985 11313 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:01.119454 11280 raft_consensus.cc:1064] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:19:01.126583  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.099660  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:01.141791  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90230.1us
W20260709 13:19:01.147446  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.146379  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:01.146958  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50073.7us
I20260709 13:19:01.148684  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:01.149973  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 50373.7us
I20260709 13:19:01.150638  4013 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.156069  4087 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:01.154482  3965 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:01.162464  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.164201  4011 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.161849  4047 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:01.168975  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:01.072661 11350 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:01.156865 11280 raft_consensus.cc:1068] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:01.153003 11175 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:01.173748  4679 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 13.
I20260709 13:19:01.155985 11340 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:19:01.174093  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 98875.9us
W20260709 13:19:01.218063  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64333.3us
I20260709 13:19:01.213387 11174 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:01.221299 11174 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:01.222301 11174 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.217139 11060 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:01.224120 11060 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.228026 11288 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.230022 11334 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:01.230554  4681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 698) took 1254 ms. Trace:
I20260709 13:19:01.230954 11418 raft_consensus.cc:2804] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:19:01.232262  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 68636.6us
I20260709 13:19:01.145979 11250 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:19:01.237476 10891 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:01.252012  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.159044 11258 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:19:01.170849 10901 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:01.153093 11069 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.264446  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:01.279719  4676 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.270079  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:01.270507  4649 leader_election.cc:336] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.989s (SENT)
I20260709 13:19:01.274289  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.274065 11116 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:01.274858  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.206755 11063 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:01.262723  4013 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:19:01.316103  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53530.6us
I20260709 13:19:01.317502  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.217999 11340 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.168125 11074 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.250631  4681 rpcz_store.cc:276] 0709 13:18:59.888563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:18:59.889089 (+   526us) service_pool.cc:224] Handling call
0709 13:19:00.781857 (+892768us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b5800202298. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b4640ab 00007fed7b464131 00007fed7b425fc0 00007fed7b410929 00007fed7b4103d2 00007fed74987bd4
0709 13:19:00.782106 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:00.782518 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:00.782545 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:00.783053 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 13:19:00.925183 (+142130us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:00.925226 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:00.926602 (+  1376us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:01.126142 (+199540us) raft_consensus.cc:1685] finished
0709 13:19:01.126164 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:01.142845 (+ 16681us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1136,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":14317440,"thread_start_us":132157,"threads_started":1,"wal-append.queue_time_us":209586}
W20260709 13:19:01.328354  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.328193  3965 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:01.331856  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.245076 11175 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.281001  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.249351 11087 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.118s
I20260709 13:19:01.273931  4012 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:01.337194  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.337507  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.406322  3963 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.339730  3968 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.340481 11280 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:01.341490 11359 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:01.314813 11418 raft_consensus.cc:697] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.416181 11418 consensus_queue.cc:237] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.342453 11074 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.349350 11069 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:01.422806 11280 raft_consensus.cc:1064] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:19:01.423254 11280 raft_consensus.cc:1068] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:01.351022  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.424815  3972 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.341622 11116 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.317785 11063 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.328512 11414 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:19:01.356753 11334 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:01.358767 11417 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:01.359445 11370 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:01.359846  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.360922 11416 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.363566 11216 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.328560 11268 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:19:01.374290 11271 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.376621  4681 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:01.383780  4676 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:01.329860 11340 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:01.427915 11060 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:01.406512  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 132303us
I20260709 13:19:01.216516 11356 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.110s
I20260709 13:19:01.413589  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.280321 10901 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.419852  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.465469 11409 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:01.465683  4087 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:01.467366 11325 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:01.444476 11074 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:01.398672 11175 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.436744  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.444741  4679 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:01.396410 11288 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:01.430241 11063 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.430498 11414 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.499794  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 225987us
I20260709 13:19:01.469094  3965 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.470104  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.471114  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:01.449134  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:01.447484  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 177011us
W20260709 13:19:01.428854 11427 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:19:01.437305  3870 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 17 to 18, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195), now has a pending config: VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195), VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:01.479372 11186 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
W20260709 13:19:01.481087  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 121329us
I20260709 13:19:01.484050  3967 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:01.455588  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:01.475925 10901 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.486419 11325 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.488348 11313 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.517597  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.519104  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.507545  3870 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 17 to 18, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 18 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:01.497082  3968 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:01.456307 11416 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:01.499312  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.501045  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.553045 11416 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.555035 11416 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.531683  3870 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
I20260709 13:19:01.538702  3972 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 22.
I20260709 13:19:01.531383 11409 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
W20260709 13:19:01.545260 11423 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:19:01.547286 11325 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.548031  4679 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:01.569555  3870 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:01.558144  4648 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:01.573746  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.566318  3969 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:01.502493 11414 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:01.567183  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.569543 11264 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:01.531082 11346 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:01.578913  3971 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:01.575763  3972 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:01.569137 10901 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.559814  3963 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:01.581710  3964 raft_consensus.cc:1240] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:01.583205  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.584406  3968 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:01.587148  3968 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:01.590900 11337 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:01.502331 11340 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:01.592787  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 121737us
I20260709 13:19:01.593394  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.595103  3972 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:01.502660 11074 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.596714  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.597621 11340 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.599993  4676 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:19:01.623665  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.599901 10901 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:01.625344  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.627012  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.599905  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:01.576097 11416 consensus_queue.cc:1059] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:19:01.584255 11288 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:19:01.634549  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 117065us
I20260709 13:19:01.594231  3968 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.636751  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.639117 11347 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:01.639603 11347 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:01.640003 11347 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.639181  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.639026  3969 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:01.643661  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.644173  3969 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.645826  3972 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:01.646833  3970 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:01.650771  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.597675 11074 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:01.652310  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:01.653496  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.650134  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.651434  4011 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.656816 11175 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.658946 11175 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:01.659579  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:01.660099  4041 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:01.661033  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:01.661276 11258 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:01.661895  4047 raft_consensus.cc:1240] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:01.662992  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:01.663563  4681 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.669102  3968 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.670550  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.672565 11426 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:01.673045  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:01.673628  4043 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:01.677901  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.681282  3969 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:19:01.682545  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:01.683149 11116 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:01.683718 11213 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:01.686396 11213 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:01.686736 11213 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:01.687057 11213 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:01.689035  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.690291  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:01.691038  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45019us
I20260709 13:19:01.690950  3966 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:01.692497  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:01.695613  4681 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:01.696748  3968 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:01.697772  4041 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:19:01.698659  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.699584  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:01.700135  3971 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:19:01.594101 11216 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:19:01.641687 11350 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:01.708091  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 56726.3us
I20260709 13:19:01.720026  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.720729  3965 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:01.649679 11288 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:01.728020 11288 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.728850 11186 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:01.729277 11186 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.729620 11186 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:01.733171  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50752.4us
I20260709 13:19:01.735206  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.736086 11175 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:01.736492 11175 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:01.736907 11175 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:01.737836  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.718709  3963 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:19:01.741070  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49353.7us
I20260709 13:19:01.741379  3963 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:01.741921  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:01.742237  3963 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.743321  3963 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:01.746665  3972 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:01.691115 11131 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:01.728479  3968 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:19:01.723758  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:01.749639  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.754403  4043 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
W20260709 13:19:01.760429  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 82618.2us
I20260709 13:19:01.777700  3966 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:01.791153  3963 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:01.792176  4085 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:01.794843  4085 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:01.800246  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90575.2us
I20260709 13:19:01.801034  4011 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.795710  4085 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:01.751384 11131 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:19:01.806560  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 82876.3us
W20260709 13:19:01.807148  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.753183 11116 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:01.807976 11131 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:01.808995  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 67158.8us
W20260709 13:19:01.817536  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.808943  4011 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.820820  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.800428 11271 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:01.825052  4012 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:01.804515 11250 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:01.753638 11264 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:19:01.804683 11268 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:01.809258 11350 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:01.808528 11323 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:01.817200 11313 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:01.815375 11258 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:01.815145 11074 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:01.846562  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:01.861264  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.826037 11435 raft_consensus.cc:2804] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:01.865305 11416 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:01.863510 11350 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:01.900339  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 74598.7us
I20260709 13:19:01.886616 11268 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.873178 11258 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:01.872076 11280 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:01.931023 11350 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:01.859774 11418 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:19:01.891417 11313 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:01.873163 11436 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:19:01.935679  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 130375us
W20260709 13:19:01.941995  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 80825us
I20260709 13:19:01.944700  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:01.940289  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 133437us
W20260709 13:19:01.949815  4650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.906492 11416 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:01.974118  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:01.934612 11060 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:01.886448 11116 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:19:01.982328  4011 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.927042 11441 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:01.935808 11258 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:01.891274 11213 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:01.896545 11143 consensus_queue.cc:1059] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.198s
I20260709 13:19:01.997856  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:01.980487 11416 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:02.002305  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:01.985265 11060 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:02.003695 11441 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:02.025607 11441 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.027496 11186 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.984130 11436 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:02.033819 11436 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.020514 11454 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:02.035295 11456 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:02.022535 11143 raft_consensus.cc:3055] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.022938 11347 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.024596 11213 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:01.999980 11356 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:19:02.040175  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 166711us
I20260709 13:19:01.985086 11250 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:01.983894 11063 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.058856  4042 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:02.018734 11340 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.036350 11060 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:01.980609 11280 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.068728  4676 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:02.049378 11346 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:19:02.076125 11346 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:02.076371 11063 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:02.076809 11439 log.cc:927] Time spent T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:19:02.078200 11063 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:19:02.079710 11445 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:02.083137 11131 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:01.902159 11417 raft_consensus.cc:2955] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:02.086815 11347 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.038115 11143 raft_consensus.cc:740] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:02.089568 11313 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:02.093902  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.101336  4681 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
W20260709 13:19:02.124699  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 122370us
W20260709 13:19:02.125347  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 65505.5us
I20260709 13:19:02.122548 11356 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.129396 11356 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.129921 11250 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.050863 11323 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:02.017343 11414 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.135201  3965 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:02.136198 11356 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.136405  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.136960 11323 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.132129  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.138005  3964 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:02.138972  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:02.139526  4679 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.136108 11414 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:02.146471  3964 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:02.122189 11074 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:02.147976 11074 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.148986 11143 consensus_queue.cc:260] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.150223 11143 raft_consensus.cc:3060] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.151603  4679 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:19:02.098305 11258 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:02.078711 11063 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:02.137096 11356 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:02.125252  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:02.185266  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.186574  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.152480 10901 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:02.187747 10901 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:02.159490  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 159798us
I20260709 13:19:02.159741  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.096594 11346 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:02.168720  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.201362  3964 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:19:02.137228  3965 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:02.204840  3967 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:19:02.198185 10901 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.206441 10901 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.210155 11258 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.047639 11268 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.198665  3968 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:02.133524 11269 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:19:02.223031  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.221979  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:02.040591 11456 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.206318 11435 raft_consensus.cc:697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:02.278405  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 54581.6us
W20260709 13:19:02.279757  4649 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.016s	sys 0.044s
W20260709 13:19:02.294004  4649 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.016s	sys 0.044s
W20260709 13:19:02.294353  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 546193us
I20260709 13:19:02.205070 11131 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:02.222893 11080 raft_consensus.cc:3055] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:02.305343  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.306064  4043 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:02.221949 11454 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:02.221755 11269 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:02.303721 11325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.015s	sys 0.055s
I20260709 13:19:02.191663 11414 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:19:02.293943 11334 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:02.312124  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.328567  3964 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 14.
I20260709 13:19:02.337023  4043 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:19:02.304747 11080 raft_consensus.cc:740] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:19:02.324383 11325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.015s	sys 0.056s
W20260709 13:19:02.361274  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 87153us
I20260709 13:19:02.362416  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:02.366786 10901 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:02.367342 10901 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.364718 11461 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:19:02.369131 11469 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:02.369799 11469 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:19:02.368814  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.326571 11186 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:02.343132 11426 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.670s	user 0.007s	sys 0.003s
I20260709 13:19:02.382949 10901 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.387926  4040 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:02.388588  4045 raft_consensus.cc:1240] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:02.389618  4046 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:02.390058  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.390822  4047 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 21: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:02.390062 11269 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.391161  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.391692 11269 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:02.391844  4039 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 26: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:02.393293  4047 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e32744704d014399851a0661c8929ded"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:19:02.391815  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.394065  4039 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:02.394490  4044 raft_consensus.cc:2410] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:19:02.399145  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.399792  4044 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:19:02.370175 11469 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:02.395394  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.399479  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.400591  4041 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:02.400053  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.402181  4045 raft_consensus.cc:1240] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:19:02.404340 11461 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.406808 11461 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:02.405496  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.298851 11462 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.146s
I20260709 13:19:02.369243 11213 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.372068  3965 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:19:02.407944  4041 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:02.407994 11461 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.426374 11461 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.426563 11451 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:19:02.428117 11459 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.428457 11069 consensus_queue.cc:1059] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:02.342610 11063 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.11, Last appended by leader: 11, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.428638 11459 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.429584 11347 raft_consensus.cc:3055] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:02.429988 11347 raft_consensus.cc:740] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:02.430820 11459 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.365610 11418 consensus_queue.cc:1059] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:19:02.431416  4649 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:02.443378  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.447399  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.344975 11334 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.478961  4676 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:19:02.484261  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.484963  4120 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:02.485244  4118 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:02.485293  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.383186 11426 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:02.490289  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:02.490082  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 299650us
I20260709 13:19:02.494417  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.495316  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.496194  4041 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:02.493330  4043 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:02.502305  4046 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:02.504208  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.504825  4044 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:02.412963 11280 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:02.366035 11346 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.509335  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.548636  4043 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:02.550652  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:02.551543  4045 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:02.552807  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.430790 11347 consensus_queue.cc:260] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.561770 11476 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.584156 11469 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.413082 11454 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.449771 11271 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:19:02.501914 11131 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.516206 11216 raft_consensus.cc:2804] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:19:02.587455  4041 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 25: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:02.486992 11435 consensus_queue.cc:237] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.591331  4044 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
W20260709 13:19:02.591940  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79739.4us
W20260709 13:19:02.599514 11175 consensus_meta.cc:287] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.003s
I20260709 13:19:02.587908 11418 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.600603 11334 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:02.593014 11268 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
W20260709 13:19:02.603273 11350 consensus_meta.cc:287] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.663s	user 0.006s	sys 0.002s
I20260709 13:19:02.593545  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.599515  4045 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
W20260709 13:19:02.612175  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61607.4us
I20260709 13:19:02.654354  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.655308  4041 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:19:02.612489  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 169074us
W20260709 13:19:02.596294 11452 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:19:02.649926  4042 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: []
W20260709 13:19:02.656052  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 159133us
I20260709 13:19:02.613327 11370 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.668607  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:02.669834  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.677162  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.679862  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.681816  4112 raft_consensus.cc:2410] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:19:02.648262 11280 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:02.654456 11143 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.691439  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.654032 11271 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.698365  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.664613 11216 raft_consensus.cc:697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:19:02.714874  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 61339.5us
I20260709 13:19:02.642158 11131 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.718565  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.613381 11476 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.649999 11175 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.720710  4040 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:02.727288  4045 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: [17.11-18.12]
I20260709 13:19:02.685235 11155 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.650287 11475 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:19:02.653836 11418 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:02.736567  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.759157  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.760099 11418 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:02.761058 11131 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:02.761336  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.751184  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.763692  4682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:02.745251  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.768370  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.768818  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.666859 11350 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.745636 11476 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:02.775720 11060 consensus_meta.cc:287] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260709 13:19:02.776190 11060 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.751137  4012 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:02.784224  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.691846 11370 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.753615 11155 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.717623 11451 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:02.755899 11416 consensus_meta.cc:287] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.002s
I20260709 13:19:02.757097  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.758281 11469 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.762602  4120 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:02.774266  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.795656  4681 raft_consensus.cc:1240] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:02.795810  3966 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:02.777065  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.778066 11175 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.749439  4040 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:02.778584  4045 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:02.782631  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:02.800544  3972 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:02.774458  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:02.801239  4676 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:02.678161 11347 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:02.788312  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.802385  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.803036  3964 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:02.789726  3968 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:02.793720  4041 raft_consensus.cc:2410] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:19:02.776623 11350 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.810413  3968 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:02.831028  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:02.833137  4040 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:02.833494  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.837755  4114 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 26.
I20260709 13:19:02.841677  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.774541 11216 consensus_queue.cc:237] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.734016 11271 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.734153 11143 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.845173  4013 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:02.845608  4040 raft_consensus.cc:2468] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:02.847165  4044 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:19:02.795812 11480 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.848097  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.849762 11350 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:19:02.848910  4041 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:02.849936 11480 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.850521 11350 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:02.850059  3963 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:02.851445 11350 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.841620 11477 raft_consensus.cc:1064] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:19:02.854936  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103914us
I20260709 13:19:02.855996  4040 raft_consensus.cc:1240] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:19:02.855880  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.843255 11313 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:02.799969 11416 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:02.870862  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 79900.1us
I20260709 13:19:02.846773 11359 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:19:02.872632  4112 raft_consensus.cc:1275] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:19:02.873030  4112 pending_rounds.cc:85] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 15
I20260709 13:19:02.873277  4112 pending_rounds.cc:107] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:19:02.874523  4112 raft_consensus.cc:2889] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:02.865397 11477 raft_consensus.cc:1068] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:02.871827  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:19:02.873409  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:02.881598  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.884362  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.884636  4040 raft_consensus.cc:1240] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:02.885897  4038 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:02.888168  3968 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:19:02.871829 11313 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:02.892840  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:02.893580 10901 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:02.896487 11483 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:19:02.896912  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 241767us
I20260709 13:19:02.897614  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:02.897691 11323 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:02.896673  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:02.898442 11477 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:02.900115  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:02.872565 11461 consensus_queue.cc:1059] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
W20260709 13:19:02.900327 11493 log.cc:927] Time spent T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:02.901160 11477 raft_consensus.cc:3055] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.901204 11497 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:02.901633 11477 raft_consensus.cc:740] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:02.901888 11497 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.904735 10901 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:02.907326  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.902281 11497 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:02.908835  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:02.910706 11116 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:02.913251 11060 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.915068 11271 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:02.916862 11478 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:19:02.909551  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:02.923130 11416 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.898389 11323 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:02.924176 11323 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.925370 11323 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:02.926476 11458 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.625s	user 0.003s	sys 0.000s
W20260709 13:19:02.927990 11484 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:19:02.905400 11477 consensus_queue.cc:260] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.929829 11477 raft_consensus.cc:3060] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:02.930219 11370 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:02.932243 10901 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.930444 11080 consensus_queue.cc:260] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.934027 11487 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:19:02.908293 11483 consensus_queue.cc:1059] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:19:02.935669  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:02.908622  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.935839  4047 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:02.937394  4047 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:02.909571  4648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:02.936792  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4208) took 1210 ms. Trace:
I20260709 13:19:02.939360  3971 rpcz_store.cc:276] 0709 13:19:01.726642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.755307 (+ 28665us) service_pool.cc:224] Handling call
0709 13:19:01.797236 (+ 41929us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:01.981561 (+184325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:01.981606 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:01.982184 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:19:02.006751 (+ 24567us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:02.006791 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:02.006865 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:02.925745 (+918880us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:19:02.931186 (+  5441us) raft_consensus.cc:1685] finished
0709 13:19:02.931214 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:02.936695 (+  5481us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4035,"raft.queue_time_us":25048,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":33721,"spinlock_wait_cycles":21073792,"thread_start_us":203932,"threads_started":2,"wal-append.queue_time_us":148539}
I20260709 13:19:02.923039 11473 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.938491  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:02.962718 11080 raft_consensus.cc:3060] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:02.964881  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64817.6us
I20260709 13:19:02.964160 11473 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:02.969477 11313 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.971117 11473 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:02.972738 11498 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:02.973213 11498 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:02.973420 11487 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:02.973559 11498 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:02.973809 11487 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:02.974630  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:02.975250 11451 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:02.967170 11370 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:19:02.967352 11155 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:02.976042 11456 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:02.964344 11359 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:02.978173  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.991652  3966 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 24.
I20260709 13:19:02.976562  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.963316 11462 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:02.964350 11492 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:19:02.981091  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 119764us
I20260709 13:19:02.980551  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:02.987749  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:02.990238  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:02.997834  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.000640  4038 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:03.000166  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:03.003983  4677 raft_consensus.cc:2410] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:19:03.005445  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:03.005378  4684 raft_consensus.cc:1240] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 15. Current term is 16. Ops: []
I20260709 13:19:02.997707 11359 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.009430 11359 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.013269  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:03.014074  4681 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:03.015159 11492 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:02.997532 11155 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.015954 11155 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.016268 11492 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:02.998541 11250 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:03.037214 11250 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.038058 11250 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.039252 11250 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.018280  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:03.091363  4120 raft_consensus.cc:2468] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:19:03.013149 11131 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.108587  3963 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:03.061329  3966 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:03.040349  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:03.211068  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:03.210455  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 235870us
I20260709 13:19:03.065601 10901 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:19:03.215902  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 215520us
I20260709 13:19:03.107110  4047 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.211102  4678 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:03.222218  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:03.010413 11116 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:03.229588 10901 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:03.226747  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.211671 11346 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:03.041386 11213 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:03.003644 11462 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.232605  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.237452  4047 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:03.081705 11359 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.245043  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:03.245131  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:03.246094 11280 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:19:03.235008 11213 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:03.247231 11280 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:03.249193  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:03.249323  4112 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:03.249044 10901 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.081441 11497 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.254045  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.253088  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:03.242283 11436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.028s	sys 0.012s
I20260709 13:19:03.223274 11131 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.297044  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.297677  4116 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:03.298210 11131 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:03.299296  3965 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:03.298468  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.302687 11462 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:03.301461  3966 raft_consensus.cc:1275] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:19:03.305174  3966 pending_rounds.cc:85] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 14
I20260709 13:19:03.305235  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.260713 11288 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.234186 11477 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:03.261592  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.307276  4115 raft_consensus.cc:2368] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23.
I20260709 13:19:03.307812  4047 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:19:03.275580  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.087127 11487 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.231154 11485 consensus_queue.cc:1059] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:19:03.282155 11448 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:03.287659  4041 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:03.305518  3966 pending_rounds.cc:107] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:19:03.259919  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.311018  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.312621  4115 raft_consensus.cc:2393] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:03.312902  3966 raft_consensus.cc:2889] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:03.318253  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.319077 11483 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:03.281523 11280 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:03.323730  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.283639 11155 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:03.295399 11436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.028s	sys 0.013s
I20260709 13:19:03.323710  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.247686 11461 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
I20260709 13:19:03.319659 11359 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:03.331473  4112 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 22 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:19:03.336071  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.332060  4047 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:03.337071  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.338617  4112 raft_consensus.cc:2410] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:19:03.339632  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 86797.5us
I20260709 13:19:03.311717 11448 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:03.340472  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.349270  4039 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:03.349699  4039 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:03.380864  4121 raft_consensus.cc:1275] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:19:03.311050 11477 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.311311 11288 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.331444 11116 consensus_queue.cc:1059] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
W20260709 13:19:03.385219  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.547832  4043 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:03.413625  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.387182  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:03.410707  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 75015.9us
I20260709 13:19:03.569000  4040 raft_consensus.cc:1240] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:03.380810  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.569895  4119 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:03.570567  4112 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:03.391311  4039 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.575754  4039 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:03.577837  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:03.458750 11515 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:19:03.578538  3971 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.577822  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:03.579411  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 239028us
I20260709 13:19:03.586477  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.454430 11250 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:03.587518  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:03.589953 11461 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:03.590386 11461 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.590627 11502 raft_consensus.cc:993] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:19:03.590744 11461 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.591717 11350 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.592257 11350 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.594301 11350 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:03.595510  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:03.595788  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.590869  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.599367  4039 raft_consensus.cc:2410] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:19:03.599766  4119 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:03.601445  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3534) took 1214 ms. Trace:
I20260709 13:19:03.601719  4042 rpcz_store.cc:276] 0709 13:19:02.386655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.388343 (+  1688us) service_pool.cc:224] Handling call
0709 13:19:02.388648 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.666283 (+277635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.601279 (+934996us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540035c0d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:03.601399 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600469248}
W20260709 13:19:03.602102  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.597008  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.603155  4121 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 22: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:03.341894 11498 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.605753  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.604933  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.607353  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:03.607832  4678 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:03.586011 11497 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:03.611129  3971 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:03.613003  4117 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 25: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:03.613978 11288 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:03.614775  4116 raft_consensus.cc:1813] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Handling vote request from an unknown peer b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.622726  4116 raft_consensus.cc:2368] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:19:03.623059 11462 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:03.623477 11462 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:03.587754 11116 consensus_queue.cc:1059] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:19:03.616788 11498 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:03.617543  4119 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:03.610841 11483 raft_consensus.cc:1081] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:19:03.626164 11485 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:03.626526 11485 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:03.627377 11485 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.628371 11485 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:03.614882 11480 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:03.629521 11451 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:03.625622 11447 raft_consensus.cc:3055] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:03.630192 11447 raft_consensus.cc:740] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:03.630956 11447 consensus_queue.cc:260] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.632161 11447 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:03.632496  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.633656  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.633744  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:03.618322 11501 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.704s	user 0.000s	sys 0.004s
I20260709 13:19:03.608359 11155 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.634172  4684 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:03.632192  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.636516  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.426623 11448 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.458921 11280 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.639155 11280 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:03.624970  3970 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:19:03.624887  4679 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:19:03.634164  4116 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 25
I20260709 13:19:03.651167  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3826) took 1519 ms. Trace:
I20260709 13:19:03.651520  3970 rpcz_store.cc:276] 0709 13:19:02.132156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.132295 (+   139us) service_pool.cc:224] Handling call
0709 13:19:02.132585 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.649495 (+1516910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.650928 (+  1433us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b540030be54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:03.651079 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3431370112}
W20260709 13:19:03.613888 11519 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:19:03.640692 11448 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.624254 11462 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:03.642846 11461 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.660095 11461 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:03.648073 11477 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:03.648574  4678 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:03.676265  4116 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:03.621920  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.641387  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:03.678005  3971 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:03.662830 11518 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:19:03.683583  4679 raft_consensus.cc:1240] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:03.666848  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:03.675899  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71027.2us
I20260709 13:19:03.680262  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.681736 11155 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:03.676193 11350 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:03.691591 11491 consensus_queue.cc:1059] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:03.692363  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.691833  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:03.386778 11213 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.693818  4678 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:03.694943  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:03.689157  4116 raft_consensus.cc:2393] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:03.692679 11498 raft_consensus.cc:3055] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:03.696187 11498 raft_consensus.cc:740] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.696962 11155 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:03.697309 11498 consensus_queue.cc:260] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.697557 11155 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.698565 11498 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:03.699791  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4316) took 1087 ms. Trace:
I20260709 13:19:03.700160  4044 rpcz_store.cc:276] 0709 13:19:02.612942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.647294 (+ 34352us) service_pool.cc:224] Handling call
0709 13:19:02.647673 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:02.849450 (+201777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.699532 (+850082us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54000df054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:03.699725 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375737216}
I20260709 13:19:03.685468 11462 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:03.702047  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.702661  3972 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:03.699739 11155 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:03.705466  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.709465  4042 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:19:03.711990  3971 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:03.714648  4121 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:19:03.715063  4121 pending_rounds.cc:85] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 14
I20260709 13:19:03.715315  4121 pending_rounds.cc:107] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:19:03.715600  4121 raft_consensus.cc:2889] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:03.718497  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.718663  4038 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:03.717746  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.690582 11264 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.719075  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.721959  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.727706  4678 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:03.693188 11258 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:03.732493  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.712990 11143 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:03.728804 11155 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:03.745167 11347 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.745793 11347 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.746654  4113 raft_consensus.cc:2468] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:03.747748 11347 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:03.738099 11497 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:03.752836  4012 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:03.737015  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:03.717417 11476 consensus_queue.cc:1175] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0f3fa9d459de485e824f023c55580bc6" responder_term: 21 status { last_received { term: 20 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:19:03.736263  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.729249 11491 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:03.733224 11418 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:03.733469 11258 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.738445  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.733315 11264 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.693406 11435 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
W20260709 13:19:03.743216 11526 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:19:03.757661 11486 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.851s	user 0.002s	sys 0.003s
I20260709 13:19:03.754021  4116 raft_consensus.cc:2410] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:19:03.756918  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.738085 11116 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.760583  4085 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:03.763368  4086 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:03.758507  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:03.738137 11523 log.cc:927] Time spent T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:19:03.765170 10901 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:03.757951 11143 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 13:19:03.764113 11334 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:19:03.764554 11258 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:03.769480 11435 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:03.770275 11491 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.799651 11491 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.771534  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.801075  4118 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:03.762075 11502 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:19:03.761945 11370 consensus_queue.cc:1048] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:19:03.747661  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.781904  4121 raft_consensus.cc:2393] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 26: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:03.806572  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.782449  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:03.808871  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:03.785941  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:03.767724 11264 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:03.759968 11456 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:19:03.804301  4011 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:03.814674  3964 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:03.809301  4116 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
W20260709 13:19:03.763911 11417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.453s	user 0.008s	sys 0.036s
I20260709 13:19:03.786384 11271 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:03.791922 11418 consensus_queue.cc:1059] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:03.792394  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.797168 10901 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:03.797911 11455 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:03.798769  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.799665  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4317) took 1148 ms. Trace:
I20260709 13:19:03.784988 11447 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:03.788480 11155 raft_consensus.cc:2804] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:03.827188  4085 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:03.784698 11116 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.829641  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:03.879264  4113 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:03.886060  4118 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:19:03.888618  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:03.827448  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 62150.6us
I20260709 13:19:03.889348  4039 rpcz_store.cc:276] 0709 13:19:02.651248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.651440 (+   192us) service_pool.cc:224] Handling call
0709 13:19:03.799451 (+1148011us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b540041c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:03.799603 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522042112}
W20260709 13:19:03.891528  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64419.4us
W20260709 13:19:03.893064  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100754us
W20260709 13:19:03.826076 11417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.518s	user 0.008s	sys 0.037s
I20260709 13:19:03.894229  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.896458  3964 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
W20260709 13:19:03.897043  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 106983us
I20260709 13:19:03.903911  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:03.904345  4012 leader_election.cc:400] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23.
W20260709 13:19:03.898449  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.829384 10901 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.906260  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:03.889855  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:03.904709  4012 leader_election.cc:403] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:03.909536  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:03.912364  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:03.913376  3963 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:03.913642  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:03.916880  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.917022  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.918035  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:03.919183  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.918764  3970 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:19:03.829903 10891 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:03.918712  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:03.917551  3969 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:03.829785 11350 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:03.850569 11502 raft_consensus.cc:3055] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:19:03.931645  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:03.850576 11271 raft_consensus.cc:697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.937867  4116 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:03.939391  4116 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.892886 11280 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:03.938771  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 343298us
I20260709 13:19:03.942268 10901 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:03.942873 10901 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:03.943128  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:03.943262 10901 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:03.944777  3963 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 17: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:03.904827 11131 raft_consensus.cc:2804] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:03.904933 11418 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:03.951938  4648 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:03.915719 11264 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:03.852710 11416 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:19:03.825762 11527 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.133s
I20260709 13:19:03.908413 11155 raft_consensus.cc:697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.914582 11531 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:03.920533 11143 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:03.954942  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:03.952834 10901 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.971180  4038 raft_consensus.cc:1240] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:19:03.875653 11497 consensus_queue.cc:1059] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:19:03.940336  4116 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.959575  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:03.898312 11447 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.900220 11455 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:03.928970 10891 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:03.938973 11350 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:03.944638 11069 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:03.940481 11502 raft_consensus.cc:740] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:03.953727 11325 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:03.974468  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:04.006292  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 1.3482e+06us
W20260709 13:19:04.037536  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 80808us
I20260709 13:19:04.251756  4044 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:04.252516  4038 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
W20260709 13:19:04.255707  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 351441us
I20260709 13:19:04.356570 10891 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.362164  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.363281  4012 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:04.135713  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.365015  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:03.960896 11491 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:19:04.366030 11069 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:03.951964 11280 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.367015 11069 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:03.971031 11534 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 23
W20260709 13:19:04.263705 11485 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.635s	user 0.018s	sys 0.003s
I20260709 13:19:03.959460 11492 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.264350 11323 raft_consensus.cc:3055] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:04.266507 11116 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:04.014427 11521 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.436s	user 0.000s	sys 0.004s
I20260709 13:19:03.961061 11347 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:03.963652 11334 consensus_queue.cc:1059] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:19:03.945236 11498 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:19:04.012651  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:03.975689 11531 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.028625 11271 consensus_queue.cc:237] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.258541 11213 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:04.258080  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4321) took 1508 ms. Trace:
I20260709 13:19:04.398046 11325 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:04.397329 11323 raft_consensus.cc:740] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:19:04.264233  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 287738us
I20260709 13:19:03.976104  4677 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:19:04.016053 11533 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:19:04.287994  4113 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:19:04.294797  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.432003  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.408299 11347 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.289335 11451 raft_consensus.cc:3055] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:04.332319  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:04.333851  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.437681  4040 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:04.317921 11487 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:04.251348 11250 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.648s	user 0.007s	sys 0.011s
I20260709 13:19:04.343351  4039 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:19:04.348332  4046 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:04.323033 11131 raft_consensus.cc:697] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:04.353798  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.368609  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:04.440274  4043 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:04.347184 11448 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.347301 11258 consensus_meta.cc:287] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.007s
I20260709 13:19:04.397802  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:04.446091  4040 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:04.422210 11543 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:04.346843 11264 consensus_queue.cc:1059] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:19:04.358348 11350 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:04.413025 10901 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.414142  4042 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:04.421245  3971 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 26.
W20260709 13:19:04.257022  4114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 800) took 1553 ms (client timeout 1685 ms). Trace:
W20260709 13:19:04.461387  4114 rpcz_store.cc:269] 0709 13:19:02.704018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.733589 (+ 29571us) service_pool.cc:224] Handling call
0709 13:19:04.013958 (+1280369us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b54001446d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:04.256944 (+242986us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":179162496}
I20260709 13:19:04.423617  4045 rpcz_store.cc:276] 0709 13:19:02.750065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.750193 (+   128us) service_pool.cc:224] Handling call
0709 13:19:02.751268 (+  1075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:02.810023 (+ 58755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.014146 (+1204123us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b540035cad4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:04.258010 (+243864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62370048}
I20260709 13:19:04.347549 11155 consensus_queue.cc:237] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:04.310111  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.435439  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:19:04.464015  4120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51850 (request call id 802) took 1668 ms (client timeout 2093 ms). Trace:
I20260709 13:19:04.440493  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4332) took 1595 ms. Trace:
W20260709 13:19:04.360066  4649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 2.665s (SENT) [suppressed 9 similar messages]
I20260709 13:19:04.439896  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.441995  4677 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: [24.19-24.19]
I20260709 13:19:04.414867 11527 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:19:04.414798 11552 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.470069  4039 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:19:04.443316 11485 consensus_queue.cc:1059] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:04.443675  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.443769  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:04.408864 11491 consensus_queue.cc:1059] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:19:04.470590  4039 pending_rounds.cc:85] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 13
I20260709 13:19:04.491017  4039 pending_rounds.cc:107] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:19:04.491281  4039 raft_consensus.cc:2889] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.452242  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.434152 11186 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.413177 11436 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:19:04.399605 11492 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.513579  4045 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:19:04.514168  4045 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:04.514572  4045 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:04.515412 11492 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:04.464074  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.437147 11347 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:04.517315 11491 raft_consensus.cc:3055] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:04.517758 11491 raft_consensus.cc:740] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:04.517880 11531 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.518568 11491 consensus_queue.cc:260] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.519166 11537 raft_consensus.cc:3055] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:04.519557 11537 raft_consensus.cc:740] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:19:04.468331  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 108289us
I20260709 13:19:04.520295 11537 consensus_queue.cc:260] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:04.520964 11501 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:19:04.523312  3964 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:19:04.469226  4120 rpcz_store.cc:269] 0709 13:19:02.798329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.810098 (+ 11769us) service_pool.cc:224] Handling call
0709 13:19:04.463789 (+1653691us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54002071d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:04.463929 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557923072}
W20260709 13:19:04.447546 11499 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 1.438s	user 0.000s	sys 0.006s
I20260709 13:19:04.436976 11456 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.472178  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:04.473856  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 105354us
I20260709 13:19:04.533826  4012 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.530761  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.535533  4012 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.474548  4046 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:04.453627 11543 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.444594 11250 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:04.437340 11451 raft_consensus.cc:740] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:04.485358 11280 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.467056  4041 rpcz_store.cc:276] 0709 13:19:02.844885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.333559 (+488674us) service_pool.cc:224] Handling call
0709 13:19:03.334126 (+   567us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.336455 (+  2329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.336485 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.337592 (+  1107us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.770894 (+433302us) spinlock_profiling.cc:243] Waited 19.5 ms on lock 0x7b1800292480. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:19:03.911208 (+140314us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:04.301919 (+390711us) log.cc:844] Serialized 14 byte log entry
0709 13:19:04.302130 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.302208 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.434802 (+132594us) raft_consensus.cc:1685] finished
0709 13:19:04.440305 (+  5503us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.440440 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39269,"prepare.queue_time_us":459188,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":11418,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":10536,"spinlock_wait_cycles":44912000,"thread_start_us":494957,"threads_started":2,"wal-append.queue_time_us":602220}
I20260709 13:19:04.488615  3970 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
W20260709 13:19:04.502086 11547 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:04.451771 11258 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.502532 11325 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.504891 11323 consensus_queue.cc:260] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.451581 11529 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:04.439827 11131 consensus_queue.cc:237] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.549644 11473 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.083s
I20260709 13:19:04.618629 11473 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:04.514102 11436 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.059s
I20260709 13:19:04.507504 11455 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:04.448518 11448 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.431211 11502 consensus_queue.cc:260] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.530675 10901 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:04.633834 11451 consensus_queue.cc:260] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.548122  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.551201  4047 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:04.637903  4113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 4041) took 1003 ms. Trace:
I20260709 13:19:04.556861 10891 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.565603 11456 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.638279  4113 rpcz_store.cc:276] 0709 13:19:03.633995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.898118 (+264123us) service_pool.cc:224] Handling call
0709 13:19:03.916775 (+ 18657us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.431772 (+514997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.637634 (+205862us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54002080d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:04.637838 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852859136}
W20260709 13:19:04.568506  4649 connection.cc:256] RPC call timeout handler was delayed by -1.0873074959997666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 13:19:04.639806  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.640390 11456 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:04.492998 11530 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:04.641808 11530 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:04.642432 11530 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:04.644410  3968 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:04.501766 11527 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:04.590885  3970 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:19:04.647436  3970 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:19:04.647694  4677 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:19:04.645745  3968 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:19:04.562764 11536 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:19:04.590582 11551 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:04.610642 11543 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.548108 11350 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.612249 11542 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:04.642560 11534 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23.
I20260709 13:19:04.623304  4043 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:19:04.670135  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.670653  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.571422 11556 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.670887 11323 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:04.632928 11541 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:19:04.493602 11552 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.531467 11186 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.633193  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.650251 11473 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.637250 11451 raft_consensus.cc:3060] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:04.563556  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 91452us
I20260709 13:19:04.638374  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.636935 10901 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:04.644466  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.694368  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.648640  3970 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:19:04.652383  4676 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:04.698800  4118 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:04.700176  4087 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:04.651396  3968 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: [24.19-24.19]
I20260709 13:19:04.652326  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:04.611475 11258 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.661779  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:04.717800  3970 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:19:04.663264 10891 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:04.719647  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:04.506357 11447 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.673336  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4239) took 1367 ms. Trace:
I20260709 13:19:04.717128 10901 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.645794 11527 consensus_queue.cc:1048] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.015s
W20260709 13:19:04.633795 11540 log.cc:927] Time spent T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:19:04.728664  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.675908  4042 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:19:04.681193  4038 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:04.683167  4119 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 26.
I20260709 13:19:04.685664 11551 raft_consensus.cc:2764] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:19:04.724591  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:04.722546  4120 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 23. Ops: []
I20260709 13:19:04.726634  4087 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.722765  3965 rpcz_store.cc:276] 0709 13:19:03.306206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.306312 (+   106us) service_pool.cc:224] Handling call
0709 13:19:03.319273 (+ 12961us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:03.587103 (+267830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.587133 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:03.587174 (+    41us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:03.587204 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.673084 (+1085880us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54003138d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:04.673135 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.673276 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615453440}
I20260709 13:19:04.740259  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.742000  4120 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 13:19:04.730793 10901 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:04.731938  3970 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:19:04.717795  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:04.743451  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.616541 11347 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.736896  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:04.745723  4118 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:04.737732  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.717731 11456 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.749469  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.756243  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.757676  4677 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 13:19:04.731943 11498 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.729230 11250 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.728878 11447 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:04.779448  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:04.782763  4676 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:04.775272  4045 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.789490  4039 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:04.738713 11552 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:04.790740  4120 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:19:04.716564 11473 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.799012  4118 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:19:04.758172 11549 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:04.807438  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:04.807752  4113 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:04.807660  4120 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 11. Preceding OpId from leader: term: 25 index: 12. (index mismatch)
I20260709 13:19:04.756462 11280 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:04.732102 11485 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
W20260709 13:19:04.808472  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 260401us
I20260709 13:19:04.814842  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:04.812640  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:04.798624 11448 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.832667  4045 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:04.827705  3969 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:04.828135  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:04.825176  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 183959us
I20260709 13:19:04.790804 11554 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:04.760113 11456 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.809347 11549 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:04.838907  3965 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:19:04.849308  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.800966 11447 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.832229  3972 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:19:04.797190 11370 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:19:04.835691  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:04.855108  4045 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:04.854915  4012 leader_election.cc:400] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25.
I20260709 13:19:04.864104  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.864265  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.834460 11531 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:04.866281  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 4020) took 1571 ms. Trace:
I20260709 13:19:04.826773 11563 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:04.827908 11280 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:04.875838  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:04.875469  4115 rpcz_store.cc:276] 0709 13:19:03.295523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.332842 (+ 37319us) service_pool.cc:224] Handling call
0709 13:19:03.340000 (+  7158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:03.340358 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:03.340387 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:03.381314 (+ 40927us) log.cc:844] Serialized 26 byte log entry
0709 13:19:03.813864 (+432550us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b18000722e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:19:03.915961 (+102097us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:03.956432 (+ 40471us) log.cc:844] Serialized 14 byte log entry
0709 13:19:03.957406 (+   974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:03.957590 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.853635 (+896045us) raft_consensus.cc:1685] finished
0709 13:19:04.866063 (+ 12428us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.866215 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35455,"prepare.queue_time_us":39673,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":11293,"raft.run_cpu_time_us":12588,"raft.run_wall_time_us":111729,"spinlock_wait_cycles":2329472,"thread_start_us":101775,"threads_started":1,"wal-append.queue_time_us":1014861}
I20260709 13:19:04.879868  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.880614  4115 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 16.
I20260709 13:19:04.884004  4115 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:04.894963  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:04.856429 11551 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:19:04.896818  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:04.897368  4117 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:04.895344 11447 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.897902  4118 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:04.850337 11549 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:04.848709 11552 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.847592 11557 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:04.909288  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.866685 11534 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.899284 11213 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.875387 11531 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:04.853248 11436 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260709 13:19:04.899489 11448 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.906137 11131 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:04.916564 11551 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.937109 11186 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:04.938694 11532 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.994s	user 0.000s	sys 0.007s
I20260709 13:19:04.939595  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:04.941346 11347 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:04.941550  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4244) took 1236 ms. Trace:
I20260709 13:19:04.942032 11347 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:04.942544 11347 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.941892  3972 rpcz_store.cc:276] 0709 13:19:03.704982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.705225 (+   243us) service_pool.cc:224] Handling call
0709 13:19:04.941391 (+1236166us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54004010d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:04.941494 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2589795712}
I20260709 13:19:04.943994  4039 raft_consensus.cc:1275] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:19:04.945399  4039 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:19:04.946707  4039 pending_rounds.cc:85] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 16
I20260709 13:19:04.946954  4039 pending_rounds.cc:107] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 21.17
I20260709 13:19:04.947165  4039 raft_consensus.cc:2889] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:04.875116 11542 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:19:04.913790  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:04.939615  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:04.948556 11069 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:04.953480 11473 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.929489 11213 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.954320 11280 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.956251 11213 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.929143 11350 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.958750 11456 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:04.914883 11216 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:04.959617 11216 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.901005 11417 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:19:04.919106 10901 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:04.930523  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.897452 11483 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:19:04.932854  4118 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 17.
I20260709 13:19:04.899857 11250 consensus_queue.cc:1059] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:19:04.969290 11530 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.912992  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:04.945467 11559 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:19:04.911307 11558 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:04.979662  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4253) took 1071 ms. Trace:
I20260709 13:19:04.963815 11258 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:19:04.932471  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 148346us
I20260709 13:19:04.944558 11347 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:04.982322  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:04.980029  3967 rpcz_store.cc:276] 0709 13:19:03.907959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.268286 (+360327us) service_pool.cc:224] Handling call
0709 13:19:04.291708 (+ 23422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.396329 (+104621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.396373 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.412984 (+ 16611us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.674683 (+261699us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:04.674728 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.674802 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:04.979413 (+304611us) raft_consensus.cc:1685] finished
0709 13:19:04.979433 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:04.979599 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27357,"raft.queue_time_us":79184,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":5030,"thread_start_us":291738,"threads_started":2,"wal-append.queue_time_us":378349}
I20260709 13:19:04.917469 11562 consensus_queue.cc:1048] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:19:04.964531 11549 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:04.988274 11551 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:04.918699 11557 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:04.919009 11574 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:19:04.991961 11216 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:04.987780  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 76860us
W20260709 13:19:04.993597 11576 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:19:04.993984 11575 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:04.900022 11563 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:04.999393 11069 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:05.001281  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:05.025420  3972 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:19:05.002974  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:05.005252  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:04.952611 11131 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:04.935774 11448 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.021114  4012 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:05.023540  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 147554us
I20260709 13:19:05.027340  3971 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 14.
W20260709 13:19:05.031265  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 195624us
I20260709 13:19:05.045356  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:04.988351 11531 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:05.119377  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 98317.6us
W20260709 13:19:05.116799  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 71497.6us
I20260709 13:19:05.119856  4011 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:05.122359  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.123052  4012 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:05.121134 11551 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:05.160611  3972 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:05.120242 11216 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:05.168356 11213 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.168601 11530 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.048957 11131 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.155186 11542 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:05.120994 11435 consensus_queue.cc:1059] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.045s
I20260709 13:19:05.157905 11552 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:05.165516 11531 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:05.183611 11566 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
W20260709 13:19:05.185643 11577 log.cc:927] Time spent T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:19:05.186347 11565 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 13:19:05.186894  4681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 746) took 1225 ms. Trace:
I20260709 13:19:05.187311  4681 rpcz_store.cc:276] 0709 13:19:03.961607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.961749 (+   142us) service_pool.cc:224] Handling call
0709 13:19:04.007563 (+ 45814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.676932 (+669369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.676966 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.716752 (+ 39786us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.914316 (+197564us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:04.914355 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.914421 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.186619 (+272198us) raft_consensus.cc:1685] finished
0709 13:19:05.186652 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.186829 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44833,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":10528,"thread_start_us":535136,"threads_started":2,"wal-append.queue_time_us":272750}
I20260709 13:19:05.191203  4112 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:19:05.168943 11213 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:05.191385  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70730.9us
I20260709 13:19:05.043412 11575 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.158002 11350 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:19:05.160341 11436 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:19:05.224182  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:05.228120  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:05.228276  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:05.185561 11569 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:19:05.229655  4118 raft_consensus.cc:2410] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:19:05.230995 11558 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:05.232512 11216 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:05.233181  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.233460 11549 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:05.233704  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.234314 11448 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.237926 11131 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:05.238677 11557 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.183640 11542 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:05.240010 11542 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.157397  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:05.243302  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 85987us
I20260709 13:19:05.244952 11569 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:05.244510  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:05.263465  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:05.263795  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:05.256714  4113 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:05.279624  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:05.267345  4012 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:05.289387  4047 raft_consensus.cc:3060] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:05.302713  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 262570us
I20260709 13:19:05.267517 11569 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:05.257741  4649 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:05.324543  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.326048  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.327126  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:05.330886 11568 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:19:05.332130  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 64857.9us
I20260709 13:19:05.333139  4012 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:05.334702 11350 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:05.335391 11350 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:05.336705 11350 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:05.336941 11569 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:05.337857 11551 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:05.338402 11350 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:05.341825  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.342839  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85173.9us
W20260709 13:19:05.353121  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49426us
I20260709 13:19:05.328552  4043 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:05.372867  4047 raft_consensus.cc:2468] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:05.378072 11350 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.380663  3938 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:05.381839 11451 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:19:05.383266 11451 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:05.383610 11451 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.383910 11451 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:05.369995 11069 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:05.397708  4649 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:05.265021 11213 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.401264  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:05.403160  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.326067 11575 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.408046  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:05.427682  4046 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:05.400652 11435 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.431963  3972 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:05.434724  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:05.443054  3967 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:05.435693  3969 raft_consensus.cc:1275] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:05.435948  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:05.436510 11323 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.448347  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:05.449029  3972 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:19:05.445569 11250 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.446753 11323 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.454718 11250 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.456310 11323 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:05.447537 11435 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.427531 11575 raft_consensus.cc:2804] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:05.407349 11558 consensus_queue.cc:1048] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:19:05.456725 11250 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:05.459686  4119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 4042) took 1825 ms (client timeout 1530 ms). Trace:
W20260709 13:19:05.463706  4119 rpcz_store.cc:269] 0709 13:19:03.634250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.636300 (+  2050us) service_pool.cc:224] Handling call
0709 13:19:05.459482 (+1823182us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b5400097754. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:05.459609 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2265201920}
I20260709 13:19:05.459976  4114 raft_consensus.cc:1240] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:19:05.464941  3967 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
W20260709 13:19:05.462054 11572 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.548s	user 0.000s	sys 0.016s
I20260709 13:19:05.462466 11575 raft_consensus.cc:697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:05.467235 11575 consensus_queue.cc:237] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.457110  3965 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:19:05.464107  4045 raft_consensus.cc:1240] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:05.427601 11560 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:05.442929 11456 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:05.476794  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.479266  3966 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
W20260709 13:19:05.458423 11571 log.cc:927] Time spent T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:19:05.460706 11435 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:05.473388 11558 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:05.479743 11560 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.488432 11456 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.510988 11560 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.533084  4649 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:05.512449 11456 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.540026  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:05.541332  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:05.542761  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.543438  4045 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:05.511504 11558 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.554193  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:05.554776  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 66191.6us
I20260709 13:19:05.539255 11583 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:05.514766 11451 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.552399 11580 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:05.604530  4045 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:05.575487 11560 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.577220 11116 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:19:05.585852 11586 log.cc:927] Time spent T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:19:05.587559 11558 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.590596  4115 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:19:05.593146 11216 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.593348  4046 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:05.594955 11451 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:05.596228  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3853) took 1269 ms. Trace:
I20260709 13:19:05.652642  3968 rpcz_store.cc:276] 0709 13:19:04.327053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.705786 (+378733us) service_pool.cc:224] Handling call
0709 13:19:04.706137 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.721362 (+ 15225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.721392 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.743401 (+ 22009us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.879809 (+136408us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:04.879857 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.879932 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.595960 (+716028us) raft_consensus.cc:1685] finished
0709 13:19:05.595985 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:05.596150 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14836,"raft.queue_time_us":20253,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":3932,"thread_start_us":89210,"threads_started":1,"wal-append.queue_time_us":730286}
I20260709 13:19:05.653460 11583 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:05.655066 11216 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.657335 11216 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.658228 11313 raft_consensus.cc:3055] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:05.658689 11313 raft_consensus.cc:740] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:05.659430  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:05.659891  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:05.659554 11313 consensus_queue.cc:260] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.661235  4676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
W20260709 13:19:05.661675  4038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49100 (request call id 3552) took 1290 ms (client timeout 1502 ms). Trace:
W20260709 13:19:05.662074  4038 rpcz_store.cc:269] 0709 13:19:04.371039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.397532 (+ 26493us) service_pool.cc:224] Handling call
0709 13:19:05.661468 (+1263936us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54000f0854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:05.661614 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531206912}
I20260709 13:19:05.663060 11563 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.661800  4676 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.664386  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.648172  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.639395 11483 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.660044  4115 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 22.
I20260709 13:19:05.651150  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3845) took 1736 ms. Trace:
I20260709 13:19:05.665778  4086 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:05.665802  3964 rpcz_store.cc:276] 0709 13:19:03.914866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.450009 (+535143us) service_pool.cc:224] Handling call
0709 13:19:04.491344 (+ 41335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.523675 (+ 32331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.650931 (+1127256us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b5400279054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:05.651093 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72246144}
W20260709 13:19:05.671352  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.674392  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:05.675063  4682 raft_consensus.cc:1240] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: [24.19-24.19]
I20260709 13:19:05.677392  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:05.673908 11483 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.682138 11560 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:05.649659 11116 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:05.674823 11313 raft_consensus.cc:3060] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:05.673731 11250 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:05.674723 11563 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:05.693590  4676 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:05.683036 11483 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:05.686182 11497 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 13:19:05.709970 11588 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.271s	user 0.003s	sys 0.001s
I20260709 13:19:05.712728 11529 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:05.714836 11529 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:05.717578  4112 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 4030) took 2148 ms (client timeout 1902 ms). Trace:
W20260709 13:19:05.718021  4112 rpcz_store.cc:269] 0709 13:19:03.569409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.577442 (+  8033us) service_pool.cc:224] Handling call
0709 13:19:05.717289 (+2139847us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b5400003054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:05.717463 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3689026944}
I20260709 13:19:05.720521 11502 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:19:05.702081 11563 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.726630 11186 raft_consensus.cc:3055] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:05.727118 11563 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:05.730464 11491 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:05.745772  4676 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:05.727041 11186 raft_consensus.cc:740] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:05.747459 11186 consensus_queue.cc:260] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.748536 11186 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.751339 11552 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:19:05.745967  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 71417.4us
I20260709 13:19:05.758576  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:05.760432  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.761970  4121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 4040) took 2128 ms. Trace:
I20260709 13:19:05.762287  4121 rpcz_store.cc:276] 0709 13:19:03.633728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.806312 (+172584us) service_pool.cc:224] Handling call
0709 13:19:05.761828 (+1955516us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b540034d854. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:05.761924 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259885312}
I20260709 13:19:05.764115  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:05.764793  3971 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:05.766980  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:05.767540  3968 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:05.774432  3968 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:05.778904  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:05.779439  3966 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:05.764744 11418 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:19:05.785821 10891 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:05.786170 10891 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:05.786398 11456 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.786895 10891 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.756829 11116 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:05.790337 11456 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:05.791180 11116 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:05.794103  4116 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.800721  4116 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:05.801512  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 4050) took 2155 ms. Trace:
I20260709 13:19:05.801745  4116 rpcz_store.cc:276] 0709 13:19:03.646390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:03.816132 (+169742us) service_pool.cc:224] Handling call
0709 13:19:05.793505 (+1977373us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54001070a0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c1a1d 00007fed763a81a4 00007fed7642a447 00007fed76442fe7 00007fed764447de 00007fed7645027c 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591
0709 13:19:05.801462 (+  7957us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1159599488}
I20260709 13:19:05.806237  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:05.780370 11611 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:05.771302 11529 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:05.809904  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:05.796922 11595 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.811787 11595 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.812009 11456 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:05.807785 11502 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:19:05.817251 11549 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:05.817590 11549 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:05.811045 11483 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260709 13:19:05.818406 11549 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.808975 11143 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:05.819752 11143 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.820092 11143 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:05.820564 11502 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:05.820971 11502 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.821291 11502 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:05.820209  4085 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:05.826206 11325 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:05.826623 11325 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:05.826992 11325 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:05.806851 11417 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
W20260709 13:19:05.827867  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.835525 11417 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:05.838896  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.839277  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.839771  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.840521  4038 raft_consensus.cc:2393] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 26: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:05.841990  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:05.842952  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:05.843448  3971 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.843974  3968 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:19:05.846607  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:05.854065  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.854389  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.835143 11548 consensus_queue.cc:1048] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:19:05.855247 11186 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:05.846228  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:05.856071  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.856817  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:05.857069 11473 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:05.858312  3965 raft_consensus.cc:2393] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:05.855481  4038 raft_consensus.cc:2393] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 16: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:05.859973  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:05.860692 10901 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:05.861640  3967 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:05.864337  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.866364  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:05.869506  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:05.869736  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.921784  4085 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:05.922482  3969 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 13:19:05.921635  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:05.923188  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:05.924309  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.930004  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:05.931231  3971 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:05.857492 11473 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:05.867208 11186 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.835110 11502 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.943862  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.944512  4043 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:05.935734  4121 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:19:05.920720 11456 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.939486  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:05.845552 11483 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.088s
I20260709 13:19:05.942040  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:05.985893  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:05.938585 11473 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:05.947806 11323 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:05.941440 11213 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:05.969543 11456 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.987257  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:06.285611  4113 raft_consensus.cc:1240] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:05.943244  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:06.287482  4116 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:06.287863  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 344661us
W20260709 13:19:05.999905  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 57943.4us
W20260709 13:19:06.006052 11582 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 13:19:06.006354 11580 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:06.288782 11497 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:06.046226 11502 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.053076 11143 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.017686 11264 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.290715 11264 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.291836 11143 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:06.024325 11561 log.cc:927] Time spent T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 1.153s	user 0.002s	sys 0.021s
W20260709 13:19:06.292672  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 348761us
W20260709 13:19:06.020361 11614 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:19:05.948777 11186 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.292709 11264 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.293768  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4251) took 2386 ms. Trace:
I20260709 13:19:06.295274 11186 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.031198 11213 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:05.998220 11619 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:19:06.296739 11143 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.297267 11143 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.297960 11213 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:06.298727  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.052433 11325 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:06.114517 11616 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:19:06.299209 11143 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.031699 11323 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:06.300861 11323 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.119067 11456 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.120123  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:06.123698 11473 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:06.191736 11537 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:06.156944 11620 log.cc:927] Time spent T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260709 13:19:06.308959  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 188903us
I20260709 13:19:06.312160 11562 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:19:06.312589 11562 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:06.312968 11562 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:06.315173 11325 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.198570  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 133) took 4868 ms. Trace:
I20260709 13:19:06.332608  3870 rpcz_store.cc:276] 0709 13:19:01.354722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:01.354905 (+   183us) service_pool.cc:224] Handling call
0709 13:19:06.198490 (+4843585us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:01.864165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:02.076633 (+212468us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:02.076685 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:19:02.076705 (+    20us) tablet.cc:662] Decoding operations
0709 13:19:02.128986 (+ 52281us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:02.129098 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:02.129136 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:19:02.129642 (+   506us) tablet.cc:701] Row locks acquired
0709 13:19:02.129694 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:19:02.129853 (+   159us) write_op.cc:270] Start()
0709 13:19:02.130011 (+   158us) write_op.cc:276] Timestamp: P: 1783603142129792 usec, L: 0
0709 13:19:02.130034 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:19:02.226583 (+ 96549us) log.cc:844] Serialized 2059 byte log entry
0709 13:19:02.863429 (+636846us) op_driver.cc:464] REPLICATION: finished
0709 13:19:03.085143 (+221714us) write_op.cc:301] APPLY: starting
0709 13:19:03.085239 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:03.088400 (+  3161us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:03.088512 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:03.149295 (+ 60783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:03.149639 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:19:03.149687 (+    48us) write_op.cc:312] APPLY: finished
0709 13:19:03.149993 (+   306us) log.cc:844] Serialized 49 byte log entry
0709 13:19:03.222142 (+ 72149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:03.228496 (+  6354us) write_op.cc:454] Released schema lock
0709 13:19:03.235977 (+  7481us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:03.283787 (+ 47810us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:03.292544 (+  8757us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":644,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":221427,"apply.run_cpu_time_us":8323,"apply.run_wall_time_us":165114,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20903,"num_ops":4,"prepare.queue_time_us":209389,"prepare.run_cpu_time_us":18376,"prepare.run_wall_time_us":588315,"raft.queue_time_us":241744,"raft.run_cpu_time_us":21859,"raft.run_wall_time_us":155367,"replication_time_us":732070,"thread_start_us":437565,"threads_started":4,"wal-append.queue_time_us":189793,"wal-append.run_cpu_time_us":42322,"wal-append.run_wall_time_us":1762869}]]}
I20260709 13:19:06.216528 11628 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:06.358472 11628 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.216930  4045 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:06.217338 11280 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:06.361477 11280 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:06.363629 11280 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:06.364167 11611 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.364696 11611 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.367002 11611 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:06.368001  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57759.7us
I20260709 13:19:06.207470 11595 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.237661  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:06.260702  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:06.261415  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:06.420377  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.422230  4087 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:06.266482 11549 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:06.271544  4044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4352) took 1828 ms. Trace:
W20260709 13:19:06.274093 11615 log.cc:927] Time spent T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.449s	user 0.003s	sys 0.000s
I20260709 13:19:06.278503  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41202 (request call id 790) took 1020 ms. Trace:
I20260709 13:19:06.423134  4120 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
W20260709 13:19:06.280055  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:06.281695 11250 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.423467  4047 rpcz_store.cc:276] 0709 13:19:05.258406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.399566 (+141160us) service_pool.cc:224] Handling call
0709 13:19:05.406342 (+  6776us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.460635 (+ 54293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.460667 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.461164 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.565651 (+104487us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:05.565695 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.278116 (+712421us) spinlock_profiling.cc:243] Waited 53.9 ms on lock 0x7b54003296d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:06.278167 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.278213 (+    46us) raft_consensus.cc:1685] finished
0709 13:19:06.278226 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.278444 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":357,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":124031232,"thread_start_us":104137,"threads_started":1,"wal-append.queue_time_us":228812}
I20260709 13:19:06.424799 11250 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.282101 11334 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.425328  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.425796 11334 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:06.426373  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.428984 11250 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.429646  4121 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:19:06.283974 11483 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.431056 11628 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:06.430784 11483 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.287982 11417 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:06.433293 11417 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:06.433781 11417 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:06.422966  4044 rpcz_store.cc:276] 0709 13:19:04.443154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.498227 (+ 55073us) service_pool.cc:224] Handling call
0709 13:19:04.570193 (+ 71966us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:04.593461 (+ 23268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.593492 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:04.593534 (+    42us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:04.593573 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.271327 (+1677754us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54000b7554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:06.271374 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.271487 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53032832}
I20260709 13:19:06.293502  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.442422  4116 raft_consensus.cc:2368] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27.
I20260709 13:19:06.443329  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.294571  3963 rpcz_store.cc:276] 0709 13:19:03.907449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.008109 (+100660us) service_pool.cc:224] Handling call
0709 13:19:04.008398 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.302627 (+294229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.302679 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.303149 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:19:04.681605 (+378456us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:04.681653 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:04.681731 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:05.920636 (+1238905us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:19:06.293496 (+372860us) raft_consensus.cc:1685] finished
0709 13:19:06.293517 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.293713 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16412,"raft.queue_time_us":59179,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12193,"spinlock_wait_cycles":53877504,"thread_start_us":374051,"threads_started":1,"wal-append.queue_time_us":522698}
I20260709 13:19:06.445530  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:06.446221  3963 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:06.282996 11548 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:06.231510  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:06.419287  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.419894  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.451464  4112 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:19:06.420495  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.420586  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.452292  4113 raft_consensus.cc:2468] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:06.422616 11473 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:06.430163  4120 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:19:06.387831  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:06.450067  3963 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:06.462815  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:06.463243  3963 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:06.451783  4117 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 16.
I20260709 13:19:06.464260  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:06.464613  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.465272  4117 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:06.452364  4115 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:19:06.262044  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:06.471158  3966 raft_consensus.cc:2393] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 18: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:19:06.470890  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 83151.5us
I20260709 13:19:06.472131  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.474066  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.475052  4113 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:06.475704 11483 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.450707 11548 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:06.478264 11548 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.478880 11334 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:06.470820 11456 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:06.484143  4087 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:06.486124  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.474311 11575 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:06.488581 11250 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:06.485149 11483 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:06.497795  4116 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:06.490742 11575 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:19:06.494176  3965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.012s	sys 0.011s
I20260709 13:19:06.498425 11575 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.498816 11417 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:06.503073 11417 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.497490 11562 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:06.503769  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:06.505374  4087 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:06.498497  3965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.012s	sys 0.011s
I20260709 13:19:06.505118  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:06.508404  4116 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:06.508682  4112 raft_consensus.cc:1240] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:06.509195 11417 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:06.509577  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:06.510149  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.510762  4117 raft_consensus.cc:1275] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:19:06.511188  4116 raft_consensus.cc:1240] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:06.513756 11562 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.508985 11549 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:06.518946  4115 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:06.519542  4113 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:06.520414  4112 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:06.524874  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:06.525192  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:06.527374  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.528909  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.529207 11575 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:06.531116  4112 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:19:06.535729  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.537160  4112 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:06.551216  4112 raft_consensus.cc:2468] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 21.
I20260709 13:19:06.547791 11575 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:06.552654  4681 raft_consensus.cc:1275] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:19:06.553140  4649 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:06.554100  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:06.554736  4681 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:06.555441 11575 raft_consensus.cc:2804] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:06.556134 11575 raft_consensus.cc:697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 21 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:06.554417  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.558023 11575 consensus_queue.cc:237] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:06.558662  4112 raft_consensus.cc:2376] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 26. Re-sending same reply.
I20260709 13:19:06.559514  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:06.560226  4112 raft_consensus.cc:2368] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22.
I20260709 13:19:06.564949 11498 consensus_queue.cc:1048] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:19:06.566507  4114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36872 (request call id 3530) took 1869 ms. Trace:
I20260709 13:19:06.566884  4114 rpcz_store.cc:276] 0709 13:19:04.696696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.722122 (+ 25426us) service_pool.cc:224] Handling call
0709 13:19:05.459755 (+737633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.465010 (+  5255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:06.566336 (+1101326us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400097750. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:06.566452 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1662627712}
I20260709 13:19:06.568233  4114 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:06.578554  4119 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:19:06.581332  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:06.582494 11583 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:06.588124  4040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4360) took 1727 ms. Trace:
I20260709 13:19:06.588557  4040 rpcz_store.cc:276] 0709 13:19:04.860546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.950194 (+ 89648us) service_pool.cc:224] Handling call
0709 13:19:04.950475 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:04.983197 (+ 32722us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:04.983229 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:04.989447 (+  6218us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.714746 (+725299us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b18001ea7e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:19:05.758128 (+ 43382us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:05.773217 (+ 15089us) log.cc:844] Serialized 14 byte log entry
0709 13:19:05.773467 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.773542 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:06.586204 (+812662us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b18001ea7e0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed7335f3f3 00007fed733617c1 00007fed73361779 00007fed73361709 00007fed733616d1 00007fed733609cd 000000000038f354 000000000038f199 00007fed7334283a
0709 13:19:06.587882 (+  1678us) raft_consensus.cc:1685] finished
0709 13:19:06.587905 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:06.588061 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16312,"prepare.queue_time_us":14925,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7087,"raft.queue_time_us":36049,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":59859968,"thread_start_us":43214,"threads_started":1,"wal-append.queue_time_us":813379}
I20260709 13:19:06.594041 11529 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:06.595481  4678 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:06.877210 11583 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:06.878414 11583 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:07.451643 11618 log.cc:927] Time spent T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 1.405s	user 0.010s	sys 0.013s
I20260709 13:19:07.798957  4119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 4068) took 1263 ms. Trace:
I20260709 13:19:07.799309  4119 rpcz_store.cc:276] 0709 13:19:06.535855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.536005 (+   150us) service_pool.cc:224] Handling call
0709 13:19:06.578328 (+ 42323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:06.579152 (+   824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:07.798763 (+1219611us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400080550. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:07.798901 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81378432}
W20260709 13:19:08.152364  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080030ea40 after lost signal to thread 2851
W20260709 13:19:08.152940  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5580 after lost signal to thread 2854
W20260709 13:19:08.442211 11640 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:19:08.449432  4121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36872 (request call id 3540) took 2154 ms (client timeout 2113 ms). Trace:
W20260709 13:19:08.450256  4121 rpcz_store.cc:269] 0709 13:19:06.294925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.298456 (+  3531us) service_pool.cc:224] Handling call
0709 13:19:08.449224 (+2150768us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540004d154. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:08.449344 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299623680}
I20260709 13:19:08.457170  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3869) took 2536 ms. Trace:
I20260709 13:19:08.457792  3971 rpcz_store.cc:276] 0709 13:19:05.920358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.931952 (+ 11594us) service_pool.cc:224] Handling call
0709 13:19:05.932247 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.950682 (+ 18435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.950712 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.986431 (+ 35719us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.455225 (+2468794us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:08.455266 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.455337 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.456937 (+  1600us) raft_consensus.cc:1685] finished
0709 13:19:08.456956 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.457093 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13084,"raft.queue_time_us":22748,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"thread_start_us":14216,"threads_started":1,"wal-append.queue_time_us":14613}
I20260709 13:19:08.474885 10891 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:08.480737  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3864) took 2636 ms. Trace:
I20260709 13:19:08.481201  3968 rpcz_store.cc:276] 0709 13:19:05.843922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.844801 (+   879us) service_pool.cc:224] Handling call
0709 13:19:05.846633 (+  1832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.846943 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.846971 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.857139 (+ 10168us) log.cc:844] Serialized 26 byte log entry
0709 13:19:05.868474 (+ 11335us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:05.868525 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:05.868609 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.480492 (+2611883us) raft_consensus.cc:1685] finished
0709 13:19:08.480524 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.480678 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":485,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":114,"spinlock_wait_cycles":11648,"thread_start_us":10845,"threads_started":1,"wal-append.queue_time_us":11228,"wal-append.run_cpu_time_us":2418,"wal-append.run_wall_time_us":1432215}
I20260709 13:19:08.489287 11537 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:08.489894 11537 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.491905 11537 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.518067  4681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 743) took 1926 ms. Trace:
I20260709 13:19:08.518519  4681 rpcz_store.cc:276] 0709 13:19:06.591869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.592025 (+   156us) service_pool.cc:224] Handling call
0709 13:19:06.592353 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.592563 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:19:06.592890 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.517708 (+1924818us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.517764 (+    56us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:08.517806 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.517870 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.517997 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1924549,"prepare.queue_time_us":1925,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47}
I20260709 13:19:08.520946 11264 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.523527 10891 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:08.527352 10891 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.522957 11264 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.528942 11498 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:08.529458 11498 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.530107 11264 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.530637 11264 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.531018 11264 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.531342 11498 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.531826 11498 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.514134 11549 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.538556 11549 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.543926  4116 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:08.532250 11498 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.558892 10891 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.560125 10891 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:08.560572 10891 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.522675 11537 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:08.540642 11549 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.574102 10891 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.564286 11537 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.588927 11264 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.592974 11558 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:08.593524 11558 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.595404 11558 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:08.595857 11558 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.597056 11069 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:08.597561 11069 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.599769 11069 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:08.601923 11498 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.607234  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4380) took 2717 ms. Trace:
I20260709 13:19:08.596282 11558 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:08.648011  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 120337us
I20260709 13:19:08.626659  4046 rpcz_store.cc:276] 0709 13:19:05.859969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.941211 (+ 81242us) service_pool.cc:224] Handling call
0709 13:19:05.949579 (+  8368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.949789 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:19:05.971101 (+ 21312us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.577075 (+2605974us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.577138 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:19:08.577191 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.577262 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.577384 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2560478,"prepare.queue_time_us":49764,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":10361,"thread_start_us":38356,"threads_started":1}
I20260709 13:19:08.646899 11537 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.650496  4038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4382) took 2790 ms. Trace:
I20260709 13:19:08.653220 11558 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:08.655844  4038 rpcz_store.cc:276] 0709 13:19:05.860452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.186423 (+325971us) service_pool.cc:224] Handling call
0709 13:19:06.186719 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.186907 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:19:06.187448 (+   541us) log.cc:844] Serialized 14 byte log entry
0709 13:19:08.649925 (+2462477us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:08.649978 (+    53us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:08.650027 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.650091 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.650439 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2352764,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":108677,"threads_started":1}
I20260709 13:19:08.681353 11537 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.692731 11648 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:08.693392 11648 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.695530 11648 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:08.712296  4116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 4065) took 2183 ms (client timeout 1607 ms). Trace:
W20260709 13:19:08.712855  4116 rpcz_store.cc:269] 0709 13:19:06.528399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.528509 (+   110us) service_pool.cc:224] Handling call
0709 13:19:08.696749 (+2168240us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b540004e054. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:08.712202 (+ 15453us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4580194560}
I20260709 13:19:08.746249  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.698954 11069 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.750110 11069 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.681986 11537 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.759344  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.760612 11069 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:08.766242  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.766191  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.786270 11537 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.787258  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.788204  4678 raft_consensus.cc:2410] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 28 because replica has last-logged OpId of term: 26 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 20.
W20260709 13:19:08.792521  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 110935us
I20260709 13:19:08.844512 11483 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.845234 11483 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.908445  4042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4383) took 2973 ms. Trace:
I20260709 13:19:08.909258  4043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4381) took 3049 ms. Trace:
I20260709 13:19:08.909163 11483 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.908993  4042 rpcz_store.cc:276] 0709 13:19:05.935024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.189727 (+254703us) service_pool.cc:224] Handling call
0709 13:19:06.190029 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.646396 (+2456367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.646427 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.647373 (+   946us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.662701 (+ 15328us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:08.662740 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.662807 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.775103 (+112296us) raft_consensus.cc:1685] finished
0709 13:19:08.775127 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.908368 (+133241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2350755,"thread_start_us":110938,"threads_started":2,"wal-append.queue_time_us":30410}
I20260709 13:19:08.911533  4043 rpcz_store.cc:276] 0709 13:19:05.860205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.945134 (+ 84929us) service_pool.cc:224] Handling call
0709 13:19:05.948788 (+  3654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.648280 (+2699492us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.648312 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.651444 (+  3132us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.743376 (+ 91932us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:08.743413 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.743480 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.909032 (+165552us) raft_consensus.cc:1685] finished
0709 13:19:08.909055 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.909200 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2584930,"thread_start_us":205688,"threads_started":2,"wal-append.queue_time_us":115060}
I20260709 13:19:08.914776  4041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4384) took 2979 ms. Trace:
I20260709 13:19:08.915441  4041 rpcz_store.cc:276] 0709 13:19:05.935355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.285057 (+349702us) service_pool.cc:224] Handling call
0709 13:19:06.285401 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.657887 (+2372486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.657920 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.658977 (+  1057us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.796965 (+137988us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:08.797003 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.797073 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.914570 (+117497us) raft_consensus.cc:1685] finished
0709 13:19:08.914591 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.914721 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2255633,"thread_start_us":238894,"threads_started":2,"wal-append.queue_time_us":246822}
I20260709 13:19:08.919308 11537 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Committing config change with OpId 23.19: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:19:08.928596  4086 connection.cc:256] RPC call timeout handler was delayed by -1.1132485840000754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 13:19:08.932010 11498 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:08.932626 11498 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.932202  4681 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Committing config change with OpId 23.19: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:08.935371 11250 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.935839 11250 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.938280 11250 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.940557 11264 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.941015 11264 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:08.941673 11483 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:08.942145 11483 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.943037  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3863) took 3099 ms. Trace:
I20260709 13:19:08.944831  4118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51850 (request call id 819) took 3410 ms. Trace:
I20260709 13:19:08.945307  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.945180  4118 rpcz_store.cc:276] 0709 13:19:05.534868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.558143 (+ 23275us) service_pool.cc:224] Handling call
0709 13:19:05.565322 (+  7179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:06.547921 (+982599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:06.547947 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:06.547976 (+    29us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:06.548000 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.944574 (+2396574us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b54003d2a54. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:08.944623 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.944736 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259276032}
I20260709 13:19:08.946094  4117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 4071) took 2400 ms. Trace:
I20260709 13:19:08.946455  4117 rpcz_store.cc:276] 0709 13:19:06.546150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.548294 (+  2144us) service_pool.cc:224] Handling call
0709 13:19:08.922476 (+2374182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:08.922827 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:08.922855 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:08.923345 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.944974 (+ 21629us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:08.945011 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.945075 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.945118 (+    43us) raft_consensus.cc:1685] finished
0709 13:19:08.945128 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.945863 (+   735us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b540004d150. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644b8ad 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:08.946039 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2539,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":5459299200,"thread_start_us":21261,"threads_started":1,"wal-append.queue_time_us":15022}
I20260709 13:19:08.949460 11483 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.943241 11325 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:08.950744 11325 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:05.805454  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:08.952756 11325 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.943466 10891 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:08.953963 10891 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:08.955814 10891 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:08.934887 11498 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.942971 11264 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:08.958832  3869 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 18 to 20, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.959681  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:08.962519  3869 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 19, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.964115  3869 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 23 to 25, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 25 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.965865  3869 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 21, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.967571  3869 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 18 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:08.969200  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48036.1us
I20260709 13:19:08.969336  3869 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.971071  3869 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 22, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.973428  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:08.943526  3964 rpcz_store.cc:276] 0709 13:19:05.843643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.843749 (+   106us) service_pool.cc:224] Handling call
0709 13:19:05.922400 (+ 78651us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.935451 (+ 13051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.935481 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.935932 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.803154 (+2867222us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b180046c420. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed73341e07 00007fed7c19cab9 00007fed7335e69b 00007fed7335c93f 00007fed7335ec02 00007fed75fe620b 00007fed75febd23 00007fed75fec0d1 00007fed76407a0f
0709 13:19:08.942638 (+139484us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:08.942677 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:08.942743 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:08.942782 (+    39us) raft_consensus.cc:1685] finished
0709 13:19:08.942793 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:08.942981 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1423,"raft.queue_time_us":17589,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8534,"spinlock_wait_cycles":9168640,"thread_start_us":139303,"threads_started":1,"wal-append.queue_time_us":3000080}
I20260709 13:19:08.974189  4116 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 27: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:08.985286  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:08.975862  3869 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 19 to 20, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.986928  3869 catalog_manager.cc:5697] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 23, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.989678  3869 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 13 to 15, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 15 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.991379  3869 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 18, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.993059  3869 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:08.997047  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:08.998500  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:08.999449 11537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:36870 (request call id 97) took 8839 ms. Trace:
W20260709 13:19:09.009811  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080039df20 after lost signal to thread 3904
I20260709 13:19:09.013227  4117 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:19:09.014430  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.015062  4116 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
W20260709 13:19:09.019769  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd8c0 after lost signal to thread 3996
W20260709 13:19:09.021234  4068 debug-util.cc:398] Leaking SignalData structure 0x7b0800307880 after lost signal to thread 4071
W20260709 13:19:09.021509  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080030f6e0 after lost signal to thread 4072
I20260709 13:19:09.024896 11350 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.025452 11350 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.027446 11350 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.028625 11435 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.029263 11435 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.031229 11435 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:08.999861 11537 rpcz_store.cc:276] 0709 13:19:00.204052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:00.256440 (+ 52388us) service_pool.cc:224] Handling call
0709 13:19:00.453202 (+196762us) log.cc:844] Serialized 501 byte log entry
0709 13:19:00.890457 (+437255us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5400394a20. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c1dbe 00007fed763cc930 00007fed763cc8d8 00007fed763cc858 00007fed763cc813 00007fed763cba9c 00007fed7c2b7626 00007fed7c2b1dd8 00007fed764087cb 00007fed7640b2c0
0709 13:19:00.893556 (+  3099us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180033c160. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed7c227de1 00007fed7c2345b1 00007fed732d9c0a 00007fed7ca19219 00007fed73361a40 00007fed7335c4e4 00007fed7335c455 00007fed763a5b0b 00007fed7642ab63 00007fed76452752 00007fed7644a9fa
0709 13:19:08.999356 (+8105800us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207521,"raft.queue_time_us":250596,"raft.run_cpu_time_us":1250,"raft.run_wall_time_us":58388,"spinlock_wait_cycles":57319680,"thread_start_us":127862,"threads_started":1,"wal-append.queue_time_us":180672,"wal-append.run_cpu_time_us":8118,"wal-append.run_wall_time_us":1244574}
I20260709 13:19:09.033056  3856 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 50aca70be0884ed09aa97127d571282f with cas_config_opid_index 18: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:19:09.033803 11543 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:09.034320 11543 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.036334 11543 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:09.045830  4068 debug-util.cc:398] Leaking SignalData structure 0x7b0800307f60 after lost signal to thread 4145
W20260709 13:19:09.046584  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080039d080 after lost signal to thread 4146
W20260709 13:19:09.047987  4068 debug-util.cc:398] Leaking SignalData structure 0x7b0800316940 after lost signal to thread 4709
W20260709 13:19:09.050251  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd060 after lost signal to thread 11116
W20260709 13:19:09.050661  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003dd2e0 after lost signal to thread 11213
W20260709 13:19:09.050969  4068 debug-util.cc:398] Leaking SignalData structure 0x7b080034af60 after lost signal to thread 11280
W20260709 13:19:09.051414  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003c2d40 after lost signal to thread 11451
I20260709 13:19:09.052320  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:09.053169  4115 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:19:09.053575  4115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36886 (request call id 4067) took 2518 ms (client timeout 2646 ms). Trace:
I20260709 13:19:09.031677 11435 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:09.053962  4115 rpcz_store.cc:269] 0709 13:19:06.535538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.536098 (+   560us) service_pool.cc:224] Handling call
0709 13:19:09.049986 (+2513888us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800160598. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327f8c 00007fed73327ef6 0000000000375939 00007fed7b39b1e0 00007fed7b4640c4 00007fed7b464131 00007fed7b4120a0 00007fed7b411984 00007fed7498c6d4 00007fed7498c662
0709 13:19:09.053518 (+  3532us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3424000}
I20260709 13:19:09.058395 11627 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 13:19:09.062337  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.064965 11069 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:09.082878 11280 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.083480 11280 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.085611 11280 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.096812  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3858) took 3254 ms. Trace:
I20260709 13:19:09.097462  3972 rpcz_store.cc:276] 0709 13:19:05.841934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.842057 (+   123us) service_pool.cc:224] Handling call
0709 13:19:05.842313 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:05.842504 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:05.869075 (+ 26571us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.096322 (+3227247us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.096399 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:09.096464 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.096571 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.096707 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2788548,"prepare.queue_time_us":33595,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2814959,"thread_start_us":438180,"threads_started":2,"wal-append.queue_time_us":241730,"wal-append.run_cpu_time_us":1323,"wal-append.run_wall_time_us":1014732}
W20260709 13:19:09.099301  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 2.86145e+06us
I20260709 13:19:09.100252  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:09.101804  4012 connection.cc:256] RPC call timeout handler was delayed by -1.6476077939998959s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31600000000000006s for a response
I20260709 13:19:09.103515  4039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4379) took 3243 ms. Trace:
I20260709 13:19:09.103871  4039 rpcz_store.cc:276] 0709 13:19:05.859694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.933377 (+ 73683us) service_pool.cc:224] Handling call
0709 13:19:05.933662 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:05.933966 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:05.933989 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:05.938757 (+  4768us) log.cc:844] Serialized 26 byte log entry
0709 13:19:08.391409 (+2452652us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:08.447767 (+ 56358us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.103205 (+655438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.103281 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.103323 (+    42us) raft_consensus.cc:1685] finished
0709 13:19:09.103334 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.103461 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":655164,"prepare.queue_time_us":52627,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":88,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":142592,"thread_start_us":87354,"threads_started":2,"wal-append.queue_time_us":2440160}
I20260709 13:19:09.105753 11644 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.106254 11644 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:09.109442  4011 connection.cc:256] RPC call timeout handler was delayed by -1.9293317229999047s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 13:19:09.109848  4011 connection.cc:256] RPC call timeout handler was delayed by -1.9284317229999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:19:09.109897 10901 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:09.110163  4011 connection.cc:256] RPC call timeout handler was delayed by -1.8042317229999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
I20260709 13:19:09.110764 11646 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.111255 11646 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.113685 11646 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.114078 11652 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.114662 11652 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.115099  4047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49100 (request call id 3566) took 3142 ms. Trace:
I20260709 13:19:09.116408 11258 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.115475  4047 rpcz_store.cc:276] 0709 13:19:05.972374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.425092 (+452718us) service_pool.cc:224] Handling call
0709 13:19:06.425389 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:08.648971 (+2223582us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:19:08.657641 (+  8670us) log.cc:844] Serialized 14 byte log entry
0709 13:19:09.114749 (+457108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:09.114804 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:09.114855 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.114934 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.115045 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2487231,"prepare.queue_time_us":8164,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":2670819,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":171418,"threads_started":2,"wal-append.queue_time_us":110608}
I20260709 13:19:09.116956 11258 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.118233  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.118340  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.118930 11258 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.118960  4040 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:09.119673 11647 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.119381  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.120657 11584 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.121176 11584 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.122167 11573 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.122723 11573 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.115486 11649 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.119406  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.110476 10901 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.118932  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.125907  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.126174 10901 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.127239  4038 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:19:09.128402 11652 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.120201 11647 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.130358  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.130995  4047 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:09.131894 11647 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:09.110486  4011 connection.cc:256] RPC call timeout handler was delayed by -1.6620317229999273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
I20260709 13:19:09.132675  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:09.132944  4011 connection.cc:256] RPC call timeout handler was delayed by -1.0497378729999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:19:09.123202 11584 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.134554  4041 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:19:09.135339  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.136404  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.136938  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.108579 11644 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.114252 11646 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.140444 11646 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.137552  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.140951 11649 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.143664 11649 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:09.144165  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.144552  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.145197  4044 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 22.
I20260709 13:19:09.145949 11573 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.146133  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.148053  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.148200  4047 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27.
I20260709 13:19:09.148641  4045 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:09.149328  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.149633  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.150209  4043 raft_consensus.cc:2410] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 26 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 18.
I20260709 13:19:09.151175  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.151886  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.152216  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.152464  4044 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:09.152948  4047 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 22.
I20260709 13:19:09.153512  4042 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:09.153860  4042 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.154565  4042 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.155485  4042 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.156237  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.157035 11573 consensus_queue.cc:1059] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:09.157073  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.158051 11649 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:09.157543  4038 raft_consensus.cc:3055] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:09.158857 11585 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:09.159245 11585 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.160140 11554 raft_consensus.cc:3055] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:09.160181  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.160004 11585 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.160738 11554 raft_consensus.cc:740] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.161367 11585 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:09.161720 11554 consensus_queue.cc:260] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.162863 11554 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.158813  4038 raft_consensus.cc:740] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.165426  4038 consensus_queue.cc:260] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.166313  4038 raft_consensus.cc:3060] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:09.167853  4041 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:09.151458  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.143600 11646 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.173511  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.158164  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.192332  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:09.193394  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.194113  4044 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:09.194214  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:09.194967 11644 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:09.195408 11644 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:09.195888 11644 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.196161 11652 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:09.196633 11543 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:09.197082  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.198271 10901 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:09.188282  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.198891  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.056806 11629 consensus_queue.cc:1059] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:19:09.057605 11435 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:09.210016  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 107582us
I20260709 13:19:09.221477  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:09.222700  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:09.223465  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.224593  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:09.226740  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.227535  4044 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:09.228317 11558 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:09.228693 11558 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.229130 11558 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.229657  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:09.230966  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.231489  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.232404  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.232583  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.233440  4047 raft_consensus.cc:2410] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 25 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 13:19:09.233486 10901 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.234198 10901 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.235083  4649 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:09.236299  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:19:09.204053 11665 log.cc:927] Time spent T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:19:09.245757  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.246333  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.247053  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.247855  4118 raft_consensus.cc:2410] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:19:09.247761  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.249051  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.249929  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.250334  4121 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 26.
I20260709 13:19:09.247390  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.247659  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.254269  4043 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:09.257041  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.257366  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.259455  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.260200  4116 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:19:09.259524  4012 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.530s (SENT)
I20260709 13:19:09.261409  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:09.261682  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:09.262151 11551 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:09.262372  4116 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:09.263007  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.263749  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:09.263091  4012 leader_election.cc:336] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Timed out: RequestConsensusVote RPC to 127.2.200.195:41513 timed out after 1.902s (SENT)
I20260709 13:19:09.268684  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:09.267411 11551 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:19:09.271473 10901 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.272521 10901 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:09.243747 11648 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:09.239804 11543 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.251551 11258 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.274580  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.275417 10901 consensus_queue.cc:1048] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:09.281864  4042 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:09.270969 11649 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:19:09.283842 11678 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:19:09.285193  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3867) took 3437 ms. Trace:
I20260709 13:19:09.285918  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.286281  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.286629  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.287165  4040 raft_consensus.cc:2376] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27. Re-sending same reply.
I20260709 13:19:09.287370  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.287925  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.207595 11473 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 13:19:09.288946  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.289407  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.289211  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.285545  3967 rpcz_store.cc:276] 0709 13:19:05.847631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:05.934567 (+ 86936us) service_pool.cc:224] Handling call
0709 13:19:05.934803 (+   236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.058198 (+3123395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.058229 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.058715 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.188754 (+130039us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:09.189274 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.189350 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.284983 (+ 95633us) raft_consensus.cc:1685] finished
0709 13:19:09.285004 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.285134 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3080020,"raft.queue_time_us":3143264,"spinlock_wait_cycles":22204800,"thread_start_us":148706,"threads_started":2,"wal-append.queue_time_us":130021}
I20260709 13:19:09.295089  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.296900  4042 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:09.297856  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.287935  4045 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:09.298626  4042 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:19:09.302357  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.316419 10901 consensus_queue.cc:1059] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:09.302887  4681 raft_consensus.cc:1240] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:09.301837  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.316922  4040 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:09.302464  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.321170  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.326504  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:09.328058  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:09.327217  4045 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:09.330634  4677 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:09.276013 11583 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:09.333389  4677 raft_consensus.cc:1240] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 21 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21. Ops: []
I20260709 13:19:09.273167 11647 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:19:09.339018  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 102765us
I20260709 13:19:09.301695 11649 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.350231  4677 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:09.341728 11583 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.358320  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:09.281049 11313 consensus_queue.cc:1059] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:19:09.323654 11652 consensus_queue.cc:1059] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:19:09.289713 11543 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.381206  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.301826 11258 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:09.408404  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 44334.6us
I20260709 13:19:09.365931 11583 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.359678 11647 consensus_queue.cc:1243] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:19:09.415534  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 97573.4us
I20260709 13:19:09.421663  4047 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:09.426211  4038 raft_consensus.cc:1275] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:19:09.427727 11687 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:19:09.431967 11417 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260709 13:19:09.438433  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.446238  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003286c0 after lost signal to thread 11557
W20260709 13:19:09.461141  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08001bd4a0 after lost signal to thread 11563
W20260709 13:19:09.463534  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003745c0 after lost signal to thread 11595
W20260709 13:19:09.463796  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003b90a0 after lost signal to thread 11598
W20260709 13:19:09.464085  4068 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0ba0 after lost signal to thread 11613
I20260709 13:19:09.465276 11644 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.467134  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.411674 11653 consensus_queue.cc:1059] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:19:09.456820 11350 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:09.457299 11435 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:09.439800 11417 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.451363 11543 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.435616 11649 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.459950  4044 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 13:19:09.436283 11651 raft_consensus.cc:3055] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:09.451448 11258 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.491482 11280 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.492079 11280 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.494160 11280 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:09.495153  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 394922us
I20260709 13:19:09.461149 11558 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.487660  4044 pending_rounds.cc:85] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 11
I20260709 13:19:09.488364  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:09.480975  4085 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.2.200.193:44737 timed out after 2.979s (SENT) [suppressed 39 similar messages]
I20260709 13:19:09.479156 11216 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.011s
I20260709 13:19:09.489789 11682 consensus_queue.cc:1048] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 13:19:09.490109 11557 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:09.474718 11350 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.479709 11417 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:09.497041 11651 raft_consensus.cc:740] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.474519  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:09.496459  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.498482  4044 pending_rounds.cc:107] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 13:19:09.509313  4044 raft_consensus.cc:2889] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:09.467612 11644 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:09.497761 11473 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:09.497018 11556 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:09.518620  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 93186us
I20260709 13:19:09.565201  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.505136 11679 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:09.525354  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.617017  4043 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:09.525784  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.543668  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:09.545576  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49190.2us
I20260709 13:19:09.504932 11313 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:19:09.524148  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.651297  3965 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:09.652118  3937 leader_election.cc:400] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27.
I20260709 13:19:09.652534  3937 leader_election.cc:403] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:19:09.609671 11673 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.193s	user 0.000s	sys 0.005s
I20260709 13:19:09.653115 11648 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:09.511471 11473 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.508247 11557 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.562448 11350 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.666988 11556 raft_consensus.cc:3060] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:19:09.673722 11350 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:09.674088 11557 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:09.674644 11473 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:09.675209 11069 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:09.675575 11069 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:09.676388 11069 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.677357 11069 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:09.667904 11679 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:09.681701 11679 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.510013 11627 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 13:19:09.651533  3967 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:09.685271  3972 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:09.686890  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.520857  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.687887  3971 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:09.687903  3969 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:09.688114  3963 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:09.686226  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.553776  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.690583  3972 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:09.691658  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.692279  3967 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
W20260709 13:19:09.692374  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.693377  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 43887.5us
W20260709 13:19:09.694327  3938 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34862 dropped due to backpressure: service queue is full with 50 items
W20260709 13:19:09.546494  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 165352us
I20260709 13:19:09.665382  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.700320  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:09.700958  3967 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:09.702502  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:09.703145  4044 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:09.704542  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:09.708470  3965 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:09.562158 11686 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.112s	user 0.001s	sys 0.001s
I20260709 13:19:09.561292 11688 raft_consensus.cc:3055] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:19:09.706877  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:09.528781 11280 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:09.692305 10901 consensus_queue.cc:1059] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:09.722108  3969 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:09.547458 11671 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.711288  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.516593 11451 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.592077 11651 consensus_queue.cc:260] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.553967 11672 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.527510 11629 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.564906 11668 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:09.714337  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49062.9us
I20260709 13:19:09.714231  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:09.706977  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:09.719035 11628 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:19:09.744423  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.747588  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.565266 11669 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.698187  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.702739  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.643428 11583 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.748360  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.752472  3963 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:09.707451 11473 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.744529  3971 raft_consensus.cc:2393] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:09.742385  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3874) took 3528 ms. Trace:
I20260709 13:19:09.717406 11688 raft_consensus.cc:740] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:09.748974  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76098.2us
I20260709 13:19:09.684458 11556 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 26. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27.
W20260709 13:19:09.760056  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 61937.5us
I20260709 13:19:09.761313  3965 raft_consensus.cc:2468] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:09.741921  4044 raft_consensus.cc:2468] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:09.765277 11632 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:09.766108  3966 rpcz_store.cc:276] 0709 13:19:06.214330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:06.479032 (+264702us) service_pool.cc:224] Handling call
0709 13:19:06.479644 (+   612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:09.063711 (+2584067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:09.063742 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:09.064108 (+   366us) log.cc:844] Serialized 26 byte log entry
0709 13:19:09.253007 (+188899us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:09.253042 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:09.253118 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:09.586481 (+333363us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:19:09.737946 (+151465us) raft_consensus.cc:1685] finished
0709 13:19:09.737969 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:09.742312 (+  4343us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2583679,"raft.queue_time_us":3010766,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"spinlock_wait_cycles":6386432,"thread_start_us":185864,"threads_started":1,"wal-append.queue_time_us":282430}
W20260709 13:19:09.768328  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57135.8us
I20260709 13:19:09.773974  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:09.777274  4649 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.775125  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:09.765311  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.746184 11668 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:09.779145 11692 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:09.780460  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:09.840653  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 60261.6us
I20260709 13:19:09.841818  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.842195  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:09.842900  3968 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:09.843124  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.787971  4678 raft_consensus.cc:1240] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:09.758478 11627 raft_consensus.cc:2804] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:09.789556  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:09.766885 11558 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.779659  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:09.776641 11543 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:09.789409 11213 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:09.774295 11653 raft_consensus.cc:3055] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:09.862598  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.863129  3969 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:09.863768  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.864184  3969 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:09.864871  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:09.836263  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 59060.4us
I20260709 13:19:09.838312  3970 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:09.866050  3970 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:09.768395 11334 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:09.746358 11628 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:09.836938 11116 raft_consensus.cc:3055] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:09.742295 11451 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:09.776850 11632 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:09.859134 11213 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:09.830523 11448 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:19:09.856174  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 76611.2us
I20260709 13:19:09.958484  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:09.733371 11280 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.758471 11629 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.836341 11682 raft_consensus.cc:2804] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:09.839524  4681 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:09.850966 11627 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:09.887311 11632 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:09.965251 11703 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:09.952751 11213 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:09.779131 11216 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:09.773764 11669 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.749010 11672 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.852195 11670 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:09.840299 11668 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:09.954579 11583 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:09.859754 11543 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.857368 11652 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:09.965938 11280 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:09.867466 11334 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.852789 11527 raft_consensus.cc:3055] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:09.860852 11692 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:09.740908 11671 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:09.861193 11653 raft_consensus.cc:740] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:09.876291 11628 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:19:09.962772 11701 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:19:09.960238 11584 raft_consensus.cc:3055] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:19:09.955945 11456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.043s	sys 0.085s
I20260709 13:19:09.966104 11627 raft_consensus.cc:3060] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:09.963629 11548 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:09.867789 11558 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:09.966889 11682 raft_consensus.cc:697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:09.973222 11670 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:09.955772 11688 consensus_queue.cc:260] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:10.038244 11456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.043s	sys 0.086s
I20260709 13:19:09.856487  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:09.694631  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:34862 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4300)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3890)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3889)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4305)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4295)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4301)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4285)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3887)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4297)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3886)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1297)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4284)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4288)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3891)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3893)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3894)
I20260709 13:19:10.039113 11473 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:09.857901  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.843902  3965 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:19:10.090898  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.091014  3964 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 18.
I20260709 13:19:10.092034  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:10.177094  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:09.868429  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:09.842250  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:10.179416  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 312333us
I20260709 13:19:09.866603  3970 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.048333 11653 consensus_queue.cc:260] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.182006  3970 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:10.182437  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:10.183338 11653 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:09.842710  3972 raft_consensus.cc:2393] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:19:10.106861  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:09.852361  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 62883us
I20260709 13:19:09.961391  4086 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:10.214617  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 253099us
I20260709 13:19:09.886376 11116 raft_consensus.cc:740] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:10.218676 11116 consensus_queue.cc:260] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.145481  4678 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
I20260709 13:19:10.006337 11334 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:10.038080 11584 raft_consensus.cc:740] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:10.222011 11280 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:10.222981 11280 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:10.223735 11584 consensus_queue.cc:260] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:09.989073 11543 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:10.042186 11670 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:10.046875 11688 raft_consensus.cc:3060] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:19:10.216486  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:10.049309 11708 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.153s	user 0.000s	sys 0.002s
I20260709 13:19:10.232681 11456 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:10.234278 11456 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.234730 11456 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:10.236080 11116 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.237941  4678 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:10.238932 11671 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:10.041621 11558 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.028558 11692 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.241253 11692 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:10.244010 11448 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:10.244580 11448 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.233549  4086 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.155965 11672 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:10.246958 11711 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 13:19:10.248857 11679 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:10.249311 11679 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:10.249750 11679 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:10.250676 11718 log.cc:927] Time spent T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:19:10.156440  3967 raft_consensus.cc:2468] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 15.
I20260709 13:19:10.157095 11669 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.028512 11527 raft_consensus.cc:740] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:10.158063 11629 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.163910  3968 raft_consensus.cc:2410] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:19:10.166606 11451 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.148186 10891 consensus_queue.cc:1059] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:19:10.174283  3963 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:10.053931 11682 consensus_queue.cc:237] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:10.206633  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.212982  4012 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.225744 11548 raft_consensus.cc:2804] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:10.224287 11280 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:10.220531 11716 log.cc:927] Time spent T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:19:10.225936 11584 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:10.234481 11707 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.398s	user 0.004s	sys 0.000s
W20260709 13:19:10.265908  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53281.1us
I20260709 13:19:10.265977  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.268164 11548 raft_consensus.cc:697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:10.270161 11548 consensus_queue.cc:237] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.271238  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.281347  3968 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:10.276539  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 27 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.283202  4112 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27. Ops: [26.21-26.21]
I20260709 13:19:10.284582  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:10.285815 11350 consensus_meta.cc:287] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.611s	user 0.013s	sys 0.015s
I20260709 13:19:10.286844 11350 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:10.287539 11350 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:10.286754  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.298151  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.301362  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.302356  4041 raft_consensus.cc:2410] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 26 because replica has last-logged OpId of term: 24 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 18.
I20260709 13:19:10.309664  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.311156  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.312112  4047 raft_consensus.cc:2410] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 25 because replica has last-logged OpId of term: 24 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
W20260709 13:19:10.312908 11417 consensus_meta.cc:287] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.780s	user 0.014s	sys 0.000s
I20260709 13:19:10.313416 11417 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:10.315970 11417 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:10.316706  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.327365  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.328254  3965 raft_consensus.cc:2393] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:10.296528  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.319533  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.317510 11558 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.337337  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.317296  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.317764  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.308534  3970 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 13:19:10.325472 11350 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.343349  3970 pending_rounds.cc:85] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 9
I20260709 13:19:10.320897 11644 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:10.341056  3966 raft_consensus.cc:2468] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27.
I20260709 13:19:10.350024 11644 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.348968  3970 pending_rounds.cc:107] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 13:19:10.351900 11644 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:10.352171  3970 raft_consensus.cc:2889] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:10.351843  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.353762  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.353894  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.354590  3970 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:10.355612 11632 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.362176  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.364289 11669 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:10.364897  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.365669  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.366583  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.367409  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.368139  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:10.371419 11644 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:10.372951  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96576.2us
I20260709 13:19:10.374455  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.374707 11651 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.355568  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.385282 11417 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:19:10.385818 11417 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.386178 11417 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.389271  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.390704  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.383358  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:10.391265  4113 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:19:10.392400  4045 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:10.401376  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.394452  4038 raft_consensus.cc:2393] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:10.405579  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.394631  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.413501  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.395854 11632 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.395648 11556 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.402143  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:10.405294 11671 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.391366  3966 raft_consensus.cc:2468] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 25.
I20260709 13:19:10.405364 11451 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.318519 11527 consensus_queue.cc:260] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.417037  4039 raft_consensus.cc:2468] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:10.418449  4118 raft_consensus.cc:1275] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:19:10.402714  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:10.419389 11213 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.400197  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:10.391522  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 203118us
I20260709 13:19:10.420902 11448 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:10.394711 11714 log.cc:927] Time spent T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.348s	user 0.000s	sys 0.003s
I20260709 13:19:10.421514  3964 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 26: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:10.400815 11549 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:10.423849  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.431232  3963 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:10.424108 11692 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.423137  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:10.434806  4119 raft_consensus.cc:2393] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:10.425124  4043 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 26.
I20260709 13:19:10.425082  4121 raft_consensus.cc:2376] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23. Re-sending same reply.
I20260709 13:19:10.409757  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:10.396032 11557 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:19:10.434538  3968 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:10.441838  4116 raft_consensus.cc:2393] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:10.442039  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.444249  4114 raft_consensus.cc:2368] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:19:10.444459  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.444994 11632 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.445417 11695 raft_consensus.cc:3055] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:10.445187 11456 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.441578  3965 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:10.405539 11629 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:10.446040  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 70465.3us
I20260709 13:19:10.442332  3969 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:10.395033 11672 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.433241 11549 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.454139  3967 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:10.445627 11632 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.457284  4047 raft_consensus.cc:1240] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 24. Ops: []
W20260709 13:19:10.460908  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.462065  3972 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:10.463346 11448 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.463619  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.391418 11543 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.445912 11695 raft_consensus.cc:740] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:10.391757 11668 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.472010 11350 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:10.472313 11688 consensus_queue.cc:1059] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 13:19:10.424738 11671 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.394912 11669 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.474691  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:10.475128 11672 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.476851 11692 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:10.480094  4648 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:10.480976  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.481310  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.481427  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.487776  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.482493  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.466566  3972 raft_consensus.cc:2376] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27. Re-sending same reply.
I20260709 13:19:10.457557 11632 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.495039 11668 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.496224 11487 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:10.496744  4119 raft_consensus.cc:2393] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 27: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:10.498584  4119 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:19:10.477020  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45588 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4306)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42884 (request call id 5)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4284)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4288)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3891)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3893)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3894)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3895)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4308)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3903)
I20260709 13:19:10.473678 11629 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.502898 11629 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.485002  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.485306  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.490296 11696 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.504711  4113 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:10.505082 11696 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.505580  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.506731  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.507200  4117 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:10.492434  4086 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.493412 11688 raft_consensus.cc:3055] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:10.494499 11672 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.501012  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.507269  3965 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:10.489343  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.510010  4114 raft_consensus.cc:2368] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20.
I20260709 13:19:10.492225 11695 consensus_queue.cc:260] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.504338  3938 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45602 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3899)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4327)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4332)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3901)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4314)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45602 (request call id 3900)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34862 (request call id 1304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4306)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:42884 (request call id 5)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1287)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4283)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1289)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4284)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4288)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4290)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3891)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3892)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3893)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4299)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3894)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4308)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3897)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3898)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3903)
W20260709 13:19:10.511567  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.464488 11549 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:10.425652 11451 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.521067  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.416249 11556 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.504302 11628 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.507505 11696 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:10.523602  3966 raft_consensus.cc:2468] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:10.525265  4678 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:19:10.526736 11451 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.527163 11487 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:10.528465  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.537711  3970 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:19:10.522682  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.553454  3972 raft_consensus.cc:2410] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:19:10.554342  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.555032  3972 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:10.555814  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.556357  3972 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:19:10.485322 11350 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.557173 11350 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:10.544901  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.561479  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.563855  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:10.512748 11688 raft_consensus.cc:740] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:10.567351 11694 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.567979 11694 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.570681 11652 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.571298 11652 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.573094 11697 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.575748 11649 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:19:10.577210  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:10.580053 11652 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.582047 11694 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.585777  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.588287 11697 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.591370  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.592557  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.593683  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.594419  3970 raft_consensus.cc:2393] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:10.599329  4012 leader_election.cc:400] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for earlier term 20. Current term is 21.
I20260709 13:19:10.600546  4012 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:10.603595 11694 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:10.517477 11527 raft_consensus.cc:3060] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:10.608150  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.475062 11679 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.510793 11417 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.636580  3968 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:10.636855  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.638446  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.638178  4116 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:10.643595  4114 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:10.644613  3971 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 16.
I20260709 13:19:10.644919 11417 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:10.645699  3964 raft_consensus.cc:2376] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22. Re-sending same reply.
I20260709 13:19:10.646855  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.647614  3964 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
W20260709 13:19:10.651183  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.652195  3967 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:19:10.652931 11721 log.cc:927] Time spent T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:19:10.653386  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.654156  3967 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:10.655139  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.657769  3967 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:10.658934  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.659153  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.659677  3967 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:10.660912 11695 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.648528  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 28 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.565260 11688 consensus_queue.cc:260] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.675896  3972 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 22: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:10.595171  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:10.668135  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 188263us
I20260709 13:19:10.648638 11549 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.669819  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.670370  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45588 (request call id 4289) took 1081 ms. Trace:
I20260709 13:19:10.611708 11487 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.672223  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.678691  4114 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:10.678246  3965 raft_consensus.cc:2410] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:19:10.681176  3968 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
W20260709 13:19:10.682505  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 259639us
W20260709 13:19:10.685689  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 301753us
I20260709 13:19:10.687521 11549 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:10.688628  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.689324  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.688855 11713 raft_consensus.cc:2804] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:19:10.690171 11713 raft_consensus.cc:697] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:10.690601  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.691366  3965 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:10.691129 11713 consensus_queue.cc:237] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.692427  3964 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 26: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
W20260709 13:19:10.700002  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.692008 11487 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:10.702829  3967 raft_consensus.cc:2410] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 13:19:10.678264  3971 rpcz_store.cc:276] 0709 13:19:09.589221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.842007 (+252786us) service_pool.cc:224] Handling call
0709 13:19:10.670158 (+828151us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54001554d4. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:10.670297 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050517248}
I20260709 13:19:10.710048  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.710683  3970 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:19:10.711424  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.696957 11584 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:10.716445  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.719447  3964 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:10.719741  3971 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:19:10.720566  3971 raft_consensus.cc:606] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:10.720932  3971 raft_consensus.cc:614] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:10.721237  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1287) took 1198 ms. Trace:
I20260709 13:19:10.723707  3964 rpcz_store.cc:276] 0709 13:19:09.522718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.720150 (+1197432us) service_pool.cc:224] Handling call
0709 13:19:10.720591 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.720893 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.720918 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.720962 (+    44us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:19:10.720993 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.721056 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.721163 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33024}
I20260709 13:19:10.729519  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.729832  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:10.730888 11694 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:10.731282 11694 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.731691 11694 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.732185  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:10.713443 11451 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.737182 11451 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.739382 11451 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:10.740200  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.740806  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.740629 11694 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.742569  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.743839 10891 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:10.744030 11694 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.745116 11549 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:10.700753 11350 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.745862 11417 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:10.747879 11350 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.749125 11334 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.750283  4112 raft_consensus.cc:2368] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25.
W20260709 13:19:10.750635 11627 consensus_meta.cc:287] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.008s
I20260709 13:19:10.751091 11627 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.751516 11334 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:10.757112  3937 connection.cc:256] RPC call timeout handler was delayed by -4.8733175910001592s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:19:10.757606  3937 connection.cc:256] RPC call timeout handler was delayed by -4.8607175910001388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 13:19:10.757912  3937 connection.cc:256] RPC call timeout handler was delayed by -4.7113175910001246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:19:10.758203  3937 connection.cc:256] RPC call timeout handler was delayed by -4.4305175910001253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:19:10.758651  3937 connection.cc:256] RPC call timeout handler was delayed by -4.294617591000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:19:10.759019  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.760013 11672 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.758131  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.760509 11672 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:10.761397  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 55577.1us
I20260709 13:19:10.762285  4648 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:10.762717 11672 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.763520 11629 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:10.764051 11629 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.709686 11213 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.712975 11644 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.713089 11584 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.745594 11549 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.750406  4044 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:10.718183 11456 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:10.764712  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.765765  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.714291 11688 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:10.724803 11653 consensus_meta.cc:287] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.541s	user 0.010s	sys 0.002s
W20260709 13:19:10.800917  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.777532  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:10.766110  3937 connection.cc:256] RPC call timeout handler was delayed by -4.0297084020000966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
I20260709 13:19:10.778391  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.779439  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4283) took 1235 ms. Trace:
W20260709 13:19:10.801857  3937 connection.cc:256] RPC call timeout handler was delayed by -3.971208402000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 13:19:10.769639 10891 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:10.790895  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:10.791142  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:10.802239  3937 connection.cc:256] RPC call timeout handler was delayed by -3.95140840199997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
I20260709 13:19:10.777240  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4284) took 1232 ms. Trace:
I20260709 13:19:10.775393  3965 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:19:10.802572 10891 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:10.777716  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1290) took 1229 ms. Trace:
I20260709 13:19:10.796674  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:10.802609  3937 connection.cc:256] RPC call timeout handler was delayed by -3.9190084019999176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:19:10.804267  3937 connection.cc:256] RPC call timeout handler was delayed by -3.879408402000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 13:19:10.804352  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.804872  3963 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 24.
W20260709 13:19:10.804899  3937 connection.cc:256] RPC call timeout handler was delayed by -3.8533084020000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:19:10.802107  3970 rpcz_store.cc:276] 0709 13:19:09.544482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.778451 (+1233969us) service_pool.cc:224] Handling call
0709 13:19:10.778843 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.779115 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.779139 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.779194 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:10.779228 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.779277 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.779368 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.833881  3969 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27.
W20260709 13:19:10.834311  3937 connection.cc:256] RPC call timeout handler was delayed by -3.8056084019999616s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:19:10.779986 11627 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:10.844002  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:10.844791  3937 connection.cc:256] RPC call timeout handler was delayed by -3.7777084020001439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 13:19:10.844460  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 78769.3us
W20260709 13:19:10.845147  3937 connection.cc:256] RPC call timeout handler was delayed by -3.766008402000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
W20260709 13:19:10.845736  3937 connection.cc:256] RPC call timeout handler was delayed by -3.7291084020000653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 13:19:10.835776  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1289) took 1259 ms. Trace:
W20260709 13:19:10.846065  3937 connection.cc:256] RPC call timeout handler was delayed by -3.6796084019999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 13:19:10.846536  3937 connection.cc:256] RPC call timeout handler was delayed by -3.665208401999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1922s for a response
W20260709 13:19:10.847029  3937 connection.cc:256] RPC call timeout handler was delayed by -3.5464084019999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 13:19:10.847325  3937 connection.cc:256] RPC call timeout handler was delayed by -3.4933084020001388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
W20260709 13:19:10.847644  3937 connection.cc:256] RPC call timeout handler was delayed by -3.0856084019999344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2566s for a response
I20260709 13:19:10.804031  3964 rpcz_store.cc:276] 0709 13:19:09.547877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.776839 (+1228962us) service_pool.cc:224] Handling call
0709 13:19:10.777212 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.777406 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.777430 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.777488 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:10.777517 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.777567 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.777666 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.846359  3965 rpcz_store.cc:276] 0709 13:19:09.544578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.774632 (+1230054us) service_pool.cc:224] Handling call
0709 13:19:10.775068 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.803416 (+ 28348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.803610 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.802820  3972 rpcz_store.cc:276] 0709 13:19:09.544737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.776253 (+1231516us) service_pool.cc:224] Handling call
0709 13:19:10.776620 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.776926 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.776948 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.776991 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:10.777026 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.777076 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.777168 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.765969 11558 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:10.765525 11669 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:10.766027 11629 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:10.856499  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.859283  3968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1be06cbb19234936aabe0a7128358755"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:19:10.771991 11556 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:10.769950 11584 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:10.777945 11549 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:10.769450 11671 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:10.771080 11679 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.858381  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:10.770344 11543 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.859994  3968 raft_consensus.cc:606] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:10.865075  3968 raft_consensus.cc:614] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:10.770061 11628 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.874958  3967 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
I20260709 13:19:10.854285 11652 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:10.877985  3964 raft_consensus.cc:1275] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:19:10.875649  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1293) took 1312 ms. Trace:
I20260709 13:19:10.871850 11694 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:10.764910 11670 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:10.890107  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1291) took 1327 ms. Trace:
I20260709 13:19:10.887825  3972 rpcz_store.cc:276] 0709 13:19:09.563257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.850633 (+1287376us) service_pool.cc:224] Handling call
0709 13:19:10.871174 (+ 20541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.875013 (+  3839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.875058 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.875109 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:19:10.875141 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.875206 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.875528 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.889245  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34862 (request call id 1292) took 1326 ms. Trace:
I20260709 13:19:10.893014  3964 rpcz_store.cc:276] 0709 13:19:09.563032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.848536 (+1285504us) service_pool.cc:224] Handling call
0709 13:19:10.872232 (+ 23696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.887342 (+ 15110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.889177 (+  1835us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.894192  4085 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:10.894830  3970 raft_consensus.cc:1275] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:19:10.895205 11456 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:10.776464 11487 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.896570  4116 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:10.895617 11456 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:10.900988 11456 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:10.889076 11694 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:10.901981 11694 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:10.907050  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.907254 11682 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:19:10.908566  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 176488us
I20260709 13:19:10.909385  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.911281  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.913069  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.914078  4684 raft_consensus.cc:2410] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:19:10.913645 11694 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:10.894224  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:10.915629  4117 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 27: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:10.916988 11694 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.917968  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4292) took 1322 ms. Trace:
I20260709 13:19:10.918342  3972 rpcz_store.cc:276] 0709 13:19:09.595631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.892518 (+1296887us) service_pool.cc:224] Handling call
0709 13:19:10.917385 (+ 24867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.917638 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.917663 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.917728 (+    65us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:10.917757 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.917812 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.917914 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.895447  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4290) took 1302 ms. Trace:
I20260709 13:19:10.909770  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:10.920737  3970 rpcz_store.cc:276] 0709 13:19:09.593403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.877207 (+1283804us) service_pool.cc:224] Handling call
0709 13:19:10.894506 (+ 17299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.895216 (+   710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.895397 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.874807 11651 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:10.892984  3969 rpcz_store.cc:276] 0709 13:19:09.562744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.835127 (+1272383us) service_pool.cc:224] Handling call
0709 13:19:10.854275 (+ 19148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.872044 (+ 17769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.872069 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.878200 (+  6131us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:10.889459 (+ 11259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.889643 (+   184us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.889748 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.928458 11350 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.929152 11350 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.931902 11670 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:10.933135  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:10.933735  4117 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:10.934059  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4291) took 1339 ms. Trace:
I20260709 13:19:10.934391  3967 rpcz_store.cc:276] 0709 13:19:09.594903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.890047 (+1295144us) service_pool.cc:224] Handling call
0709 13:19:10.933517 (+ 43470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.933741 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.933766 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.933808 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:10.933846 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.933911 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.934007 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:10.936534 11697 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:19:10.935556  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.936395  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:10.937477  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
W20260709 13:19:10.961196  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51601.9us
W20260709 13:19:10.975270  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:10.929095  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:10.886864 11652 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:10.978070 10891 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:10.944028  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:10.981240  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.981882  3969 raft_consensus.cc:3060] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 27
I20260709 13:19:10.981475  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:10.983780  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:10.984179  3972 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:10.937085 11697 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:10.985989  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.933107 11350 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:10.990244  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4288) took 1407 ms. Trace:
I20260709 13:19:10.989637  3970 raft_consensus.cc:2393] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 25: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:10.924836 11651 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.006014 11651 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:11.006242 11727 log.cc:927] Time spent T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
I20260709 13:19:11.008843 11549 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.011448 11549 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:11.012326  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:11.012943  3967 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:19:10.993767  4684 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:11.013959  4114 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:10.992057 11697 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:10.995613  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 103840us
I20260709 13:19:10.997409  4043 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:10.942201 11543 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.004911  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:10.993105  3965 rpcz_store.cc:276] 0709 13:19:09.576144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.858086 (+1281942us) service_pool.cc:224] Handling call
0709 13:19:10.919670 (+ 61584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:10.982669 (+ 62999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.982704 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:10.982755 (+    51us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:10.982795 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:10.982860 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:10.982980 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.020637  3968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:10.980340 11652 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:11.038864  3968 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:11.035233  4117 raft_consensus.cc:2468] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:11.055161  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:11.056007  3970 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:19:11.056285  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.040529 11628 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:11.059772 10891 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:11.064956  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 170245us
I20260709 13:19:11.005802 11456 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.062666 11527 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:11.076936  4047 raft_consensus.cc:1240] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:11.060663 11334 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:11.047923 11543 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:11.078994  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 149944us
I20260709 13:19:11.077564  3969 raft_consensus.cc:2468] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27.
I20260709 13:19:11.065809 11487 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:11.064234 11644 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:11.082104 11584 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.083648  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:11.084229  3965 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:11.084440 11584 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:11.085206 11644 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.088939  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:11.104383  3967 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:11.106504  3972 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:19:11.108781  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:11.109542  4113 raft_consensus.cc:1240] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:11.081046 11692 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.119378  3969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:42884
W20260709 13:19:11.116195  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 132653us
I20260709 13:19:11.112567  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:11.120151  3969 raft_consensus.cc:606] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.120527  3969 raft_consensus.cc:614] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:11.110903  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:11.122365  4114 raft_consensus.cc:3060] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:11.123504  4120 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:11.124753  3967 raft_consensus.cc:1240] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:19:11.125499  3967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3891) took 1500 ms. Trace:
I20260709 13:19:11.101262 11644 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:11.132325  3972 raft_consensus.cc:1240] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 26. Current term is 27. Ops: [26.16-26.16]
I20260709 13:19:11.133157  3972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3892) took 1487 ms. Trace:
I20260709 13:19:11.133608  3972 rpcz_store.cc:276] 0709 13:19:09.645571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.110207 (+1464636us) service_pool.cc:224] Handling call
0709 13:19:11.132005 (+ 21798us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.132858 (+   853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.133062 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.125818  3967 rpcz_store.cc:276] 0709 13:19:09.625135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.108198 (+1483063us) service_pool.cc:224] Handling call
0709 13:19:11.124539 (+ 16341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:11.125191 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.125412 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.130748  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:11.140803  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.147403  3965 raft_consensus.cc:2410] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 27 because replica has last-logged OpId of term: 25 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 14.
W20260709 13:19:11.147629  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.149842  3965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4299) took 1495 ms. Trace:
I20260709 13:19:11.152024  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4281) took 1608 ms. Trace:
I20260709 13:19:11.152650 11739 consensus_queue.cc:1048] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:11.152467  3966 rpcz_store.cc:276] 0709 13:19:09.544009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.721054 (+1177045us) service_pool.cc:224] Handling call
0709 13:19:10.721443 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.721875 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.721904 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.722899 (+   995us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.064313 (+341414us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:11.064355 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.064430 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.151776 (+ 87346us) raft_consensus.cc:1685] finished
0709 13:19:11.151797 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.151936 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1425,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":29472,"thread_start_us":319143,"threads_started":1,"wal-append.queue_time_us":344027}
I20260709 13:19:11.155105  3968 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:11.155685  3968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3893) took 1509 ms. Trace:
I20260709 13:19:11.155808  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4303) took 1484 ms. Trace:
I20260709 13:19:11.156226  3966 rpcz_store.cc:276] 0709 13:19:09.671540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.154976 (+1483436us) service_pool.cc:224] Handling call
0709 13:19:11.155321 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.155520 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.155551 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.155588 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:11.155625 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.155672 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.155759 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.157684  4119 raft_consensus.cc:3055] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:11.158039  4119 raft_consensus.cc:740] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:11.159125  3966 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:11.158839  4119 consensus_queue.cc:260] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.160316  3966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45602 (request call id 3894) took 1459 ms. Trace:
I20260709 13:19:11.161036  4119 raft_consensus.cc:3060] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:11.150496  3965 rpcz_store.cc:276] 0709 13:19:09.654123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.148528 (+1494405us) service_pool.cc:224] Handling call
0709 13:19:11.149009 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.149284 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.149311 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.149383 (+    72us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:11.149466 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.149529 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.149760 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.161666  3966 rpcz_store.cc:276] 0709 13:19:09.700719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.158421 (+1457702us) service_pool.cc:224] Handling call
0709 13:19:11.158890 (+   469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.159944 (+  1054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.160215 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.166918  3971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4282) took 1622 ms. Trace:
I20260709 13:19:11.167383  3971 rpcz_store.cc:276] 0709 13:19:09.544250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.721693 (+1177443us) service_pool.cc:224] Handling call
0709 13:19:10.722255 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.722644 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.722671 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.790860 (+ 68189us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.022751 (+231891us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:19:11.022796 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.022886 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.166692 (+143806us) raft_consensus.cc:1685] finished
0709 13:19:11.166713 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.166852 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3829,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":227088,"threads_started":1,"wal-append.queue_time_us":349595}
I20260709 13:19:11.169442  3971 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:11.169759 11720 consensus_queue.cc:1059] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:11.167770  3965 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:19:11.171147  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:11.170007 11543 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.173404  3969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4298) took 1523 ms. Trace:
I20260709 13:19:11.173942  3969 rpcz_store.cc:276] 0709 13:19:09.649700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.144598 (+1494898us) service_pool.cc:224] Handling call
0709 13:19:11.172578 (+ 27980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.172989 (+   411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:11.173016 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.173067 (+    51us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:11.173135 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.173200 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.173332 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.176081 11558 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:11.176497  3969 raft_consensus.cc:1240] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:11.106283 11527 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.173892  3965 raft_consensus.cc:1240] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 14. Current term is 15. Ops: []
W20260709 13:19:11.152189  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101329us
W20260709 13:19:11.179919  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.177358  4681 raft_consensus.cc:1240] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:11.182116  4121 raft_consensus.cc:2468] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 23.
I20260709 13:19:11.180323  3968 rpcz_store.cc:276] 0709 13:19:09.645883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.136339 (+1490456us) service_pool.cc:224] Handling call
0709 13:19:11.154927 (+ 18588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.155490 (+   563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.155637 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:11.198397  4047 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:11.202425  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 88308us
I20260709 13:19:11.177053 11558 raft_consensus.cc:3055] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:11.209296 11558 raft_consensus.cc:740] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:11.210295 11558 consensus_queue.cc:260] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.219208  3963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4286) took 1671 ms. Trace:
W20260709 13:19:11.224540  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.225747  3970 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:11.226636  3970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:19:11.227207  3970 raft_consensus.cc:606] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.227439  3970 raft_consensus.cc:614] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:11.219651  3963 rpcz_store.cc:276] 0709 13:19:09.547994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.834208 (+1286214us) service_pool.cc:224] Handling call
0709 13:19:10.897200 (+ 62992us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:10.897734 (+   534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.897762 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:10.898952 (+  1190us) log.cc:844] Serialized 527 byte log entry
0709 13:19:11.055409 (+156457us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:19:11.055447 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.055506 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.218985 (+163479us) raft_consensus.cc:1685] finished
0709 13:19:11.219002 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.219145 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3384,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":131,"thread_start_us":156060,"threads_started":1,"wal-append.queue_time_us":315914}
I20260709 13:19:11.234016  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:11.234869  4684 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.238520  4677 raft_consensus.cc:1240] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:11.234095  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.240430 10891 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:11.241025  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:11.241909 11653 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:11.242277 11653 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.242640 11653 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:11.245536  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:11.232585  4012 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:11.248962  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:11.137320 11692 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.256181  4119 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:19:11.257402 11527 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:11.259440  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:11.261130 11670 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:11.266088 11670 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.266561 11670 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:11.279016  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 75981.8us
I20260709 13:19:11.257926 11558 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:11.253213 11456 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:11.291785  4117 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:19:11.258473 11584 raft_consensus.cc:2804] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:11.289793 11679 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.296644 11679 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.298578 11679 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.269023 11350 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:11.303696  4684 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:11.309589  4085 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.312877  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:11.315163  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.316042 10891 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:11.319514  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.325575  3969 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:11.335651  3969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b"
dest_uuid: "1e032f02b0aa450384dda978641ba666"
mode: GRACEFUL
new_leader_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:42884
I20260709 13:19:11.304899 11350 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.326191  4085 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.333900 11456 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:11.337405 11456 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.337927 11456 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:11.338374 11747 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:11.309008 11584 raft_consensus.cc:697] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:11.341681 11584 consensus_queue.cc:237] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.336730 11350 raft_consensus.cc:3060] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:11.336387  3969 raft_consensus.cc:606] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Received request to transfer leadership to TS b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.347664  3969 raft_consensus.cc:614] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:11.349045  3964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4293) took 1749 ms. Trace:
I20260709 13:19:11.349498  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:19:11.353130 11694 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.353787 11694 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.355782 11652 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:11.356853 11741 log.cc:927] Time spent T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:19:11.357324  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:11.358382  4115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 4092) took 1015 ms. Trace:
I20260709 13:19:11.356281  3964 rpcz_store.cc:276] 0709 13:19:09.599252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.942068 (+1342816us) service_pool.cc:224] Handling call
0709 13:19:10.980943 (+ 38875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.994828 (+ 13885us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:10.994859 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:10.995365 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.129416 (+134051us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:19:11.129467 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.129532 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.348830 (+219298us) raft_consensus.cc:1685] finished
0709 13:19:11.348850 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.348986 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7425,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":133691,"threads_started":1,"wal-append.queue_time_us":349975}
I20260709 13:19:11.358817  4115 rpcz_store.cc:276] 0709 13:19:10.342592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:10.342752 (+   160us) service_pool.cc:224] Handling call
0709 13:19:10.437144 (+ 94392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:10.507799 (+ 70655us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:19:10.712168 (+204369us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.101481 (+389313us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:11.126352 (+ 24871us) log.cc:844] Serialized 26 byte log entry
0709 13:19:11.126514 (+   162us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:19:11.128886 (+  2372us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.129096 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.129165 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:11.358203 (+229038us) raft_consensus.cc:1685] finished
0709 13:19:11.358224 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.358329 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64318,"prepare.queue_time_us":235671,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":176,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":5608,"thread_start_us":504696,"threads_started":2,"wal-append.queue_time_us":527469}
I20260709 13:19:11.358384  4119 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:11.363050  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:19:11.335932 11692 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:11.347680  4114 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 24.
I20260709 13:19:11.358994  3867 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 23 to 24, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 24 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.364812 11692 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:11.365829  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 120422us
I20260709 13:19:11.364954  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.364897 11694 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.367411  4045 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:11.367661  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 265) took 9020 ms. Trace:
I20260709 13:19:11.368155  3867 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 23 to 24, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 24 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.369422 11456 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:11.369863  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.353246 11628 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.366760  4085 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.371353 11628 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:11.371034  3867 catalog_manager.cc:5697] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 20 to 21, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 21 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.372033 11692 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:11.366699  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:11.373185  3867 catalog_manager.cc:5697] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 23 to 25, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 25 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.374181 11671 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:11.374572 11671 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.374995 11671 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:11.375136  3867 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 15 to 16, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 16 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:11.377513 11688 consensus_meta.cc:287] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.572s	user 0.007s	sys 0.005s
I20260709 13:19:11.379375 11628 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.380436 11726 consensus_queue.cc:1059] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260709 13:19:11.383641 11651 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.386891  3867 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 20 to 21, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 21 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.368000  3869 rpcz_store.cc:276] 0709 13:19:02.370651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:02.409048 (+ 38397us) service_pool.cc:224] Handling call
0709 13:19:11.367421 (+8958373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:09.450797 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:09.451353 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:09.451386 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:19:09.451404 (+    18us) tablet.cc:662] Decoding operations
0709 13:19:09.452369 (+   965us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:09.452428 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:09.452454 (+    26us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:19:09.453469 (+  1015us) tablet.cc:701] Row locks acquired
0709 13:19:09.453489 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:19:09.453649 (+   160us) write_op.cc:270] Start()
0709 13:19:09.453759 (+   110us) write_op.cc:276] Timestamp: P: 1783603149453586 usec, L: 0
0709 13:19:09.453780 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:09.494765 (+ 40985us) log.cc:844] Serialized 4810 byte log entry
0709 13:19:09.836063 (+341298us) op_driver.cc:464] REPLICATION: finished
0709 13:19:10.053263 (+217200us) write_op.cc:301] APPLY: starting
0709 13:19:10.053515 (+   252us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:10.213471 (+159956us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:10.213645 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:10.640625 (+426980us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:10.649898 (+  9273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:19:10.649939 (+    41us) write_op.cc:312] APPLY: finished
0709 13:19:10.650434 (+   495us) log.cc:844] Serialized 113 byte log entry
0709 13:19:10.650685 (+   251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:10.650965 (+   280us) write_op.cc:454] Released schema lock
0709 13:19:10.651028 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:10.651613 (+   585us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:10.651637 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2780551,"reported_tablets":30,"spinlock_wait_cycles":16640,"child_traces":[["op",{"apply.queue_time_us":216950,"apply.run_cpu_time_us":22887,"apply.run_wall_time_us":598260,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54455,"num_ops":12,"prepare.queue_time_us":342889,"prepare.run_cpu_time_us":15146,"prepare.run_wall_time_us":203664,"raft.queue_time_us":178712,"raft.run_cpu_time_us":43478,"raft.run_wall_time_us":219119,"replication_time_us":379947,"thread_start_us":713030,"threads_started":4,"wal-append.queue_time_us":110131}]]}
I20260709 13:19:11.387688 11671 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.384578  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:11.409739  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.422372 11671 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.397425  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.398968  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.401579 11692 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:11.425040  4042 raft_consensus.cc:3060] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:11.412128 11456 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:11.422971 11628 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.400264  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.387920  4085 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.429214  4040 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 27: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:19:11.429519  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44307.4us
I20260709 13:19:11.429972 11350 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.395735 11653 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.401656 11627 raft_consensus.cc:3055] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:11.430912 11627 raft_consensus.cc:740] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:11.431157  4041 raft_consensus.cc:1240] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:11.431819 11627 consensus_queue.cc:260] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 26.21, Last appended by leader: 21, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.395625 11670 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:11.413973  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.432929  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.430277  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:11.433589  4041 raft_consensus.cc:3060] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:11.435920 11670 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.421592  3867 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 19 to 22, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:11.437713  3867 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 20 to 21, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 21 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:11.424593  4046 raft_consensus.cc:3060] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.442406  4041 raft_consensus.cc:2468] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:11.309988  4649 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:11.456224  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.476634  4042 raft_consensus.cc:2468] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:19:11.488184  4046 raft_consensus.cc:2468] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:11.476012  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:11.489452  4677 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.460891  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:11.476434  4045 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27.
I20260709 13:19:11.495350  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.496315  4045 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:11.452490  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:11.497743  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 121211us
I20260709 13:19:11.451794  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:11.497413  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 212504us
I20260709 13:19:11.471138 11688 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:11.453524 11456 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:11.432969 11627 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:11.496052  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.510056  4046 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:11.453181 11653 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.458581 11527 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.452689 11692 raft_consensus.cc:2804] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:11.460911 11694 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.494597  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:11.511042  4041 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.516672  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:11.495270 11543 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:11.505189 11682 raft_consensus.cc:2804] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:11.507614 11688 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:11.532145  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 224150us
I20260709 13:19:11.509011 11456 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:11.535518  4040 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 26
I20260709 13:19:11.541515  4042 raft_consensus.cc:2410] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:19:11.528488 11694 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.547698  4045 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:19:11.534792 11688 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:11.558676  4041 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:11.538839 11456 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:11.520800 11527 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.537694 11682 raft_consensus.cc:697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
W20260709 13:19:11.569325  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55037.7us
I20260709 13:19:11.543617 11653 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:11.583711  4677 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:11.540349 11543 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.586300 11543 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:11.597612  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.599411  4040 raft_consensus.cc:2468] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
W20260709 13:19:11.602497  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 150110us
W20260709 13:19:11.605367  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 88130.2us
W20260709 13:19:11.605680  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 112700us
I20260709 13:19:11.605814 10891 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:11.606343 10891 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:11.606798 10891 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.609114  4649 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:11.602991 11742 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.009s
I20260709 13:19:11.576709 11652 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:11.593621 11692 raft_consensus.cc:697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:19:11.613040 11697 consensus_meta.cc:287] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.569s	user 0.006s	sys 0.005s
I20260709 13:19:11.608152 11696 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:11.644906  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.594437 11653 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:11.665798  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 51045.1us
W20260709 13:19:11.668408  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.620242 11713 raft_consensus.cc:2804] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:11.607949 11558 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.053s
W20260709 13:19:11.675872  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 134853us
I20260709 13:19:11.682919 11543 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.694337 10891 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.677772 11696 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.677150  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:11.626585 11651 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.676196  3970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45588 (request call id 4337) took 1020 ms. Trace:
I20260709 13:19:11.676105  4013 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:11.673684 11350 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:11.677330 11742 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:11.617373 11644 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:11.718878  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 103409us
W20260709 13:19:11.729413  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 53362.9us
I20260709 13:19:11.614960 11487 consensus_queue.cc:1059] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 13:19:11.732430  4011 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:11.728302 11417 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:19:11.736172 11543 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
W20260709 13:19:11.742735 11753 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:19:11.746168 11651 raft_consensus.cc:2804] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:11.729887  3970 rpcz_store.cc:276] 0709 13:19:10.655248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:11.227823 (+572575us) service_pool.cc:224] Handling call
0709 13:19:11.252546 (+ 24723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:19:11.284982 (+ 32436us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:19:11.520827 (+235845us) log.cc:844] Serialized 14 byte log entry
0709 13:19:11.674203 (+153376us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:19:11.674345 (+   142us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:11.674485 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:11.674639 (+   154us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:11.676076 (+  1437us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":388344,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":2532,"raft.queue_time_us":330,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":41576192,"thread_start_us":302448,"threads_started":2,"wal-append.queue_time_us":200415}
I20260709 13:19:11.751859  4678 raft_consensus.cc:2468] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
W20260709 13:19:11.749079  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 55966.8us
I20260709 13:19:11.758505  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:11.761308 11742 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.763609 11644 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.764117  4043 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:11.766453  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:11.751802 11713 raft_consensus.cc:697] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:11.665946 11697 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.773963 10891 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:11.781327  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:11.782305  4121 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:11.782648  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:11.785071 11713 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.785936 11742 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:11.792614  4038 raft_consensus.cc:1240] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:11.793030  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:11.793939  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:11.794653  4118 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:11.795176 11549 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:11.799274 11651 raft_consensus.cc:697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:11.799700 11456 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.779100 11350 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:11.800318 11651 consensus_queue.cc:237] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:11.719235 11682 consensus_queue.cc:237] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:11.802690  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70338.6us
I20260709 13:19:11.803076 11694 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:11.809721  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.817418  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:11.820369  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.823179  4114 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 17. Current term is 18. Ops: []
W20260709 13:19:11.824898  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 46778.4us
I20260709 13:19:11.821946  4087 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:11.819811  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:11.832039  4038 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:11.862079  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.866586  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:11.867112  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.868193  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:11.868916  3970 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:19:11.825847  4086 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:11.872349 10891 consensus_queue.cc:1059] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:11.802660 11696 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:11.875445  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49675.9us
I20260709 13:19:11.887308  4086 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:11.889622  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:11.899977 11487 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:11.900543 11487 raft_consensus.cc:697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:11.901754 11697 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.874325  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:11.902796 11527 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.902827 11749 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:11.903761 11749 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:11.904089 11749 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:11.906251 11334 raft_consensus.cc:3055] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:11.906647 11334 raft_consensus.cc:740] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:11.907439 11334 consensus_queue.cc:260] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:11.909092  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 135562us
I20260709 13:19:11.909289  4086 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:11.882397  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 212244us
I20260709 13:19:11.901427 11487 consensus_queue.cc:237] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:11.881243  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 59378.9us
I20260709 13:19:11.895578  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:11.919836  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.780987 11692 consensus_queue.cc:237] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:11.918462  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:11.924000  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.867156 11694 consensus_queue.cc:1048] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:19:11.910949 11743 raft_consensus.cc:2804] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:11.929068 11651 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:11.959010 11549 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:11.921713 11527 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:19:11.960079  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.908648 11334 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:11.972187  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:11.962309 11649 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:11.987993 11543 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:11.998163  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:11.971408 11417 raft_consensus.cc:2804] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:12.000653  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:11.969259 11651 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:11.971333 11549 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:19:11.999691  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 90484.3us
I20260709 13:19:12.004115  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.007851  4117 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:12.004504  4115 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:12.005127  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:12.006163  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 139094us
I20260709 13:19:12.008864  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.008934  4086 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.008952  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:11.994985 11696 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.011983 10891 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.009371  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.011916  4120 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:11.994766 11743 raft_consensus.cc:697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.007507 11651 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:12.018954  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:12.015769  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.021411  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:11.999346 11776 raft_consensus.cc:2804] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:12.014187 11653 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:12.024904 11527 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:12.025355 11527 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:19:12.026930  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 100517us
I20260709 13:19:12.027647  4012 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.025705 11527 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.026042  4112 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 27.
I20260709 13:19:12.035826 11652 consensus_queue.cc:1059] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:19:12.013298 11417 raft_consensus.cc:697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.035732 11644 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:12.037504 11417 consensus_queue.cc:237] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.016219 11696 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.038784 11749 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.041564 11777 raft_consensus.cc:3055] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:12.041976 11777 raft_consensus.cc:740] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.042755 11777 consensus_queue.cc:260] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.043255 11696 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:12.044181 11777 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.045946  4113 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:12.047430 11781 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:12.030294  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.052577  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.055804 10891 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.056037  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:12.057691  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.060727  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:12.061055  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 137150us
I20260709 13:19:12.060115  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.057760 11780 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:19:12.063791 11543 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:12.064247  4113 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:12.065182 11549 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.066454 11549 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:12.058159 11649 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:12.067301 11649 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.067662 11649 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:12.069576  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.072293  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.056569 11782 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:12.115150 11627 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.115924  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:12.116504  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44303.6us
I20260709 13:19:12.118204 11651 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.057994 11653 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:12.122668  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:12.108325  4038 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:12.122609 11653 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.131970  4012 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.133188 11653 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:12.135543  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.108057 11649 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:12.108736 11688 consensus_meta.cc:287] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.006s
W20260709 13:19:12.109284  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90192.2us
I20260709 13:19:12.109799 11696 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:12.110203 11543 raft_consensus.cc:3055] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:12.110948 11749 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:12.077699 11743 consensus_queue.cc:237] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.116528  3966 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.118533  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.091529 11456 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:12.056389 11776 raft_consensus.cc:697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.135808 11527 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:12.140549  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 110494us
I20260709 13:19:12.138227 11775 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.149562 11776 consensus_queue.cc:237] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.146422  4086 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.153146 11780 raft_consensus.cc:2804] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:12.153709 11780 raft_consensus.cc:697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.154639 11780 consensus_queue.cc:237] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.141229 11688 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.140298 11696 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.158838 11688 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.159123 11696 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.159248 11627 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:12.158813  4086 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.165076  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.165951 11627 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:12.167340 11651 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.167515  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.170277  3966 raft_consensus.cc:2468] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:19:12.171583  4648 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:12.141387 11543 raft_consensus.cc:740] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.177794  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.181058 11713 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:12.181571 11713 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:12.182446 11653 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:12.182391 11713 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.177194 11627 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.146544 11781 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.187415 11649 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.186937 11781 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:12.189281  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.190775  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.191594 11670 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:12.192530  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:12.142377 11652 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:19:12.192498  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.144991 11417 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.198252  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.198892  4113 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:12.191463 11527 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:12.200449  4085 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.200992  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.179639 11456 raft_consensus.cc:2804] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:12.202020  4115 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.202353 11549 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:12.202749 11789 consensus_queue.cc:1059] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:12.203341  4086 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:12.204704  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57025us
I20260709 13:19:12.199631 11670 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:12.207652  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.208245  4119 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:12.213868  4085 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.217689  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.218568 11628 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:12.219730  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.220546 11628 raft_consensus.cc:2804] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:12.204934 11743 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:12.221024 11628 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:12.225063  4119 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 26.
I20260709 13:19:12.225451  4115 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:12.226001  4113 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 28.
I20260709 13:19:12.220666  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.221583 11653 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.229919 11628 raft_consensus.cc:3060] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.235399  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.236696  4012 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.241760 11782 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:12.242226 11782 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.243335 11777 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:12.243158 11782 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.244396 11782 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:12.246163 11789 raft_consensus.cc:3055] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:12.246543 11789 raft_consensus.cc:740] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.247371 11789 consensus_queue.cc:260] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.232880 11627 raft_consensus.cc:2764] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260709 13:19:12.248971 11653 raft_consensus.cc:2804] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:12.249105 11760 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.233489 11456 raft_consensus.cc:697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.249850 11760 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.251917 11670 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:12.252377 11670 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:12.252920 11670 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.249492 11653 raft_consensus.cc:697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 28 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.257789 11653 consensus_queue.cc:237] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.259507  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.259871  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.260389  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.261215  4012 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.262420  4012 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.263108 11649 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:12.263568 11649 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.264196 11527 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:12.264780 11527 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.264391 11649 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.266012  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.265748 11527 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:12.266712  4046 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:12.267127  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.267402  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.267593  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.268890  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.269549  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.221854 11696 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.243978 11543 consensus_queue.cc:260] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:12.277155  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63486.4us
I20260709 13:19:12.277657  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.278034  4043 raft_consensus.cc:2410] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:19:12.277909  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.279724  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.280202  4039 raft_consensus.cc:2368] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 16. Current term is 17.
I20260709 13:19:12.281041 11760 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.282820 11696 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.285441 11543 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.248646 11789 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:12.281179  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.291432  4038 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:12.293087 11456 consensus_queue.cc:237] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.295495  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.296554  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:12.299324  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.299144  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:12.300439  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 97152.5us
I20260709 13:19:12.321192  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.322290  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.324116  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:12.324994  4041 raft_consensus.cc:2410] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
W20260709 13:19:12.326967  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.327363  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.328083  4113 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:19:12.330694  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 52033us
I20260709 13:19:12.334733  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:12.341702  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.342614  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.343391  4118 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:12.344201  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.344683 11670 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.345011  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.342626  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.349579  4045 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 26: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:12.350509  4085 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.351248  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.350675  4045 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:19:12.317960 11777 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:12.353049  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.345223  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:12.357736  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.347028 11670 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.355206  4113 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 17.
I20260709 13:19:12.356794  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:12.359344  4043 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:12.330353 11791 raft_consensus.cc:2804] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:12.361340  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:12.365454  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.360471  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.360353  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.366809  4120 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:12.368465  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.369097  4117 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:12.373111  4121 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:12.375388  4118 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 23. Current term is 24. Ops: [22.15-23.16]
I20260709 13:19:12.363871  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.334260 11627 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:12.377573  4046 raft_consensus.cc:2393] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 19: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:12.359963  4113 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:12.378916  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.371531 11776 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.384399  4085 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.378926  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:12.384792  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.386988  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.403098  4115 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:19:12.355018 11682 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:19:12.407271  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:19:12.412094  4684 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:12.413782 11696 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:12.416559  4042 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:12.378131 11791 raft_consensus.cc:697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.424418  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.425268  4115 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 26: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:12.373664 11780 consensus_queue.cc:1048] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
W20260709 13:19:12.419461 11797 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:19:12.426429  4120 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:12.437029 10891 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:12.384512 11627 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.449239  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:12.449527  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 227102us
W20260709 13:19:12.460531  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 76201us
I20260709 13:19:12.459750  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:12.468941  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:12.478274  4012 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:12.487423  4115 raft_consensus.cc:1240] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:12.487460  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 26.
I20260709 13:19:12.460506 11628 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.501924  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.504287  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:12.487005 11653 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:19:12.508442  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:12.513414  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 51695.6us
I20260709 13:19:12.525673  4042 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:12.526684 11628 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.528070  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:12.528519  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:12.528674  4119 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:12.528831 11804 consensus_queue.cc:1059] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:12.529201  4120 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.536900  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:12.557204 11800 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:19:12.556943 11742 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:12.558367  4042 raft_consensus.cc:1275] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:19:12.558830  4042 pending_rounds.cc:85] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 13
I20260709 13:19:12.559033  4042 pending_rounds.cc:107] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:19:12.559281  4042 raft_consensus.cc:2889] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.504405 11791 consensus_queue.cc:237] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.560555  4120 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:12.560891 11627 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.541929  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.563274 11760 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:12.563827 11760 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.535545 11649 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:12.564333 11760 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:12.564406 11649 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:12.565395  4011 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.565820  3966 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:12.566043 11743 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:12.570567  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48943.1us
I20260709 13:19:12.564206  4012 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:12.583415  4117 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:19:12.589628  4085 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.509521 11653 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:12.571473 11769 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.062s	user 0.001s	sys 0.001s
I20260709 13:19:12.604988  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.606263 11775 raft_consensus.cc:2804] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:12.586671 11804 raft_consensus.cc:3055] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:12.609059 11804 raft_consensus.cc:740] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:12.609964 11804 consensus_queue.cc:260] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.611258 11804 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.612907 11527 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:12.613449 11527 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.613689 11813 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:12.614665 11627 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:12.615550 11527 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.616466 11775 raft_consensus.cc:697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.617408 11775 consensus_queue.cc:237] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:12.618283  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53002.4us
I20260709 13:19:12.619621  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.622624 11527 raft_consensus.cc:2804] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:12.623405 11527 raft_consensus.cc:697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.624605  4119 raft_consensus.cc:1240] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:12.624491 11527 consensus_queue.cc:237] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.581347 11649 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.590227 11696 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.520403 11771 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.100s
I20260709 13:19:12.602986 11653 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:12.620852 11789 raft_consensus.cc:2804] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:12.635365 11810 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:12.642474  4678 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:12.646900 11627 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:19:12.647464 11810 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.649688 11810 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:12.653008 11760 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.653450 11789 raft_consensus.cc:697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:12.653951 11749 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:12.654359 11749 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:12.654480 11789 consensus_queue.cc:237] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.655189 11749 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:12.657269 11543 consensus_queue.cc:1059] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 25.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:12.654527  3937 leader_election.cc:400] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20.
I20260709 13:19:12.658524  3937 leader_election.cc:403] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.659251 11652 raft_consensus.cc:3055] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:12.659665 11652 raft_consensus.cc:740] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:12.660598 11652 consensus_queue.cc:260] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:12.661913 11652 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:12.662546 11781 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:19:12.663942 11781 consensus_queue.cc:1048] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:12.671419  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:12.690145  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46500.4us
I20260709 13:19:12.693717  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:12.697701 11810 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20.
I20260709 13:19:12.699223 11627 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:12.697664  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.700803  3937 leader_election.cc:400] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25.
I20260709 13:19:12.701100  3937 leader_election.cc:403] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:19:12.701370 11627 raft_consensus.cc:2804] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:12.701855 11627 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:12.702234 11627 raft_consensus.cc:3060] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:12.703461 11810 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25.
I20260709 13:19:12.698788 11780 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:19:12.705099  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.707494 11810 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:12.708925  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.711014 11810 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:12.713239  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:12.686559 11749 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:19:12.722935  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 133704us
I20260709 13:19:12.734555  3966 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:12.737623  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:12.744684  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:12.751219  4678 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 25 LEARNER]: Advancing to term 27
I20260709 13:19:12.750584  4038 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:12.747565  4040 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:12.747311 11810 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:19:12.747938 11670 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:12.764649  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:12.782799  4678 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 27 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 15. (term mismatch)
I20260709 13:19:12.756616 11558 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:19:12.781157 11549 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:19:12.765424 11628 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.773833 11670 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:12.796510  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.822741  3970 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:12.800470  3966 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 13:19:12.802994  4115 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:12.802858  4680 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 24 LEARNER]: Advancing to term 26
I20260709 13:19:12.777177 11743 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:19:12.815713  4678 pending_rounds.cc:85] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 14
I20260709 13:19:12.824591  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.832801  4678 pending_rounds.cc:107] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:19:12.833102  3963 raft_consensus.cc:3060] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.833186  4678 raft_consensus.cc:2889] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 27 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:12.838230  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.839089  3967 raft_consensus.cc:3060] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.784838 11649 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:12.843468  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 79937.2us
I20260709 13:19:12.846024  3964 raft_consensus.cc:1275] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:19:12.844493  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:12.848055  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.824244 11670 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:12.879076  4042 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
W20260709 13:19:12.887512  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45582.1us
I20260709 13:19:12.888325  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.888990  3964 raft_consensus.cc:3060] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:12.851867 11628 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:12.906145  3963 raft_consensus.cc:2468] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:12.911381  3972 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.877463 11777 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:12.823977 11543 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
W20260709 13:19:12.946422  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 55078.7us
I20260709 13:19:12.843344 11696 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.051s
I20260709 13:19:12.943005  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:12.972000  3971 raft_consensus.cc:3060] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:12.961383  3967 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:12.985772  4120 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:12.981284 10891 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:19:12.988372  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 143934us
I20260709 13:19:12.991545  3970 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:12.989454  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:13.002689  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.016834  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.017915  3965 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:13.018467  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:13.027884  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.029150  3965 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:19:13.032395  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.032893  3970 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:19:13.037506  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.038260  3970 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:13.039007  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.039496  3970 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.040927 11649 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:13.042886  3965 raft_consensus.cc:2393] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 27: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:13.004729 11829 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.027769  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 50758us
I20260709 13:19:13.047230  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:13.048902  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.048122  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.049641  3969 raft_consensus.cc:2393] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 24: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:13.050671  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.053122  4680 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 26 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 13:19:13.025465 11810 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.053556  4680 pending_rounds.cc:85] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Aborting all ops after (but not including) 15
I20260709 13:19:13.054557  4085 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.085497  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.055050 11834 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:13.092739  4680 pending_rounds.cc:107] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:19:13.093094  4680 raft_consensus.cc:2889] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 26 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.094106  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.094199  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.094780  3967 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.095144  3970 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:13.097563  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.098196  3969 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:13.099463  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.100248  3965 raft_consensus.cc:2410] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 23 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:19:13.102183  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.102764  3970 raft_consensus.cc:3060] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:19:13.098704  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44165.6us
I20260709 13:19:13.104128  4085 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.096819 11628 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.108922 11628 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.087406 11789 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:13.053076 11776 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:19:13.114728  3969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.124385  3970 raft_consensus.cc:2468] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:13.125480  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.126238  3970 raft_consensus.cc:2393] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 26: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:13.128890  3969 raft_consensus.cc:2393] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:13.055804 11487 consensus_queue.cc:1048] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:19:13.052795 11829 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:13.133515 11821 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:19:13.134289 11822 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:19:13.137084 11837 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.136811 11627 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.138206  3970 raft_consensus.cc:1275] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:19:13.139760  3971 raft_consensus.cc:2468] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:13.107751 11456 raft_consensus.cc:2804] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:13.141743  3964 raft_consensus.cc:2468] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:13.147028  3967 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:13.114189 11833 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.153587  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.155812  3969 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 15. (term mismatch)
I20260709 13:19:13.158404  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.163908  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.164152  3969 pending_rounds.cc:85] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 14
I20260709 13:19:13.163316  3967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.164503  3971 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 27.
I20260709 13:19:13.164732  3969 pending_rounds.cc:107] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 25.15
I20260709 13:19:13.164856  3970 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 26: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:13.164142  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.165170  3967 raft_consensus.cc:3060] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:13.166711  3969 raft_consensus.cc:2889] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.165827  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.166548  3964 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:13.167883  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
W20260709 13:19:13.156962 11818 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:19:13.168040  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 134028us
I20260709 13:19:13.168990  3971 raft_consensus.cc:3060] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:13.166108  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.171466  3970 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:13.171586  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:13.173985  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.175343  3966 raft_consensus.cc:2393] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:13.178256  4119 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:19:13.181159  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:13.182567  3970 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:13.183547  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.183876  3964 raft_consensus.cc:2468] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 19.
I20260709 13:19:13.185173  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.158764 11834 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.189930  3971 raft_consensus.cc:2468] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 28.
I20260709 13:19:13.193360  3970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.194065  3970 raft_consensus.cc:2393] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 26: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:13.194340  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.194977  3970 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:13.195899 11841 consensus_queue.cc:1059] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:13.198539  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.199688  3971 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666"
I20260709 13:19:13.200731  3967 raft_consensus.cc:2468] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:13.201071  3971 raft_consensus.cc:1275] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:19:13.183475 11653 consensus_meta.cc:287] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:19:13.196632 11840 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:13.173220 11456 raft_consensus.cc:697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:13.203939  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "1e032f02b0aa450384dda978641ba666" is_pre_election: true
I20260709 13:19:13.217788  3964 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:13.218300 11841 consensus_queue.cc:1243] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 26.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:13.221942  3964 raft_consensus.cc:3055] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:19:13.222319  3964 raft_consensus.cc:740] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.223033  3964 consensus_queue.cc:260] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.223907  3964 raft_consensus.cc:3060] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:13.225298  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:13.227828  4120 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
W20260709 13:19:13.228119  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.228941  3965 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:13.202427 11820 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.229207  4119 raft_consensus.cc:1217] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 19.11->[20.12-20.12]   Dedup: 20.12->[]
I20260709 13:19:13.230468  4119 raft_consensus.cc:1240] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:19:13.174836 11833 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.232059  3967 raft_consensus.cc:2955] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Committing config change with OpId 23.19: config changed from index 18 to 19, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:13.236505  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.237296  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260709 13:19:13.240078  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.238498  3969 raft_consensus.cc:1240] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:19:13.240418  4119 raft_consensus.cc:2393] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:13.175238 11810 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.255272 11670 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:13.257329 11816 log.cc:927] Time spent T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.489s	user 0.000s	sys 0.004s
I20260709 13:19:13.263033 11651 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:13.225301 11838 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.248950 11839 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:13.238943 11836 raft_consensus.cc:3055] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:13.253774 11627 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:13.253986 11829 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:13.254591 11456 consensus_queue.cc:237] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.266294  3968 raft_consensus.cc:1275] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:19:13.206437 11653 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.279503  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:13.280300  4041 raft_consensus.cc:2393] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 22: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:13.236661 11843 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:19:13.273468  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 158848us
I20260709 13:19:13.277014  3964 raft_consensus.cc:1275] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:19:13.284449  3964 pending_rounds.cc:85] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 11
I20260709 13:19:13.284732  3964 pending_rounds.cc:107] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:19:13.284988  3964 raft_consensus.cc:2889] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.281229  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.239904 11841 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:19:13.263422 11651 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:13.294055  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.314466  4040 raft_consensus.cc:2368] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24.
I20260709 13:19:13.273090 11836 raft_consensus.cc:740] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.235288 11820 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.298223  3964 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 16. (term mismatch)
I20260709 13:19:13.321806  3964 pending_rounds.cc:85] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Aborting all ops after (but not including) 15
I20260709 13:19:13.322098  3964 pending_rounds.cc:107] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:19:13.322324  3964 raft_consensus.cc:2889] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.293255  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.298781  4039 raft_consensus.cc:1240] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25. Ops: []
W20260709 13:19:13.299571  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.297763  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:13.303273 11842 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.304323  3968 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:19:13.323789  4045 raft_consensus.cc:2410] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 9.
I20260709 13:19:13.306226 11653 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:13.272903 11838 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.273914 11834 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.310321  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.310915 11843 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:13.294741 11777 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:13.312227  4038 raft_consensus.cc:1240] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 17. Current term is 18. Ops: []
I20260709 13:19:13.312556 11670 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:13.313045  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
I20260709 13:19:13.313855  4085 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.310776 11833 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:13.342355  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.319200 11840 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.292939 11839 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:13.297354 11628 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.336280 11851 consensus_queue.cc:1048] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:19:13.337683 11334 raft_consensus.cc:2804] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:13.344852 11670 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.343760 11776 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:19:13.351418 11417 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.355172 11417 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.353147 11334 raft_consensus.cc:697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:13.356688 11334 consensus_queue.cc:237] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.357220 11417 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:13.354527 11820 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:13.366042 11823 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:19:13.370734 11838 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:13.372830  4119 raft_consensus.cc:1275] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:19:13.372790  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:13.373678  4116 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.374120  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:13.374925  4117 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:13.376026  4113 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:13.380049 11527 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.381176  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:13.350962 11836 consensus_queue.cc:260] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.383766 11775 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:13.384284 11836 raft_consensus.cc:3060] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:13.386333 11688 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:19:13.348996 11651 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.392917 11651 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:13.393359 11853 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:13.393899 11853 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.395962 11853 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:13.396925  4116 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 25.
I20260709 13:19:13.380568 11527 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.354521 11839 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.402902  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.403685  4040 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:13.404613  4046 raft_consensus.cc:1240] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:13.401471 11653 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.004s
I20260709 13:19:13.416741 11854 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:13.417850 11853 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:13.418229 11853 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:13.419052 11853 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.428977 11840 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.398789 11527 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:13.384317 11775 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.441720  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.477262  4112 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 16. Current term is 17. Ops: []
I20260709 13:19:13.478150  4046 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:19:13.474989  4012 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:13.482280  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45408.3us
I20260709 13:19:13.483673  4120 raft_consensus.cc:1275] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:19:13.487567 11775 leader_election.cc:290] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:13.469163 11853 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:13.496589  3963 raft_consensus.cc:1275] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:13.505841 11777 consensus_queue.cc:1048] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:13.512006  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:13.512912  4113 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 27.
I20260709 13:19:13.514446  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:13.515131  4040 raft_consensus.cc:2393] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:13.492295 11527 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:13.497738 11549 consensus_queue.cc:1059] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:19:13.523226 11760 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:13.523859  4042 raft_consensus.cc:1275] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:19:13.525153 11549 raft_consensus.cc:3055] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:13.525525 11549 raft_consensus.cc:740] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:13.526304 11549 consensus_queue.cc:260] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.527485 11549 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:13.527944  4042 raft_consensus.cc:1275] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:19:13.537477  4040 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 293c0ff21e6f4e9f93555aaba177566b for earlier term 22. Current term is 23. Ops: []
I20260709 13:19:13.538264  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:13.539417  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.540400  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.542014  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:13.542833  4046 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:19:13.544494  4042 raft_consensus.cc:2393] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:13.546492  4042 raft_consensus.cc:1275] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:19:13.520339 11527 raft_consensus.cc:697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:13.557163  4042 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 16. (term mismatch)
I20260709 13:19:13.557582  4042 pending_rounds.cc:85] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 15
I20260709 13:19:13.558128  4042 pending_rounds.cc:107] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 23.16
I20260709 13:19:13.558393  4042 raft_consensus.cc:2889] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:13.560050  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:13.560820  4680 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 27.
I20260709 13:19:13.560122  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:13.562685  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:13.568353  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.574290  4677 raft_consensus.cc:1275] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:19:13.578016  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.589355  4042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50aca70be0884ed09aa97127d571282f"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:19:13.589917  4042 raft_consensus.cc:606] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:13.589982  4011 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.590221  4042 raft_consensus.cc:614] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:13.592458  4040 raft_consensus.cc:1240] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:13.593768 10891 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.594175 10891 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.599567  4677 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:13.599705  4011 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.574081 11780 consensus_queue.cc:1059] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:19:13.573894 11848 consensus_queue.cc:1059] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:19:13.593132 11813 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:13.595124 11651 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:13.605718  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:13.604743  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:13.615182  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.588476 11760 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:19:13.601894 11831 consensus_queue.cc:1048] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:19:13.616465 11848 raft_consensus.cc:3055] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:13.616876 11848 raft_consensus.cc:740] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:13.610345  4011 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.619848  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:13.620537 10891 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:13.624976  4011 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.609575 11807 consensus_queue.cc:1048] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:19:13.607931 11837 consensus_queue.cc:1059] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:19:13.609520 11854 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.629266 11543 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:13.638332  4011 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.640730  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:13.632622 11858 log.cc:927] Time spent T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:19:13.615031 11688 consensus_queue.cc:1059] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:19:13.643072  4011 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:13.646727 11649 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:13.647996 11863 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:19:13.632198 11804 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.023s
I20260709 13:19:13.639588 11854 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:13.653975 11864 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:19:13.660267  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:13.642045 11853 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:13.659739 11688 consensus_queue.cc:1243] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 293c0ff21e6f4e9f93555aaba177566b log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:19:13.662175 11649 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:13.665522 11749 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:13.610018 11527 consensus_queue.cc:237] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.637323 11813 consensus_queue.cc:1048] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 13:19:13.620723 11848 consensus_queue.cc:260] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.669859  4011 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:13.671523  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 62433.9us
I20260709 13:19:13.675530  4011 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.677356  4684 raft_consensus.cc:1275] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:13.673133 11649 raft_consensus.cc:697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:13.679441 11649 consensus_queue.cc:237] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.684875 11688 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.684958 11848 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:13.669366 11749 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:13.671155 11853 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:19:13.696862  3918 auto_rebalancer.cc:893] Removing replace marker failed: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 25 committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:13.698042 11854 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:13.698478  3918 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:19:13.699031  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:19:13.698642 11854 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.700908 11854 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:13.702847 11651 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:13.703577  4038 raft_consensus.cc:1240] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:13.696676 11688 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:19:13.711197  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 368885us
I20260709 13:19:13.814262  3937 leader_election.cc:400] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 16. Current term is 17.
I20260709 13:19:13.814601  3937 leader_election.cc:403] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
W20260709 13:19:13.716553  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.749359  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:13.759219  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:13.783335  4115 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:19:13.822875  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 63752.1us
W20260709 13:19:13.735469  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:13.806157  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.824576  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.806427  4114 raft_consensus.cc:1240] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 21. Current term is 22. Ops: []
W20260709 13:19:13.825251  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.697284  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:13.774533  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.828590  3938 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:13.746621  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:13.856177 11836 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:13.856665 11836 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.857019 11836 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:13.857649  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.858846  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.859864  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.727500 11852 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:13.750957 11869 consensus_queue.cc:1048] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.113s
I20260709 13:19:13.863956 11869 consensus_queue.cc:1243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:19:13.865620  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.799266  3870 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.866854  3870 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 22 to 23, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 23 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:13.871229  4113 pending_rounds.cc:85] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 12
I20260709 13:19:13.871604  4113 pending_rounds.cc:107] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:19:13.871840  4113 raft_consensus.cc:2889] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:19:13.851568  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.873075  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47259us
I20260709 13:19:13.877307  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 271) took 9432 ms. Trace:
I20260709 13:19:13.879242 11696 consensus_queue.cc:1059] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:13.713689 11780 raft_consensus.cc:3055] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:13.881281 11780 raft_consensus.cc:740] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:13.721988 11543 raft_consensus.cc:3055] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.882717 11543 raft_consensus.cc:740] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:13.883787  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:13.883628 11543 consensus_queue.cc:260] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.697854 11853 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:13.884584  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 187370us
I20260709 13:19:13.697576 11749 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.885093 11853 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:13.747740 11868 log.cc:927] Time spent T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
W20260709 13:19:13.733642 11846 log.cc:927] Time spent T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.480s	user 0.006s	sys 0.000s
I20260709 13:19:13.885244 11869 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:13.733731 11487 raft_consensus.cc:3055] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:13.896268 11487 raft_consensus.cc:740] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:13.897159 11487 consensus_queue.cc:260] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.898270 11487 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.730500 11652 raft_consensus.cc:3055] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:13.899057 11652 raft_consensus.cc:740] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:13.899828 11652 consensus_queue.cc:260] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.900975 11652 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:13.904856 11839 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 16. Current term is 17.
I20260709 13:19:13.894286 11834 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.894124 11843 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:13.894446 11833 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:13.882087 11780 consensus_queue.cc:260] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.908630 11780 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:13.922668  4648 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.923271  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 49588.7us
W20260709 13:19:13.923955  4648 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:13.924978  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.722184 11848 consensus_queue.cc:1048] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.164s
I20260709 13:19:13.741065 11417 consensus_queue.cc:1048] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:19:13.750690 11688 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.136s
I20260709 13:19:13.937531 11688 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:19:13.937970 11688 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:13.938913 11688 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:13.940210 11688 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:19:13.852754 11760 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
W20260709 13:19:13.949002  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:13.949491  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 82948.3us
W20260709 13:19:13.949034  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.865528 11807 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:13.889281  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:13.881891 11836 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:13.892688  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:13.892752  4013 leader_election.cc:304] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:13.884605 11543 raft_consensus.cc:3060] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:13.925614 11749 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:13.976384  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 83704.5us
W20260709 13:19:13.976866  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89055.9us
I20260709 13:19:13.977726  4011 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:19:13.978271  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85654.8us
I20260709 13:19:13.868480  3870 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 23 to 26, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 26 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:19:13.950135  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.981099  3870 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } }
W20260709 13:19:13.989468  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.877936  3867 rpcz_store.cc:276] 0709 13:19:04.444893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:04.530209 (+ 85316us) service_pool.cc:224] Handling call
0709 13:19:13.877133 (+9346924us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:11.924858 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:11.988837 (+ 63979us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:11.988889 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:19:11.988908 (+    19us) tablet.cc:662] Decoding operations
0709 13:19:11.989912 (+  1004us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:11.990006 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:11.990037 (+    31us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:19:11.990747 (+   710us) tablet.cc:701] Row locks acquired
0709 13:19:11.990794 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:19:11.990956 (+   162us) write_op.cc:270] Start()
0709 13:19:11.991113 (+   157us) write_op.cc:276] Timestamp: P: 1783603151990894 usec, L: 0
0709 13:19:11.991134 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:19:12.016345 (+ 25211us) log.cc:844] Serialized 3306 byte log entry
0709 13:19:12.496492 (+480147us) op_driver.cc:464] REPLICATION: finished
0709 13:19:12.826266 (+329774us) write_op.cc:301] APPLY: starting
0709 13:19:12.851937 (+ 25671us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:13.100495 (+248558us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:13.100603 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:13.266125 (+165522us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:13.298092 (+ 31967us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:19:13.309373 (+ 11281us) write_op.cc:312] APPLY: finished
0709 13:19:13.309686 (+   313us) log.cc:844] Serialized 81 byte log entry
0709 13:19:13.309849 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.309976 (+   127us) write_op.cc:454] Released schema lock
0709 13:19:13.310025 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:13.310439 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:13.310466 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4413736,"reported_tablets":22,"spinlock_wait_cycles":16640,"child_traces":[["op",{"apply.queue_time_us":321122,"apply.run_cpu_time_us":13433,"apply.run_wall_time_us":490671,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37679,"num_ops":8,"prepare.queue_time_us":403642,"prepare.run_cpu_time_us":25752,"prepare.run_wall_time_us":268891,"raft.queue_time_us":210463,"raft.run_cpu_time_us":11718,"raft.run_wall_time_us":262407,"replication_time_us":488000,"thread_start_us":733076,"threads_started":4,"wal-append.queue_time_us":183928}]]}
W20260709 13:19:13.990171  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.952615 11807 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:13.990443  4677 raft_consensus.cc:2955] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:13.993202  3870 catalog_manager.cc:5697] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 15 to 16, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 16 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:13.996730  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:13.994076 11833 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:14.018093  4046 raft_consensus.cc:1275] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 13:19:13.998705  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:14.019886  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:14.016196  4011 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:14.021770  4680 raft_consensus.cc:1240] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Rejecting Update request from peer b8c8b10100a146e6a81f308505fe9f46 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:19:14.024475  4044 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:13.993681 11859 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:13.999341 11527 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:13.993664 11487 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.014853 11807 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:13.993803 11649 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:14.022038  4085 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.036648  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.029584  3870 catalog_manager.cc:5697] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 20 to 23. New cstate: current_term: 23 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.024171  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:14.036993  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.021919 11843 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:14.031781  4011 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:14.000190  4038 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260709 13:19:14.031591  3937 leader_election.cc:400] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24.
I20260709 13:19:14.044234  3937 leader_election.cc:403] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:19:13.997288 11760 consensus_queue.cc:1048] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
W20260709 13:19:14.040521  4085 leader_election.cc:336] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:14.029464 11775 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:14.027276 11834 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:14.046128  4680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:14.047020  4038 raft_consensus.cc:1275] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:14.049134  4042 raft_consensus.cc:1240] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:14.047537 11836 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:14.047789  3870 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:14.114610  4043 raft_consensus.cc:1275] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:14.057368  4011 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
W20260709 13:19:14.058177  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.093168  4041 raft_consensus.cc:1275] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 27 index: 14. (index mismatch)
W20260709 13:19:14.115548  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57428.4us
W20260709 13:19:14.116430  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.087608 11651 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:19:14.119854  4085 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.089480  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 63732.8us
I20260709 13:19:14.117661  4039 raft_consensus.cc:1275] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
W20260709 13:19:14.116336  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59058.6us
I20260709 13:19:14.049731 11859 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:14.125097  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:14.127039 11852 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.127533 11838 consensus_queue.cc:1059] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:14.127586 11852 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:14.128679 11810 raft_consensus.cc:3055] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:14.129314 11810 raft_consensus.cc:740] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:14.129838 11852 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.130128 11810 consensus_queue.cc:260] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.133345 11810 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:14.137321  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:14.142144 11869 raft_consensus.cc:2804] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:14.035140 11527 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.144549  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:14.144248  3870 catalog_manager.cc:5697] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:19:14.120687  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:14.189393  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.159979  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:14.190125  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 69494.8us
W20260709 13:19:14.108680 11882 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:19:14.212253  4117 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:19:14.213074  3937 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.161999  4121 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:19:14.159106  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:14.155797  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:14.240747  4041 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:14.241124  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:14.190884  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.148540  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.230803  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:14.038645 11487 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:14.156378  4010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.259938  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.243099  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:14.158241  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.261423  4120 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 27.
I20260709 13:19:14.282471  4118 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:14.242412  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:14.283900  4114 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:14.260927  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 70092.6us
W20260709 13:19:14.284119  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:14.118476 11833 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24.
I20260709 13:19:14.261961  4038 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:19:14.242681  3870 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.281211  4042 raft_consensus.cc:2468] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:19:14.291767  4043 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:19:14.212481 11869 raft_consensus.cc:697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:14.293507  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 52439.1us
I20260709 13:19:14.301502  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:14.189282 11870 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.097337 11775 raft_consensus.cc:697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:14.321851  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:14.301700  4041 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
W20260709 13:19:14.308523  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 183503us
W20260709 13:19:14.380697  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 66656.6us
I20260709 13:19:14.314462  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:14.242079 11838 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.233726 11780 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.421717 11780 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.424050 11780 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:14.424896 11843 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.425438 11843 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.427459 11843 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.428114 11843 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:14.430114  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.430753  4043 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 27.
I20260709 13:19:14.317242 11872 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.294910 11848 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.431831 11848 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.136013 11853 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.322453 11549 consensus_queue.cc:1048] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:14.327263  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:14.325294  3870 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.147826 11651 raft_consensus.cc:697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:14.444746 11760 consensus_queue.cc:1048] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:14.446121  3870 catalog_manager.cc:5697] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:14.402791 11882 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:14.451928  3870 catalog_manager.cc:5697] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 19 to 21, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 21 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:14.456311  3870 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 21 to 22, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:14.322502 11782 consensus_queue.cc:1059] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260709 13:19:14.323513 11869 consensus_queue.cc:237] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.325874 11527 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.320291 11859 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:14.309393 11852 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:19:14.327476  4085 leader_election.cc:336] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:14.514014  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 186560us
W20260709 13:19:14.514817  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:14.289047 11831 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.242375 11628 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:14.313717 11839 raft_consensus.cc:2764] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:19:14.382838  4039 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
W20260709 13:19:14.403648  4013 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.406450 11883 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:19:14.407217 11692 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:14.418043 11487 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:14.420646 11775 consensus_queue.cc:237] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:14.406348  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 84587.2us
I20260709 13:19:14.437363 11848 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:14.427328 11334 raft_consensus.cc:1064] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:19:14.448810  4041 raft_consensus.cc:1240] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 24. Current term is 25. Ops: []
I20260709 13:19:14.449054  4114 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:19:14.293056 11836 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:14.573161 11848 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:19:14.573625 11836 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:14.458150 11853 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.431731 11872 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:14.575062 11848 consensus_queue.cc:1048] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:14.575822 11836 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:14.461063  3870 catalog_manager.cc:5697] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: config changed from index 18 to 19, term changed from 24 to 25, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 25 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:14.576859 11549 consensus_queue.cc:1048] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:14.466162  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:14.578145 11549 consensus_queue.cc:1048] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:19:14.576462 11848 consensus_queue.cc:1048] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:19:14.458488 11649 consensus_queue.cc:1048] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.123s
I20260709 13:19:14.582049 11831 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:14.584252 11831 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.405172 11833 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:14.356269 11870 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:14.540941  4085 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 41 similar messages]
W20260709 13:19:14.658862  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 117949us
I20260709 13:19:14.662271  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.663316  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.663938  4038 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:14.665141  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:14.665736  4039 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:14.655983  4118 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 28.
I20260709 13:19:14.662994  4043 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:14.438580 11838 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.463243 11843 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:19:14.548269 11875 log.cc:927] Time spent T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.394s	user 0.000s	sys 0.001s
I20260709 13:19:14.544902 11417 raft_consensus.cc:3055] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:19:14.691654 11881 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.577s	user 0.001s	sys 0.000s
W20260709 13:19:14.672398 11884 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.107s	user 0.000s	sys 0.004s
I20260709 13:19:14.444783 11651 consensus_queue.cc:237] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.671707 11836 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:14.722819  4677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.022s	sys 0.061s
W20260709 13:19:14.723210  4677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.022s	sys 0.061s
W20260709 13:19:14.698084 11826 log.cc:927] Time spent T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:19:14.573738 11628 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:14.687918 11549 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.699360 11417 raft_consensus.cc:740] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:14.696609  4042 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:19:14.687646 11833 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:14.756597  4045 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.064s	sys 0.129s
W20260709 13:19:14.757864  4045 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.064s	sys 0.129s
W20260709 13:19:14.759337  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 444905us
I20260709 13:19:14.760437  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:14.700706 11843 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:14.773478  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:14.775784  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:14.810303  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 406541us
I20260709 13:19:14.728231 11836 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.819540 11836 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.820106 11836 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:14.820565 11880 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.684s	user 0.011s	sys 0.000s
W20260709 13:19:14.824043 11334 raft_consensus.cc:1068] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Unable to promote non-voter 293c0ff21e6f4e9f93555aaba177566b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:19:14.825592 11859 consensus_queue.cc:1048] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:19:14.759027  4045 raft_consensus.cc:2955] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Committing config change with OpId 17.11: config changed from index 10 to 11, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:14.815486 11852 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:14.747128 11549 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.856369 11839 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:14.877112  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:14.884459 11810 consensus_meta.cc:287] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.749s	user 0.010s	sys 0.000s
W20260709 13:19:14.907666 11543 consensus_meta.cc:287] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.000s
I20260709 13:19:14.827694 11836 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:19:14.923965  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:14.933681  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:14.935891  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:14.936211 11848 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:14.936700 11848 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.936857 11487 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:14.937361 11487 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:14.937721 11487 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:14.839310 11417 consensus_queue.cc:260] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.935026 11810 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:14.928505 11834 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:14.883905 11839 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:14.982331 11839 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.984423 11834 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:14.937073 11848 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:14.974627 11838 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:14.974774 11417 raft_consensus.cc:3060] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:14.975319 11870 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:14.975739 11879 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.848s	user 0.002s	sys 0.009s
I20260709 13:19:14.932526 11852 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:14.977510 11872 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:14.979664 11807 consensus_meta.cc:287] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 0.938s	user 0.004s	sys 0.002s
I20260709 13:19:14.973672 11890 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:14.960086 11692 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:19:14.989084  4084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.006s	sys 0.019s
W20260709 13:19:14.984158 11688 consensus_meta.cc:287] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 1.044s	user 0.005s	sys 0.004s
W20260709 13:19:15.026522  4084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.007s	sys 0.019s
I20260709 13:19:15.027141  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.027860  4684 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:15.025800 11692 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.030972 11692 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:14.966431 11780 consensus_queue.cc:1059] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:19:15.042932  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:14.975693 11810 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.044729  4013 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:15.038506 11749 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Time spent flushing consensus metadata: real 1.044s	user 0.011s	sys 0.000s
I20260709 13:19:15.031157 11549 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.021322 11859 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:19:15.069182 11834 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.026273 11807 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.072031 11807 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 28 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:15.078145 11887 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:19:15.082046  4680 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 28: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:15.022312 11852 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.063498 11872 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:15.065433 11628 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.033010 11890 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.089653 11833 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.110040  4116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36886 (request call id 4178) took 1341 ms. Trace:
W20260709 13:19:15.110056  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 276009us
I20260709 13:19:15.110452  4116 rpcz_store.cc:276] 0709 13:19:13.763626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.763760 (+   134us) service_pool.cc:224] Handling call
0709 13:19:13.764099 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:19:13.764522 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:13.764548 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:19:13.765165 (+   617us) log.cc:844] Serialized 52 byte log entry
0709 13:19:13.896425 (+131260us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:19:13.896466 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:13.896546 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:14.971860 (+1075314us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:19:15.099290 (+127430us) raft_consensus.cc:1685] finished
0709 13:19:15.099310 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.104435 (+  5125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52,"raft.queue_time_us":1107,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":105,"spinlock_wait_cycles":199220992,"thread_start_us":130900,"threads_started":1,"wal-append.queue_time_us":286068}
I20260709 13:19:15.108914 11852 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.105643 11628 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.162207  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:15.169361  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 394905us
I20260709 13:19:15.171416  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:15.189530  3937 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:15.195173  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 278169us
I20260709 13:19:15.148846 11628 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.210188  4047 raft_consensus.cc:1240] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Rejecting Update request from peer 0f3fa9d459de485e824f023c55580bc6 for earlier term 18. Current term is 19. Ops: []
W20260709 13:19:15.213065 11902 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:19:15.216379 11894 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.198212 11652 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.217417 11652 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.217789  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.218498  4038 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:15.219658  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.225852  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.195933 11893 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:15.236313  4038 raft_consensus.cc:2410] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
W20260709 13:19:15.208658  4649 leader_election.cc:336] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Timed out: RequestConsensusVote RPC to 127.2.200.194:33461 timed out after 1.644s (SENT)
I20260709 13:19:15.194800 11833 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:15.244731  4677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51360 (request call id 785) took 1286 ms. Trace:
I20260709 13:19:15.245252  4677 rpcz_store.cc:276] 0709 13:19:13.951873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.952008 (+   135us) service_pool.cc:224] Handling call
0709 13:19:13.952736 (+   728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:13.974743 (+ 22007us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:19:14.056499 (+ 81756us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.097378 (+1040879us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.097629 (+   251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:15.112430 (+ 14801us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.112621 (+   191us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:15.112658 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.112727 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.237950 (+125223us) raft_consensus.cc:1685] finished
0709 13:19:15.237970 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.238101 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":485068,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":69752,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":34540,"thread_start_us":973960,"threads_started":2,"wal-append.queue_time_us":825829}
W20260709 13:19:15.249382  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 233168us
I20260709 13:19:15.210633 11834 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader election won for term 28
W20260709 13:19:15.254495  4085 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.255719  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.256456  4684 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:15.259650  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.198321 11804 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:15.193164 11852 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
W20260709 13:19:15.271091  4011 leader_election.cc:336] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.272169 11652 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.273247  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.276063  4011 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:15.278348  4045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49112 (request call id 4480) took 1277 ms. Trace:
I20260709 13:19:15.278750  4045 rpcz_store.cc:276] 0709 13:19:13.997244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:13.997370 (+   126us) service_pool.cc:224] Handling call
0709 13:19:14.021464 (+ 24094us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:19:14.032632 (+ 11168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.032669 (+    37us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:19:14.037789 (+  5120us) log.cc:844] Serialized 616 byte log entry
0709 13:19:14.758898 (+721109us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:19:14.918501 (+159603us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.267340 (+348839us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.274083 (+  6743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.274167 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.274211 (+    44us) raft_consensus.cc:1685] finished
0709 13:19:15.274223 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.274381 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26195,"prepare.queue_time_us":29408,"raft.queue_time_us":116415,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":9715,"spinlock_wait_cycles":2861440,"thread_start_us":1027558,"threads_started":2,"wal-append.queue_time_us":923797}
I20260709 13:19:15.255450 11810 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.250272 11838 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.284214  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:15.286926  4011 leader_election.cc:336] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.262571 11833 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:15.298550  3938 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:15.300243  4011 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:15.300907  4038 raft_consensus.cc:1275] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260709 13:19:15.303253  4038 pending_rounds.cc:85] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Aborting all ops after (but not including) 14
I20260709 13:19:15.303498  4038 pending_rounds.cc:107] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260709 13:19:15.303776  4038 raft_consensus.cc:2889] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:15.276392 11834 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 28 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
W20260709 13:19:15.307973  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.315202  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 274510us
I20260709 13:19:15.298707 11543 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:15.319223 11543 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.321311 11543 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.276559 11804 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.324162 11804 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.307034 11838 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.327069 11838 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.328012 11834 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 26.21, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.328334 11838 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.329025 11890 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.301618 11652 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:19:15.329185 11838 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:15.310494  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.336993  3938 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:15.333416 11838 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.216929 11894 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.342789  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.340921  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.309412 11527 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:19:15.343904  4038 raft_consensus.cc:2468] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:15.369414  4044 raft_consensus.cc:2393] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:15.369755  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:15.344369  4011 leader_election.cc:336] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.373414  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.374970  4011 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:15.204962 11896 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.173s
I20260709 13:19:15.333472 11628 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.405012  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.410305  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:15.380214 11899 log.cc:927] Time spent T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:15.414352  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.415087  4043 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:15.231086 11893 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.413677  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.373523 11838 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:15.373067 11911 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:15.419912  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 83346.6us
I20260709 13:19:15.415635  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:15.422029  4011 leader_election.cc:336] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.409688 11628 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:15.334450 11692 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.368069 11903 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:15.422993  4011 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:15.421480 11838 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:15.334432 11833 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:15.433295  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 154109us
W20260709 13:19:15.445329 11909 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:19:15.445919 11843 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.421334 11894 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.448787  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.449311 11527 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.449689 11912 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:19:15.449429 11897 consensus_queue.cc:1048] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:15.457710  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.456851  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:15.448940 11906 log.cc:927] Time spent T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 13:19:15.479844  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 162484us
I20260709 13:19:15.431059 11903 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:15.517254 11903 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:15.521324  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.522116  4681 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
W20260709 13:19:15.522286 11487 consensus_meta.cc:287] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.004s
I20260709 13:19:15.522823 11487 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.474656 11749 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.524556 11749 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.527552 11749 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.488494 11527 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.531306 11527 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:15.551088  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 286665us
I20260709 13:19:15.450297 11838 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:15.474402 11852 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.491379 11893 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.503337  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:15.503536 11917 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:19:15.504945 11896 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:15.507367  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.510111 11834 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.539472 11549 raft_consensus.cc:3055] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:19:15.432365 11911 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.527776  4678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51352 (request call id 800) took 1140 ms. Trace:
I20260709 13:19:15.608831  4046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49112 (request call id 4490) took 1568 ms. Trace:
I20260709 13:19:15.541869 11692 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.543339 11836 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.544366  4042 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:15.545661 11928 raft_consensus.cc:1064] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
W20260709 13:19:15.546051  4011 leader_election.cc:336] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.429651 11628 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:15.554201  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 99736.8us
I20260709 13:19:15.432742 11914 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:15.566085  4013 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:15.622910  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 56905us
W20260709 13:19:15.585247  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:15.498415 11904 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.597411  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.592806 11921 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:15.609251  4678 rpcz_store.cc:276] 0709 13:19:14.387450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.387619 (+   169us) service_pool.cc:224] Handling call
0709 13:19:14.401437 (+ 13818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:19:14.702883 (+301446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:19:14.702914 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:19:14.706517 (+  3603us) log.cc:844] Serialized 26 byte log entry
0709 13:19:15.108101 (+401584us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:19:15.302226 (+194125us) log.cc:844] Serialized 14 byte log entry
0709 13:19:15.306592 (+  4366us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:19:15.527348 (+220756us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54008da254. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed7644ce01 00007fed7644b83e 00007fed7b410419 00007fed74987bd4 00007fed74987b62 00007fed74987a91 00007fed74987a0c 00007fed74986cc2 00007fed7478748c 00007fed747868c6
0709 13:19:15.527405 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:19:15.527460 (+    55us) raft_consensus.cc:1685] finished
0709 13:19:15.527560 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:19:15.527713 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104518,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":48842,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":8544,"spinlock_wait_cycles":692432640,"thread_start_us":594940,"threads_started":2,"wal-append.queue_time_us":525028}
I20260709 13:19:15.609565  4046 rpcz_store.cc:276] 0709 13:19:14.036284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.036401 (+   117us) service_pool.cc:224] Handling call
0709 13:19:15.604236 (+1567835us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540041c654. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:15.604408 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2576568192}
I20260709 13:19:15.616909  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:15.606737 11549 raft_consensus.cc:740] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:15.616292 11843 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:15.675501  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 129497us
W20260709 13:19:15.676265  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.596463 11852 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:15.676811  4011 leader_election.cc:336] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.677335  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:15.635689 11921 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:15.605767 11896 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:15.678561  4648 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.635874 11890 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.638306 11859 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:15.637285 11904 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.684823 11930 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.685127 11692 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:15.686492 11923 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.608696 11834 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.686837 11913 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.621815 11836 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:15.695107  4011 leader_election.cc:336] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.699564  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:15.687731 11651 raft_consensus.cc:1064] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: attempting to promote NON_VOTER 293c0ff21e6f4e9f93555aaba177566b to VOTER
I20260709 13:19:15.681339 11775 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.702025 11775 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.703372  4116 raft_consensus.cc:1275] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:19:15.693971  4648 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.687860 11894 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:15.705440  4648 leader_election.cc:336] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.706935  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:15.687966 11921 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:15.690436 11859 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:15.711670  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.712050  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 89675.1us
I20260709 13:19:15.713069 11932 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.710458  4116 raft_consensus.cc:2410] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:19:15.720791  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:15.696076 11487 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.680061 11843 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.725687  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:15.699294 11893 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:15.725015  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.693521 11890 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.719934 11527 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:15.722715 11859 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:15.737439  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.740520  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:15.709651 11549 consensus_queue.cc:260] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.741659 11836 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.699473 11692 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.721876 11936 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.745780 11890 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.721556 11653 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.727434 11804 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:15.725291 11914 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.723495 11833 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.706073 11913 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.760689 11775 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.758757 11834 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:15.759069 11848 consensus_meta.cc:287] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.742s	user 0.009s	sys 0.002s
I20260709 13:19:15.760830  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.762042 11896 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.767241 11893 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.726786 11932 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.770067 11911 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.732685 11810 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.781669  4116 raft_consensus.cc:1275] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:19:15.782779  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.735671 11943 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.738477 11892 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:15.826524 11775 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.828336  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:15.705430 11923 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.798532 11903 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.833318 11487 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:15.803628 11922 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.833914 11487 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.834386 11922 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.835330 11903 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.836333 11922 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:15.756608  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.837240  4116 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:19:15.696722 11930 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:15.838902  4680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53318 (request call id 564) took 1793 ms (client timeout 1677 ms). Trace:
I20260709 13:19:15.839243 11930 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.807014  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.702574 11651 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 15, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.807727 11833 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.798673 11936 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.842619 11833 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.842751 11936 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:15.798480  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 75403.6us
I20260709 13:19:15.815786  4112 raft_consensus.cc:1275] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:19:15.806075 11549 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:15.820189  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:15.801694 11527 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.812194 11944 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.826213 11628 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.829452 11904 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.830767 11692 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.828351 11775 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:15.810767  4648 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.820571 11931 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:19:15.839257  4680 rpcz_store.cc:269] 0709 13:19:14.045761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.045908 (+   147us) service_pool.cc:224] Handling call
0709 13:19:15.838685 (+1792777us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400a8a554. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed764502fa 00007fed7b411b17 00007fed7498c6d4 00007fed7498c662 00007fed7498c591 00007fed7498c50c 00007fed7498b7c2 00007fed7478748c 00007fed747868c6 00007fed7478626f
0709 13:19:15.838798 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228707072}
W20260709 13:19:15.845788  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89231.8us
I20260709 13:19:15.801630 11653 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.860167  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:15.861210  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:15.863356  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 52619.3us
W20260709 13:19:15.869638 11940 log.cc:927] Time spent T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:19:15.822508 11927 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.895098 11927 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.897279 11927 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.865746  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:15.811457 11914 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.833949 11923 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.867110 11913 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.821825 11893 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.869735 11950 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.859833 11833 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:15.836570 11487 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:15.852695  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.817163 11848 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.881050  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:15.881018  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.912441  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.888031  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:15.857179 11943 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.855911 11932 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:15.902532  4684 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 28: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
I20260709 13:19:15.904702  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:15.908692 11938 log.cc:927] Time spent T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:19:15.909804  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57435us
W20260709 13:19:15.908174  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 44060.2us
W20260709 13:19:15.964579  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.826597 11810 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.861863 11527 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.911223  4677 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:15.952535  4112 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:15.953190  4038 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:19:15.875975 11852 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:15.959367  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 62187.4us
I20260709 13:19:15.968076  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:15.962741  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:15.966702  3938 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:19:15.965159  4011 leader_election.cc:336] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:15.969914  4011 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:15.970925  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:15.978590 11688 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:15.978991  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.979580  4011 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:15.980376  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:15.980922  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.981030 11914 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.879719 11931 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:15.984272 11893 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.952522 11804 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:15.985117 11931 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:15.985347 11804 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:15.961895  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:15.958797 11903 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:15.989207  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:15.990490  4684 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 26 LEARNER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:19:15.991111  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 179955us
I20260709 13:19:15.988893  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:15.986195 11848 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.011260 11804 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.992807 11836 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:19:16.012079 11890 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:16.013144  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:16.011788 11628 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:19:16.018895 11653 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:16.021085  4648 leader_election.cc:336] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.021199  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.050114  4677 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 20.
I20260709 13:19:16.050963  4112 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
I20260709 13:19:16.022236  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.022629  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.024405  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:16.054575  4043 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.024298 11651 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:16.025167  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.031996  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 28 candidate_status { last_received { term: 26 index: 21 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:16.040014  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.044178  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:16.056039  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45499.2us
I20260709 13:19:16.058848  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.065877  4047 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:16.072510  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 105883us
I20260709 13:19:16.066375  4113 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:19:15.864799 11944 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:15.959079 11911 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:19:15.990871 11852 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:15.912271 11833 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.074210  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 87438.9us
I20260709 13:19:16.076728  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.077942  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:16.153407  4011 leader_election.cc:336] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.078574  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.153975  4011 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.154578  4118 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 26.
I20260709 13:19:16.079246  4115 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:19:16.079488  4112 raft_consensus.cc:1275] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:16.080088  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.080847  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:16.081338  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.083484  4119 raft_consensus.cc:2393] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 28: Already voted for candidate 1e032f02b0aa450384dda978641ba666 in this term.
I20260709 13:19:16.084667  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:16.081573  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.163101  4117 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 17.
I20260709 13:19:16.088820  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.048985 11843 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:15.991433 11834 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.088s
I20260709 13:19:15.909386 11950 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.113662  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 85861.5us
W20260709 13:19:16.149077  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 58897us
I20260709 13:19:16.086934 11775 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.151688  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.112004  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.093007 11903 raft_consensus.cc:2804] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:16.164094  4039 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:16.173419 11893 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:16.173451  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.213279  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.114838 11852 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.161388  4681 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:16.217275  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.246793  4041 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:16.247735  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.248371  4041 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:16.225368  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:16.233855  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.237160  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.233234  4042 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 17.
I20260709 13:19:16.250341  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.175530 11782 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.256079  4039 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
W20260709 13:19:16.245369  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 71985.6us
I20260709 13:19:16.238597  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:16.246896  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 131874us
W20260709 13:19:16.218954 11838 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.626s	user 0.014s	sys 0.003s
I20260709 13:19:16.254784  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:16.258450  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:16.262907  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.258836  4681 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 26 index: 21. Preceding OpId from leader: term: 28 index: 22. (index mismatch)
I20260709 13:19:16.263651  4041 raft_consensus.cc:2393] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:16.218705 11628 raft_consensus.cc:493] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.266435  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:16.268754  4011 leader_election.cc:336] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.269265  4011 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:16.251163 11879 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.101s	user 0.001s	sys 0.002s
I20260709 13:19:16.211953 11843 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:19:16.246120 11903 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:19:16.257517 11900 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:19:16.255923 11924 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.585s	user 0.010s	sys 0.002s
I20260709 13:19:16.234493 11953 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:16.266574 11921 consensus_meta.cc:287] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 13:19:16.301429  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:16.287793 11957 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:19:16.313799  4040 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:16.314446  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.288158 11652 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.288676 11950 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.290609  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.291325  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.292035  4113 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:19:16.292399  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.291951  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.294683  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.295323  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.286201 11959 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.280588 11651 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:16.251863 11852 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:16.368912  4118 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:16.286883 11943 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.370570  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:16.370769 11970 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:16.371528  4113 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 18: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:16.371366 11970 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.381537  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.301607 11903 raft_consensus.cc:3060] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.374606  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.374977  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.387985  4118 raft_consensus.cc:2468] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 25.
I20260709 13:19:16.375473  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.376538  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:16.372556 11968 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.381974  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.302290 11653 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.266036 11782 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.385882  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.397804  4114 raft_consensus.cc:2468] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:16.383018  4113 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:19:16.300004 11869 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.390451  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.390018  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.390323  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.268042 11838 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.318722 11911 raft_consensus.cc:493] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:16.317039 11780 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.416180  4043 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 23.
I20260709 13:19:16.280846 11628 raft_consensus.cc:515] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.307497 11890 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:16.414278  4120 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:16.416633  4047 raft_consensus.cc:2468] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 27.
W20260709 13:19:16.406873 11859 consensus_meta.cc:287] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.000s
I20260709 13:19:16.378713 11922 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.415824  4116 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:16.383469 11834 raft_consensus.cc:493] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.316581 11921 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.409567 11963 log.cc:927] Time spent T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.193s	user 0.002s	sys 0.000s
I20260709 13:19:16.436985  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.445698  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.446750  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.447465  4043 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:16.448194  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.408353 11944 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.399202 11810 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:16.473688 11810 raft_consensus.cc:493] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.474170 11810 raft_consensus.cc:515] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.444240 11843 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.475056 11843 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.420840 11956 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:19:16.421129 11789 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:16.408640 11968 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.432505 11879 log.cc:927] Time spent T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:19:16.400856 11653 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.451534 11834 raft_consensus.cc:515] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.422128 11869 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.451912 11922 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.489084  4038 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:19:16.437939  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.408401 11782 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.418807 11961 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.407580 11833 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.452212  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:16.378042 11652 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.418191 11527 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.393292 11959 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:16.462519 11948 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
W20260709 13:19:16.463725  4087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.444454 11859 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.494714  4043 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:16.484490  4117 raft_consensus.cc:1240] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 19. Current term is 20. Ops: []
I20260709 13:19:16.498338  4047 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
W20260709 13:19:16.491336  4085 leader_election.cc:336] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.477946 11789 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.503849  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237eb348003645f7abcc1c18bd324690" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:16.472692 11549 consensus_meta.cc:287] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.628s	user 0.006s	sys 0.001s
I20260709 13:19:16.493280 11890 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.502713 11961 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.506464  4112 raft_consensus.cc:2410] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
W20260709 13:19:16.503942  4085 leader_election.cc:336] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.507428  4085 leader_election.cc:336] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.507702 11961 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.490998 11869 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.497181 11922 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.476706 11810 leader_election.cc:290] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.486480 11653 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.479714 11968 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.480978 11628 leader_election.cc:290] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.484284 11921 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.477613 11843 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.488524 11834 leader_election.cc:290] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:16.519399  4085 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.440409 11780 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.434934 11911 raft_consensus.cc:515] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.526615  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.520900 11980 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:16.519696 11897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.009s	sys 0.008s
I20260709 13:19:16.511577 11789 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:16.553994  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:16.548349  4085 leader_election.cc:336] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.555557  4040 raft_consensus.cc:2468] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:16.510869 11833 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.035s
I20260709 13:19:16.557425  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.560282  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:16.561540  4085 leader_election.cc:336] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.558467 11843 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:16.558297 11834 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:16.544533 11961 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.562949 11961 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.563627  4085 leader_election.cc:336] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.564235  4085 leader_election.cc:336] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.561393  3937 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.545173 11810 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
W20260709 13:19:16.564742  4085 leader_election.cc:336] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.577054  4085 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.568646 11903 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.578408  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.579510 11974 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:16.580451  4085 leader_election.cc:336] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.580969 11968 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:16.582144  4085 leader_election.cc:336] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.583747  4085 leader_election.cc:336] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.584367  4085 leader_election.cc:336] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.584937 11487 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:16.586151  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:19:16.557343 11897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.009s	sys 0.008s
I20260709 13:19:16.589393  3937 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.591341  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.593080  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.594683  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.597651 11944 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:16.598083 11944 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.598419 11944 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:16.600226 11549 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:16.600626 11549 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.592293 11834 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:16.585757 11652 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.596729  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.516284 11948 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.586642 11628 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:16.601030 11549 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:16.607368  3937 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:16.609779 11911 leader_election.cc:290] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:16.609799 11948 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.595189 11921 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:16.559511 11980 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.619102 11859 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:16.620102 11980 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:16.620460  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 400071us
I20260709 13:19:16.610827 11838 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:16.613694  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.613868  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.596032 11843 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:16.614873  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:16.630425 11843 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:16.630892 11843 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:16.631237 11780 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.630810 11959 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.615882 11628 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:16.632256 11628 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:16.632678 11628 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:16.632966 11980 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.633471 11980 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.635552 11980 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.623147  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:16.606673 11836 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:16.617108 11487 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:16.617434 11904 consensus_queue.cc:1059] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:19:16.637975 11487 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.638259 11904 raft_consensus.cc:3055] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:19:16.638381 11487 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:16.638732 11904 raft_consensus.cc:740] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:16.638839  4681 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:16.639539 11904 consensus_queue.cc:260] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.642343  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.643543  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.645551 11487 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.646410 11807 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:16.646842 11807 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.647239 11807 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:16.647652 11487 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.648998 11896 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:16.640714 11904 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:16.644542  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.654198  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.654773 11955 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:16.652648 11852 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:16.708312 11852 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.709646 11749 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:16.705566  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51455.5us
I20260709 13:19:16.711983  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.713413  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:16.713634 11976 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.145s	user 0.002s	sys 0.002s
W20260709 13:19:16.715847 11960 log.cc:927] Time spent T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.294s	user 0.002s	sys 0.000s
I20260709 13:19:16.716033 11804 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:16.654592 11944 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.662140  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 48529.4us
I20260709 13:19:16.719430  4086 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.720696  4086 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:16.721766  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.722810  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:16.663128  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 49319.9us
I20260709 13:19:16.723758  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:16.725271 11928 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.15, Last appended by leader: 14, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.664192 11980 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:16.666662 11961 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.667964 11970 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.669088  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.669526  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.745146  4042 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 24.
I20260709 13:19:16.645629 11789 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.748481 11789 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:16.670529  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:16.744525  4121 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:16.670825  4120 raft_consensus.cc:1275] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:16.671135  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.671608  3938 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
W20260709 13:19:16.761776  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 90232.5us
I20260709 13:19:16.762611 11970 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:16.763294 11970 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:16.764175 11970 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.671911  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.673076  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.767109  4114 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:16.674214  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.768034  4041 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 22.
I20260709 13:19:16.667874 11628 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.674114 11549 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.679320  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.776226  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:16.776415  4113 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:16.776921  4677 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:16.672556  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:16.684592  3936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.011s	sys 0.027s
W20260709 13:19:16.778627  3936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.011s	sys 0.027s
W20260709 13:19:16.723089 11965 log.cc:927] Time spent T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.355s	user 0.000s	sys 0.002s
I20260709 13:19:16.726647 11948 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:19:16.727092 11780 raft_consensus.cc:2804] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:16.789162 11780 raft_consensus.cc:697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:16.790238 11780 consensus_queue.cc:237] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 25.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.727499 11921 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:16.792605 11903 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:16.793143 11961 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.793602  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:16.793659 11961 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.794876 11549 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.729529  4086 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:16.725724  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:16.731519  2851 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 3997)
I20260709 13:19:16.796097 11961 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:16.733237 11931 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.000s	sys 0.005s
I20260709 13:19:16.731559 11944 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:16.733913 11852 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:16.739591 11978 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:19:16.670035  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.776125 11789 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:16.727913 11487 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:16.664072 11930 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:19:16.796609 11931 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.006s
W20260709 13:19:16.795876  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66426.6us
W20260709 13:19:16.798651  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 72978.8us
I20260709 13:19:16.843349  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:16.804136  4677 raft_consensus.cc:2468] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:16.845638  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.756445 11843 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:16.830922  4011 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:16.834568  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:16.835572  4012 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.848613  4013 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:16.831627 11990 log.cc:927] Time spent T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:19:16.858668  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:16.859340  4043 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:19:16.819396  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 223478us
W20260709 13:19:16.861395  4085 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.846521  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.814453 11549 raft_consensus.cc:2804] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:16.852443  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:16.851037  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:16.870337  4046 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:16.849546  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:16.871153  4044 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:16.848417  4012 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:16.815218 11961 raft_consensus.cc:2804] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:16.811755 11948 raft_consensus.cc:697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
W20260709 13:19:16.872972  4085 leader_election.cc:336] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.873193  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:16.876070  4011 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.837512 11930 raft_consensus.cc:493] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:16.920027  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47085.8us
I20260709 13:19:16.838217 11487 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:16.897253  4043 raft_consensus.cc:2468] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:16.880514  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:16.920275  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44254.1us
I20260709 13:19:16.878299  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:16.928593  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 48066.3us
W20260709 13:19:16.928220  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 50015.5us
I20260709 13:19:16.859452 11649 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:16.831934 11854 consensus_queue.cc:1048] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:19:16.839350 11789 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:16.934967  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:16.939473  4085 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:16.943604  4085 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:16.875286 11961 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:16.927145 11930 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:16.875460 11947 raft_consensus.cc:2804] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:16.869436 11810 raft_consensus.cc:2804] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:16.926334 11852 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:16.930694 11487 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:16.928006 11903 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:19:16.941463 11549 raft_consensus.cc:697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:16.930155 11955 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:19:16.928331 11892 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:19:16.955971  4042 raft_consensus.cc:1240] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260709 13:19:16.998265  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.955047  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.957871  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.958822  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.960721  4041 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: [25.15-25.15]
I20260709 13:19:17.001979  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.962229  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.960475  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36d2ae4b33244245aaa1efb074fadddf" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.961575  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.004266  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:16.979486  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet 50aca70be0884ed09aa97127d571282f with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 19) from {username='slave'} at 127.0.0.1:49084
I20260709 13:19:16.978575 11948 consensus_queue.cc:237] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:16.982285 11836 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.982471 11838 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.982937  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.983143 11959 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.978420  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.975160 11688 consensus_queue.cc:1048] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:19:16.963425  4119 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:19:16.986373 11628 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:16.977415  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d8048c0ac04c4be68d870fbac077eb4a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:16.986516  4011 leader_election.cc:336] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.039268  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 63562.1us
I20260709 13:19:17.005656  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.006274  4115 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:16.951150 11961 raft_consensus.cc:3060] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:19:17.005504  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 223329us
W20260709 13:19:17.039863  4011 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.018247  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.043992  4117 raft_consensus.cc:2468] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 22.
I20260709 13:19:16.950640 11968 consensus_queue.cc:1059] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
I20260709 13:19:17.044947  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:17.048532  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 103749us
I20260709 13:19:17.047590  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.042497  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 134) took 7994 ms. Trace:
I20260709 13:19:17.054816  4045 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:19:17.054948  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:19:17.044178  4011 leader_election.cc:336] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.056182  4011 leader_election.cc:336] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.021265  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.057142  4112 raft_consensus.cc:2468] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:17.022532  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:16.976357 11810 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.026149  4046 raft_consensus.cc:2468] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 19.
I20260709 13:19:17.030787  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.982462  3868 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:16.938485 11853 consensus_queue.cc:1048] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:19:16.976868 11970 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:16.947695 11980 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:16.987363 11852 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:19:17.034160  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 153703us
I20260709 13:19:17.035192  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.118396  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:16.963814  4085 leader_election.cc:336] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.035475  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:16.986554 11903 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:17.020236  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b759a28e523c491c941636a30d249939" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:17.119568  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 155793us
I20260709 13:19:17.049038  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.060310  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.060976  4043 raft_consensus.cc:2393] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 25: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:17.122115  4043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.031711  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.031616 11947 raft_consensus.cc:697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:17.124219  4042 raft_consensus.cc:2393] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 27: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:17.068087  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.045104 11928 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:17.066470 11911 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:17.068964 11810 raft_consensus.cc:3060] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.037621 11838 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.031838 11836 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.052546 11807 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.121506 11980 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.050694  3870 rpcz_store.cc:276] 0709 13:19:09.035115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.048378 (+ 13263us) service_pool.cc:224] Handling call
0709 13:19:17.028751 (+7980373us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:14.981754 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:14.982290 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:14.982322 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:19:14.982337 (+    15us) tablet.cc:662] Decoding operations
0709 13:19:14.983513 (+  1176us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:14.983563 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:14.983587 (+    24us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:19:14.984548 (+   961us) tablet.cc:701] Row locks acquired
0709 13:19:14.984571 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:19:14.984706 (+   135us) write_op.cc:270] Start()
0709 13:19:14.992849 (+  8143us) write_op.cc:276] Timestamp: P: 1783603154984661 usec, L: 0
0709 13:19:14.997110 (+  4261us) op_driver.cc:348] REPLICATION: starting
0709 13:19:15.076992 (+ 79882us) log.cc:844] Serialized 5575 byte log entry
0709 13:19:16.025709 (+948717us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b4400022b4c. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73285c85 00007fed732866a2 00007fed75ff81db 00007fed75ff3aaf 00007fed75fe786e 00007fed75fe6bb6 00007fed75fe67d8 00007fed75ff0221 00007fed75ff01d9 00007fed75ff0169
0709 13:19:16.621534 (+595825us) op_driver.cc:464] REPLICATION: finished
0709 13:19:16.679954 (+ 58420us) write_op.cc:301] APPLY: starting
0709 13:19:16.680048 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:16.688789 (+  8741us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:16.688816 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:16.696537 (+  7721us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:16.696859 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:19:16.696915 (+    56us) write_op.cc:312] APPLY: finished
0709 13:19:16.697256 (+   341us) log.cc:844] Serialized 129 byte log entry
0709 13:19:16.697433 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.697595 (+   162us) write_op.cc:454] Released schema lock
0709 13:19:16.697646 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:16.698090 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:16.698119 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34889,"reported_tablets":16,"spinlock_wait_cycles":69504,"child_traces":[["op",{"apply.queue_time_us":55979,"apply.run_cpu_time_us":17062,"apply.run_wall_time_us":18100,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62843,"num_ops":14,"prepare.queue_time_us":397972,"prepare.run_cpu_time_us":20066,"prepare.run_wall_time_us":291149,"raft.queue_time_us":179698,"raft.run_cpu_time_us":8150,"raft.run_wall_time_us":97193,"replication_time_us":1608187,"spinlock_wait_cycles":10736896,"thread_start_us":696741,"threads_started":4,"wal-append.queue_time_us":332106}]]}
I20260709 13:19:17.036682 11652 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:17.093055 11869 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:19:17.119329  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
W20260709 13:19:17.124977  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 75998.5us
I20260709 13:19:17.093727 11760 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.023s
W20260709 13:19:17.125819  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 57817.9us
I20260709 13:19:17.153755  4012 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.124321 11903 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:17.115818 11843 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.106182 11970 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.111277 11549 consensus_queue.cc:237] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.042083 11959 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.120210 11852 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.144536  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.150671 11869 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:17.151899  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:17.158756  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.126212 11928 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.126734 11904 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:17.164247  4012 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.162878 11980 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.164928  4044 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 18.
I20260709 13:19:17.177767  4046 raft_consensus.cc:1240] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:19:17.174010  4011 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:17.184033  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:17.184326  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 123472us
I20260709 13:19:17.174283  4679 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 19: Already voted for candidate 293c0ff21e6f4e9f93555aaba177566b in this term.
W20260709 13:19:17.179615  3938 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 133388us
I20260709 13:19:17.198423  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:17.167368 11992 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:19:17.163156 11921 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:17.202687  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf4967e9db3b4158acf225267ad19344" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.211054 11975 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.211620 11975 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.207229 11780 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:17.214402 11780 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.215351 11973 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.173231 12004 consensus_queue.cc:1048] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
W20260709 13:19:17.207306  4011 leader_election.cc:336] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.216377 11780 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:17.217541 12001 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:19:17.217938 12005 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:17.218544 11996 log.cc:927] Time spent T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 13:19:17.217461  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53302.6us
I20260709 13:19:17.222630  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.179498 12008 tablet_replica.cc:333] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:17.223894  4012 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.224045 11854 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:17.183087 11653 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.224500 11854 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.224936 11854 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.227065 11838 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:17.224615 11651 consensus_queue.cc:1048] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:19:17.228945 11959 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.230171  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.231305 11649 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:17.231951 11649 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:17.232306 11649 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.232681 11854 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:17.233459 11999 log.cc:927] Time spent T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:19:17.173677 11869 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:17.234526  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.232618 11649 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.241436 12005 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:17.241204 11947 consensus_queue.cc:237] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.242005 12005 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.242424 12005 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.246790  4012 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.249598 11527 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.255398 11890 raft_consensus.cc:3055] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:19:17.255784 11807 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.184525 11928 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:17.259759 11649 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:17.277371  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 116960us
I20260709 13:19:17.279029  4086 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:17.292001  4011 leader_election.cc:336] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.292521  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.298645  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.199831 11892 raft_consensus.cc:2764] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:19:17.205129 11843 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.200678 11922 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:17.265331 11993 log.cc:927] Time spent T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
W20260709 13:19:17.259255 12009 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:19:17.314440 12012 log.cc:927] Time spent T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:19:17.298105 11780 raft_consensus.cc:2804] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:17.322376  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.204334 11833 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:17.265887 11921 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.259128 12005 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.255859 11890 raft_consensus.cc:740] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:17.166316 11652 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:17.287734  4086 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
W20260709 13:19:17.320684 12003 log.cc:927] Time spent T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:19:17.298331 11859 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:17.325806  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:17.334370  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 136020us
I20260709 13:19:17.341163  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:17.344213  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 50389.3us
I20260709 13:19:17.345214 11836 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:17.346127 11789 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:17.346725 12005 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:17.347568 11998 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:19:17.348914 11890 consensus_queue.cc:260] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.350279 11890 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:17.341248  3937 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:17.353981  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 66329.9us
W20260709 13:19:17.345167  4011 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.355319  4086 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.332050 11921 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:19:17.357671  4011 leader_election.cc:336] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.366722  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:17.367069  4011 leader_election.cc:336] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.367844  4042 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
W20260709 13:19:17.367936  4011 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.368881  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.373984  4681 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:17.375108  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.374166  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:17.315630 11922 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.379945 11931 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:19:17.364081 11836 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.375360 11649 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.392010 11810 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.397073 11922 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.395486 11946 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:17.397696 11946 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:17.399722 11946 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.396226 11931 raft_consensus.cc:697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:17.353858 11780 raft_consensus.cc:697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:17.400816 11931 consensus_queue.cc:237] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.401600 11780 consensus_queue.cc:237] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.402113 11903 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:17.405362  3938 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.363668 11334 raft_consensus.cc:2804] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:17.417012 11836 consensus_queue.cc:1059] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.004s
I20260709 13:19:17.423025 12015 consensus_queue.cc:1059] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:17.424301 12015 raft_consensus.cc:3055] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:19:17.424808 12015 raft_consensus.cc:740] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:17.420044  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:17.431638  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.433820 12015 consensus_queue.cc:260] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.437491  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:17.388614 11980 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.445315 11890 raft_consensus.cc:3055] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:19:17.445792 11890 raft_consensus.cc:740] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:17.446605 11980 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.429523 11334 raft_consensus.cc:697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:17.449745 11904 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.449626 11334 consensus_queue.cc:237] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.438798 11911 raft_consensus.cc:2804] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:19:17.453332 11911 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.453715 11911 raft_consensus.cc:3060] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:19:17.456262  4677 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:17.456971 11836 raft_consensus.cc:2804] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:17.458134 11836 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.458477 11836 raft_consensus.cc:3060] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.446628 11890 consensus_queue.cc:260] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.460832 11890 raft_consensus.cc:3060] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.463542 11970 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.388515 11852 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.465663  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.465842  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.466572  4046 raft_consensus.cc:2393] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 20: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:17.466893  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.467549  4042 raft_consensus.cc:2393] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:17.468371  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.469233  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.477630 11487 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.480108 11487 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.480686  4044 raft_consensus.cc:1240] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 23. Current term is 24. Ops: []
I20260709 13:19:17.481451 11930 raft_consensus.cc:515] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.483856 11930 leader_election.cc:290] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.466583 11852 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.418752 11928 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.491961 11928 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.494349 11921 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.496034 11652 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.429271 11810 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.500504 11921 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.504221  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.514144  3937 leader_election.cc:304] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.516222  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.440496 12015 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:19:17.518461  3937 leader_election.cc:304] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.522346  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.522631  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.524410  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.524896  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.525223  4045 raft_consensus.cc:2368] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:19:17.527350  4041 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:17.526367  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.533149  4042 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:17.517143 11904 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.535545  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:17.538589  3935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.519807 11980 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:17.517365 11628 raft_consensus.cc:2749] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:17.532816  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.539170  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.512291 11961 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.541775  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.545295  4038 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:17.545734  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.544157  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.547324  4116 raft_consensus.cc:2393] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 293c0ff21e6f4e9f93555aaba177566b in current term 19: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:17.548522  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.549013  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.517417 11852 consensus_queue.cc:1059] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:19:17.531976 11970 raft_consensus.cc:2749] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.549633  4041 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:17.530196 11903 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.551543  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.555662  4045 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:17.551990  4042 raft_consensus.cc:1275] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 25 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 13:19:17.552461  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.554096  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.551431 12007 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:17.538548 12014 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:19:17.558694 11961 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.565359 11852 raft_consensus.cc:3060] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:17.565622 11980 raft_consensus.cc:3055] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:19:17.566078 11980 raft_consensus.cc:740] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:17.566987 12008 raft_consensus.cc:2243] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:17.566875 11980 consensus_queue.cc:260] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.567875 12008 pending_rounds.cc:70] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Trying to abort 1 pending ops.
I20260709 13:19:17.568127 11980 raft_consensus.cc:3060] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.534214 11975 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:17.570775  4118 raft_consensus.cc:1240] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 25. Current term is 26. Ops: []
I20260709 13:19:17.570994  4038 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0f3fa9d459de485e824f023c55580bc6 in current term 23: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:17.573375  4041 raft_consensus.cc:2468] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:19:17.577522  3937 leader_election.cc:304] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.577468  4045 raft_consensus.cc:2468] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 25.
I20260709 13:19:17.580617  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.582024 11810 raft_consensus.cc:2749] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:17.582135  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.589082 11975 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.573133 11775 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:17.605502 11775 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.607600 11775 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.609035  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.610357  3937 leader_election.cc:304] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.611061 11970 raft_consensus.cc:3060] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:17.612248  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:17.612982  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.573599 11869 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.613986 11628 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:17.614823 11628 raft_consensus.cc:2749] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:19:17.615710 11869 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.610718 11854 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.568172 12008 pending_rounds.cc:77] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Aborting op as it isn't in flight: id { term: 24 index: 19 } timestamp: 7305638466636689408 op_type: NO_OP noop_request { }
I20260709 13:19:17.618707 12008 raft_consensus.cc:2889] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:17.616925 11975 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:17.579403 12014 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.619098  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.615533 11628 consensus_queue.cc:1059] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:17.619122 12008 raft_consensus.cc:2272] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:17.620527 12006 log.cc:927] Time spent T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.445s	user 0.001s	sys 0.002s
I20260709 13:19:17.621027 12014 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:19:17.621085 11628 raft_consensus.cc:3055] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:19:17.645219 11628 raft_consensus.cc:740] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:17.646083 11628 consensus_queue.cc:260] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:17.647269 11628 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:17.622825  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 490977us
W20260709 13:19:17.649328  4085 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.649766  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.623332  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.624876 11970 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:17.650774 11970 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.626894 12008 ts_tablet_manager.cc:1916] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:17.651468  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.652869  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.654408 11810 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:17.655086 11810 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:17.631697  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 322849us
I20260709 13:19:17.655612 11836 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.576550 11911 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.659761  3937 leader_election.cc:400] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:19:17.635885  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:17.636245  4684 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 27 LEARNER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 13:19:17.660728  3937 leader_election.cc:403] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.662206 12014 raft_consensus.cc:3060] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:17.667533 11837 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:17.668098 11837 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:17.670729  4648 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.672889  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.660437 11911 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.676985  4047 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27. Ops: []
I20260709 13:19:17.684890  4044 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:19:17.685642  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
W20260709 13:19:17.689006  4011 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.691939  4011 leader_election.cc:336] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:17.692453  4011 leader_election.cc:336] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.697921  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.702311 11837 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:17.703730 11943 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 13:19:17.711509  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.712100  4117 raft_consensus.cc:3060] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:17.712183  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.712575  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.718174  4115 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.717744  4112 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:17.719846 11911 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:17.720367 11911 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.722479 11911 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.717111  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.726493  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.728681  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:17.729001  3936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:17.732333  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:17.730615  4117 raft_consensus.cc:2468] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
I20260709 13:19:17.697306 11930 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:19:17.768504  4011 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:17.774482  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c90b568035464cd5a8006c0d5876087d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.778565  4112 raft_consensus.cc:2368] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21.
I20260709 13:19:17.690855 11970 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.075s
W20260709 13:19:17.798108  2851 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 3997)
I20260709 13:19:17.807806  4112 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 28 index: 22. (index mismatch)
I20260709 13:19:17.731027 11969 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:17.772893 11943 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:19:17.811422  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.813017  4112 raft_consensus.cc:2368] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25.
I20260709 13:19:17.803951  3867 catalog_manager.cc:5697] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 18 to 19, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.770638 11487 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:17.777979 12014 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461) with higher term. Message: Invalid argument: T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19.
I20260709 13:19:17.816298  4112 raft_consensus.cc:1240] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 26. Current term is 27. Ops: []
W20260709 13:19:17.816555  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 104664us
I20260709 13:19:17.814671  3867 catalog_manager.cc:5697] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.819644  3867 catalog_manager.cc:5697] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.818821  4086 leader_election.cc:304] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.821532  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:17.822885  4112 raft_consensus.cc:1240] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 18. Current term is 19. Ops: []
I20260709 13:19:17.821165  3867 catalog_manager.cc:5697] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 19 to 21, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 21 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:19:17.833711  3867 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 24, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 24 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.785157 11980 consensus_queue.cc:1059] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:19:17.812820 11943 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:17.845623  4115 raft_consensus.cc:2468] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:17.846645  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.840821  4086 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:17.849516  3868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60820 (request call id 264) took 8253 ms. Trace:
I20260709 13:19:17.846725  4119 raft_consensus.cc:1240] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Rejecting Update request from peer 1e032f02b0aa450384dda978641ba666 for earlier term 21. Current term is 22. Ops: []
I20260709 13:19:17.842494  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.836191  3867 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 25 to 27, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 27 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.815073 11969 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.857299  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.842136 11852 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:17.847803 11943 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:17.821472 11780 consensus_queue.cc:1048] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:19:17.845501 11948 raft_consensus.cc:2804] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:17.882967  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.858250 11928 raft_consensus.cc:2804] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:17.823099 11487 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.894151  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.879110 12014 raft_consensus.cc:3055] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:19:17.908715  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.909646  4119 raft_consensus.cc:2393] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:17.878612 11836 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:17.918134  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.854143  3867 catalog_manager.cc:5697] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 10 to 11, term changed from 18 to 20, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195), VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:17.905704 11948 raft_consensus.cc:697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:17.924563  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.907567 11928 raft_consensus.cc:697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:17.911731 12014 raft_consensus.cc:740] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:17.849922  3868 rpcz_store.cc:276] 0709 13:19:09.596543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:09.604279 (+  7736us) service_pool.cc:224] Handling call
0709 13:19:17.849455 (+8245176us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:17.210770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:17.211315 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:17.211352 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:19:17.211369 (+    17us) tablet.cc:662] Decoding operations
0709 13:19:17.211697 (+   328us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:17.211768 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:17.211799 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:17.211977 (+   178us) tablet.cc:701] Row locks acquired
0709 13:19:17.211994 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:19:17.212132 (+   138us) write_op.cc:270] Start()
0709 13:19:17.212239 (+   107us) write_op.cc:276] Timestamp: P: 1783603157212088 usec, L: 0
0709 13:19:17.212258 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:19:17.212976 (+   718us) log.cc:844] Serialized 541 byte log entry
0709 13:19:17.462821 (+249845us) op_driver.cc:464] REPLICATION: finished
0709 13:19:17.674608 (+211787us) write_op.cc:301] APPLY: starting
0709 13:19:17.679171 (+  4563us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:17.755711 (+ 76540us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:17.755819 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:17.756697 (+   878us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:17.756934 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:19:17.756981 (+    47us) write_op.cc:312] APPLY: finished
0709 13:19:17.757191 (+   210us) log.cc:844] Serialized 25 byte log entry
0709 13:19:17.757360 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.757451 (+    91us) write_op.cc:454] Released schema lock
0709 13:19:17.757488 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:17.757923 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:17.757951 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":211502,"apply.run_cpu_time_us":3751,"apply.run_wall_time_us":83309,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8321,"num_ops":1,"prepare.queue_time_us":62032,"prepare.run_cpu_time_us":2505,"prepare.run_wall_time_us":2506,"replication_time_us":250385,"thread_start_us":168224,"threads_started":2}]]}
I20260709 13:19:17.923019  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.933009  4119 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 23: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:17.932369  4678 raft_consensus.cc:1275] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:19:17.923286  3867 catalog_manager.cc:5697] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 20, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.936954 11928 consensus_queue.cc:237] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.938265 12014 consensus_queue.cc:260] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:17.939481 12014 raft_consensus.cc:3060] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:17.943681 12008 ts_tablet_manager.cc:1929] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.19
I20260709 13:19:17.944226 12008 log.cc:1199] T 50aca70be0884ed09aa97127d571282f P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/50aca70be0884ed09aa97127d571282f
I20260709 13:19:17.946076  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.948212  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.948525 11946 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:19:17.949159 12029 log.cc:927] Time spent T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:19:17.945690  3867 catalog_manager.cc:5697] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.950232  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:17.949093  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:17.937615 11969 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.950500  4087 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.963217  3937 leader_election.cc:400] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21.
I20260709 13:19:17.963557  3937 leader_election.cc:403] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.965250  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.966521  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.967366  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:17.937634 11487 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:17.971051  4012 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.958853  3867 catalog_manager.cc:5697] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 23, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 23 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:17.975509  3937 leader_election.cc:400] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25.
I20260709 13:19:17.975845  3937 leader_election.cc:403] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:19:17.976876  3867 catalog_manager.cc:5697] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 22, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 22 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.977345  4012 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:17.950651 11527 consensus_queue.cc:1048] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.021s
I20260709 13:19:17.978703  3867 catalog_manager.cc:5697] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 18, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.973552 11919 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:17.976519 11653 raft_consensus.cc:2804] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:18.002962  3867 catalog_manager.cc:5697] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 23, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 23 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:17.973933 11628 raft_consensus.cc:3060] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:17.982553 11651 raft_consensus.cc:2804] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:19:18.012627  3867 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 23 to 24, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 24 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:17.970727 11969 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:18.014192  3867 catalog_manager.cc:5697] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.015933  3867 catalog_manager.cc:5697] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.971820 11760 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:18.011523 11852 raft_consensus.cc:3060] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:18.018497  3867 catalog_manager.cc:5697] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:18.017112 12030 log.cc:927] Time spent T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:19:18.018288 11653 raft_consensus.cc:697] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:18.023531  3867 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 18, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.015818 12008 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49084 (request call id 89) took 1053 ms. Trace:
I20260709 13:19:18.025705  3867 catalog_manager.cc:5697] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 24, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 24 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:17.976744 11970 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 20, Time since last communication: 0.043s
I20260709 13:19:18.027420  3867 catalog_manager.cc:5697] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 24, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 24 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.018275 11651 raft_consensus.cc:697] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
W20260709 13:19:18.028568  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 200438us
I20260709 13:19:18.010541  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:18.032130  4085 leader_election.cc:336] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:18.014196 11836 consensus_queue.cc:1059] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:19:18.032598  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.032384  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:18.034979  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.036062  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.037191  3937 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.041168 11980 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:18.044838  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.041285  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:18.051447  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.053305  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:17.976912 11948 consensus_queue.cc:237] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.044196  3867 catalog_manager.cc:5697] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:18.059428  3867 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 24, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 24 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:18.061151  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.042964 12015 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:18.046068 11810 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:18.042730 11911 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:18.047966 11834 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:18.080322  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.070127 11975 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:18.082302 12015 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:18.055140 11980 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:19:18.054934 11836 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:18.054589 11760 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.089653 11890 raft_consensus.cc:3055] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:18.090160 11890 raft_consensus.cc:740] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:18.091053 11890 consensus_queue.cc:260] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.092486 11890 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:18.090366  2851 tablet_replica.cc:333] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:18.083971 11904 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:18.102672  2851 raft_consensus.cc:2243] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.106029  2851 raft_consensus.cc:2272] T c01d887181724ddca1d1982ca3ad050f P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.106698 11969 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:18.089689 11760 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.121454 11760 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.127533  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.094446 11653 consensus_queue.cc:237] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.026521 12008 rpcz_store.cc:276] 0709 13:19:16.962401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:16.979196 (+ 16795us) service_pool.cc:224] Handling call
0709 13:19:17.179083 (+199887us) ts_tablet_manager.cc:1151] Deleting tablet 50aca70be0884ed09aa97127d571282f
0709 13:19:17.179184 (+   101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:19:17.709897 (+530713us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:17.943540 (+233643us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:18.002444 (+ 58904us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292731,"tablet-delete.queue_time_us":142484,"thread_start_us":71072,"threads_started":1}
W20260709 13:19:18.139313  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.099586 11651 consensus_queue.cc:237] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.149701  4649 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:18.126899 11904 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:18.161175  2851 tablet_replica.cc:333] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:18.066291 11854 raft_consensus.cc:2955] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Committing config change with OpId 26.17: config changed from index 15 to 17, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:18.161264 11951 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:18.193778 11943 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.199306 11852 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 24. Current term is 25.
I20260709 13:19:18.201190 11852 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:18.201763 11852 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.203346 11628 raft_consensus.cc:2749] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513) with higher term. Message: Invalid argument: T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for earlier term 20. Current term is 21.
I20260709 13:19:18.204003 11852 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.206004  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.206622  4044 raft_consensus.cc:2468] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 24.
I20260709 13:19:18.209808  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.211122  2851 raft_consensus.cc:2243] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.210901  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:18.162110 11904 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.245484 11527 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:18.250803  2851 raft_consensus.cc:2272] T 237eb348003645f7abcc1c18bd324690 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.249183 12014 raft_consensus.cc:2804] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:18.259935 12014 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:18.260493 12014 raft_consensus.cc:3060] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:18.261089 11904 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.267081  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.267598  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.268463  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.270239  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.250155 11943 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:18.257503 11852 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:18.280949  4038 raft_consensus.cc:1275] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:19:18.270465 11904 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.282369  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.282744  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.270176 11649 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:18.274025 11628 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:18.283576  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 123138us
I20260709 13:19:18.255453 11527 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.276635  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet 50aca70be0884ed09aa97127d571282f (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:19:18.301040  4041 raft_consensus.cc:1275] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:19:18.319972  4038 raft_consensus.cc:1275] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:19:18.282809 11852 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:18.285594 11904 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.324002  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:18.286893 11649 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.329648  4038 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:18.328629  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:18.324474 12049 log.cc:927] Time spent T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:19:18.341143  4038 raft_consensus.cc:2468] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 26.
I20260709 13:19:18.348853 11943 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:18.370585 12022 consensus_queue.cc:1048] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:19:18.372789 11859 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:18.373405 11859 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.374432 11946 consensus_queue.cc:1048] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:19:18.375414 11859 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.375188 12022 consensus_queue.cc:1048] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:19:18.377836 11904 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.378795  4086 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:18.380147  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.380781  4038 raft_consensus.cc:2468] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 23.
I20260709 13:19:18.381382  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.382851  4677 raft_consensus.cc:2955] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 15 to 17, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:18.381968  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:18.388428  2851 tablet_replica.cc:333] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:18.389928 11923 raft_consensus.cc:2804] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:19:18.392313 11923 raft_consensus.cc:697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:18.467686  2851 raft_consensus.cc:2243] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.411018 11923 consensus_queue.cc:237] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:18.472857  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 46284.6us
I20260709 13:19:18.393186 11628 raft_consensus.cc:2804] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:18.477931  2851 raft_consensus.cc:2272] T d8048c0ac04c4be68d870fbac077eb4a P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.484012  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:18.493182  4011 leader_election.cc:336] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:18.493775  4011 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:18.473845 11810 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.478793 11628 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.509061 11869 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:18.509429 11628 raft_consensus.cc:3060] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:19:18.540977  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 47856.2us
W20260709 13:19:18.544605  4011 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:18.545084  4011 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:18.596000 12056 log.cc:927] Time spent T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:19:18.599583  4039 raft_consensus.cc:1275] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:19:18.606983 12014 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.562336 11775 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:19:18.509100 11810 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.609557 11852 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:18.510092 11527 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.621050  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:18.601426 12045 log.cc:927] Time spent T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:19:18.636897  3938 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:18.623330 11904 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:18.629307 11924 log.cc:927] Time spent T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: Append to log took a long time: real 0.283s	user 0.000s	sys 0.002s
I20260709 13:19:18.639829 11852 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:18.626513 11943 consensus_queue.cc:1048] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:19:18.660957  4039 raft_consensus.cc:1275] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:19:18.661677  2851 tablet_replica.cc:333] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:18.662632  2851 raft_consensus.cc:2243] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:18.662865 11810 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.663244  2851 raft_consensus.cc:2272] T 591ff6c19f7a4eb5b62c1a1043659414 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:18.666712  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.674582  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.677870  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.679139 11810 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:18.647821 11904 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.657585 11852 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:18.706284  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:18.708320  4084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:18.710390  2851 tablet_replica.cc:333] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:18.711099  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:18.711365  2851 raft_consensus.cc:2243] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:18.714452 12058 log.cc:927] Time spent T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:19:18.680311 11948 consensus_queue.cc:1048] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:19:18.726562  2851 raft_consensus.cc:2272] T cf4967e9db3b4158acf225267ad19344 P 1e032f02b0aa450384dda978641ba666 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:18.732267  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 675456us
I20260709 13:19:18.699940 11852 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:18.738112  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:18.740747  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.734381 12063 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.742205 12063 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.744850 11904 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.745396 11904 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:19:18.747301 11852 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:18.748375  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:18.751991 12063 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.730198 11649 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:18.735072 11810 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.739620 12014 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:18.782202 12060 log.cc:927] Time spent T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:19:18.794056  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 53367.4us
I20260709 13:19:18.798760 12072 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:18.799366 12072 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:18.802340  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.802983  4038 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:19:18.809193  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.821179  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:18.825722  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:18.810932  4116 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
W20260709 13:19:18.825959  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90660.5us
I20260709 13:19:18.835696  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.835270  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:18.775556 11810 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:18.829737 12014 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:18.847146  2851 tablet_replica.cc:333] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:18.849061  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:18.848973 12014 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:18.852320 12063 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:18.886111 12014 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:18.986280 11487 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:18.986894 11487 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:19.036594 12072 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:19.054656 12063 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.080968  4011 leader_election.cc:336] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:19.092875  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:19.136348 12074 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:19.137177 12074 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:19.145668 12063 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.167341 12072 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.167961 12072 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:19.176323  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 327317us
I20260709 13:19:19.177937  2851 raft_consensus.cc:2243] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:19.178480  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.183728  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:19.186905  4011 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:19.181692  4040 raft_consensus.cc:2955] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index 14 to 16, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:19.188042  4047 raft_consensus.cc:1275] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
W20260709 13:19:19.187729  4011 leader_election.cc:336] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:19.191846  4011 leader_election.cc:336] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:19.192513  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:19.193598  4042 raft_consensus.cc:1275] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:19:19.202867  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:19.221521  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 369318us
I20260709 13:19:19.225140  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:19.198797 11904 raft_consensus.cc:493] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.231091  2851 raft_consensus.cc:2272] T 36d2ae4b33244245aaa1efb074fadddf P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:19.203106 12004 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:19.233639  4678 raft_consensus.cc:2955] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Committing config change with OpId 27.16: config changed from index 14 to 16, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:19.224551 11946 consensus_queue.cc:1048] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:19:19.277835  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.236745 11904 raft_consensus.cc:515] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.264321 11890 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.291958 11890 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:19.229493 11944 consensus_queue.cc:1048] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:19:19.343822  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 121445us
W20260709 13:19:19.308684 11628 consensus_meta.cc:287] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.011s
I20260709 13:19:19.345978 11628 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.348022 11628 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.271603 12074 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:19.353700  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 128606us
I20260709 13:19:19.363320  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.364080  4045 raft_consensus.cc:2393] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 26: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:19.348573 11628 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.365813  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:19.367118  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 397733us
W20260709 13:19:19.427488  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.124701 12013 raft_consensus.cc:2955] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Committing config change with OpId 27.16: config changed from index 14 to 16, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:19:19.470279  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 89968.1us
I20260709 13:19:19.487128  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:19.487556  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.465178 12004 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.450400 11810 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.377236 12072 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.486790 12093 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:19.532301  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.533313  4116 raft_consensus.cc:2393] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c8b10100a146e6a81f308505fe9f46 in current term 20: Already voted for candidate 0f3fa9d459de485e824f023c55580bc6 in this term.
I20260709 13:19:19.532531  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.510251 12087 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.512516  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.512513 11852 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:19.497550  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 139297us
I20260709 13:19:19.541482  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.561930  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:19.565325  4116 raft_consensus.cc:1275] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:19:19.573799  4116 raft_consensus.cc:1275] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:19:19.515542 12090 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.569763  4117 raft_consensus.cc:2955] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Committing config change with OpId 26.17: config changed from index 15 to 17, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:19.448402 11628 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:19.527565 12004 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.570003 11852 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.610564  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:19.567088 12087 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.606837 12090 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:19.705435 12096 log.cc:927] Time spent T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
I20260709 13:19:19.706548  4012 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:19.578346 12093 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:19.701375 12072 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.724630 12093 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.724462 12072 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.725263 12093 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.726711 12072 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.727283 12072 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.727733 12072 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:19.702709 12014 consensus_meta.cc:287] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Time spent flushing consensus metadata: real 0.722s	user 0.014s	sys 0.001s
I20260709 13:19:19.728739 11652 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:19.730528  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 142221us
I20260709 13:19:19.702867  2851 tablet_replica.cc:333] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:19.733961  2851 raft_consensus.cc:2243] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:19.734565  2851 pending_rounds.cc:70] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:19.734794  2851 pending_rounds.cc:77] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305638504113262592 op_type: NO_OP noop_request { }
I20260709 13:19:19.735176  2851 raft_consensus.cc:2889] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:19.735510  2851 raft_consensus.cc:2272] T b759a28e523c491c941636a30d249939 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:19.703153  4041 raft_consensus.cc:2468] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 18.
I20260709 13:19:19.574878 11810 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.737555 12093 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.707988 12004 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.739717  4012 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:19.708933 11919 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:19.730628 11904 leader_election.cc:290] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.745765 11904 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.746634 11904 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.748574 11487 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:19.710615 11852 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.740943 11653 consensus_queue.cc:1048] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260709 13:19:19.547143  4648 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 191 similar messages]
I20260709 13:19:19.737386 11810 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.706667 12090 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:19.738831 11652 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.742954 12063 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.708638 12087 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.778752  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.741901 12093 raft_consensus.cc:493] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.758388 11653 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:19.760712  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:19.760924  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 213794us
I20260709 13:19:19.773921 11852 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.729094 12014 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.700623 11628 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:19.797075  4085 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.014s	sys 0.046s
W20260709 13:19:19.804950  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.779832  4120 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:19:19.781785 11919 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:19:19.818326  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.762673 12004 consensus_queue.cc:1048] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
W20260709 13:19:19.820408  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:19.819227  4085 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.014s	sys 0.046s
I20260709 13:19:19.800894 11854 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:19.778651 11652 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:19.824976  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.822288 12004 consensus_queue.cc:1243] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Peer 0f3fa9d459de485e824f023c55580bc6 log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:19:19.809201 11890 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:19.809893 11852 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.817014 12093 raft_consensus.cc:515] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.849642  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.850884  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:19.852006  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.853168  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.854125  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:19.840996 11928 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:19.826350 11854 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:19.868257  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:19.844727 11780 raft_consensus.cc:493] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:19.846081 11904 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.847126 12101 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.881820  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.870286 11890 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
W20260709 13:19:19.890964  4648 leader_election.cc:336] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:19.894742  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:19.895001  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:19.902516  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:19.903668  4677 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 19.
I20260709 13:19:19.889768 11487 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.871789 11928 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:19.907609  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.877345 11780 raft_consensus.cc:515] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:19.912551  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 57880.7us
I20260709 13:19:19.916458  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.919396  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.921664  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.922618  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.924299  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.925339  4047 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.925868  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.899752 12004 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:19.900048 12074 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:19.882206 12101 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:19.924486  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:19.927734  4085 leader_election.cc:336] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:19.933316  4085 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:19.934084  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a389492bb09a4483ad432f0b945c7a61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.899943 12109 raft_consensus.cc:493] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:19.935109  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.935190  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.935792  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:19.906234 11810 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.992674  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:19.933470 11628 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:19.995482  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f21aeb9fd3a643048c424b1d243ad8ba" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.995527  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e58a5e86e7dd4d16a56a3a67f2ac29d7" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.000306  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:19.896598 11890 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:20.005340  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 77636.5us
I20260709 13:19:20.004623 11652 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.918195 12014 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.005935  2851 tablet_replica.cc:333] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
W20260709 13:19:20.013849 12099 log.cc:927] Time spent T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:19:20.011406 11628 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.020241 11628 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.021365  4086 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.024305 11936 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:20.025982 12101 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:19.995389 12004 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.007001 12077 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:20.031150 11890 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:20.008026  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 78077.4us
I20260709 13:19:20.005054 12091 raft_consensus.cc:493] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:20.036181 11852 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.010126  4042 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:19.909816 11487 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.037735 11780 leader_election.cc:290] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.038743 11487 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:20.038657  4115 pending_rounds.cc:85] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Aborting all ops after (but not including) 10
I20260709 13:19:20.040346  4115 pending_rounds.cc:107] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:19:20.040613  4115 raft_consensus.cc:2889] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:19.942800  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.050367  4040 raft_consensus.cc:2410] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:19:19.930589  3937 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
W20260709 13:19:20.053138  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 122619us
I20260709 13:19:20.053891  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:20.054461  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48404.4us
W20260709 13:19:20.055126  4085 leader_election.cc:336] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.055500  4085 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.056193  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.057946 12093 leader_election.cc:290] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.011766 12104 raft_consensus.cc:493] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.059876 12104 raft_consensus.cc:515] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.061990 12104 leader_election.cc:290] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:20.062913 12110 log.cc:927] Time spent T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:19:20.063225  4042 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:19:20.065303 11852 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:19:20.065722 11852 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.066064 11852 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.066423 11928 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.039505 12072 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.046265 12087 raft_consensus.cc:493] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:20.069690 12087 raft_consensus.cc:515] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:20.045065  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 98233.6us
I20260709 13:19:20.075670  4046 raft_consensus.cc:1275] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 26 index: 13. (index mismatch)
I20260709 13:19:20.035218 12091 raft_consensus.cc:515] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.093287  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.078315  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.094617  4118 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 23.
I20260709 13:19:20.079005  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.082088  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:19.910324 12088 raft_consensus.cc:493] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.104327  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.105964  3937 leader_election.cc:304] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.107014 12072 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:20.107671 12072 raft_consensus.cc:2749] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:20.109416  3937 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:20.110297 12104 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:20.111760  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6
I20260709 13:19:20.113202  3937 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.113618 11890 raft_consensus.cc:2804] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:20.113948 12101 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:20.115479  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:20.116609  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 93031.5us
W20260709 13:19:20.117871  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 62774.1us
I20260709 13:19:20.118269  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
W20260709 13:19:20.118505  4085 leader_election.cc:336] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:20.119380  4085 leader_election.cc:336] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:20.120189  4085 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.120549  4085 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:20.121559  4085 leader_election.cc:336] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.124820  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:20.125746  4085 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.114274 11890 raft_consensus.cc:493] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.132566 11890 raft_consensus.cc:3060] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:20.135962  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.138926  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 29 candidate_status { last_received { term: 28 index: 22 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.142992  3937 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.098333 12093 raft_consensus.cc:3060] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:19:20.155077  3937 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.158774  3937 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:20.159600  4085 leader_election.cc:336] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.160094  4085 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.122895 12087 leader_election.cc:290] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.141325 12022 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:20.135526 12101 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:20.117132 11904 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:19:20.161576  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:20.152554 12072 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:20.009949 12109 raft_consensus.cc:515] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.191960  3937 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:20.157217 11943 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:20.207259  4085 leader_election.cc:336] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:20.212312  4085 leader_election.cc:336] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.214145  4121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:19:20.214785  4121 raft_consensus.cc:606] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Received request to transfer leadership
I20260709 13:19:20.165051 12014 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:20.164556 12004 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.161440 12063 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.213644  4085 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.164914 12107 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:20.222648  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.161998 11628 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:20.236287  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 101628us
I20260709 13:19:20.237224  4013 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
W20260709 13:19:20.208415  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 43660.1us
I20260709 13:19:20.122753 12088 raft_consensus.cc:515] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.209384 11527 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:19:20.202009 12117 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:20.240134  4085 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.209717 12087 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:20.241024  4085 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.244705  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.245218  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.246178  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.246323  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.246766  4114 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 27.
I20260709 13:19:20.247064  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.246865  4042 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 27.
I20260709 13:19:20.252066  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 23 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.241027 11549 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:20.253701  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:20.253978 12115 log.cc:927] Time spent T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:19:20.246393  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6112c480d954932a8aa350e7919f25d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.240700 11527 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.236884 12063 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.257952  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e32744704d014399851a0661c8929ded" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.258720 12063 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.242870 11854 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.260720  4117 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:19:20.263712 12088 leader_election.cc:290] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.265202 12077 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:19:20.265579  4085 leader_election.cc:336] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:20.266456  4085 leader_election.cc:336] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:20.267228  4085 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.267587  4085 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.226612 11932 consensus_queue.cc:1048] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:19:20.269065 12087 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:20.269768 12095 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:19:20.257216 11527 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:20.271299 12109 leader_election.cc:290] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.272266  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:20.274501 12112 log.cc:927] Time spent T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:19:20.270112 12087 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.278393  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:20.284509  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 64533.1us
I20260709 13:19:20.289671  4117 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 21.
I20260709 13:19:20.292327  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.295614  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fdf62b06bdd54048a2cc215663a17a2e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.296509  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d07f106b6d347c6bb068bd5140bc810" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.296445  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.297068  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.298131  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.298840  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f289732f2a4c498b8d722dbadc5721" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.297161  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.250969 11649 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:20.301007  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666; no voters: 
I20260709 13:19:20.301925 12109 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:20.300390 12104 raft_consensus.cc:493] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.300560 12088 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.303704 12093 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:20.327939 12104 raft_consensus.cc:515] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.332468 12104 leader_election.cc:290] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.336324 12091 leader_election.cc:290] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.314925 11852 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.338163 11852 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Requested vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:20.326067 12088 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.340452 12088 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.341657 11890 raft_consensus.cc:515] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.374303  2851 raft_consensus.cc:2243] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:20.390753  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 89663.4us
I20260709 13:19:20.393016  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:20.409916  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:20.421667  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95319.9us
I20260709 13:19:20.423784  4086 leader_election.cc:304] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.426555  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.427321  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.426610  4678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:20.429339  4678 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.433350  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3ee0cd50984b8594b3c3f0dda39a22" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:20.343446 11890 leader_election.cc:290] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.444694 11780 raft_consensus.cc:2749] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:20.454023  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:20.454473  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:19:20.455619  4115 raft_consensus.cc:606] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Received request to transfer leadership
I20260709 13:19:20.457269 11852 raft_consensus.cc:493] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.458544 11852 raft_consensus.cc:515] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.460930 11904 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:19:20.461580 11904 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:20.462002 11904 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:19:20.473377  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 49896.7us
I20260709 13:19:20.474130 11890 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:20.483187 12092 raft_consensus.cc:993] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: : Instructing follower b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:19:20.483947 12092 raft_consensus.cc:1081] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Signalling peer b8c8b10100a146e6a81f308505fe9f46 to start an election
I20260709 13:19:20.486514  2851 raft_consensus.cc:2272] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:20.473608 12088 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:20.487636 12088 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:20.492340  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 96724.5us
I20260709 13:19:20.493572  3937 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:20.494881 11890 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:20.497272  4679 consensus_queue.cc:237] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:20.493139 12088 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:20.505720  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:20.506880  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:20.520315 11852 leader_election.cc:290] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.522557  4086 leader_election.cc:304] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.523876 11487 raft_consensus.cc:2749] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:20.528276  4011 leader_election.cc:336] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.555083  4011 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:20.570487  4085 leader_election.cc:336] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.571324  4085 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.582430  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.564144  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:20.570302  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 45090.6us
I20260709 13:19:20.596681  4678 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:20.591725 11904 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:20.599663  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 89653us
I20260709 13:19:20.600817 11904 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.600948 11859 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:20.602705  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:20.604270  4649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:19:20.602707  4011 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.611824 11946 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:20.592988  2851 tablet_replica.cc:333] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:20.619155  2851 raft_consensus.cc:2243] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:20.616431  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a714afc3c644f991d9a9aa8e5be0c1" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.620606  2851 raft_consensus.cc:2272] T c90b568035464cd5a8006c0d5876087d P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:20.616323  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a83d90df1f344e4bcaf5128f021d5a8" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.626658 11527 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:20.627815  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:20.615000  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45885.3us
W20260709 13:19:20.629647  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59368.5us
I20260709 13:19:20.631347  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:20.632264  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.633024  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0ea046ec794443af9a7689d2920002" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 21 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:20.634649  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1be06cbb19234936aabe0a7128358755" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.635459  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
W20260709 13:19:20.622697  4011 leader_election.cc:336] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.635197  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8b8c30ab5342a588659a5531a6a633" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:20.637387  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17894d3c75534c379dd3bb78bf4eea00" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:20.626082  3869 catalog_manager.cc:5697] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 19 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:20.645334  4119 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:19:20.643283  3937 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.658425  3938 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:20.661037  4038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
 from {username='slave'} at 127.0.0.1:49112
I20260709 13:19:20.661756  4038 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:20.662173  4038 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:20.662503 11852 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:19:20.663187 11852 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:20.664584 11852 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:20.667213  4085 leader_election.cc:336] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:20.667766  4085 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.668673 11943 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:20.669255  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.669740 12088 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:19:20.670491  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 60454.5us
I20260709 13:19:20.673661  3937 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:20.670127  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.676868 12088 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:20.678712 12132 log.cc:927] Time spent T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:19:20.685930  3937 leader_election.cc:304] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.686926 12088 raft_consensus.cc:2749] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:20.688529  3937 leader_election.cc:304] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:20.690277 11527 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:20.699256  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:20.699443  4120 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909"
dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:36870
W20260709 13:19:20.699484  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.708638  4120 raft_consensus.cc:606] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Received request to transfer leadership
I20260709 13:19:20.716115  4038 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.085707  4038 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.100785 11852 raft_consensus.cc:2749] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:21.100992  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 412541us
I20260709 13:19:21.102016  3937 leader_election.cc:304] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.103255 11852 raft_consensus.cc:2749] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:21.105408  3937 leader_election.cc:304] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.107787  3937 leader_election.cc:304] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.108664 11890 raft_consensus.cc:2749] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:19:21.109493 11890 raft_consensus.cc:2749] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:21.112923 11890 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.113613 11890 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.115820 11890 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.118323 11890 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.119217 11890 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } }
I20260709 13:19:21.121528 11890 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.122313  3937 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.123291 11890 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:21.123772  3937 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:21.124531  3937 raft_consensus.cc:2686] T c6a714afc3c644f991d9a9aa8e5be0c1 P 1e032f02b0aa450384dda978641ba666: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:19:21.125526  3937 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.126260 11890 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:21.126633  3937 leader_election.cc:304] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.127457 11890 raft_consensus.cc:2749] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:19:21.128012  3937 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.128875 11890 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:21.133292 11890 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.133924 11890 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:21.137109  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:21.137959  4085 leader_election.cc:336] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:21.139273  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:21.140200  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:21.140779  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:21.150851  2851 tablet_replica.cc:333] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:21.159045 11890 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:21.165915  4011 leader_election.cc:336] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:21.166497  4011 leader_election.cc:304] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:21.167722  2851 raft_consensus.cc:2243] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.168746  2851 raft_consensus.cc:2272] T f8e3b561578040338afbbb292ee9e4b7 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.173702  2851 tablet_replica.cc:333] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
W20260709 13:19:21.141513  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:21.176946  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:20.723237  4115 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.179524 12100 raft_consensus.cc:2749] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:21.181314  2851 raft_consensus.cc:2243] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.186023 12088 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.193933 12088 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.199033  4115 raft_consensus.cc:2468] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 24.
W20260709 13:19:21.199494  4085 leader_election.cc:336] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:21.207660  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:21.208376  4044 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:21.207566  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.209834  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.211321  4038 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:21.213305  4038 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:19:21.210695  4119 consensus_meta.cc:287] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: Time spent flushing consensus metadata: real 0.565s	user 0.016s	sys 0.003s
I20260709 13:19:21.215032  4119 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 20.
I20260709 13:19:21.216069  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.220075  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.225144  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.237342  4044 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 28.
W20260709 13:19:21.247355  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:21.185534 11852 raft_consensus.cc:493] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.248039  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:21.248962  4011 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:21.249491  4011 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:21.250361  4011 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:21.251019  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:21.248219 11852 raft_consensus.cc:515] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.255038 11852 leader_election.cc:290] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.252993  3937 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:21.255884  4012 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:21.259769  2851 raft_consensus.cc:2272] T 1d07f106b6d347c6bb068bd5140bc810 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.260124 11859 raft_consensus.cc:2804] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:19:21.279426  4677 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:19:21.285549  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: true dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:21.288604  4679 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:21.260738 11859 raft_consensus.cc:697] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:21.263449  2851 tablet_replica.cc:333] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:21.263644 11852 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.297142 11852 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.298830 12140 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:19:21.299454 11852 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.299997 11852 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:21.300412 11852 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 28 LEADER]: Becoming Leader. State: Replica: 1e032f02b0aa450384dda978641ba666, State: Running, Role: LEADER
I20260709 13:19:21.300273 12140 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:21.300853  4677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.303406  2851 raft_consensus.cc:2243] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.304273  2851 pending_rounds.cc:70] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Trying to abort 2 pending ops.
I20260709 13:19:21.304507  2851 pending_rounds.cc:77] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 18 index: 12 } timestamp: 7305638448137498624 op_type: NO_OP noop_request { }
I20260709 13:19:21.306915  2851 raft_consensus.cc:2889] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:21.307263  2851 pending_rounds.cc:77] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 17 index: 11 } timestamp: 7305638415361462272 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "42df9a30a23e4bd581e33127f2204a0b" old_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } } } new_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } } }
I20260709 13:19:21.309698  2851 raft_consensus.cc:2917] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Aborting config change with OpId 17.11: Aborted: Op aborted
I20260709 13:19:21.310338  2851 raft_consensus.cc:2889] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:19:21.314064 11859 consensus_queue.cc:237] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.318146 12140 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:21.321882  2851 raft_consensus.cc:2272] T 42df9a30a23e4bd581e33127f2204a0b P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.316681 11852 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.323891  4679 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 28.
W20260709 13:19:21.328181  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 70192.8us
W20260709 13:19:21.327781  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:21.346294  4085 leader_election.cc:336] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:21.346789  4085 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:21.344491  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 91557.3us
I20260709 13:19:21.353428  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:21.352278  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:21.361485  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:21.355839 12092 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:21.370981  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:21.371618  4119 raft_consensus.cc:3055] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:19:21.371941  4119 raft_consensus.cc:740] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:21.385898 12077 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:21.390905 12092 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.393287 12092 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:21.394876  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48636us
W20260709 13:19:21.395618  4085 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:21.396008  4085 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:21.397377  4119 consensus_queue.cc:260] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.398633  4119 raft_consensus.cc:3060] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:21.399036  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "450ecd71cd99442cb269ac276ec3d83e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.400846  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:21.401425  4113 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:19:21.402089 12080 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:21.407497  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 72601.6us
W20260709 13:19:21.486076  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 90477.3us
I20260709 13:19:21.489464  2851 tablet_replica.cc:333] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:21.362965 12140 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.492625 12140 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.493182 12140 raft_consensus.cc:493] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.493677 12140 raft_consensus.cc:515] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.495169 12141 raft_consensus.cc:493] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.495739 12140 leader_election.cc:290] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.496305 12140 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.498008  4679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.499500  4120 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:19:21.184724  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:21.509778  4648 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 325081us
I20260709 13:19:21.520447  4119 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 28.
I20260709 13:19:21.533994  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.537436  2851 raft_consensus.cc:2243] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:21.541514  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ef4e92169eb4f9e9b2217d164131a56" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.549602  4112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b34dfd1b29be4147bfda87c498945aeb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.549988  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.550487  4112 raft_consensus.cc:2393] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e032f02b0aa450384dda978641ba666 in current term 24: Already voted for candidate b8c8b10100a146e6a81f308505fe9f46 in this term.
I20260709 13:19:21.550940  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e20b6631af674e838a0accf36c31749f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.551947  4114 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 13:19:21.553378 12117 raft_consensus.cc:493] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:21.553978 12117 raft_consensus.cc:515] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.551101  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "685b92d286284315bf0bfd731587b546" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.554910  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cb75fd2816c4878a8cdd7b7595c52f3" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.553300  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa0ecf853c3e4d398a5b18c0126a0448" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.565905  3937 leader_election.cc:304] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:21.576094  3918 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0f3fa9d459de485e824f023c55580bc6 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 28 committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:21.495739 12141 raft_consensus.cc:515] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.579200 12141 leader_election.cc:290] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.579921 12141 raft_consensus.cc:2749] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:21.580986  3918 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 03c57dfd62654a78a41a253899d8f909 already in progress
W20260709 13:19:21.582224  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 173368us
W20260709 13:19:21.581518  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 03c57dfd62654a78a41a253899d8f909 already in progress
I20260709 13:19:21.536021 11852 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:21.537761 12140 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.603955 12117 leader_election.cc:290] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.604058  3937 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.595738 12079 raft_consensus.cc:493] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:21.608379  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:21.609439  4086 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:19:21.612448  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.185827 12104 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:21.615509 12104 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.617177  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43c0a60eab684a2386715908ca218355" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.618942  3937 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.619578 12141 raft_consensus.cc:2749] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:21.620774 12141 raft_consensus.cc:3060] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:19:21.625444  3937 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:21.626362 12138 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:21.630201 12138 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.631593  3937 leader_election.cc:304] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.632227  2851 pending_rounds.cc:70] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Trying to abort 2 pending ops.
I20260709 13:19:21.632377 12138 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.632877 11890 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:21.634130  3869 catalog_manager.cc:5697] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 21 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.634663 12079 raft_consensus.cc:515] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.643826  3869 catalog_manager.cc:5697] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 25 to 28, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 28 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.635723  2851 pending_rounds.cc:77] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305638544501157888 op_type: NO_OP noop_request { }
I20260709 13:19:21.645462  3869 catalog_manager.cc:5697] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 20 to 23, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 23 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.647068  2851 raft_consensus.cc:2889] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:19:21.648948  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:21.651871  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:21.647459  2851 pending_rounds.cc:77] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 19 index: 12 } timestamp: 7305638516365668352 op_type: NO_OP noop_request { }
W20260709 13:19:21.653296  4012 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 87095.8us
I20260709 13:19:21.653446  2851 raft_consensus.cc:2889] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:21.612030 11852 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.663242  3869 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 24 to 26, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), now has a pending config: VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195), VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 26 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: NON_VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: true } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:21.664791  4012 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:21.667670 12141 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:21.668110 12143 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:21.671433 12140 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.645516 11890 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.015s
I20260709 13:19:21.662178  2851 raft_consensus.cc:2272] T ca8ba08e728f473582080f90e4e45db9 P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:21.682631  3937 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:41513, user_credentials={real_user=slave}} blocked reactor thread for 51119.7us
I20260709 13:19:21.683269  3937 leader_election.cc:304] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.684253  3937 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:21.685817  3937 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.681598  3869 catalog_manager.cc:5697] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 22 to 23, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 23 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.687769  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.686522 12079 leader_election.cc:290] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.681078 11527 raft_consensus.cc:2804] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:19:21.688822 12100 raft_consensus.cc:493] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:21.689394 12100 raft_consensus.cc:515] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.691013 11527 raft_consensus.cc:697] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 28 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:21.691382 12100 leader_election.cc:290] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.692019 11527 consensus_queue.cc:237] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 27.16, Last appended by leader: 16, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.695115  3937 leader_election.cc:304] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.696226  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.685797 12141 raft_consensus.cc:2749] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:21.701944 12140 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:21.725365  4118 raft_consensus.cc:1275] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:19:21.727527  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "591ff6c19f7a4eb5b62c1a1043659414" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.732362  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.742463  4113 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e032f02b0aa450384dda978641ba666 in term 28.
I20260709 13:19:21.693388 12143 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.726568  3869 catalog_manager.cc:5697] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:21.728478 12141 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:21.756693 12140 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.770830  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98d2f9d8927b4f92bc7e4a37d023c1f8" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.771006 12140 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.773582 12140 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.780920  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e61a3a06f437423cad355c7951a460bc" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.781102  4044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68b34d0f4bd480da49284d88135af8b" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.791800  2851 tablet_replica.cc:333] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:21.792969  2851 raft_consensus.cc:2243] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.793690  2851 raft_consensus.cc:2272] T e1f289732f2a4c498b8d722dbadc5721 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.796378 12143 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.765120 12100 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:21.829478 12100 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:21.831205 12104 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.808279 12157 raft_consensus.cc:2749] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:21.834476  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.809962 12088 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.836246  4117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.836483  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.837092  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "254ff72f01fd4cc2ade8c8909c20f5bb" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.837997  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b8eecd98f04495f9ed7470925ed9487" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.836521  4039 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 13:19:21.820263 12146 log.cc:927] Time spent T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: Append to log took a long time: real 0.200s	user 0.000s	sys 0.003s
I20260709 13:19:21.842146  3937 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.839733  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a36ac8ab5384748b125e964d94793fd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.843429  3937 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.844592  3937 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.845655 12157 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:21.843439 12088 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:21.846377 12157 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:21.799881  3869 catalog_manager.cc:5697] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.854190  3869 catalog_manager.cc:5697] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 22 to 24, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 24 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.856073  3869 catalog_manager.cc:5697] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:21.796702  2851 tablet_replica.cc:333] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:21.865353 12088 raft_consensus.cc:493] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:21.867014  4648 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:21.867982 12100 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.869160 11852 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:21.803478 12150 raft_consensus.cc:2749] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:21.869863  3867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60848 (request call id 266) took 6961 ms. Trace:
I20260709 13:19:21.870302  4684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.870337 12149 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.877555  3937 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:21.885926  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:21.889506  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50aca70be0884ed09aa97127d571282f" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:21.881376  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 111163us
I20260709 13:19:21.896023  3869 catalog_manager.cc:5697] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 16 to 20, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 20 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:21.898883  3869 catalog_manager.cc:5697] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 20 to 23, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 23 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:21.901024  3869 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 18 to 19, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 19 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:19:21.903699 12088 raft_consensus.cc:515] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.904270  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.885254 12104 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.019s
I20260709 13:19:21.918900  3938 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:21.918334 11852 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:21.928740 12157 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:21.939561  4012 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:21.929417 11890 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:21.951493 12164 consensus_queue.cc:1048] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:21.957876 11890 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:21.958416  2851 raft_consensus.cc:2243] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.959316  2851 pending_rounds.cc:70] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:21.959573  2851 pending_rounds.cc:77] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 24 index: 16 } timestamp: 7305638501105577984 op_type: NO_OP noop_request { }
I20260709 13:19:21.959877  2851 raft_consensus.cc:2889] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:21.960201  2851 raft_consensus.cc:2272] T 6ef4e92169eb4f9e9b2217d164131a56 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.962327 12088 leader_election.cc:290] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.964112  2851 tablet_replica.cc:333] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:21.965255  2851 raft_consensus.cc:2243] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:21.966115  2851 raft_consensus.cc:2272] T 2d0ea046ec794443af9a7689d2920002 P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:21.888928  3867 rpcz_store.cc:276] 0709 13:19:14.772681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:14.817770 (+ 45089us) service_pool.cc:224] Handling call
0709 13:19:21.718794 (+6901024us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:18.297236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:18.336810 (+ 39574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:18.336842 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:19:18.336858 (+    16us) tablet.cc:662] Decoding operations
0709 13:19:18.338414 (+  1556us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:18.338469 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:18.338494 (+    25us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:19:18.339878 (+  1384us) tablet.cc:701] Row locks acquired
0709 13:19:18.339908 (+    30us) write_op.cc:260] PREPARE: finished
0709 13:19:18.340060 (+   152us) write_op.cc:270] Start()
0709 13:19:18.344916 (+  4856us) write_op.cc:276] Timestamp: P: 1783603158340007 usec, L: 0
0709 13:19:18.344946 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:19:18.345834 (+   888us) log.cc:844] Serialized 8836 byte log entry
0709 13:19:18.764542 (+418708us) op_driver.cc:464] REPLICATION: finished
0709 13:19:18.797978 (+ 33436us) write_op.cc:301] APPLY: starting
0709 13:19:18.798085 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:19.512972 (+714887us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:19.513073 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:19.858645 (+345572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:19.906604 (+ 47959us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:19:19.909398 (+  2794us) write_op.cc:312] APPLY: finished
0709 13:19:19.997042 (+ 87644us) log.cc:844] Serialized 196 byte log entry
0709 13:19:20.105485 (+108443us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:20.105874 (+   389us) write_op.cc:454] Released schema lock
0709 13:19:20.106006 (+   132us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:20.107399 (+  1393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:20.107460 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70321,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":33139,"apply.run_cpu_time_us":43151,"apply.run_wall_time_us":1309230,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96395,"num_ops":22,"prepare.queue_time_us":150073,"prepare.run_cpu_time_us":5439,"prepare.run_wall_time_us":61236,"replication_time_us":419394,"thread_start_us":153457,"threads_started":3,"wal-append.queue_time_us":195710,"wal-append.run_cpu_time_us":2406,"wal-append.run_wall_time_us":1107034}]]}
I20260709 13:19:21.966180  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.970268  4045 raft_consensus.cc:2468] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 20.
I20260709 13:19:21.972390  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.975571  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.922307 12149 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:21.976452  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45132.2us
I20260709 13:19:21.978578  4045 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31345ac12b54b42b93f8e1e71274615" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.989897  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff7454fcd1f54b6eb01038eb8ecb273c" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:21.997745 12149 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.009183  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:21.976308 11890 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:21.978969 11527 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:22.022612  4011 leader_election.cc:336] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:22.029474  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 78936.9us
I20260709 13:19:22.025368  4011 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.068166  3937 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.069051  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:22.069512 11852 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.070219 11852 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.079587  3937 leader_election.cc:304] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.080721 12088 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:19:22.082226  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.069468 11854 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:22.072530 11852 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.081027 12149 raft_consensus.cc:2749] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:22.100962  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc7c268f55f94e0daca09ce6107e964b" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 29 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:22.101531  4121 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Refusing update from remote peer 1e032f02b0aa450384dda978641ba666: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 13:19:22.102309  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.102620  2851 tablet_replica.cc:333] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.103570  2851 raft_consensus.cc:2243] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.104182  2851 raft_consensus.cc:2272] T 43c0a60eab684a2386715908ca218355 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.109659 11890 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:19:22.110391 11854 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:22.110939 11854 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.113565 11854 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.109808  3937 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.118423  3937 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:22.067649  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 73874.7us
I20260709 13:19:22.122120 11890 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:22.119421  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.125751  4086 leader_election.cc:304] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.126591  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 27 candidate_status { last_received { term: 26 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.128820  4086 leader_election.cc:304] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.127586 12149 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:22.129534 11943 raft_consensus.cc:2749] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:22.134701 12079 raft_consensus.cc:2749] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:19:22.132964  4011 leader_election.cc:336] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.146427  4011 leader_election.cc:304] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.140619  2851 tablet_replica.cc:333] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.153931  2851 raft_consensus.cc:2243] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.155326 11653 raft_consensus.cc:2749] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:22.156261  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.155431  2851 pending_rounds.cc:70] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:22.160619  2851 pending_rounds.cc:77] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 23 index: 19 } timestamp: 7305638530119053312 op_type: NO_OP noop_request { }
I20260709 13:19:22.161055  2851 raft_consensus.cc:2889] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.161329 11653 raft_consensus.cc:493] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:22.162170 11653 raft_consensus.cc:515] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.164850 12152 raft_consensus.cc:493] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:22.165782 12152 raft_consensus.cc:515] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.167483 11527 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:22.168049 11527 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.170282 11527 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.170861  4119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8494aa7ed7a6427dbfb02b4753609e41" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 28 candidate_status { last_received { term: 27 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.161386  2851 raft_consensus.cc:2272] T 9b8eecd98f04495f9ed7470925ed9487 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.159099  4011 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:22.177304  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:22.183920  4118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.168658 12152 leader_election.cc:290] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.188081 11653 leader_election.cc:290] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.192957  2851 tablet_replica.cc:333] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
W20260709 13:19:22.193614  4085 leader_election.cc:336] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.194146  2851 raft_consensus.cc:2243] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.196024  2851 pending_rounds.cc:70] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:22.196254  2851 pending_rounds.cc:77] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 17 index: 13 } timestamp: 7305638516036161536 op_type: NO_OP noop_request { }
I20260709 13:19:22.196614  2851 raft_consensus.cc:2889] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.198365  2851 raft_consensus.cc:2272] T 17894d3c75534c379dd3bb78bf4eea00 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.194072  4085 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.200939 12149 raft_consensus.cc:493] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.201329 12173 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:22.201463 12149 raft_consensus.cc:515] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.203948 12149 leader_election.cc:290] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:22.205578  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800380020 after lost signal to thread 2854
W20260709 13:19:22.206712  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800301320 after lost signal to thread 3904
W20260709 13:19:22.207340  4142 debug-util.cc:398] Leaking SignalData structure 0x7b08001915a0 after lost signal to thread 3996
W20260709 13:19:22.208714  4142 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6f80 after lost signal to thread 4071
W20260709 13:19:22.209918  4142 debug-util.cc:398] Leaking SignalData structure 0x7b08003997a0 after lost signal to thread 4072
W20260709 13:19:22.211494  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800399200 after lost signal to thread 4145
W20260709 13:19:22.212869  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800353e20 after lost signal to thread 4709
W20260709 13:19:22.213201  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800376d20 after lost signal to thread 4710
W20260709 13:19:22.214310  4142 debug-util.cc:398] Leaking SignalData structure 0x7b0800198ce0 after lost signal to thread 12130
W20260709 13:19:22.214586  4142 debug-util.cc:398] Leaking SignalData structure 0x7b08003f5780 after lost signal to thread 12131
I20260709 13:19:22.206733  2851 tablet_replica.cc:333] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.223326 11653 raft_consensus.cc:493] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:22.225534  4042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:22.227332 11653 raft_consensus.cc:515] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.229538 11653 leader_election.cc:290] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.230722  2851 raft_consensus.cc:2243] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.231597  2851 raft_consensus.cc:2272] T 8494aa7ed7a6427dbfb02b4753609e41 P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.247236  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42df9a30a23e4bd581e33127f2204a0b" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.247181  2851 tablet_replica.cc:333] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.251322  2851 raft_consensus.cc:2243] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.251839  2851 pending_rounds.cc:70] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Trying to abort 2 pending ops.
I20260709 13:19:22.252077  2851 pending_rounds.cc:77] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305638516078882816 op_type: NO_OP noop_request { }
I20260709 13:19:22.252457  2851 raft_consensus.cc:2889] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:19:22.255837  4011 leader_election.cc:336] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.257239  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53a55b3994714eaca86c1f4d5e9a466e" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.256316  4011 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.259101  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c01d887181724ddca1d1982ca3ad050f" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.261471  4117 raft_consensus.cc:1275] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:19:22.265017  4121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd2df3c22d48b1b21bf6951d14bc61" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 27 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.268922 11527 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:19:22.271974  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.273190  3937 leader_election.cc:304] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.273753 11854 consensus_queue.cc:1048] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:19:22.275336 11890 raft_consensus.cc:2749] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:19:22.252743  2851 pending_rounds.cc:77] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7305638459711045632 op_type: NO_OP noop_request { }
I20260709 13:19:22.278505  2851 raft_consensus.cc:2889] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.278901  2851 raft_consensus.cc:2272] T ff7454fcd1f54b6eb01038eb8ecb273c P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.288652  4011 leader_election.cc:336] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.289110  4011 leader_election.cc:304] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.271883 11527 raft_consensus.cc:493] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:22.292963 11854 raft_consensus.cc:2749] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:22.288069  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:22.293242  4011 leader_election.cc:336] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.296342 12148 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:22.297030  4011 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.284369 12152 raft_consensus.cc:493] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
W20260709 13:19:22.301033  4011 leader_election.cc:336] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.302219 12152 raft_consensus.cc:515] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.304327 12152 leader_election.cc:290] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.302485 11854 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:22.301759  4011 leader_election.cc:304] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
W20260709 13:19:22.309702  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.315582  4011 leader_election.cc:336] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.319839  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e95edd135954b96b72b4881f6d032db" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.320549  4011 leader_election.cc:304] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.309334 12152 raft_consensus.cc:2749] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:22.325194 11854 raft_consensus.cc:2749] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:22.337554 11951 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 LEADER]: Committing config change with OpId 24.17: config changed from index 7 to 17, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:22.342338  4113 raft_consensus.cc:2955] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Committing config change with OpId 24.17: config changed from index 7 to 17, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:22.307461 11527 raft_consensus.cc:515] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:22.351085 11527 leader_election.cc:290] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:22.355506  4677 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:19:22.356992  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:22.337015  2851 tablet_replica.cc:333] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.365641  2851 raft_consensus.cc:2243] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.375057  2851 pending_rounds.cc:70] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:22.375598  2851 pending_rounds.cc:77] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305638447187439616 op_type: NO_OP noop_request { }
I20260709 13:19:22.381397  2851 raft_consensus.cc:2889] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.368847  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8e3b561578040338afbbb292ee9e4b7" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.367154 11890 raft_consensus.cc:493] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.366278 12149 raft_consensus.cc:493] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:22.386363  2851 raft_consensus.cc:2272] T 8a36ac8ab5384748b125e964d94793fd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.386735 12149 raft_consensus.cc:515] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.389176 12149 leader_election.cc:290] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:22.390168  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.378587 12158 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:19:22.367221  4116 raft_consensus.cc:1275] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 27 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
W20260709 13:19:22.391690  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.392632  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:22.395179 11890 raft_consensus.cc:515] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.397387  2851 tablet_replica.cc:333] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.397852 11890 leader_election.cc:290] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.398408  2851 raft_consensus.cc:2243] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.399109  2851 raft_consensus.cc:2272] T 1be06cbb19234936aabe0a7128358755 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.399952  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:22.402400  4012 leader_election.cc:304] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:22.403512 12158 raft_consensus.cc:2749] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:22.404338 12158 consensus_queue.cc:1048] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:19:22.406483  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08c710fdf5ab4acda53986eba38f08dd" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.407920  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d32e7a943df43b289705f4bb80afdda" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 28 candidate_status { last_received { term: 25 index: 12 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.427644  3937 leader_election.cc:304] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.428875 11890 raft_consensus.cc:2749] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:22.430368  3937 leader_election.cc:304] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.430835  2851 tablet_replica.cc:333] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.431602 11890 raft_consensus.cc:2749] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:19:22.431967  2851 raft_consensus.cc:2243] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.437677  2851 raft_consensus.cc:2272] T a389492bb09a4483ad432f0b945c7a61 P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.448747 11951 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56100 (request call id 5) took 1995 ms. Trace:
I20260709 13:19:22.449326 11951 rpcz_store.cc:276] 0709 13:19:20.451841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:20.452140 (+   299us) service_pool.cc:224] Handling call
0709 13:19:20.493060 (+ 40920us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b54009feaa0. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed763b5571 00007fed763c9520 00007fed76452b42 00007fed76451800 00007fed7644a9fa 00007fed7b4124c9 00007fed7498ec54 00007fed7498ebe2 00007fed7498eb11 00007fed7498ea8c 00007fed7498dd42
0709 13:19:20.501213 (+  8153us) log.cc:844] Serialized 501 byte log entry
0709 13:19:22.447066 (+1945853us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":245,"mutex_wait_us":1566,"raft.queue_time_us":3816,"raft.run_cpu_time_us":1993,"raft.run_wall_time_us":128770,"spinlock_wait_cycles":82799360,"thread_start_us":49347,"threads_started":1,"wal-append.queue_time_us":113965,"wal-append.run_cpu_time_us":3090,"wal-append.run_wall_time_us":1029490}
I20260709 13:19:22.451786  2851 tablet_replica.cc:333] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.452750  2851 raft_consensus.cc:2243] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.453881  2851 raft_consensus.cc:2272] T fdf62b06bdd54048a2cc215663a17a2e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.455039 11890 raft_consensus.cc:493] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 293c0ff21e6f4e9f93555aaba177566b)
I20260709 13:19:22.455976 11890 raft_consensus.cc:515] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:22.457178  3857 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8e3b561578040338afbbb292ee9e4b7 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 13:19:22.459822 11890 leader_election.cc:290] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:22.462064  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.462574  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "397fa935c4d84e7fbb1e5dc631ce3711" candidate_uuid: "1e032f02b0aa450384dda978641ba666" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:22.465109  3937 leader_election.cc:304] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e032f02b0aa450384dda978641ba666; no voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:22.465197  2851 tablet_replica.cc:333] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
W20260709 13:19:22.485450  4011 leader_election.cc:336] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.486790  2851 raft_consensus.cc:2243] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.487331  4011 leader_election.cc:304] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c8b10100a146e6a81f308505fe9f46; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.493832  2851 raft_consensus.cc:2272] T 1a83d90df1f344e4bcaf5128f021d5a8 P 1e032f02b0aa450384dda978641ba666 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.498318 12158 raft_consensus.cc:2749] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:19:22.503332  2851 tablet_replica.cc:333] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.507886  2851 raft_consensus.cc:2243] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.481200 11890 raft_consensus.cc:2749] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:22.532687  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.542145  2851 raft_consensus.cc:2272] T 450ecd71cd99442cb269ac276ec3d83e P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.562860  2851 tablet_replica.cc:333] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.566663  2851 raft_consensus.cc:2243] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.567210  2851 pending_rounds.cc:70] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Trying to abort 2 pending ops.
I20260709 13:19:22.567433  2851 pending_rounds.cc:77] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 21 index: 12 } timestamp: 7305638525132382208 op_type: NO_OP noop_request { }
I20260709 13:19:22.567791  2851 raft_consensus.cc:2889] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.568070  2851 pending_rounds.cc:77] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 19 index: 11 } timestamp: 7305638473080541184 op_type: NO_OP noop_request { }
I20260709 13:19:22.568348  2851 raft_consensus.cc:2889] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:19:22.568871  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.582293  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:19:22.582897  4046 raft_consensus.cc:606] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Received request to transfer leadership
I20260709 13:19:22.582932  3870 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:22.591032 12152 raft_consensus.cc:993] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: : Instructing follower 293c0ff21e6f4e9f93555aaba177566b to start an election
I20260709 13:19:22.591673 12152 raft_consensus.cc:1081] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Signalling peer 293c0ff21e6f4e9f93555aaba177566b to start an election
W20260709 13:19:22.594080  4011 leader_election.cc:336] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.594663  4046 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:19:22.607988  4046 raft_consensus.cc:606] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Received request to transfer leadership
I20260709 13:19:22.598374  4681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
 from {username='slave'} at 127.0.0.1:51352
I20260709 13:19:22.609292  4681 raft_consensus.cc:493] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:19:22.609746  4681 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:22.612020  3870 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 135) took 4949 ms. Trace:
W20260709 13:19:22.607466  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.620002  3869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60834 (request call id 272) took 4859 ms. Trace:
W20260709 13:19:22.620601  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:22.621959  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.568663  2851 raft_consensus.cc:2272] T c31345ac12b54b42b93f8e1e71274615 P 1e032f02b0aa450384dda978641ba666 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.616879  4681 raft_consensus.cc:515] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:22.617648  3870 rpcz_store.cc:276] 0709 13:19:17.662443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.662636 (+   193us) service_pool.cc:224] Handling call
0709 13:19:22.611935 (+4949299us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:22.595172 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:22.595689 (+   517us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:22.595726 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:19:22.595739 (+    13us) tablet.cc:662] Decoding operations
0709 13:19:22.596067 (+   328us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:22.596123 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:22.596148 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:19:22.596317 (+   169us) tablet.cc:701] Row locks acquired
0709 13:19:22.596330 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:19:22.596486 (+   156us) write_op.cc:270] Start()
0709 13:19:22.596584 (+    98us) write_op.cc:276] Timestamp: P: 1783603162596440 usec, L: 0
0709 13:19:22.596601 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:19:22.597198 (+   597us) log.cc:844] Serialized 536 byte log entry
0709 13:19:22.599021 (+  1823us) op_driver.cc:464] REPLICATION: finished
0709 13:19:22.599425 (+   404us) write_op.cc:301] APPLY: starting
0709 13:19:22.599499 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:22.600307 (+   808us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:22.600402 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:22.601073 (+   671us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:22.601222 (+   149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:19:22.601268 (+    46us) write_op.cc:312] APPLY: finished
0709 13:19:22.601438 (+   170us) log.cc:844] Serialized 25 byte log entry
0709 13:19:22.601587 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.601665 (+    78us) write_op.cc:454] Released schema lock
0709 13:19:22.601701 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:22.602035 (+   334us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.602064 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4661,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":216,"apply.run_cpu_time_us":2571,"apply.run_wall_time_us":2570,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4194,"num_ops":1,"prepare.queue_time_us":107,"prepare.run_cpu_time_us":2275,"prepare.run_wall_time_us":2275,"replication_time_us":2290}]]}
I20260709 13:19:22.623036  3869 rpcz_store.cc:276] 0709 13:19:17.760384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:17.760509 (+   125us) service_pool.cc:224] Handling call
0709 13:19:22.619939 (+4859430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:19:22.019781 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:19:22.020276 (+   495us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:19:22.020312 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:19:22.020324 (+    12us) tablet.cc:662] Decoding operations
0709 13:19:22.113817 (+ 93493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:19:22.113935 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:19:22.113963 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:19:22.115078 (+  1115us) tablet.cc:701] Row locks acquired
0709 13:19:22.115132 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:19:22.115288 (+   156us) write_op.cc:270] Start()
0709 13:19:22.115434 (+   146us) write_op.cc:276] Timestamp: P: 1783603162115225 usec, L: 0
0709 13:19:22.115471 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:19:22.116194 (+   723us) log.cc:844] Serialized 5487 byte log entry
0709 13:19:22.296043 (+179849us) op_driver.cc:464] REPLICATION: finished
0709 13:19:22.414893 (+118850us) write_op.cc:301] APPLY: starting
0709 13:19:22.415106 (+   213us) tablet.cc:1367] starting BulkCheckPresence
0709 13:19:22.423075 (+  7969us) tablet.cc:1370] finished BulkCheckPresence
0709 13:19:22.423190 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:19:22.550270 (+127080us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:19:22.550669 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:19:22.550717 (+    48us) write_op.cc:312] APPLY: finished
0709 13:19:22.551110 (+   393us) log.cc:844] Serialized 121 byte log entry
0709 13:19:22.551288 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.551435 (+   147us) write_op.cc:454] Released schema lock
0709 13:19:22.551505 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:19:22.551937 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:19:22.551966 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":940917,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":118574,"apply.run_cpu_time_us":18779,"apply.run_wall_time_us":137025,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58649,"num_ops":13,"prepare.queue_time_us":34938,"prepare.run_cpu_time_us":15023,"prepare.run_wall_time_us":198096,"raft.queue_time_us":47985,"raft.run_cpu_time_us":66022,"raft.run_wall_time_us":141523,"replication_time_us":180373,"thread_start_us":269138,"threads_started":4,"wal-append.queue_time_us":128740}]]}
I20260709 13:19:22.637259  4681 leader_election.cc:290] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 27 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.642203  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:22.642858  4114 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:19:22.636778  2851 tablet_replica.cc:333] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.644273  2851 raft_consensus.cc:2243] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:22.644824  4648 leader_election.cc:336] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.645165  2851 raft_consensus.cc:2272] T 50aca70be0884ed09aa97127d571282f P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.655594  2851 tablet_replica.cc:333] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.660992  2851 raft_consensus.cc:2243] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.661881  2851 raft_consensus.cc:2272] T 5e95edd135954b96b72b4881f6d032db P 1e032f02b0aa450384dda978641ba666 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.670447  4114 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 27.
I20260709 13:19:22.675871  2851 tablet_replica.cc:333] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.683825  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: true dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
I20260709 13:19:22.684486  4038 raft_consensus.cc:3055] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:19:22.684810  4038 raft_consensus.cc:740] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:22.685572  4038 consensus_queue.cc:260] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:22.687044  4038 raft_consensus.cc:3060] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:19:22.687655  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59415.6us
I20260709 13:19:22.695144 12079 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:22.695536  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.695681 12079 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.699819  4046 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
I20260709 13:19:22.697794 12079 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:22.707995  4038 raft_consensus.cc:2468] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 27.
I20260709 13:19:22.709932  4649 leader_election.cc:304] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.711208 12143 raft_consensus.cc:2804] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:19:22.711691 12143 raft_consensus.cc:697] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 27 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:22.682391  2851 raft_consensus.cc:2243] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.712615 12143 consensus_queue.cc:237] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:22.713680  2851 raft_consensus.cc:2272] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.722842  3867 catalog_manager.cc:5697] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 18, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 18 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.724529  3867 catalog_manager.cc:5697] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 24, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 24 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:19:22.725811  3867 catalog_manager.cc:5697] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 21 to 23, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 23 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.727239  3867 catalog_manager.cc:5697] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 24 to 26, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 26 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:22.727281  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.728907  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.728991  3867 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 28, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 28 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
W20260709 13:19:22.729857  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.730510  4085 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.730891  4085 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:22.731619 11943 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:22.732086  3867 catalog_manager.cc:5697] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:22.735702  3856 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 96988.8us
I20260709 13:19:22.737846  4041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d99c13fc3b7f4e2687824e0a5911512a"
dest_uuid: "b8c8b10100a146e6a81f308505fe9f46"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:49084
I20260709 13:19:22.738391  4041 raft_consensus.cc:606] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Received request to transfer leadership
I20260709 13:19:22.738656  2851 tablet_replica.cc:333] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.738718  4041 raft_consensus.cc:614] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:19:22.739668  2851 raft_consensus.cc:2243] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.740221  2851 pending_rounds.cc:70] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:22.735818  3867 catalog_manager.cc:5697] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 14 to 16, term changed from 27 to 28, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER. New cstate: current_term: 28 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:22.746992  3867 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 15 to 17, 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 1e032f02b0aa450384dda978641ba666 (127.2.200.193), VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194), VOTER 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195), VOTER 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 26 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:19:22.759721  3918 auto_rebalancer.cc:893] Removing replace marker failed: Replica b8c8b10100a146e6a81f308505fe9f46 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 27 committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
W20260709 13:19:22.760155  3918 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:19:22.756956  3867 catalog_manager.cc:5697] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:22.760437  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
W20260709 13:19:22.770190  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.770141  3867 catalog_manager.cc:5697] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.772537  3867 catalog_manager.cc:5697] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 23 to 27, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 27 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.774716  3867 catalog_manager.cc:5697] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 18 to 22, leader changed from 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:19:22.769170  2851 pending_rounds.cc:77] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305638473596977152 op_type: NO_OP noop_request { }
I20260709 13:19:22.776616  3867 catalog_manager.cc:5697] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 16 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 19 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.777395  2851 raft_consensus.cc:2889] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.777782  2851 raft_consensus.cc:2272] T b34dfd1b29be4147bfda87c498945aeb P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.792395  2851 tablet_replica.cc:333] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.797334  2851 raft_consensus.cc:2243] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.797967  2851 pending_rounds.cc:70] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:22.798202  2851 pending_rounds.cc:77] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 18 index: 12 } timestamp: 7305638477012414464 op_type: NO_OP noop_request { }
I20260709 13:19:22.798555  2851 raft_consensus.cc:2889] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.798902  2851 raft_consensus.cc:2272] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.802526  2851 tablet_replica.cc:333] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.803333  2851 raft_consensus.cc:2243] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:22.803650  3867 catalog_manager.cc:5697] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 22 to 25, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 25 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.805457  3867 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 17 to 20, leader changed from 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196) to 1e032f02b0aa450384dda978641ba666 (127.2.200.193). New cstate: current_term: 20 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:22.806818  3867 catalog_manager.cc:5697] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: config changed from index 7 to 17, VOTER b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) evicted. New cstate: current_term: 24 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } } }
I20260709 13:19:22.820422  3867 catalog_manager.cc:5697] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 24, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 24 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:19:22.804431  2851 raft_consensus.cc:2272] T 2c6116be669b48d88215ae1f69b092a1 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.837035  2851 tablet_replica.cc:333] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.838054  2851 raft_consensus.cc:2243] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.838853  2851 pending_rounds.cc:70] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:22.839082  2851 pending_rounds.cc:77] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305638480331599872 op_type: NO_OP noop_request { }
I20260709 13:19:22.839449  2851 raft_consensus.cc:2889] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:22.839783  2851 raft_consensus.cc:2272] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.844189  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.850472  2851 tablet_replica.cc:333] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.851392  2851 raft_consensus.cc:2243] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.851958  2851 raft_consensus.cc:2272] T 53a55b3994714eaca86c1f4d5e9a466e P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.854974  2851 tablet_replica.cc:333] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.855792  2851 raft_consensus.cc:2243] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.856441  2851 raft_consensus.cc:2272] T fa0ecf853c3e4d398a5b18c0126a0448 P 1e032f02b0aa450384dda978641ba666 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:22.866731  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.873327 12158 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:22.873917 12158 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.876245 12158 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:22.885349  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:22.886880  4011 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:19:22.892241  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:22.892953  4114 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 21.
I20260709 13:19:22.893591  2851 tablet_replica.cc:333] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.894125  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.896183 12158 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:19:22.896624 12158 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:22.897044 12158 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:19:22.905767  2851 raft_consensus.cc:2243] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.906673  2851 raft_consensus.cc:2272] T d99c13fc3b7f4e2687824e0a5911512a P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.920110  2851 tablet_replica.cc:333] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:22.921402 12158 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.931329  2851 raft_consensus.cc:2243] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:22.937414  2851 raft_consensus.cc:2272] T f6112c480d954932a8aa350e7919f25d P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:22.935994  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca8ba08e728f473582080f90e4e45db9" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:22.942346  4113 raft_consensus.cc:3060] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:19:22.918519  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.946275  3870 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "1e032f02b0aa450384dda978641ba666" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } }
I20260709 13:19:22.953253  4033 tablet_service.cc:1558] Processing DeleteTablet for tablet f8e3b561578040338afbbb292ee9e4b7 with delete_type TABLET_DATA_TOMBSTONED (TS b8c8b10100a146e6a81f308505fe9f46 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:49084
W20260709 13:19:22.950074  4011 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:19:22.959990  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:22.963537  4113 raft_consensus.cc:2468] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 22.
I20260709 13:19:22.965350  4012 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:22.966243 11527 raft_consensus.cc:2804] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:19:22.963433  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:22.941682 12158 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 22 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:22.969842 11527 raft_consensus.cc:697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:22.970769 11527 consensus_queue.cc:237] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:22.991632 12189 tablet_replica.cc:333] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:22.991632  3867 catalog_manager.cc:5697] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 26 to 27, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 27 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:19:22.998365  2851 tablet_replica.cc:333] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.003136  2851 raft_consensus.cc:2243] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.003726  2851 pending_rounds.cc:70] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:23.003949  2851 pending_rounds.cc:77] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305638515143712768 op_type: NO_OP noop_request { }
I20260709 13:19:23.004289  2851 raft_consensus.cc:2889] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:23.005010 12189 raft_consensus.cc:2243] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.005733 12189 raft_consensus.cc:2272] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.004608  2851 raft_consensus.cc:2272] T 08c710fdf5ab4acda53986eba38f08dd P 1e032f02b0aa450384dda978641ba666 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.019793  3869 catalog_manager.cc:5697] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 21 to 22, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 22 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:23.042239 12189 ts_tablet_manager.cc:1916] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:19:23.019776  2851 tablet_replica.cc:333] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.049573  2851 raft_consensus.cc:2243] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.057399  2851 raft_consensus.cc:2272] T 254ff72f01fd4cc2ade8c8909c20f5bb P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.067518  2851 tablet_replica.cc:333] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.081466  2851 raft_consensus.cc:2243] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.082475  2851 raft_consensus.cc:2272] T 685b92d286284315bf0bfd731587b546 P 1e032f02b0aa450384dda978641ba666 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.103055  2851 tablet_replica.cc:333] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.103945  2851 raft_consensus.cc:2243] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.104606  2851 raft_consensus.cc:2272] T 397fa935c4d84e7fbb1e5dc631ce3711 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:23.104954  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:23.110638  2851 tablet_replica.cc:333] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.127779  2851 raft_consensus.cc:2243] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.132078  4113 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:19:23.134014 12143 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:23.134474  2851 raft_consensus.cc:2272] T c86a274746124a40b574d2dfb4d0e34d P 1e032f02b0aa450384dda978641ba666 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.137872  2851 tablet_replica.cc:333] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
W20260709 13:19:23.143841  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:23.132197 12189 ts_tablet_manager.cc:1929] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 24.16
W20260709 13:19:23.155647  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:23.164969 12189 log.cc:1199] T f8e3b561578040338afbbb292ee9e4b7 P b8c8b10100a146e6a81f308505fe9f46: Deleting WAL directory at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/wals/f8e3b561578040338afbbb292ee9e4b7
I20260709 13:19:23.167402  3856 catalog_manager.cc:5028] TS b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): tablet f8e3b561578040338afbbb292ee9e4b7 (table test-workload [id=8708f4c240794fbb8c3b86fcac2bef11]) successfully deleted
I20260709 13:19:23.173640  2851 raft_consensus.cc:2243] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.174525  2851 raft_consensus.cc:2272] T 03c57dfd62654a78a41a253899d8f909 P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.204098  2851 tablet_replica.cc:333] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.204986  2851 raft_consensus.cc:2243] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.205541  2851 raft_consensus.cc:2272] T de8b8c30ab5342a588659a5531a6a633 P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.208300  2851 tablet_replica.cc:333] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.217187  2851 raft_consensus.cc:2243] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.217751  2851 raft_consensus.cc:2272] T c59c25d70b304877b556dc3d686ab76e P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:23.221438  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.222997  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:23.220687  2851 tablet_replica.cc:333] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.238699  2851 raft_consensus.cc:2243] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.239245  2851 raft_consensus.cc:2272] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 1e032f02b0aa450384dda978641ba666 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.255460  2851 tablet_replica.cc:333] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.256206  2851 raft_consensus.cc:2243] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:23.257316  2851 raft_consensus.cc:2272] T 921fb867175f444ca511e3c2b6c9aa5c P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:23.268090  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:23.268800  4038 raft_consensus.cc:1275] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Refusing update from remote peer 293c0ff21e6f4e9f93555aaba177566b: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:19:23.270371  2851 tablet_replica.cc:333] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.271344  2851 raft_consensus.cc:2243] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.272679  2851 raft_consensus.cc:2272] T e20b6631af674e838a0accf36c31749f P 1e032f02b0aa450384dda978641ba666 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.273948 12143 consensus_queue.cc:1048] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:19:23.289144  2851 tablet_replica.cc:333] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.290223  2851 raft_consensus.cc:2243] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.290724  2851 pending_rounds.cc:70] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:23.290941  2851 pending_rounds.cc:77] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 21 index: 13 } timestamp: 7305638471618801664 op_type: NO_OP noop_request { }
I20260709 13:19:23.291291  2851 raft_consensus.cc:2889] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:23.291647  2851 raft_consensus.cc:2272] T f21aeb9fd3a643048c424b1d243ad8ba P 1e032f02b0aa450384dda978641ba666 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.297554  2851 tablet_replica.cc:333] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.298377  2851 raft_consensus.cc:2243] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.302240  2851 raft_consensus.cc:2272] T bc7c268f55f94e0daca09ce6107e964b P 1e032f02b0aa450384dda978641ba666 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.305167  2851 tablet_replica.cc:333] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: stopping tablet replica
I20260709 13:19:23.305871  2851 raft_consensus.cc:2243] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:23.306376  2851 pending_rounds.cc:70] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Trying to abort 1 pending ops.
I20260709 13:19:23.306587  2851 pending_rounds.cc:77] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666: Aborting op as it isn't in flight: id { term: 25 index: 12 } timestamp: 7305638471395848192 op_type: NO_OP noop_request { }
I20260709 13:19:23.307049  2851 raft_consensus.cc:2889] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:23.316179  2851 raft_consensus.cc:2272] T 9d32e7a943df43b289705f4bb80afdda P 1e032f02b0aa450384dda978641ba666 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:23.479216  4113 raft_consensus.cc:1275] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:19:23.481582 11527 consensus_queue.cc:1048] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:19:23.493340  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:23.563328  4011 consensus_peers.cc:597] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:23.662360  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 50282us
W20260709 13:19:23.754608  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:23.795998  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.797219  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 45084.6us
W20260709 13:19:23.804833  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.818473  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:23.825212  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:23.837286  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:23.882512  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.920974  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.944489  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.958235  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:23.965085  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.020663  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:24.030995  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:24.098659 12143 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.099268 12143 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.101404 12143 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:24.103890  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 29 candidate_status { last_received { term: 28 index: 22 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:24.138342  4648 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:24.138916  4648 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:24.139745 12143 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:24.155244  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:24.181767  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.223254  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:24.240087  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:24.276239 12211 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.276855 12211 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.278923 12211 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:24.286927  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 29 candidate_status { last_received { term: 28 index: 22 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:24.287642  4681 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 28.
I20260709 13:19:24.289294  4087 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:24.293229 12210 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:24.294453 12210 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.295199 12210 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:19:24.303553  4085 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:24.315747  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:24.334875 12210 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.370585 11527 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.371129 11527 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:24.381946 11527 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:24.383754  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:24.384403  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 28.
I20260709 13:19:24.384572 12210 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:24.386142  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c6116be669b48d88215ae1f69b092a1" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 29 candidate_status { last_received { term: 28 index: 22 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:24.386232  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 
I20260709 13:19:24.386700  4681 raft_consensus.cc:3060] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:24.388341 11527 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:19:24.388696 11527 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.389027 11527 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:19:24.392017  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.405041  4011 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:24.416103  4085 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:24.404363 11527 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:24.409566  4681 raft_consensus.cc:2468] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 29.
I20260709 13:19:24.420713  4087 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:24.422653 12210 raft_consensus.cc:2804] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:19:24.423389 12210 raft_consensus.cc:697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 29 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:24.424980 12210 consensus_queue.cc:237] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 28.22, Last appended by leader: 22, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.427007  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "921fb867175f444ca511e3c2b6c9aa5c" candidate_uuid: "b8c8b10100a146e6a81f308505fe9f46" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:24.427619  4120 raft_consensus.cc:3060] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:19:24.434669 12195 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.435273 12195 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.437399 12195 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:24.438413  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
W20260709 13:19:24.445524  4648 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:24.445969  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:24.447077 12195 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:24.471277 11527 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 29 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:24.553334  4085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111) [suppressed 381 similar messages]
I20260709 13:19:24.572554 12205 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
W20260709 13:19:24.451337  4011 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:24.573277  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 121976us
I20260709 13:19:24.573167 12205 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.575227 12205 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:24.577194  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:24.578042  4681 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 20.
I20260709 13:19:24.559827  4120 raft_consensus.cc:2468] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c8b10100a146e6a81f308505fe9f46 in term 29.
I20260709 13:19:24.602594  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 
I20260709 13:19:24.623311 12202 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:19:24.628739 12202 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 1e032f02b0aa450384dda978641ba666)
I20260709 13:19:24.629228 12202 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:24.636670  4085 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:24.647063  4012 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, b8c8b10100a146e6a81f308505fe9f46; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:24.653661 12219 raft_consensus.cc:2804] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:19:24.654214 12219 raft_consensus.cc:697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 29 LEADER]: Becoming Leader. State: Replica: b8c8b10100a146e6a81f308505fe9f46, State: Running, Role: LEADER
I20260709 13:19:24.655079 12219 consensus_queue.cc:237] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
W20260709 13:19:24.665453  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.665580  4087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 63050.9us
I20260709 13:19:24.667982  3867 catalog_manager.cc:5697] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 28 to 29, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 29 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:24.670593 12202 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:24.698793 12202 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Requested vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:24.699893  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86a274746124a40b574d2dfb4d0e34d" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b"
I20260709 13:19:24.700515  4681 raft_consensus.cc:3060] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:19:24.704840  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 95077.8us
W20260709 13:19:24.717403  4085 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:24.720134  4681 raft_consensus.cc:2468] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f3fa9d459de485e824f023c55580bc6 in term 21.
I20260709 13:19:24.721890  4087 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666
I20260709 13:19:24.723438 12211 raft_consensus.cc:2804] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:19:24.725203 12211 raft_consensus.cc:697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Becoming Leader. State: Replica: 0f3fa9d459de485e824f023c55580bc6, State: Running, Role: LEADER
I20260709 13:19:24.726202 12211 consensus_queue.cc:237] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:24.729328  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:24.736174  3869 catalog_manager.cc:5697] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 reported cstate change: term changed from 28 to 29, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194). New cstate: current_term: 29 leader_uuid: "b8c8b10100a146e6a81f308505fe9f46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:24.755795  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:24.851696  3869 catalog_manager.cc:5697] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 reported cstate change: term changed from 20 to 21, leader changed from 1e032f02b0aa450384dda978641ba666 (127.2.200.193) to 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195). New cstate: current_term: 21 leader_uuid: "0f3fa9d459de485e824f023c55580bc6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:24.854334  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:24.905458  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.928599  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:24.941526  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:19:24.973541  4681 raft_consensus.cc:1275] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 28 index: 22. Preceding OpId from leader: term: 29 index: 23. (index mismatch)
I20260709 13:19:24.976646 12224 consensus_queue.cc:1048] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
W20260709 13:19:25.008615  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.011745  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.037483  2851 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:25.058094  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:25.116852  4011 consensus_peers.cc:597] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:25.118489  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.127696  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.133906  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:25.171571  4681 raft_consensus.cc:1275] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Refusing update from remote peer 0f3fa9d459de485e824f023c55580bc6: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
I20260709 13:19:25.173229 12211 consensus_queue.cc:1048] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:19:25.187151  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.189955  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.241242  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:25.259308  4114 raft_consensus.cc:1275] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Refusing update from remote peer b8c8b10100a146e6a81f308505fe9f46: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 18. (index mismatch)
I20260709 13:19:25.261669 12220 consensus_queue.cc:1048] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:19:25.266047  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.340049  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:25.361989  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.038216  2851 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:26.292297  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 45092.7us
W20260709 13:19:26.358969  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 53368.7us
W20260709 13:19:26.425824  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:19:26.460060 12265 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:26.460729 12265 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:26.463172 12265 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:26.473523  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.481249  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.481846  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:26.491315  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59c25d70b304877b556dc3d686ab76e" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "b8c8b10100a146e6a81f308505fe9f46" is_pre_election: true
W20260709 13:19:26.504069  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.548209  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.560556  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.561086  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.561479  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.567780  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.569058  4011 consensus_peers.cc:597] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:26.568339  4085 leader_election.cc:336] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:26.570513  4085 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:26.571380 12267 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:26.587803  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.588461  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.621212  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.683779  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.693465  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.708529  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.842031  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:26.901980  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.935114  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:26.942744  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.038822  2851 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:27.174425  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.197459  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.206151  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.280017  4705 debug-util.cc:398] Leaking SignalData structure 0x7b080027d0c0 after lost signal to thread 2854
W20260709 13:19:27.281232  4705 debug-util.cc:398] Leaking SignalData structure 0x7b080039ad00 after lost signal to thread 3904
W20260709 13:19:27.282670  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea4c0 after lost signal to thread 4071
W20260709 13:19:27.283829  4705 debug-util.cc:398] Leaking SignalData structure 0x7b08002ea5e0 after lost signal to thread 4145
W20260709 13:19:27.285100  4705 debug-util.cc:398] Leaking SignalData structure 0x7b0800201be0 after lost signal to thread 4709
W20260709 13:19:27.388201  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.390974  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.397169  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.397784  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.436985  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.437513  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.450664  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.494786  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.526484  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:27.614015  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.745388  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.756531  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.757241  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:27.838583  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:27.947187  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.014454  4011 consensus_peers.cc:597] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.039338  2851 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:28.071780  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:28.223158  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:28.243901  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.271103  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.320425  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 48770.6us
W20260709 13:19:28.373296  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.378259  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.389698  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.397033  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.447721  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:28.449081  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.460527  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:28.480160  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.588371  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.591778  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.672700  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.675756  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:28.682844  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:28.746903  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:28.756011  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.757424  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.867753  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.880141  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.944953  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:28.954183  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:28.956522  4011 consensus_peers.cc:597] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:28.966964  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.039870  2851 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:29.126804  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.237660  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.335846  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.378978  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.459141  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.532866  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.556166  4085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111) [suppressed 465 similar messages]
W20260709 13:19:29.559669  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.593947  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.619498  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.724352  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.724953  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.728013  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.813060  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.824656  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.860383  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.891685  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:29.928068  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:29.937275  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:29.974831  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.041054  2851 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:30.092464  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:30.118497  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.126461  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.142978  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:30.394606  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.474464  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.499380  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.551834  4011 consensus_peers.cc:597] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.596940  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.786940  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:30.806764  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.836170  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.847230  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:19:30.856375  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.878360  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.917634  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:30.944377  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:30.956980  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.041913  2851 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:31.079452  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.145893  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.179457  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.279332  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.302939  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.301715  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.328559  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.340200  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.399904  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.448866  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.485824  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.555044  4011 consensus_peers.cc:597] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:31.602393  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.624027  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:31.662357  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:31.851596  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.859414  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.892395  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.957540  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.958261  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:31.958742  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.042420  2851 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:32.043648  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.053527  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.126354  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.168373  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.198246  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.257688  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.284336  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.309900  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.361989  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.370388  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.371062  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.374104  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.384249  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.444700  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.503741  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.514056  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.533571  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:32.797935  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:32.907007  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:32.995920  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.042945  2851 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:33.059047  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.069679  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.093858  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.094452  4011 consensus_peers.cc:597] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:33.135721  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.204162  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.269043  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:33.295881  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:19:33.318403  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.385262  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.426641  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.450181  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.456344  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.651029  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.689002  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.700546  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:33.790500  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.823386  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.830130  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.947906  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:33.974510  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:33.989802  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:34.011461  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:34.012753  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:34.035055  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:34.043427  2851 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:34.621842  4648 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111) [suppressed 488 similar messages]
W20260709 13:19:34.905344  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:34.915699  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:35.043937  2851 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:35.144409  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.150329  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.166358  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.177430  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 43878.6us
W20260709 13:19:35.212996  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.215976  4011 consensus_peers.cc:597] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:35.216681  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.217340  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.217985  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.220901  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.221379  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.221812  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.222234  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.249729  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.264510  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:35.280256  4013 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:37407, user_credentials={real_user=slave}} blocked reactor thread for 54236us
W20260709 13:19:35.295104  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.330693  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.431636  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.438683  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.520780  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.551112  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.581138  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.605741  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:35.614585  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.628093  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:35.634410  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.687777  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:35.766332  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:36.044453  2851 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:36.106793  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.136955  4011 consensus_peers.cc:597] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:36.216722  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.245337  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.275661  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:36.347134  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.362614  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.370121  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.379618  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:36.437973  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.444705  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:19:36.465181  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:36.496241  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.546547  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:36.686601  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.907538  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:36.933947  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.964243  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:36.971606  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.013269  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.045194  2851 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:37.080902  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.147307  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.150786  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.168196  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.236034  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.241225  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.292884  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.381873  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.426088  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.454728  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.547333  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.563583  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.578825  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.611431  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.630915  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:37.631479  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.767982  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.769116  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:37.869040  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:37.875505  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.037269  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.042671  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.045718  2851 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:38.087248  4011 consensus_peers.cc:597] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.102870  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.117798  4011 consensus_peers.cc:597] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:38.114787  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.155638  4011 consensus_peers.cc:597] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.169351  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.169977  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:38.170415  4011 consensus_peers.cc:597] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.177012  4011 consensus_peers.cc:597] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.229673  4011 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44677.8us
W20260709 13:19:38.285274  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.341290  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 53394.1us
W20260709 13:19:38.422976  4011 consensus_peers.cc:597] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.580080  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.666664  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.731247  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.747931  4011 consensus_peers.cc:597] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:38.828039  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 59830.5us
W20260709 13:19:38.871395  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.920994  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:38.939901  4011 consensus_peers.cc:597] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:38.941151  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.945802  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:38.957640  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:19:38.988874  4086 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 80743.9us
W20260709 13:19:39.039096  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.039623  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.051559  2851 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 3993)
W20260709 13:19:39.063254  4649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:33461, user_credentials={real_user=slave}} blocked reactor thread for 143453us
W20260709 13:19:39.254334  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:39.281387  4011 consensus_peers.cc:597] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:39.296895  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.386991  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.388979  4011 consensus_peers.cc:597] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:39.512490  4011 consensus_peers.cc:597] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:39.547777  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.577989  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.614315  4011 consensus_peers.cc:597] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:39.622457  4085 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111) [suppressed 513 similar messages]
W20260709 13:19:39.716391  4011 consensus_peers.cc:597] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:39.795722  4085 consensus_peers.cc:597] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.812804  4011 consensus_peers.cc:597] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:39.813457  4011 consensus_peers.cc:597] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:39.819449  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
W20260709 13:19:39.862534  4011 consensus_peers.cc:597] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:39.875859  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:39.975689  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
W20260709 13:19:39.979854  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:39.980696  4085 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:39.985330  4086 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.001741  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.012130  4011 consensus_peers.cc:597] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:40.024932  4649 consensus_peers.cc:597] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.025357  4086 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.027024  4085 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.041808  4011 consensus_peers.cc:597] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.066256  4086 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.067343  4086 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.070266  4086 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.074229  4649 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.086372  4085 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:40.095975  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:19:40.094233  4086 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.098973  4649 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.099514  2851 tablet_replica.cc:333] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.100214  2851 raft_consensus.cc:2243] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.101166  2851 raft_consensus.cc:2272] T c01d887181724ddca1d1982ca3ad050f P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.104072  2851 tablet_replica.cc:333] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.104789  2851 raft_consensus.cc:2243] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.105777  2851 raft_consensus.cc:2272] T 237eb348003645f7abcc1c18bd324690 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.108215  2851 tablet_replica.cc:333] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.109301  2851 raft_consensus.cc:2243] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.110808  2851 raft_consensus.cc:2272] T ca8ba08e728f473582080f90e4e45db9 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.114840  2851 tablet_replica.cc:333] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.116421  2851 raft_consensus.cc:2243] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:40.116470  4649 consensus_peers.cc:597] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.117514  2851 raft_consensus.cc:2272] T d8048c0ac04c4be68d870fbac077eb4a P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.120018  2851 tablet_replica.cc:333] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.120999  2851 raft_consensus.cc:2243] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.122074  2851 raft_consensus.cc:2272] T 42df9a30a23e4bd581e33127f2204a0b P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.124782  2851 tablet_replica.cc:333] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.125766  2851 raft_consensus.cc:2243] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:40.126042  4086 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.126556  2851 raft_consensus.cc:2272] T 1d07f106b6d347c6bb068bd5140bc810 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.127075  4085 consensus_peers.cc:597] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:40.128509  2851 tablet_replica.cc:333] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.129390  2851 raft_consensus.cc:2243] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.129998  2851 raft_consensus.cc:2272] T e61a3a06f437423cad355c7951a460bc P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.132591  2851 tablet_replica.cc:333] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.133411  2851 raft_consensus.cc:2243] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.134377  2851 raft_consensus.cc:2272] T b759a28e523c491c941636a30d249939 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.136461  2851 tablet_replica.cc:333] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.137076  2851 raft_consensus.cc:2243] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.137722  2851 raft_consensus.cc:2272] T 36d2ae4b33244245aaa1efb074fadddf P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.141486  2851 tablet_replica.cc:333] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.142247  2851 raft_consensus.cc:2243] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.143030  2851 raft_consensus.cc:2272] T e32744704d014399851a0661c8929ded P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.145432  4086 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.145715  2851 tablet_replica.cc:333] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.147082  2851 raft_consensus.cc:2243] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.147562  2851 raft_consensus.cc:2272] T cf4967e9db3b4158acf225267ad19344 P b8c8b10100a146e6a81f308505fe9f46 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.149595  4086 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.150207  2851 tablet_replica.cc:333] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.151041  2851 raft_consensus.cc:2243] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.151712  2851 raft_consensus.cc:2272] T c6a714afc3c644f991d9a9aa8e5be0c1 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.154318  2851 tablet_replica.cc:333] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.155236  2851 raft_consensus.cc:2243] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.157887  2851 raft_consensus.cc:2272] T c90b568035464cd5a8006c0d5876087d P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.161912  4086 consensus_peers.cc:597] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.162418  2851 tablet_replica.cc:333] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.163055  2851 raft_consensus.cc:2243] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.163661  2851 raft_consensus.cc:2272] T 2d0ea046ec794443af9a7689d2920002 P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.166407  2851 tablet_replica.cc:333] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.167275  2851 raft_consensus.cc:2243] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.168053  2851 raft_consensus.cc:2272] T 43c0a60eab684a2386715908ca218355 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.170306  4649 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.171546  2851 tablet_replica.cc:333] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.172297  2851 raft_consensus.cc:2243] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.174146  2851 raft_consensus.cc:2272] T 9b8eecd98f04495f9ed7470925ed9487 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.177414  2851 tablet_replica.cc:333] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.178349  2851 raft_consensus.cc:2243] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.179628  2851 raft_consensus.cc:2272] T 8a36ac8ab5384748b125e964d94793fd P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.182411  2851 tablet_replica.cc:333] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.183247  2851 raft_consensus.cc:2243] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.184422  2851 raft_consensus.cc:2272] T 1be06cbb19234936aabe0a7128358755 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.187485  2851 tablet_replica.cc:333] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.188308  2851 raft_consensus.cc:2243] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.188953  2851 raft_consensus.cc:2272] T a389492bb09a4483ad432f0b945c7a61 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.191795  2851 tablet_replica.cc:333] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.192574  2851 raft_consensus.cc:2243] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.193204  2851 raft_consensus.cc:2272] T 8494aa7ed7a6427dbfb02b4753609e41 P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.195849  2851 tablet_replica.cc:333] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.196830  2851 raft_consensus.cc:2243] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.197450  2851 raft_consensus.cc:2272] T ff7454fcd1f54b6eb01038eb8ecb273c P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.200028  2851 tablet_replica.cc:333] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.200847  2851 raft_consensus.cc:2243] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:19:40.201825  4086 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.202270  2851 raft_consensus.cc:2272] T 2e7bedca9d544f8992960c04a55f9233 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.204859  2851 tablet_replica.cc:333] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.205716  2851 raft_consensus.cc:2243] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.206635  2851 raft_consensus.cc:2272] T 591ff6c19f7a4eb5b62c1a1043659414 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.208608  4085 consensus_peers.cc:597] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:40.209340  2851 tablet_replica.cc:333] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.210037  2851 raft_consensus.cc:2243] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.210542  2851 raft_consensus.cc:2272] T e1f289732f2a4c498b8d722dbadc5721 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.212674  2851 tablet_replica.cc:333] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.213253  2851 raft_consensus.cc:2243] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.214152  2851 raft_consensus.cc:2272] T 6ef4e92169eb4f9e9b2217d164131a56 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.216373  2851 tablet_replica.cc:333] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.217252  2851 raft_consensus.cc:2243] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.217801  2851 raft_consensus.cc:2272] T 17894d3c75534c379dd3bb78bf4eea00 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.221505  2851 tablet_replica.cc:333] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.222667  2851 raft_consensus.cc:2243] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.223968  2851 raft_consensus.cc:2272] T c31345ac12b54b42b93f8e1e71274615 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.227259  2851 tablet_replica.cc:333] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.228097  2851 raft_consensus.cc:2243] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.229434  2851 raft_consensus.cc:2272] T f6112c480d954932a8aa350e7919f25d P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.232093  2851 tablet_replica.cc:333] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.233592  2851 raft_consensus.cc:2243] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:40.234833  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:19:40.235865  2851 raft_consensus.cc:2272] T d99c13fc3b7f4e2687824e0a5911512a P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.239388  2851 tablet_replica.cc:333] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.240224  2851 raft_consensus.cc:2243] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.241353  2851 raft_consensus.cc:2272] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.241695  4086 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.244174  2851 tablet_replica.cc:333] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
W20260709 13:19:40.244737  4086 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.245186  2851 raft_consensus.cc:2243] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.246089  2851 raft_consensus.cc:2272] T bd0cb418885343fdbc63ca85b6214aec P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.248340  2851 tablet_replica.cc:333] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.249008  2851 raft_consensus.cc:2243] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.249521  2851 raft_consensus.cc:2272] T b68b34d0f4bd480da49284d88135af8b P b8c8b10100a146e6a81f308505fe9f46 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.251856  2851 tablet_replica.cc:333] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.252708  2851 raft_consensus.cc:2243] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.253367  2851 raft_consensus.cc:2272] T 5e95edd135954b96b72b4881f6d032db P b8c8b10100a146e6a81f308505fe9f46 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.255955  2851 tablet_replica.cc:333] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.256564  2851 raft_consensus.cc:2243] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.257382  2851 raft_consensus.cc:2272] T 8cb75fd2816c4878a8cdd7b7595c52f3 P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.260282  2851 tablet_replica.cc:333] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.261132  2851 raft_consensus.cc:2243] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.261765  2851 raft_consensus.cc:2272] T 53a55b3994714eaca86c1f4d5e9a466e P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.264468  2851 tablet_replica.cc:333] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.265342  2851 raft_consensus.cc:2243] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:40.265910  4086 consensus_peers.cc:597] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.266328  2851 raft_consensus.cc:2272] T fdf62b06bdd54048a2cc215663a17a2e P b8c8b10100a146e6a81f308505fe9f46 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.267040  4086 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.268807  2851 tablet_replica.cc:333] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.269464  2851 raft_consensus.cc:2243] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.270390  2851 raft_consensus.cc:2272] T 921fb867175f444ca511e3c2b6c9aa5c P b8c8b10100a146e6a81f308505fe9f46 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.273343  2851 tablet_replica.cc:333] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.274210  2851 raft_consensus.cc:2243] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.275038  2851 raft_consensus.cc:2272] T 7e3ee0cd50984b8594b3c3f0dda39a22 P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.278015  2851 tablet_replica.cc:333] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.279510  2851 raft_consensus.cc:2243] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.281025  2851 raft_consensus.cc:2272] T f21aeb9fd3a643048c424b1d243ad8ba P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.283958  2851 tablet_replica.cc:333] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.284754  2851 raft_consensus.cc:2243] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.286131  2851 raft_consensus.cc:2272] T bc7c268f55f94e0daca09ce6107e964b P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.288280  2851 tablet_replica.cc:333] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.289067  2851 raft_consensus.cc:2243] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.290493  2851 raft_consensus.cc:2272] T c59c25d70b304877b556dc3d686ab76e P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.293344  2851 tablet_replica.cc:333] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.294106  2851 raft_consensus.cc:2243] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.295765  2851 raft_consensus.cc:2272] T 0dbd2df3c22d48b1b21bf6951d14bc61 P b8c8b10100a146e6a81f308505fe9f46 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.298327  2851 tablet_replica.cc:333] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.299082  2851 raft_consensus.cc:2243] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.299757  2851 raft_consensus.cc:2272] T 450ecd71cd99442cb269ac276ec3d83e P b8c8b10100a146e6a81f308505fe9f46 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.303587  2851 tablet_replica.cc:333] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.304386  2851 raft_consensus.cc:2243] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.305137  2851 raft_consensus.cc:2272] T 1a83d90df1f344e4bcaf5128f021d5a8 P b8c8b10100a146e6a81f308505fe9f46 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.307749  2851 tablet_replica.cc:333] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.308460  2851 raft_consensus.cc:2243] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.310199  2851 raft_consensus.cc:2272] T 03c57dfd62654a78a41a253899d8f909 P b8c8b10100a146e6a81f308505fe9f46 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.311306  4086 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:40.312950  2851 tablet_replica.cc:333] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.313690  2851 raft_consensus.cc:2243] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.315232  2851 raft_consensus.cc:2272] T de8b8c30ab5342a588659a5531a6a633 P b8c8b10100a146e6a81f308505fe9f46 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.319180  2851 tablet_replica.cc:333] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.320101  2851 raft_consensus.cc:2243] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.320716  2851 raft_consensus.cc:2272] T 08c710fdf5ab4acda53986eba38f08dd P b8c8b10100a146e6a81f308505fe9f46 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.323359  2851 tablet_replica.cc:333] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.324110  2851 raft_consensus.cc:2243] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.325206  2851 raft_consensus.cc:2272] T 254ff72f01fd4cc2ade8c8909c20f5bb P b8c8b10100a146e6a81f308505fe9f46 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.328058  2851 tablet_replica.cc:333] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.328835  2851 raft_consensus.cc:2243] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.329651  2851 raft_consensus.cc:2272] T 685b92d286284315bf0bfd731587b546 P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.333448  2851 tablet_replica.cc:333] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.334664  2851 raft_consensus.cc:2243] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:40.335465  2851 raft_consensus.cc:2272] T 9d32e7a943df43b289705f4bb80afdda P b8c8b10100a146e6a81f308505fe9f46 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.338264  2851 tablet_replica.cc:333] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.339035  2851 raft_consensus.cc:2243] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.340382  2851 raft_consensus.cc:2272] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P b8c8b10100a146e6a81f308505fe9f46 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:40.343116  2851 tablet_replica.cc:333] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46: stopping tablet replica
I20260709 13:19:40.343943  2851 raft_consensus.cc:2243] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:40.346849  2851 raft_consensus.cc:2272] T b34dfd1b29be4147bfda87c498945aeb P b8c8b10100a146e6a81f308505fe9f46 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:40.361680  4086 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.369848  4649 consensus_peers.cc:597] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.386415  4649 consensus_peers.cc:597] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.390671  4649 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.395583  4086 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.450418  4086 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.452836  4086 consensus_peers.cc:597] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.451892  4085 consensus_peers.cc:597] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.456928  4086 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.465564  4086 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.476046  4085 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.479297  4085 consensus_peers.cc:597] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.485211  4649 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.490348  4085 consensus_peers.cc:597] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.512447  4086 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:40.516470  4085 consensus_peers.cc:597] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.519017  4085 consensus_peers.cc:597] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.586252  4085 consensus_peers.cc:597] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.658030  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:40.728955  4085 consensus_peers.cc:597] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:19:40.923229  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:40.966270  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:19:41.036091  4085 consensus_peers.cc:597] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:41.141795  4085 consensus_peers.cc:597] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:41.241679  4085 consensus_peers.cc:597] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:41.272089 12314 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.277637 12314 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.289925  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:41.293015 12314 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
I20260709 13:19:41.301646 12309 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.309885 12309 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.317423 12309 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.297457  4086 leader_election.cc:336] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.319367  4086 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.328229 12295 raft_consensus.cc:2749] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:41.333048  4085 consensus_peers.cc:597] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:19:41.341702  4649 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.348272 12295 raft_consensus.cc:493] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.349030 12295 raft_consensus.cc:515] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.353808 12295 leader_election.cc:290] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.375276  4648 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.375885  4648 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.377216 12309 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:41.394744 12309 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.395507 12309 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.398411 12309 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:41.399487  4085 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:41.412352 12295 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.413482 12295 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.414275 12314 raft_consensus.cc:493] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.415653 12314 raft_consensus.cc:515] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.417768 12310 raft_consensus.cc:493] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.418388 12310 raft_consensus.cc:515] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.420668 12310 leader_election.cc:290] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.422719 12314 leader_election.cc:290] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.425479  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:41.425992 12295 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:41.428462  4085 leader_election.cc:336] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.434243  4085 consensus_peers.cc:597] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:41.436547  4086 leader_election.cc:336] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.438175  4086 leader_election.cc:304] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:41.440198  4649 leader_election.cc:336] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.446439 12295 raft_consensus.cc:2749] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:19:41.470316  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:41.470978  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 24.
W20260709 13:19:41.485543  4085 leader_election.cc:336] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.487771  4085 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.489748  4085 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.491107  4085 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, 293c0ff21e6f4e9f93555aaba177566b
I20260709 13:19:41.492748  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.494829 12309 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:19:41.495216 12309 raft_consensus.cc:493] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.495555 12309 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:41.512461 12295 raft_consensus.cc:493] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.515965 12295 raft_consensus.cc:515] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.522135 12295 leader_election.cc:290] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.523180 12314 raft_consensus.cc:493] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.525619 12314 raft_consensus.cc:515] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.527693 12314 leader_election.cc:290] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.533795  4085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:44737, user_credentials={real_user=slave}} blocked reactor thread for 44072.9us
I20260709 13:19:41.536263 12295 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:41.538304  4648 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:19:41.540483 12308 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.545499 12308 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.549170 12308 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.554987  4649 leader_election.cc:336] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.562708 12314 raft_consensus.cc:493] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.563735 12314 raft_consensus.cc:515] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.566725 12314 leader_election.cc:290] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.571604 12310 raft_consensus.cc:493] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.575127 12310 raft_consensus.cc:515] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.577309 12310 leader_election.cc:290] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.573526  4648 leader_election.cc:336] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.585597  4648 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.586426 12308 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:41.584700 12309 raft_consensus.cc:515] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:41.595579  4649 leader_election.cc:336] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.597554 12310 raft_consensus.cc:493] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.599467 12310 raft_consensus.cc:515] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.601917 12310 leader_election.cc:290] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.604292 12310 raft_consensus.cc:493] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.604913 12310 raft_consensus.cc:515] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.609412 12310 leader_election.cc:290] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.613857 12314 raft_consensus.cc:493] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.614872 12314 raft_consensus.cc:515] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.616446 12309 leader_election.cc:290] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:41.619604 12314 leader_election.cc:290] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.622093  4086 leader_election.cc:336] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.626659  4086 leader_election.cc:304] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:41.627636  4086 leader_election.cc:336] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.628075  4086 leader_election.cc:304] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.628854 12310 raft_consensus.cc:2749] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:41.629768 12310 raft_consensus.cc:2749] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:41.630707  4086 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.643594 12309 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.644503 12309 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:41.652436  4648 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.656325 12295 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.657017 12295 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.660482  4681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "0f3fa9d459de485e824f023c55580bc6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "293c0ff21e6f4e9f93555aaba177566b" is_pre_election: true
I20260709 13:19:41.662729 12295 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196:37407)
W20260709 13:19:41.673094  4649 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.674094  4649 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.674995 12308 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:19:41.676695 12309 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:41.680853 12309 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.681550 12309 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:41.701682  4649 leader_election.cc:336] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.703717 12318 raft_consensus.cc:493] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.704352 12318 raft_consensus.cc:515] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.709374 12318 leader_election.cc:290] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.711897 12309 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:41.713680  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cb418885343fdbc63ca85b6214aec" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:41.717440  4113 raft_consensus.cc:3060] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:19:41.728292  4113 raft_consensus.cc:2468] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 25.
W20260709 13:19:41.729923  4085 leader_election.cc:336] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.730913  4116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03c57dfd62654a78a41a253899d8f909" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:41.733242  4116 raft_consensus.cc:2468] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 28.
I20260709 13:19:41.732321  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6" is_pre_election: true
I20260709 13:19:41.734308  4114 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 18.
W20260709 13:19:41.746990  4085 leader_election.cc:336] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.752986  4085 consensus_peers.cc:597] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:41.755946  4085 leader_election.cc:336] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.759511  4085 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.783699 12314 raft_consensus.cc:493] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.784381 12314 raft_consensus.cc:515] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.786450 12314 leader_election.cc:290] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.798516  4649 leader_election.cc:304] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.801872 12309 raft_consensus.cc:2804] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:19:41.803350 12309 raft_consensus.cc:697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 25 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:41.804915 12309 consensus_queue.cc:237] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.801460  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.817579 12308 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:19:41.818014 12308 raft_consensus.cc:493] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Starting leader election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.818356 12308 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:19:41.834141 12314 raft_consensus.cc:493] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.834872 12314 raft_consensus.cc:515] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.837014 12314 leader_election.cc:290] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
I20260709 13:19:41.868409 12318 raft_consensus.cc:493] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:41.869056 12318 raft_consensus.cc:515] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:41.871272 12318 leader_election.cc:290] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:41.879920  4085 leader_election.cc:336] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.882002  4085 leader_election.cc:336] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.886292  4085 consensus_peers.cc:597] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:19:41.890810  3867 catalog_manager.cc:5697] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 24 to 25, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 25 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:41.900216  4085 leader_election.cc:336] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.831265 12308 raft_consensus.cc:515] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:41.902642 12308 leader_election.cc:290] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Requested vote from peers b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:41.883976  4086 leader_election.cc:336] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.911041  4086 leader_election.cc:304] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.912495 12314 raft_consensus.cc:2749] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:41.913408  4086 leader_election.cc:336] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.914016  4086 leader_election.cc:304] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:41.920706  4086 leader_election.cc:336] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.928660  4086 leader_election.cc:304] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
W20260709 13:19:41.924098  4649 leader_election.cc:336] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.921249 12314 raft_consensus.cc:2749] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:41.932431  4086 leader_election.cc:336] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.934424  4086 leader_election.cc:304] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.933045 12314 raft_consensus.cc:2749] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:41.938864  4086 leader_election.cc:336] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.939376 12314 raft_consensus.cc:2749] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:19:41.937423  4085 leader_election.cc:336] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.941183  4085 leader_election.cc:336] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:41.942153  4086 leader_election.cc:304] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.945343 12314 raft_consensus.cc:2749] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:19:41.947685  4086 leader_election.cc:336] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.952972  4086 leader_election.cc:304] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.961342 12314 raft_consensus.cc:2749] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:41.963037  4086 leader_election.cc:336] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:41.975379  4086 leader_election.cc:304] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:41.978812 12314 raft_consensus.cc:2749] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:19:41.977444  4085 consensus_peers.cc:597] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:41.992996  4085 leader_election.cc:336] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:41.998407  4085 leader_election.cc:336] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:42.011137  4085 consensus_peers.cc:597] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:42.019001 12314 raft_consensus.cc:493] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:42.019780 12314 raft_consensus.cc:515] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } }
I20260709 13:19:42.026115 12314 leader_election.cc:290] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:42.055874  4086 leader_election.cc:336] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
W20260709 13:19:42.058322  4085 consensus_peers.cc:597] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:42.057469  4086 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 293c0ff21e6f4e9f93555aaba177566b, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.059988 12314 raft_consensus.cc:2749] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:19:42.062070  4086 leader_election.cc:336] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:42.066283  4086 leader_election.cc:304] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.067158 12314 raft_consensus.cc:2749] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:19:42.096359  4085 consensus_peers.cc:597] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:19:42.099359  4085 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:42.119038  4120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e7bedca9d544f8992960c04a55f9233" candidate_uuid: "293c0ff21e6f4e9f93555aaba177566b" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0f3fa9d459de485e824f023c55580bc6"
I20260709 13:19:42.119709  4120 raft_consensus.cc:3060] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:19:42.128716  4085 consensus_peers.cc:597] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:42.146528  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
W20260709 13:19:42.153620  4086 leader_election.cc:336] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:42.138760  4120 raft_consensus.cc:2468] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 293c0ff21e6f4e9f93555aaba177566b in term 19.
I20260709 13:19:42.156803  4086 leader_election.cc:304] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.171379 12314 raft_consensus.cc:2749] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:19:42.176932  4086 leader_election.cc:336] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:42.177491  4086 leader_election.cc:304] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.179281 12314 raft_consensus.cc:2749] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:19:42.180423  4086 leader_election.cc:336] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:42.182391  4086 leader_election.cc:304] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.184996 12314 raft_consensus.cc:2749] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:42.202148  4649 leader_election.cc:304] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6, 293c0ff21e6f4e9f93555aaba177566b; no voters: b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.203529 12308 raft_consensus.cc:2804] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:19:42.204228 12308 raft_consensus.cc:697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEADER]: Becoming Leader. State: Replica: 293c0ff21e6f4e9f93555aaba177566b, State: Running, Role: LEADER
I20260709 13:19:42.205461 12308 consensus_queue.cc:237] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:42.214359  4086 leader_election.cc:336] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:42.218849  4086 leader_election.cc:304] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0f3fa9d459de485e824f023c55580bc6; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:42.220961 12314 raft_consensus.cc:2749] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:42.243961  3867 catalog_manager.cc:5697] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b reported cstate change: term changed from 18 to 19, leader changed from b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194) to 293c0ff21e6f4e9f93555aaba177566b (127.2.200.196). New cstate: current_term: 19 leader_uuid: "293c0ff21e6f4e9f93555aaba177566b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:19:42.252136  4085 consensus_peers.cc:597] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:42.322249  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
W20260709 13:19:42.331823  4086 consensus_peers.cc:597] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:42.355234  4649 consensus_peers.cc:597] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:42.380928  4649 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:42.382369  4649 consensus_peers.cc:597] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:42.392897  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:42.394431  2851 tablet_replica.cc:333] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.395495  2851 raft_consensus.cc:2243] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.396849  2851 raft_consensus.cc:2272] T c01d887181724ddca1d1982ca3ad050f P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.399770  2851 tablet_replica.cc:333] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.400483  2851 raft_consensus.cc:2243] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.401559  2851 raft_consensus.cc:2272] T c6a714afc3c644f991d9a9aa8e5be0c1 P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.403617  2851 tablet_replica.cc:333] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.404188  2851 raft_consensus.cc:2243] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.404687  2851 raft_consensus.cc:2272] T ca8ba08e728f473582080f90e4e45db9 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.406685  2851 tablet_replica.cc:333] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.407241  2851 raft_consensus.cc:2243] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.407974  2851 raft_consensus.cc:2272] T f8e3b561578040338afbbb292ee9e4b7 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.410636  2851 tablet_replica.cc:333] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.411254  2851 raft_consensus.cc:2243] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.413210  2851 raft_consensus.cc:2272] T 42df9a30a23e4bd581e33127f2204a0b P 0f3fa9d459de485e824f023c55580bc6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.415866  2851 tablet_replica.cc:333] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.416648  2851 raft_consensus.cc:2243] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.417766  2851 raft_consensus.cc:2272] T 1d07f106b6d347c6bb068bd5140bc810 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.418812  4649 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:42.421739  2851 tablet_replica.cc:333] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.422670  2851 raft_consensus.cc:2243] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.423337  2851 raft_consensus.cc:2272] T e61a3a06f437423cad355c7951a460bc P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.426694  2851 tablet_replica.cc:333] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.427753  2851 raft_consensus.cc:2243] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.429580  2851 raft_consensus.cc:2272] T d8048c0ac04c4be68d870fbac077eb4a P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.432020  4649 consensus_peers.cc:597] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:42.432756  2851 tablet_replica.cc:333] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.433629  2851 raft_consensus.cc:2243] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.434249  2851 raft_consensus.cc:2272] T e32744704d014399851a0661c8929ded P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.436425  2851 tablet_replica.cc:333] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.437000  2851 raft_consensus.cc:2243] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.438306  2851 raft_consensus.cc:2272] T 36d2ae4b33244245aaa1efb074fadddf P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.441718  2851 tablet_replica.cc:333] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.442524  2851 raft_consensus.cc:2243] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.443812  2851 raft_consensus.cc:2272] T b759a28e523c491c941636a30d249939 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.446424  2851 tablet_replica.cc:333] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.447348  2851 raft_consensus.cc:2243] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.448414  2851 raft_consensus.cc:2272] T c90b568035464cd5a8006c0d5876087d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.450985  2851 tablet_replica.cc:333] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
W20260709 13:19:42.450980  4648 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:19:42.451824  2851 raft_consensus.cc:2243] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:19:42.452032  4086 consensus_peers.cc:597] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:42.452576  2851 raft_consensus.cc:2272] T 2e7bedca9d544f8992960c04a55f9233 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.454784  2851 tablet_replica.cc:333] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.455387  2851 raft_consensus.cc:2243] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.456287  2851 raft_consensus.cc:2272] T 591ff6c19f7a4eb5b62c1a1043659414 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.458658  2851 tablet_replica.cc:333] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.459261  2851 raft_consensus.cc:2243] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.460315  2851 raft_consensus.cc:2272] T e1f289732f2a4c498b8d722dbadc5721 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.462754  2851 tablet_replica.cc:333] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.463342  2851 raft_consensus.cc:2243] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.464089  2851 raft_consensus.cc:2272] T 6ef4e92169eb4f9e9b2217d164131a56 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.466132  4649 consensus_peers.cc:597] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:42.466514  2851 tablet_replica.cc:333] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.467134  2851 raft_consensus.cc:2243] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.468264  2851 raft_consensus.cc:2272] T a389492bb09a4483ad432f0b945c7a61 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.470729  2851 tablet_replica.cc:333] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.471562  2851 raft_consensus.cc:2243] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.472225  2851 raft_consensus.cc:2272] T 8a36ac8ab5384748b125e964d94793fd P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.474550  2851 tablet_replica.cc:333] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.475063  2851 raft_consensus.cc:2243] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.475521  2851 raft_consensus.cc:2272] T 1be06cbb19234936aabe0a7128358755 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.478814  2851 tablet_replica.cc:333] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.479544  2851 raft_consensus.cc:2243] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.481004  2851 raft_consensus.cc:2272] T 43c0a60eab684a2386715908ca218355 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.481277  4649 consensus_peers.cc:597] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:42.483142  2851 tablet_replica.cc:333] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.483745  2851 raft_consensus.cc:2243] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.484730  2851 raft_consensus.cc:2272] T 17894d3c75534c379dd3bb78bf4eea00 P 0f3fa9d459de485e824f023c55580bc6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.487367  2851 tablet_replica.cc:333] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.487869  2851 raft_consensus.cc:2243] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.488745  2851 raft_consensus.cc:2272] T 450ecd71cd99442cb269ac276ec3d83e P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.490691  2851 tablet_replica.cc:333] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.491170  2851 raft_consensus.cc:2243] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.491767  2851 raft_consensus.cc:2272] T c31345ac12b54b42b93f8e1e71274615 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.493968  2851 tablet_replica.cc:333] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.494779  2851 raft_consensus.cc:2243] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.496301  2851 raft_consensus.cc:2272] T 8494aa7ed7a6427dbfb02b4753609e41 P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.499475  2851 tablet_replica.cc:333] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.500190  2851 raft_consensus.cc:2243] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.501678  2851 raft_consensus.cc:2272] T ff7454fcd1f54b6eb01038eb8ecb273c P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.504289  2851 tablet_replica.cc:333] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.504864  2851 raft_consensus.cc:2243] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.505791  2851 raft_consensus.cc:2272] T 50aca70be0884ed09aa97127d571282f P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.507632  2851 tablet_replica.cc:333] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.508148  2851 raft_consensus.cc:2243] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.508829  2851 raft_consensus.cc:2272] T bd0cb418885343fdbc63ca85b6214aec P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.510689  2851 tablet_replica.cc:333] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.511255  2851 raft_consensus.cc:2243] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.511791  2851 raft_consensus.cc:2272] T b68b34d0f4bd480da49284d88135af8b P 0f3fa9d459de485e824f023c55580bc6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.514159  2851 tablet_replica.cc:333] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.514683  2851 raft_consensus.cc:2243] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.516526  2851 raft_consensus.cc:2272] T 5e95edd135954b96b72b4881f6d032db P 0f3fa9d459de485e824f023c55580bc6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.519284  2851 tablet_replica.cc:333] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.519852  2851 raft_consensus.cc:2243] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.520427  2851 raft_consensus.cc:2272] T e58a5e86e7dd4d16a56a3a67f2ac29d7 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.523455  2851 tablet_replica.cc:333] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.524286  2851 raft_consensus.cc:2243] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.525491  2851 raft_consensus.cc:2272] T 8cb75fd2816c4878a8cdd7b7595c52f3 P 0f3fa9d459de485e824f023c55580bc6 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.527644  2851 tablet_replica.cc:333] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.528142  2851 raft_consensus.cc:2243] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.529071  2851 raft_consensus.cc:2272] T 2c6116be669b48d88215ae1f69b092a1 P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.530906  2851 tablet_replica.cc:333] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.531402  2851 raft_consensus.cc:2243] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.532374  2851 raft_consensus.cc:2272] T 53a55b3994714eaca86c1f4d5e9a466e P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.535882  2851 tablet_replica.cc:333] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.536695  2851 raft_consensus.cc:2243] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.537955  2851 raft_consensus.cc:2272] T fa0ecf853c3e4d398a5b18c0126a0448 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.540481  2851 tablet_replica.cc:333] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.541237  2851 raft_consensus.cc:2243] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.541812  2851 raft_consensus.cc:2272] T 98d2f9d8927b4f92bc7e4a37d023c1f8 P 0f3fa9d459de485e824f023c55580bc6 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.544301  2851 tablet_replica.cc:333] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.544993  2851 raft_consensus.cc:2243] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.545588  2851 raft_consensus.cc:2272] T b34dfd1b29be4147bfda87c498945aeb P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.548130  2851 tablet_replica.cc:333] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.548888  2851 raft_consensus.cc:2243] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.550215  2851 raft_consensus.cc:2272] T d99c13fc3b7f4e2687824e0a5911512a P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.552243  2851 tablet_replica.cc:333] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.552731  2851 raft_consensus.cc:2243] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.553179  2851 raft_consensus.cc:2272] T f6112c480d954932a8aa350e7919f25d P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.554862  2851 tablet_replica.cc:333] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.555346  2851 raft_consensus.cc:2243] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.556222  2851 raft_consensus.cc:2272] T 08c710fdf5ab4acda53986eba38f08dd P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.558992  2851 tablet_replica.cc:333] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.559626  2851 raft_consensus.cc:2243] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.560472  2851 raft_consensus.cc:2272] T 254ff72f01fd4cc2ade8c8909c20f5bb P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.563263  2851 tablet_replica.cc:333] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.563778  2851 raft_consensus.cc:2243] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.564680  2851 raft_consensus.cc:2272] T 685b92d286284315bf0bfd731587b546 P 0f3fa9d459de485e824f023c55580bc6 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.566627  2851 tablet_replica.cc:333] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.567126  2851 raft_consensus.cc:2243] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.568135  2851 raft_consensus.cc:2272] T e20b6631af674e838a0accf36c31749f P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.570039  2851 tablet_replica.cc:333] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.570502  2851 raft_consensus.cc:2243] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.570940  2851 raft_consensus.cc:2272] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.573235  2851 tablet_replica.cc:333] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.573724  2851 raft_consensus.cc:2243] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.574337  2851 raft_consensus.cc:2272] T f21aeb9fd3a643048c424b1d243ad8ba P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.576357  2851 tablet_replica.cc:333] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.576896  2851 raft_consensus.cc:2243] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.577507  2851 raft_consensus.cc:2272] T bc7c268f55f94e0daca09ce6107e964b P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.579694  2851 tablet_replica.cc:333] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.580335  2851 raft_consensus.cc:2243] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:19:42.581259  4649 consensus_peers.cc:597] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:42.581555  2851 raft_consensus.cc:2272] T 0dbd2df3c22d48b1b21bf6951d14bc61 P 0f3fa9d459de485e824f023c55580bc6 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.584159  2851 tablet_replica.cc:333] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.584713  2851 raft_consensus.cc:2243] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.585412  2851 raft_consensus.cc:2272] T c59c25d70b304877b556dc3d686ab76e P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.587630  2851 tablet_replica.cc:333] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.588100  2851 raft_consensus.cc:2243] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.588577  2851 raft_consensus.cc:2272] T 397fa935c4d84e7fbb1e5dc631ce3711 P 0f3fa9d459de485e824f023c55580bc6 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.590345  2851 tablet_replica.cc:333] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.590826  2851 raft_consensus.cc:2243] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.592078  2851 raft_consensus.cc:2272] T c86a274746124a40b574d2dfb4d0e34d P 0f3fa9d459de485e824f023c55580bc6 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.594003  2851 tablet_replica.cc:333] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.594458  2851 raft_consensus.cc:2243] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.595896  2851 raft_consensus.cc:2272] T 03c57dfd62654a78a41a253899d8f909 P 0f3fa9d459de485e824f023c55580bc6 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.598029  2851 tablet_replica.cc:333] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.598515  2851 raft_consensus.cc:2243] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.598986  2851 raft_consensus.cc:2272] T de8b8c30ab5342a588659a5531a6a633 P 0f3fa9d459de485e824f023c55580bc6 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.601349  2851 tablet_replica.cc:333] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.601948  2851 raft_consensus.cc:2243] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:42.602943  2851 raft_consensus.cc:2272] T 9d32e7a943df43b289705f4bb80afdda P 0f3fa9d459de485e824f023c55580bc6 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:42.605221  2851 tablet_replica.cc:333] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6: stopping tablet replica
I20260709 13:19:42.605612  2851 raft_consensus.cc:2243] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:42.606032  2851 raft_consensus.cc:2272] T 921fb867175f444ca511e3c2b6c9aa5c P 0f3fa9d459de485e824f023c55580bc6 [term 29 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:42.640204  4648 consensus_peers.cc:597] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:42.654692  4649 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:42.657434  4649 consensus_peers.cc:597] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:42.659452  4648 consensus_peers.cc:597] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:42.673590  4649 consensus_peers.cc:597] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:42.683480  4649 consensus_peers.cc:597] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:42.691821  4649 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:42.712006  4649 consensus_peers.cc:597] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Couldn't send request to peer 0f3fa9d459de485e824f023c55580bc6. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:42.751741  3859 maintenance_manager.cc:419] P 8dad18bff2f044b2a76f2e5726c72315: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033399
W20260709 13:19:42.789589  4649 consensus_peers.cc:597] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:42.800570  3858 maintenance_manager.cc:643] P 8dad18bff2f044b2a76f2e5726c72315: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.048s	user 0.029s	sys 0.011s Metrics: {"bytes_written":8107,"delete_count":0,"lbm_write_time_us":951,"lbm_writes_lt_1ms":7,"reinsert_count":0,"update_count":334}
I20260709 13:19:42.803097  3859 maintenance_manager.cc:419] P 8dad18bff2f044b2a76f2e5726c72315: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.404220
W20260709 13:19:42.858741  4649 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:42.905819  4649 consensus_peers.cc:597] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:42.970896  3858 maintenance_manager.cc:643] P 8dad18bff2f044b2a76f2e5726c72315: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.167s	user 0.099s	sys 0.060s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":29888,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":25174,"dirs.run_cpu_time_us":779,"dirs.run_wall_time_us":1561,"lbm_read_time_us":2052,"lbm_reads_lt_1ms":26,"lbm_write_time_us":2149,"lbm_writes_lt_1ms":12,"peak_mem_usage":595737,"reinsert_count":0,"thread_start_us":32791,"threads_started":2,"update_count":366}
W20260709 13:19:42.973196  4649 consensus_peers.cc:597] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:42.973451  3859 maintenance_manager.cc:419] P 8dad18bff2f044b2a76f2e5726c72315: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:19:42.974344  3858 maintenance_manager.cc:643] P 8dad18bff2f044b2a76f2e5726c72315: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 13:19:43.037602  4649 consensus_peers.cc:597] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:19:43.082733  4648 consensus_peers.cc:597] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:43.258069  4648 consensus_peers.cc:597] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260709 13:19:43.268635  4649 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Couldn't send request to peer b8c8b10100a146e6a81f308505fe9f46. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:19:43.349560 12320 raft_consensus.cc:493] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:43.350183 12320 raft_consensus.cc:515] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.353351 12320 leader_election.cc:290] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:43.355760  4648 leader_election.cc:336] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:43.359124  4649 leader_election.cc:336] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:43.359496  4649 leader_election.cc:304] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:43.360119 12320 raft_consensus.cc:2749] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:19:43.369990 12320 raft_consensus.cc:493] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:43.370666 12320 raft_consensus.cc:515] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.375674 12320 leader_election.cc:290] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461)
W20260709 13:19:43.382377  4649 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
W20260709 13:19:43.383744  4648 leader_election.cc:336] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:43.384150  4648 leader_election.cc:304] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:43.384903 12320 raft_consensus.cc:2749] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:19:43.488453 12320 raft_consensus.cc:493] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting pre-election (detected failure of leader b8c8b10100a146e6a81f308505fe9f46)
I20260709 13:19:43.489051 12320 raft_consensus.cc:515] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } attrs { replace: true } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
W20260709 13:19:43.490746  4648 consensus_peers.cc:597] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b -> Peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Couldn't send request to peer 1e032f02b0aa450384dda978641ba666. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260709 13:19:43.491691 12320 leader_election.cc:290] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:43.497284  4648 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:43.499711  4649 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:43.500149  4649 leader_election.cc:304] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:43.500911 12320 raft_consensus.cc:2749] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260709 13:19:43.501035  4649 leader_election.cc:336] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
I20260709 13:19:43.518528 12320 raft_consensus.cc:493] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:43.519142 12320 raft_consensus.cc:515] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "b8c8b10100a146e6a81f308505fe9f46" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 33461 } attrs { replace: true } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.522049 12320 leader_election.cc:290] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:43.527293  4648 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:43.528887  4649 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer b8c8b10100a146e6a81f308505fe9f46 (127.2.200.194:33461): Network error: Client connection negotiation failed: client connection to 127.2.200.194:33461: connect: Connection refused (error 111)
I20260709 13:19:43.529383  4649 leader_election.cc:304] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 1e032f02b0aa450384dda978641ba666, b8c8b10100a146e6a81f308505fe9f46
I20260709 13:19:43.530185 12320 raft_consensus.cc:2749] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:19:43.530316  4649 leader_election.cc:336] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
I20260709 13:19:43.579015 12320 raft_consensus.cc:493] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:43.579612 12320 raft_consensus.cc:515] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.581667 12320 leader_election.cc:290] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:43.586314  4648 leader_election.cc:336] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:43.587441  4649 leader_election.cc:336] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
I20260709 13:19:43.587857  4649 leader_election.cc:304] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:43.588552 12320 raft_consensus.cc:2749] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:19:43.725278 12320 raft_consensus.cc:493] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:43.725880 12320 raft_consensus.cc:515] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.728013 12320 leader_election.cc:290] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:43.733496  4649 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
W20260709 13:19:43.734057  4648 leader_election.cc:336] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:43.734505  4648 leader_election.cc:304] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:43.735293 12320 raft_consensus.cc:2749] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:43.752751  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:19:43.826330 12308 raft_consensus.cc:493] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:43.827009 12308 raft_consensus.cc:515] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.829224 12308 leader_election.cc:290] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:43.835052  4649 leader_election.cc:336] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
W20260709 13:19:43.835703  4648 leader_election.cc:336] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
I20260709 13:19:43.836151  4648 leader_election.cc:304] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:43.836949 12308 raft_consensus.cc:2749] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:19:43.870421  2851 tablet_server.cc:179] TabletServer@127.2.200.196:0 shutting down...
I20260709 13:19:43.885269 12308 raft_consensus.cc:493] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:43.885857 12308 raft_consensus.cc:515] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:43.888019 12308 leader_election.cc:290] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
W20260709 13:19:43.892252  4648 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:43.902642  4649 leader_election.cc:336] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
I20260709 13:19:43.903041  4649 leader_election.cc:304] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:43.903967 12308 raft_consensus.cc:2749] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:19:43.931833  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:43.933089  2851 tablet_replica.cc:333] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.935578  2851 raft_consensus.cc:2243] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:43.937177  2851 raft_consensus.cc:2272] T 50aca70be0884ed09aa97127d571282f P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.941128  2851 tablet_replica.cc:333] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.942080  2851 raft_consensus.cc:2243] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.943626  2851 raft_consensus.cc:2272] T d99c13fc3b7f4e2687824e0a5911512a P 293c0ff21e6f4e9f93555aaba177566b [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.946955  2851 tablet_replica.cc:333] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.947989  2851 raft_consensus.cc:2243] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:43.948679  2851 raft_consensus.cc:2272] T 03c57dfd62654a78a41a253899d8f909 P 293c0ff21e6f4e9f93555aaba177566b [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.951292  2851 tablet_replica.cc:333] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.951920  2851 raft_consensus.cc:2243] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:43.952507  2851 raft_consensus.cc:2272] T 42df9a30a23e4bd581e33127f2204a0b P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.955003  2851 tablet_replica.cc:333] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.955581  2851 raft_consensus.cc:2243] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.956393  2851 pending_rounds.cc:70] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Trying to abort 1 pending ops.
I20260709 13:19:43.956581  2851 pending_rounds.cc:77] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b: Aborting op as it isn't in flight: id { term: 19 index: 17 } timestamp: 7305638634330464256 op_type: NO_OP noop_request { }
I20260709 13:19:43.956943  2851 raft_consensus.cc:2889] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 19 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:43.957199  2851 raft_consensus.cc:2272] T 2e7bedca9d544f8992960c04a55f9233 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.959332  2851 tablet_replica.cc:333] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.960120  2851 raft_consensus.cc:2243] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.961477  2851 raft_consensus.cc:2272] T 397fa935c4d84e7fbb1e5dc631ce3711 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.963841  2851 tablet_replica.cc:333] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.964392  2851 raft_consensus.cc:2243] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.965272  2851 raft_consensus.cc:2272] T e61a3a06f437423cad355c7951a460bc P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.967316  2851 tablet_replica.cc:333] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.967922  2851 raft_consensus.cc:2243] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:43.968412  2851 raft_consensus.cc:2272] T 9b8eecd98f04495f9ed7470925ed9487 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.970857  2851 tablet_replica.cc:333] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.971426  2851 raft_consensus.cc:2243] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.972337  2851 raft_consensus.cc:2272] T fdf62b06bdd54048a2cc215663a17a2e P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.975629  2851 tablet_replica.cc:333] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.976405  2851 raft_consensus.cc:2243] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.977473  2851 pending_rounds.cc:70] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Trying to abort 1 pending ops.
I20260709 13:19:43.977710  2851 pending_rounds.cc:77] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b: Aborting op as it isn't in flight: id { term: 25 index: 18 } timestamp: 7305638632699400192 op_type: NO_OP noop_request { }
I20260709 13:19:43.978041  2851 raft_consensus.cc:2889] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 25 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:19:43.979074  2851 raft_consensus.cc:2272] T bd0cb418885343fdbc63ca85b6214aec P 293c0ff21e6f4e9f93555aaba177566b [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.981901  2851 tablet_replica.cc:333] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.982697  2851 raft_consensus.cc:2243] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.983762  2851 raft_consensus.cc:2272] T b68b34d0f4bd480da49284d88135af8b P 293c0ff21e6f4e9f93555aaba177566b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.986546  2851 tablet_replica.cc:333] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.987362  2851 raft_consensus.cc:2243] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:43.987949  2851 raft_consensus.cc:2272] T 237eb348003645f7abcc1c18bd324690 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.990962  2851 tablet_replica.cc:333] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.991652  2851 raft_consensus.cc:2243] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.992924  2851 raft_consensus.cc:2272] T 2d0ea046ec794443af9a7689d2920002 P 293c0ff21e6f4e9f93555aaba177566b [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.995643  2851 tablet_replica.cc:333] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:43.996402  2851 raft_consensus.cc:2243] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:19:43.997551  2851 raft_consensus.cc:2272] T cf4967e9db3b4158acf225267ad19344 P 293c0ff21e6f4e9f93555aaba177566b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:43.999589 12308 raft_consensus.cc:493] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0f3fa9d459de485e824f023c55580bc6)
I20260709 13:19:43.999997 12308 raft_consensus.cc:515] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1e032f02b0aa450384dda978641ba666" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 44737 } } peers { permanent_uuid: "0f3fa9d459de485e824f023c55580bc6" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 41513 } } peers { permanent_uuid: "293c0ff21e6f4e9f93555aaba177566b" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 37407 } attrs { promote: false } }
I20260709 13:19:44.000520  2851 tablet_replica.cc:333] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.001356  2851 raft_consensus.cc:2243] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:19:44.001813 12308 leader_election.cc:290] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737), 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513)
I20260709 13:19:44.002458  2851 raft_consensus.cc:2272] T e32744704d014399851a0661c8929ded P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.005635  2851 tablet_replica.cc:333] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.006386  2851 raft_consensus.cc:2243] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 LEADER]: Raft consensus shutting down.
W20260709 13:19:44.006460  4648 leader_election.cc:336] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 1e032f02b0aa450384dda978641ba666 (127.2.200.193:44737): Network error: Client connection negotiation failed: client connection to 127.2.200.193:44737: connect: Connection refused (error 111)
W20260709 13:19:44.007195  4649 leader_election.cc:336] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0f3fa9d459de485e824f023c55580bc6 (127.2.200.195:41513): Network error: Client connection negotiation failed: client connection to 127.2.200.195:41513: connect: Connection refused (error 111)
I20260709 13:19:44.007571  4649 leader_election.cc:304] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 293c0ff21e6f4e9f93555aaba177566b; no voters: 0f3fa9d459de485e824f023c55580bc6, 1e032f02b0aa450384dda978641ba666
I20260709 13:19:44.007791  2851 raft_consensus.cc:2272] T f8e3b561578040338afbbb292ee9e4b7 P 293c0ff21e6f4e9f93555aaba177566b [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.008117 12308 raft_consensus.cc:2749] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:19:44.010869  2851 tablet_replica.cc:333] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.011629  2851 raft_consensus.cc:2243] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:19:44.012725  2851 raft_consensus.cc:2272] T 1a83d90df1f344e4bcaf5128f021d5a8 P 293c0ff21e6f4e9f93555aaba177566b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.015489  2851 tablet_replica.cc:333] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.016198  2851 raft_consensus.cc:2243] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:44.016805  2851 raft_consensus.cc:2272] T c86a274746124a40b574d2dfb4d0e34d P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.019263  2851 tablet_replica.cc:333] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.019922  2851 raft_consensus.cc:2243] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:19:44.021039  2851 raft_consensus.cc:2272] T 7e3ee0cd50984b8594b3c3f0dda39a22 P 293c0ff21e6f4e9f93555aaba177566b [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.023870  2851 tablet_replica.cc:333] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.024536  2851 raft_consensus.cc:2243] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:44.025228  2851 raft_consensus.cc:2272] T e20b6631af674e838a0accf36c31749f P 293c0ff21e6f4e9f93555aaba177566b [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.027988  2851 tablet_replica.cc:333] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.028638  2851 raft_consensus.cc:2243] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:44.029580  2851 raft_consensus.cc:2272] T 2c6116be669b48d88215ae1f69b092a1 P 293c0ff21e6f4e9f93555aaba177566b [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.033043  2851 tablet_replica.cc:333] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b: stopping tablet replica
I20260709 13:19:44.033663  2851 raft_consensus.cc:2243] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:44.034245  2851 raft_consensus.cc:2272] T fa0ecf853c3e4d398a5b18c0126a0448 P 293c0ff21e6f4e9f93555aaba177566b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.357342  2851 tablet_server.cc:196] TabletServer@127.2.200.196:0 shutdown complete.
I20260709 13:19:44.416354  2851 master.cc:562] Master@127.2.200.254:44439 shutting down...
W20260709 13:19:44.467877  3918 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:19:44.468181  3918 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:19:44.468392  3918 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:19:44.471863  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:44.472447  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:44.472810  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8dad18bff2f044b2a76f2e5726c72315: stopping tablet replica
I20260709 13:19:44.680521  2851 master.cc:584] Master@127.2.200.254:44439 shutdown complete.
I20260709 13:19:44.727612  2851 test_util.cc:182] -----------------------------------------------
I20260709 13:19:44.727838  2851 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602908838664-2851-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (252682 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:19:44.731496  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:41609
I20260709 13:19:44.733098  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:44.739004 12331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:44.739548 12332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:44.741161 12334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:44.741202  2851 server_base.cc:1061] running on GCE node
I20260709 13:19:44.745697  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:44.745927  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:44.746084  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603184746067 us; error 0 us; skew 500 ppm
I20260709 13:19:44.746604  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:44.749457  2851 webserver.cc:533] Webserver started at http://127.2.200.254:33829/ using document root <none> and password file <none>
I20260709 13:19:44.750223  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:44.750428  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:44.750700  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:44.752312  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "4006fd8b490c4d738902da4b5d80981d"
format_stamp: "Formatted at 2026-07-09 13:19:44 on dist-test-slave-108k"
I20260709 13:19:44.757895  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:19:44.761739 12339 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:44.762569  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:19:44.763019  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "4006fd8b490c4d738902da4b5d80981d"
format_stamp: "Formatted at 2026-07-09 13:19:44 on dist-test-slave-108k"
I20260709 13:19:44.763414  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:44.784485  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:44.785940  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:44.833679  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:41609
I20260709 13:19:44.833827 12390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:41609 every 8 connection(s)
I20260709 13:19:44.838117 12391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:44.848680 12391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d: Bootstrap starting.
I20260709 13:19:44.853449 12391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:44.858079 12391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d: No bootstrap required, opened a new log
I20260709 13:19:44.860428 12391 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4006fd8b490c4d738902da4b5d80981d" member_type: VOTER }
I20260709 13:19:44.860870 12391 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:44.861297 12391 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4006fd8b490c4d738902da4b5d80981d, State: Initialized, Role: FOLLOWER
I20260709 13:19:44.862604 12391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4006fd8b490c4d738902da4b5d80981d" member_type: VOTER }
I20260709 13:19:44.863094 12391 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:19:44.863291 12391 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:19:44.863538 12391 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:44.868278 12391 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4006fd8b490c4d738902da4b5d80981d" member_type: VOTER }
I20260709 13:19:44.868831 12391 leader_election.cc:304] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4006fd8b490c4d738902da4b5d80981d; no voters: 
I20260709 13:19:44.870074 12391 leader_election.cc:290] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:19:44.870652 12394 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:44.872270 12394 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 1 LEADER]: Becoming Leader. State: Replica: 4006fd8b490c4d738902da4b5d80981d, State: Running, Role: LEADER
I20260709 13:19:44.873021 12391 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:19:44.873193 12394 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4006fd8b490c4d738902da4b5d80981d" member_type: VOTER }
I20260709 13:19:44.878626 12396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4006fd8b490c4d738902da4b5d80981d. Latest consensus state: current_term: 1 leader_uuid: "4006fd8b490c4d738902da4b5d80981d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4006fd8b490c4d738902da4b5d80981d" member_type: VOTER } }
I20260709 13:19:44.878571 12395 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4006fd8b490c4d738902da4b5d80981d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4006fd8b490c4d738902da4b5d80981d" member_type: VOTER } }
I20260709 13:19:44.879305 12395 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:44.879277 12396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [sys.catalog]: This master's current role is: LEADER
I20260709 13:19:44.884193 12401 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:19:44.888929 12401 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:19:44.890868  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:19:44.898749 12401 catalog_manager.cc:1383] Generated new cluster ID: 8ed85c7738cc4bf896cca3a2fe968ff6
I20260709 13:19:44.899072 12401 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:19:44.927824 12401 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:19:44.929689 12401 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:19:44.943691 12401 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d: Generated new TSK 0
I20260709 13:19:44.944377 12401 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:19:44.958261  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:44.964596 12412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:44.965503 12413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:44.968577 12415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:44.969342  2851 server_base.cc:1061] running on GCE node
I20260709 13:19:44.972492  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:44.972693  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:44.972863  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603184972849 us; error 0 us; skew 500 ppm
I20260709 13:19:44.973555  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:44.976428  2851 webserver.cc:533] Webserver started at http://127.2.200.193:45915/ using document root <none> and password file <none>
I20260709 13:19:44.976959  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:44.977154  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:44.977617  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:44.979198  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "6b0179dde0454d1e819be37e79c733af"
format_stamp: "Formatted at 2026-07-09 13:19:44 on dist-test-slave-108k"
I20260709 13:19:44.984252  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:19:44.989446 12420 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:44.990396  2851 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:19:44.990834  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "6b0179dde0454d1e819be37e79c733af"
format_stamp: "Formatted at 2026-07-09 13:19:44 on dist-test-slave-108k"
I20260709 13:19:44.991163  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:45.032120  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:45.033408  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:45.034911  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:45.037243  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:45.037438  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.037653  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:45.037815  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.086148  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:34251
I20260709 13:19:45.086596 12482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:34251 every 8 connection(s)
I20260709 13:19:45.091061  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:45.097994 12487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:45.102257 12488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:45.105149  2851 server_base.cc:1061] running on GCE node
W20260709 13:19:45.106043 12490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:45.108453  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:45.108747  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:45.109005  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603185108982 us; error 0 us; skew 500 ppm
I20260709 13:19:45.109834  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:45.112896  2851 webserver.cc:533] Webserver started at http://127.2.200.194:44927/ using document root <none> and password file <none>
I20260709 13:19:45.113574  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:45.113780  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:45.114038  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:45.114115 12483 heartbeater.cc:344] Connected to a master server at 127.2.200.254:41609
I20260709 13:19:45.114642 12483 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:45.115216  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "edb4d71736c5490ab4008aa30a223e25"
format_stamp: "Formatted at 2026-07-09 13:19:45 on dist-test-slave-108k"
I20260709 13:19:45.115684 12483 heartbeater.cc:507] Master 127.2.200.254:41609 requested a full tablet report, sending...
I20260709 13:19:45.118095 12356 ts_manager.cc:194] Registered new tserver with Master: 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:45.119942 12356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53156
I20260709 13:19:45.120885  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:19:45.125077 12495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.126034  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:19:45.126375  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "edb4d71736c5490ab4008aa30a223e25"
format_stamp: "Formatted at 2026-07-09 13:19:45 on dist-test-slave-108k"
I20260709 13:19:45.126646  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:45.142657  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:45.143816  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:45.145327  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:45.147481  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:45.147677  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.148049  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:45.148417  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.194674  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:35029
I20260709 13:19:45.194802 12557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:35029 every 8 connection(s)
I20260709 13:19:45.199788  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:45.207376 12561 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:45.208992 12562 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:45.213223 12558 heartbeater.cc:344] Connected to a master server at 127.2.200.254:41609
I20260709 13:19:45.213758 12558 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:45.214754 12558 heartbeater.cc:507] Master 127.2.200.254:41609 requested a full tablet report, sending...
I20260709 13:19:45.218044  2851 server_base.cc:1061] running on GCE node
I20260709 13:19:45.217941 12356 ts_manager.cc:194] Registered new tserver with Master: edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:19:45.218585 12565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:45.219866  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:45.220276  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:45.220570  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603185220545 us; error 0 us; skew 500 ppm
I20260709 13:19:45.220533 12356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53164
I20260709 13:19:45.221825  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:45.225169  2851 webserver.cc:533] Webserver started at http://127.2.200.195:43657/ using document root <none> and password file <none>
I20260709 13:19:45.225660  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:45.225838  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:45.226075  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:45.227259  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "be08affc17214c5081ca9d2d19f0c1bd"
format_stamp: "Formatted at 2026-07-09 13:19:45 on dist-test-slave-108k"
I20260709 13:19:45.231590  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:19:45.235539 12569 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.236361  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:19:45.236651  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "be08affc17214c5081ca9d2d19f0c1bd"
format_stamp: "Formatted at 2026-07-09 13:19:45 on dist-test-slave-108k"
I20260709 13:19:45.236974  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:45.259721  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:45.261442  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:45.263159  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:45.265545  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:45.265756  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.265996  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:45.266135  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.314828  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:45643
I20260709 13:19:45.314935 12631 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:45643 every 8 connection(s)
I20260709 13:19:45.320152  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:45.327135 12635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:45.328833 12636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:45.332299 12638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:45.332464 12632 heartbeater.cc:344] Connected to a master server at 127.2.200.254:41609
I20260709 13:19:45.332940 12632 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:45.333076  2851 server_base.cc:1061] running on GCE node
I20260709 13:19:45.333899 12632 heartbeater.cc:507] Master 127.2.200.254:41609 requested a full tablet report, sending...
I20260709 13:19:45.333947  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:45.334316  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:45.334491  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603185334475 us; error 0 us; skew 500 ppm
I20260709 13:19:45.335125  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:45.336072 12356 ts_manager.cc:194] Registered new tserver with Master: be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:45.337929 12356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53180
I20260709 13:19:45.339226  2851 webserver.cc:533] Webserver started at http://127.2.200.196:38653/ using document root <none> and password file <none>
I20260709 13:19:45.339923  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:45.340199  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:19:45.340516  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:19:45.341594  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-3-root/instance:
uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
format_stamp: "Formatted at 2026-07-09 13:19:45 on dist-test-slave-108k"
I20260709 13:19:45.346513  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:19:45.351897 12643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.353240  2851 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:19:45.353607  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-3-root
uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
format_stamp: "Formatted at 2026-07-09 13:19:45 on dist-test-slave-108k"
I20260709 13:19:45.353871  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:45.396116  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:45.397657  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:45.399130  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:45.401715  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:19:45.401944  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.402192  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:19:45.402365  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:45.453761  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.196:34371
I20260709 13:19:45.453884 12705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.196:34371 every 8 connection(s)
I20260709 13:19:45.468247 12706 heartbeater.cc:344] Connected to a master server at 127.2.200.254:41609
I20260709 13:19:45.468650 12706 heartbeater.cc:461] Registering TS with master...
I20260709 13:19:45.469429 12706 heartbeater.cc:507] Master 127.2.200.254:41609 requested a full tablet report, sending...
I20260709 13:19:45.471422 12356 ts_manager.cc:194] Registered new tserver with Master: e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:45.471764  2851 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01460934s
I20260709 13:19:45.472867 12356 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53188
I20260709 13:19:45.499832 12356 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53204:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:19:45.751295 12521 tablet_service.cc:1511] Processing CreateTablet for tablet 53c73e9183b4401b8f75411b63878062 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:45.751583 12523 tablet_service.cc:1511] Processing CreateTablet for tablet aa9710dd994b40c18e7d33112d946085 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:45.753002 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c73e9183b4401b8f75411b63878062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.753563 12522 tablet_service.cc:1511] Processing CreateTablet for tablet aaa0adc1589a4002b4c0544f03a1ef2f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:45.754436 12597 tablet_service.cc:1511] Processing CreateTablet for tablet aa9710dd994b40c18e7d33112d946085 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:45.755833 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9710dd994b40c18e7d33112d946085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.756332 12595 tablet_service.cc:1511] Processing CreateTablet for tablet dc3b8ac766444654ab744eef004d23cb (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:45.757661 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3b8ac766444654ab744eef004d23cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.757899 12596 tablet_service.cc:1511] Processing CreateTablet for tablet aaa0adc1589a4002b4c0544f03a1ef2f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:45.759296 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa0adc1589a4002b4c0544f03a1ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.762794 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa0adc1589a4002b4c0544f03a1ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.770063 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9710dd994b40c18e7d33112d946085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.776398 12520 tablet_service.cc:1511] Processing CreateTablet for tablet ffc6e30caa094ccea21a8d8063628ac6 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:45.777979 12520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc6e30caa094ccea21a8d8063628ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.785782 12594 tablet_service.cc:1511] Processing CreateTablet for tablet ffc6e30caa094ccea21a8d8063628ac6 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:45.787277 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc6e30caa094ccea21a8d8063628ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.795791 12670 tablet_service.cc:1511] Processing CreateTablet for tablet 53c73e9183b4401b8f75411b63878062 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:45.796939 12519 tablet_service.cc:1511] Processing CreateTablet for tablet 61a0977d71c94c28a715e132c73798ad (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:45.797616 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c73e9183b4401b8f75411b63878062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.798318 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a0977d71c94c28a715e132c73798ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.802090 12671 tablet_service.cc:1511] Processing CreateTablet for tablet aa9710dd994b40c18e7d33112d946085 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:19:45.804231 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa9710dd994b40c18e7d33112d946085. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.808075 12669 tablet_service.cc:1511] Processing CreateTablet for tablet dc3b8ac766444654ab744eef004d23cb (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:45.810264 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3b8ac766444654ab744eef004d23cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.814247 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 54cd9a065a174d478feebb6406e59340 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:45.815708 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cd9a065a174d478feebb6406e59340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.815824 12668 tablet_service.cc:1511] Processing CreateTablet for tablet 61a0977d71c94c28a715e132c73798ad (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:45.819046 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a0977d71c94c28a715e132c73798ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.834615 12725 tablet_bootstrap.cc:492] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:45.835893 12446 tablet_service.cc:1511] Processing CreateTablet for tablet dc3b8ac766444654ab744eef004d23cb (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:19:45.837674 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc3b8ac766444654ab744eef004d23cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.837873 12447 tablet_service.cc:1511] Processing CreateTablet for tablet 53c73e9183b4401b8f75411b63878062 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:19:45.839453 12447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53c73e9183b4401b8f75411b63878062. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.841980 12445 tablet_service.cc:1511] Processing CreateTablet for tablet ffc6e30caa094ccea21a8d8063628ac6 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:19:45.843484 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffc6e30caa094ccea21a8d8063628ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.843972 12726 tablet_bootstrap.cc:492] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:45.846398 12444 tablet_service.cc:1511] Processing CreateTablet for tablet 61a0977d71c94c28a715e132c73798ad (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:19:45.847908 12667 tablet_service.cc:1511] Processing CreateTablet for tablet 54cd9a065a174d478feebb6406e59340 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:45.836526 12448 tablet_service.cc:1511] Processing CreateTablet for tablet aaa0adc1589a4002b4c0544f03a1ef2f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:19:45.842440 12725 tablet_bootstrap.cc:654] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.849609 12667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cd9a065a174d478feebb6406e59340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.851362 12443 tablet_service.cc:1511] Processing CreateTablet for tablet 54cd9a065a174d478feebb6406e59340 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:19:45.847813 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61a0977d71c94c28a715e132c73798ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.853380 12443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cd9a065a174d478feebb6406e59340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.855041 12448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaa0adc1589a4002b4c0544f03a1ef2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.867172 12522 tablet_service.cc:1511] Processing CreateTablet for tablet fc6c218527eb41bea885fbf10aa66427 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:45.868599 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6c218527eb41bea885fbf10aa66427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.883683 12596 tablet_service.cc:1511] Processing CreateTablet for tablet fc6c218527eb41bea885fbf10aa66427 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:45.885310 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6c218527eb41bea885fbf10aa66427. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:45.886821 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:45.888573 12726 tablet_bootstrap.cc:654] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.890455 12666 tablet_service.cc:1511] Processing CreateTablet for tablet fc6c218527eb41bea885fbf10aa66427 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:19:45.894843 12442 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9742746d5449a9a172aee8c6d76947 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:45.897326 12442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9742746d5449a9a172aee8c6d76947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.897317 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc6c218527eb41bea885fbf10aa66427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.905776 12725 tablet_bootstrap.cc:492] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:45.906457 12725 ts_tablet_manager.cc:1403] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.004s
I20260709 13:19:45.910172 12725 raft_consensus.cc:359] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:45.911132 12725 raft_consensus.cc:385] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:45.911504 12725 raft_consensus.cc:740] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:45.912611 12725 consensus_queue.cc:260] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:45.917070 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9742746d5449a9a172aee8c6d76947 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:45.918463 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9742746d5449a9a172aee8c6d76947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.930279 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9742746d5449a9a172aee8c6d76947 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:19:45.931914 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9742746d5449a9a172aee8c6d76947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.943244 12665 tablet_service.cc:1511] Processing CreateTablet for tablet af86257960744ce4a2cfb315fb7d5138 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:45.944747 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af86257960744ce4a2cfb315fb7d5138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.949779 12444 tablet_service.cc:1511] Processing CreateTablet for tablet af86257960744ce4a2cfb315fb7d5138 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:45.951226 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af86257960744ce4a2cfb315fb7d5138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.957238 12727 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:45.969930 12523 tablet_service.cc:1511] Processing CreateTablet for tablet af86257960744ce4a2cfb315fb7d5138 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:19:45.971470 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af86257960744ce4a2cfb315fb7d5138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:45.977828 12727 tablet_bootstrap.cc:654] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:45.993103 12632 heartbeater.cc:499] Master 127.2.200.254:41609 was elected leader, sending a full tablet report...
I20260709 13:19:45.998075 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 1b594978646c4c39afe3c9f91baad874 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:45.999336 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b594978646c4c39afe3c9f91baad874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.001401 12726 tablet_bootstrap.cc:492] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:46.001998 12726 ts_tablet_manager.cc:1403] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.158s	user 0.013s	sys 0.004s
I20260709 13:19:46.006745 12670 tablet_service.cc:1511] Processing CreateTablet for tablet 1b594978646c4c39afe3c9f91baad874 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:46.006922 12445 tablet_service.cc:1511] Processing CreateTablet for tablet 1b594978646c4c39afe3c9f91baad874 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:19:46.008082 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b594978646c4c39afe3c9f91baad874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.008292 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b594978646c4c39afe3c9f91baad874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.019245 12725 ts_tablet_manager.cc:1434] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.112s	user 0.031s	sys 0.000s
I20260709 13:19:46.020188 12726 raft_consensus.cc:359] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.021006 12726 raft_consensus.cc:385] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.021301 12726 raft_consensus.cc:740] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.022207 12727 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:46.022044 12726 consensus_queue.cc:260] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.023335 12727 ts_tablet_manager.cc:1403] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.008s
I20260709 13:19:46.026556 12519 tablet_service.cc:1511] Processing CreateTablet for tablet f9667dd4e5324ecda6b4dead6bff47de (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:46.027848 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9667dd4e5324ecda6b4dead6bff47de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.020337 12730 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:46.028441 12725 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:46.033649 12727 raft_consensus.cc:359] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.038831 12727 raft_consensus.cc:385] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.039232 12727 raft_consensus.cc:740] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.038460 12730 tablet_bootstrap.cc:654] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.041320 12670 tablet_service.cc:1511] Processing CreateTablet for tablet f9667dd4e5324ecda6b4dead6bff47de (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:46.042570 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9667dd4e5324ecda6b4dead6bff47de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.042207 12727 consensus_queue.cc:260] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.040261 12596 tablet_service.cc:1511] Processing CreateTablet for tablet f9667dd4e5324ecda6b4dead6bff47de (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:19:46.044873 12731 raft_consensus.cc:493] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.038604 12725 tablet_bootstrap.cc:654] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.045377 12731 raft_consensus.cc:515] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.052520 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 0b491a2c8e034b4198ba19e2c8fe49fc (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:46.054466 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b491a2c8e034b4198ba19e2c8fe49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.054780 12558 heartbeater.cc:499] Master 127.2.200.254:41609 was elected leader, sending a full tablet report...
I20260709 13:19:46.056950 12726 ts_tablet_manager.cc:1434] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.003s
I20260709 13:19:46.057042 12731 leader_election.cc:290] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:46.058106 12726 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:46.042490 12444 tablet_service.cc:1511] Processing CreateTablet for tablet 0b491a2c8e034b4198ba19e2c8fe49fc (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:46.061208 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b491a2c8e034b4198ba19e2c8fe49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.066468 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 835464d15acb4280aa3484ff857fbbd0 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:46.073381 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835464d15acb4280aa3484ff857fbbd0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:46.069938 12633 tablet.cc:2406] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:19:46.077255 12448 tablet_service.cc:1511] Processing CreateTablet for tablet 835464d15acb4280aa3484ff857fbbd0 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:46.078670 12448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835464d15acb4280aa3484ff857fbbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.078812 12483 heartbeater.cc:499] Master 127.2.200.254:41609 was elected leader, sending a full tablet report...
I20260709 13:19:46.082176 12522 tablet_service.cc:1511] Processing CreateTablet for tablet 835464d15acb4280aa3484ff857fbbd0 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:19:46.083504 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 835464d15acb4280aa3484ff857fbbd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.086911 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9667dd4e5324ecda6b4dead6bff47de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.064633 12726 tablet_bootstrap.cc:654] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.095746 12671 tablet_service.cc:1511] Processing CreateTablet for tablet bea13bfc0b6042faac37932e2b31c21a (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:46.097162 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea13bfc0b6042faac37932e2b31c21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.098654 12727 ts_tablet_manager.cc:1434] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.006s
I20260709 13:19:46.107991 12727 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:46.114888 12519 tablet_service.cc:1511] Processing CreateTablet for tablet 01c20adb4d124ae681d4c43be777969e (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:46.106369 12730 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:46.115974 12730 ts_tablet_manager.cc:1403] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.010s
I20260709 13:19:46.116246 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c20adb4d124ae681d4c43be777969e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.118752 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 01c20adb4d124ae681d4c43be777969e (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:46.120195 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c20adb4d124ae681d4c43be777969e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.120894 12446 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdb79ea7d064a729a9a450e5ca8045f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:46.122227 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdb79ea7d064a729a9a450e5ca8045f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.125458 12730 raft_consensus.cc:359] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.139818 12595 tablet_service.cc:1511] Processing CreateTablet for tablet 01c20adb4d124ae681d4c43be777969e (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:19:46.141911 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c20adb4d124ae681d4c43be777969e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.131767 12445 tablet_service.cc:1511] Processing CreateTablet for tablet bea13bfc0b6042faac37932e2b31c21a (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:46.135270 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 0b491a2c8e034b4198ba19e2c8fe49fc (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:19:46.137598 12594 tablet_service.cc:1511] Processing CreateTablet for tablet bea13bfc0b6042faac37932e2b31c21a (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:19:46.146010 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea13bfc0b6042faac37932e2b31c21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.139883 12730 raft_consensus.cc:385] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.147562 12730 raft_consensus.cc:740] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.148389 12730 consensus_queue.cc:260] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.149708 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b491a2c8e034b4198ba19e2c8fe49fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.157668 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea13bfc0b6042faac37932e2b31c21a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.157989 12706 heartbeater.cc:499] Master 127.2.200.254:41609 was elected leader, sending a full tablet report...
I20260709 13:19:46.158618 12730 ts_tablet_manager.cc:1434] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.042s	user 0.001s	sys 0.012s
I20260709 13:19:46.159771 12730 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:46.165813 12730 tablet_bootstrap.cc:654] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.139147 12727 tablet_bootstrap.cc:654] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.139529 12726 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:46.169586 12726 ts_tablet_manager.cc:1403] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.002s
I20260709 13:19:46.171556 12725 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:46.172091 12725 ts_tablet_manager.cc:1403] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.040s
I20260709 13:19:46.172695 12726 raft_consensus.cc:359] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.173745 12522 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdb79ea7d064a729a9a450e5ca8045f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:46.175201 12597 tablet_service.cc:1511] Processing CreateTablet for tablet 2bdb79ea7d064a729a9a450e5ca8045f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:19:46.176144 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdb79ea7d064a729a9a450e5ca8045f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.177012 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bdb79ea7d064a729a9a450e5ca8045f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.175225 12726 raft_consensus.cc:385] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.180056 12726 raft_consensus.cc:740] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.180979 12726 consensus_queue.cc:260] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.175169 12725 raft_consensus.cc:359] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.185534 12725 raft_consensus.cc:385] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.185822 12725 raft_consensus.cc:740] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.188917 12725 consensus_queue.cc:260] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.190135 12726 ts_tablet_manager.cc:1434] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:19:46.199060 12726 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:46.199152 12725 ts_tablet_manager.cc:1434] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260709 13:19:46.208273 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9710dd994b40c18e7d33112d946085" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:46.209100 12533 raft_consensus.cc:2468] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:46.209545 12725 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:46.210659 12573 leader_election.cc:304] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:46.211534 12731 raft_consensus.cc:2804] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.211918 12731 raft_consensus.cc:493] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.212257 12731 raft_consensus.cc:3060] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.217175 12725 tablet_bootstrap.cc:654] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.219702 12730 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:46.222877 12731 raft_consensus.cc:515] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.248523 12730 ts_tablet_manager.cc:1403] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.002s
I20260709 13:19:46.250195 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9710dd994b40c18e7d33112d946085" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:46.251536 12533 raft_consensus.cc:3060] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.261242 12726 tablet_bootstrap.cc:654] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.263091 12725 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:46.268026 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 722f7ee62121485b869fb4f23af88977 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:46.268306 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9710dd994b40c18e7d33112d946085" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:46.269393 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722f7ee62121485b869fb4f23af88977. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:46.270401 12570 leader_election.cc:343] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.271472 12725 ts_tablet_manager.cc:1403] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.018s
I20260709 13:19:46.271759 12727 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:46.272302 12727 ts_tablet_manager.cc:1403] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.165s	user 0.011s	sys 0.006s
I20260709 13:19:46.275427 12725 raft_consensus.cc:359] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.276247 12725 raft_consensus.cc:385] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.276583 12725 raft_consensus.cc:740] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.275920 12727 raft_consensus.cc:359] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:46.277422 12727 raft_consensus.cc:385] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.277415 12725 consensus_queue.cc:260] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.278283 12727 raft_consensus.cc:740] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.279320 12727 consensus_queue.cc:260] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:46.279691 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 722f7ee62121485b869fb4f23af88977 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:46.281476 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722f7ee62121485b869fb4f23af88977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.281792 12727 ts_tablet_manager.cc:1434] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:46.287753 12731 leader_election.cc:290] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:46.287451 12446 tablet_service.cc:1511] Processing CreateTablet for tablet 722f7ee62121485b869fb4f23af88977 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:19:46.288985 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9710dd994b40c18e7d33112d946085" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:46.289249 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 722f7ee62121485b869fb4f23af88977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.290042 12533 raft_consensus.cc:2468] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
W20260709 13:19:46.290550 12570 leader_election.cc:343] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.292842 12730 raft_consensus.cc:359] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.299958 12730 raft_consensus.cc:385] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.300338 12730 raft_consensus.cc:740] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.296180 12727 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:46.301234 12730 consensus_queue.cc:260] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.306578 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae14799191e4d7a994bf30ffcf750dc (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:46.298918 12573 leader_election.cc:304] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:46.308117 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae14799191e4d7a994bf30ffcf750dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.307278 12730 ts_tablet_manager.cc:1434] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:19:46.318056 12727 tablet_bootstrap.cc:654] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.318949 12445 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae14799191e4d7a994bf30ffcf750dc (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:46.310416 12731 raft_consensus.cc:2804] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.324802 12726 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:46.325477 12726 ts_tablet_manager.cc:1403] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.127s	user 0.008s	sys 0.009s
I20260709 13:19:46.329496 12595 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae14799191e4d7a994bf30ffcf750dc (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:19:46.330832 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae14799191e4d7a994bf30ffcf750dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.331198 12730 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:46.336910 12731 raft_consensus.cc:697] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:46.337869 12731 consensus_queue.cc:237] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.339998 12730 tablet_bootstrap.cc:654] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.341284 12726 raft_consensus.cc:359] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.342023 12726 raft_consensus.cc:385] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.342314 12726 raft_consensus.cc:740] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.343168 12726 consensus_queue.cc:260] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.322135 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae14799191e4d7a994bf30ffcf750dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.357271 12726 ts_tablet_manager.cc:1434] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 13:19:46.388433 12726 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:46.389173 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8c719430c241dc9304ef2ebd8df639 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:46.390939 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8c719430c241dc9304ef2ebd8df639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.393052 12727 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:46.393673 12727 ts_tablet_manager.cc:1403] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.003s
I20260709 13:19:46.395074 12734 raft_consensus.cc:493] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.395622 12734 raft_consensus.cc:515] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.397570 12725 ts_tablet_manager.cc:1434] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.126s	user 0.024s	sys 0.062s
I20260709 13:19:46.408018 12725 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:46.408263 12734 leader_election.cc:290] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:46.409842 12595 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8c719430c241dc9304ef2ebd8df639 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:46.425974 12356 catalog_manager.cc:5697] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:46.441670 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 2c8c719430c241dc9304ef2ebd8df639 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:19:46.443053 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8c719430c241dc9304ef2ebd8df639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.446357 12730 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:46.446933 12730 ts_tablet_manager.cc:1403] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.007s
I20260709 13:19:46.453747 12727 raft_consensus.cc:359] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.454769 12727 raft_consensus.cc:385] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.454056 12730 raft_consensus.cc:359] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.455220 12727 raft_consensus.cc:740] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.455646 12730 raft_consensus.cc:385] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.456054 12730 raft_consensus.cc:740] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.456600 12727 consensus_queue.cc:260] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.456837 12730 consensus_queue.cc:260] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.473498 12445 tablet_service.cc:1511] Processing CreateTablet for tablet 2dffa974b56c4c00a103f46b509f5965 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:46.460404 12731 raft_consensus.cc:493] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.466567 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:46.475031 12681 raft_consensus.cc:2468] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:46.477051 12421 leader_election.cc:304] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:46.477577 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dffa974b56c4c00a103f46b509f5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.438354 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c8c719430c241dc9304ef2ebd8df639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.469219 12726 tablet_bootstrap.cc:654] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.479522 12734 raft_consensus.cc:2804] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.479944 12734 raft_consensus.cc:493] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.480286 12734 raft_consensus.cc:3060] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.483634 12731 raft_consensus.cc:515] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.484061 12730 ts_tablet_manager.cc:1434] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 13:19:46.486634 12731 leader_election.cc:290] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:46.489511 12734 raft_consensus.cc:515] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.490391 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc6e30caa094ccea21a8d8063628ac6" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:46.491014 12533 raft_consensus.cc:2468] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:46.483197 12725 tablet_bootstrap.cc:654] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.492605 12734 leader_election.cc:290] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:46.493806 12573 leader_election.cc:304] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:46.503562 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:46.505381 12681 raft_consensus.cc:3060] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.505652 12596 tablet_service.cc:1511] Processing CreateTablet for tablet 2dffa974b56c4c00a103f46b509f5965 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:46.506968 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dffa974b56c4c00a103f46b509f5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.499960 12731 raft_consensus.cc:2804] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:46.510279 12734 raft_consensus.cc:493] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.527316 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 47b322fccf59456095cd4773a162b412 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:46.527837 12734 raft_consensus.cc:515] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:46.528326 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:46.528638 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b322fccf59456095cd4773a162b412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.529398 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:46.530126 12607 raft_consensus.cc:2468] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:46.518774 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 5ebd5e8c4c884c419dacec563c1e30ac (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:46.532105 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ebd5e8c4c884c419dacec563c1e30ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.505666 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 2dffa974b56c4c00a103f46b509f5965 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:19:46.546473 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dffa974b56c4c00a103f46b509f5965. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.520542 12522 tablet_service.cc:1511] Processing CreateTablet for tablet 5ebd5e8c4c884c419dacec563c1e30ac (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:46.549669 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ebd5e8c4c884c419dacec563c1e30ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.518956 12446 tablet_service.cc:1511] Processing CreateTablet for tablet 5ebd5e8c4c884c419dacec563c1e30ac (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:19:46.553728 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ebd5e8c4c884c419dacec563c1e30ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.556483 12595 tablet_service.cc:1511] Processing CreateTablet for tablet 7a22d36ba14b48d9a8dfbc803ac44305 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:46.556998 12670 tablet_service.cc:1511] Processing CreateTablet for tablet c94ecddd09134d23b4cf3abd9a7a5f31 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:46.557902 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a22d36ba14b48d9a8dfbc803ac44305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.558293 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94ecddd09134d23b4cf3abd9a7a5f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.560060 12520 tablet_service.cc:1511] Processing CreateTablet for tablet b3ed01e93b104e1a8816c0965b585db1 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:46.561403 12520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ed01e93b104e1a8816c0965b585db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.562711 12667 tablet_service.cc:1511] Processing CreateTablet for tablet b3ed01e93b104e1a8816c0965b585db1 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:46.565601 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:46.565902 12448 tablet_service.cc:1511] Processing CreateTablet for tablet 7a22d36ba14b48d9a8dfbc803ac44305 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
W20260709 13:19:46.567327 12423 leader_election.cc:343] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.567207 12665 tablet_service.cc:1511] Processing CreateTablet for tablet ad8fad451d52413fbe9076d53d09eb19 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:46.567239 12448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a22d36ba14b48d9a8dfbc803ac44305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.570045 12442 tablet_service.cc:1511] Processing CreateTablet for tablet b3ed01e93b104e1a8816c0965b585db1 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:19:46.571244 12442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ed01e93b104e1a8816c0965b585db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.571938 12597 tablet_service.cc:1511] Processing CreateTablet for tablet 5f232fdc7c0e4d8190333cff24352967 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:46.573171 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f232fdc7c0e4d8190333cff24352967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.544188 12594 tablet_service.cc:1511] Processing CreateTablet for tablet c94ecddd09134d23b4cf3abd9a7a5f31 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:46.575346 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94ecddd09134d23b4cf3abd9a7a5f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.578476 12592 tablet_service.cc:1511] Processing CreateTablet for tablet d54686caf81d4b5b82fd2d32243d743a (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:46.579792 12592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54686caf81d4b5b82fd2d32243d743a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.581136 12517 tablet_service.cc:1511] Processing CreateTablet for tablet d54686caf81d4b5b82fd2d32243d743a (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:46.582415 12517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54686caf81d4b5b82fd2d32243d743a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.585261 12667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3ed01e93b104e1a8816c0965b585db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.587622 12591 tablet_service.cc:1511] Processing CreateTablet for tablet 49a785fe68e845f4bdbac514c3f8efcf (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:46.589226 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8fad451d52413fbe9076d53d09eb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.589972 12590 tablet_service.cc:1511] Processing CreateTablet for tablet fcedc26f17ec4b449603d23a954af416 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:46.591276 12591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a785fe68e845f4bdbac514c3f8efcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.597154 12590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcedc26f17ec4b449603d23a954af416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.597909 12515 tablet_service.cc:1511] Processing CreateTablet for tablet fcedc26f17ec4b449603d23a954af416 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:46.599273 12515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcedc26f17ec4b449603d23a954af416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.601347 12589 tablet_service.cc:1511] Processing CreateTablet for tablet a4f0e015fd1245df8b4f7ac03925ae09 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:46.601924 12514 tablet_service.cc:1511] Processing CreateTablet for tablet a4f0e015fd1245df8b4f7ac03925ae09 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:46.603240 12514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f0e015fd1245df8b4f7ac03925ae09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.603585 12588 tablet_service.cc:1511] Processing CreateTablet for tablet a41bc8bb09ea4170a53464bccb6477ba (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:46.604753 12733 raft_consensus.cc:493] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.605330 12588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41bc8bb09ea4170a53464bccb6477ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.605238 12733 raft_consensus.cc:515] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.612509 12733 leader_election.cc:290] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:46.613651 12589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f0e015fd1245df8b4f7ac03925ae09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.613407 12516 tablet_service.cc:1511] Processing CreateTablet for tablet 8c27a8f81e2943eb9cf5ee3dd7577d88 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:46.614773 12516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c27a8f81e2943eb9cf5ee3dd7577d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.579886 12518 tablet_service.cc:1511] Processing CreateTablet for tablet 5f232fdc7c0e4d8190333cff24352967 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:46.620218 12518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f232fdc7c0e4d8190333cff24352967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.623620 12740 raft_consensus.cc:493] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.624367 12740 raft_consensus.cc:515] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.526007 12727 ts_tablet_manager.cc:1434] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.132s	user 0.014s	sys 0.000s
I20260709 13:19:46.513191 12731 raft_consensus.cc:493] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:46.530224 12734 leader_election.cc:290] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:46.534788 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:46.519030 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 47b322fccf59456095cd4773a162b412 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:46.536039 12606 raft_consensus.cc:3060] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.514683 12730 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:46.536870 12444 tablet_service.cc:1511] Processing CreateTablet for tablet 47b322fccf59456095cd4773a162b412 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:19:46.539372 12521 tablet_service.cc:1511] Processing CreateTablet for tablet 7a22d36ba14b48d9a8dfbc803ac44305 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:19:46.543157 12519 tablet_service.cc:1511] Processing CreateTablet for tablet c94ecddd09134d23b4cf3abd9a7a5f31 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:19:46.636323 12731 raft_consensus.cc:3060] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:46.666356 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b322fccf59456095cd4773a162b412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.667080 12445 tablet_service.cc:1511] Processing CreateTablet for tablet ad8fad451d52413fbe9076d53d09eb19 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:46.668624 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8fad451d52413fbe9076d53d09eb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.641983 12740 leader_election.cc:290] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:46.688942 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b322fccf59456095cd4773a162b412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.690194 12606 raft_consensus.cc:2468] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:46.691556 12423 leader_election.cc:304] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:19:46.692703 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c94ecddd09134d23b4cf3abd9a7a5f31. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.693301 12734 raft_consensus.cc:2804] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:46.693817 12734 raft_consensus.cc:697] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:46.694623 12734 consensus_queue.cc:237] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:46.697834 12447 tablet_service.cc:1511] Processing CreateTablet for tablet d54686caf81d4b5b82fd2d32243d743a (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:19:46.698167 12443 tablet_service.cc:1511] Processing CreateTablet for tablet 8c27a8f81e2943eb9cf5ee3dd7577d88 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:46.699501 12447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d54686caf81d4b5b82fd2d32243d743a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.700155 12443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c27a8f81e2943eb9cf5ee3dd7577d88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:46.706321 12421 leader_election.cc:343] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.706815 12421 leader_election.cc:304] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:46.708063 12755 raft_consensus.cc:2749] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:46.709282 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a22d36ba14b48d9a8dfbc803ac44305. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.710498 12725 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:46.711048 12725 ts_tablet_manager.cc:1403] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.303s	user 0.025s	sys 0.048s
I20260709 13:19:46.713742 12726 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:46.714248 12726 ts_tablet_manager.cc:1403] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.326s	user 0.017s	sys 0.004s
I20260709 13:19:46.715655 12730 tablet_bootstrap.cc:654] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.724946 12596 tablet_service.cc:1511] Processing CreateTablet for tablet ad8fad451d52413fbe9076d53d09eb19 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:19:46.726307 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad8fad451d52413fbe9076d53d09eb19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.681375 12740 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.742501 12441 tablet_service.cc:1511] Processing CreateTablet for tablet 49a785fe68e845f4bdbac514c3f8efcf (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:46.718176 12727 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:46.744249 12441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a785fe68e845f4bdbac514c3f8efcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.750725 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 5f232fdc7c0e4d8190333cff24352967 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:19:46.752219 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f232fdc7c0e4d8190333cff24352967. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.733736 12740 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.736382 12726 raft_consensus.cc:359] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.768102 12755 raft_consensus.cc:493] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.783730 12440 tablet_service.cc:1511] Processing CreateTablet for tablet a4f0e015fd1245df8b4f7ac03925ae09 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:19:46.783740 12670 tablet_service.cc:1511] Processing CreateTablet for tablet 8c27a8f81e2943eb9cf5ee3dd7577d88 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:19:46.785638 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c27a8f81e2943eb9cf5ee3dd7577d88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.785435 12755 raft_consensus.cc:515] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.789132 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9742746d5449a9a172aee8c6d76947" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:46.790096 12755 leader_election.cc:290] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
W20260709 13:19:46.791297 12423 leader_election.cc:343] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.792402 12440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4f0e015fd1245df8b4f7ac03925ae09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.794101 12668 tablet_service.cc:1511] Processing CreateTablet for tablet 49a785fe68e845f4bdbac514c3f8efcf (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:19:46.795372 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49a785fe68e845f4bdbac514c3f8efcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.795984 12589 tablet_service.cc:1511] Processing CreateTablet for tablet c1950837058f4c6da84a2dec12b369e2 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:46.797331 12589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1950837058f4c6da84a2dec12b369e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.802242 12669 tablet_service.cc:1511] Processing CreateTablet for tablet fcedc26f17ec4b449603d23a954af416 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:19:46.803519 12664 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8e4aa584954c6cb3fb640e00299a4e (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:46.805704 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcedc26f17ec4b449603d23a954af416. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.809664 12664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8e4aa584954c6cb3fb640e00299a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.775208 12726 raft_consensus.cc:385] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.825702 12726 raft_consensus.cc:740] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.850565 12439 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8e4aa584954c6cb3fb640e00299a4e (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:46.852098 12439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8e4aa584954c6cb3fb640e00299a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.853945 12663 tablet_service.cc:1511] Processing CreateTablet for tablet a41bc8bb09ea4170a53464bccb6477ba (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:19:46.855316 12663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41bc8bb09ea4170a53464bccb6477ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.861305 12727 tablet_bootstrap.cc:654] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:46.864086 12447 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88422ad42d465fbb3161af884776f4 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:46.864526 12662 tablet_service.cc:1511] Processing CreateTablet for tablet c1950837058f4c6da84a2dec12b369e2 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:46.868655 12662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1950837058f4c6da84a2dec12b369e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.871734 12740 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:46.874799 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:46.876366 12355 catalog_manager.cc:5697] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:46.884562 12496 leader_election.cc:343] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:46.891693 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:46.893370 12726 consensus_queue.cc:260] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:46.895784 12726 ts_tablet_manager.cc:1434] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.181s	user 0.009s	sys 0.000s
I20260709 13:19:46.902046 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 1d02b1f993f04219ab72cd3d163a11f6 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:46.903448 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d02b1f993f04219ab72cd3d163a11f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.905048 12591 tablet_service.cc:1511] Processing CreateTablet for tablet 0533952f2edb40af8e517e228d720738 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:46.834911 12731 raft_consensus.cc:515] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.911756 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:46.914189 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:46.914031 12681 raft_consensus.cc:2468] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:46.917304 12448 tablet_service.cc:1511] Processing CreateTablet for tablet a41bc8bb09ea4170a53464bccb6477ba (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:19:46.917963 12644 leader_election.cc:343] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:46.919371 12644 leader_election.cc:343] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.920135 12725 raft_consensus.cc:359] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.921120 12725 raft_consensus.cc:385] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:46.921439 12725 raft_consensus.cc:740] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:46.922389 12725 consensus_queue.cc:260] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:46.934938 12726 tablet_bootstrap.cc:492] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:46.955232 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc6e30caa094ccea21a8d8063628ac6" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:46.961992 12570 leader_election.cc:343] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.967881 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc6e30caa094ccea21a8d8063628ac6" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:46.969326 12588 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd04e41dc224298aa74af4ed0318c83 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:46.945856 12731 leader_election.cc:290] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:19:46.978195 12570 leader_election.cc:343] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:46.974538 12591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0533952f2edb40af8e517e228d720738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.976708 12733 raft_consensus.cc:493] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:46.999238 12447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88422ad42d465fbb3161af884776f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:46.998457 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc6e30caa094ccea21a8d8063628ac6" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:46.999910 12533 raft_consensus.cc:3060] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:47.000160 12570 consensus_peers.cc:597] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd -> Peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Couldn't send request to peer e42f0f6820a54d65880b5a40d1e1d4e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.004379 12669 tablet_service.cc:1511] Processing CreateTablet for tablet 560aebc4cc8147368f02be5f1491f6fd (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:46.993186 12733 raft_consensus.cc:515] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.005764 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560aebc4cc8147368f02be5f1491f6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.005446 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 3e8e4aa584954c6cb3fb640e00299a4e (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:19:47.006709 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e8e4aa584954c6cb3fb640e00299a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.011689 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:47.012398 12606 raft_consensus.cc:2468] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:47.013908 12498 leader_election.cc:304] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:47.016075 12668 tablet_service.cc:1511] Processing CreateTablet for tablet faf1541d3e80425ea5524a9a73c92450 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:47.016921 12588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd04e41dc224298aa74af4ed0318c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.018323 12519 tablet_service.cc:1511] Processing CreateTablet for tablet c1950837058f4c6da84a2dec12b369e2 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:19:47.019740 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1950837058f4c6da84a2dec12b369e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.020504 12733 leader_election.cc:290] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:47.021113 12773 consensus_queue.cc:1048] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.021510 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:47.023169 12496 leader_election.cc:343] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.024420 12665 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd04e41dc224298aa74af4ed0318c83 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:47.021126 12733 raft_consensus.cc:2804] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.028362 12733 raft_consensus.cc:493] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.028717 12733 raft_consensus.cc:3060] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.030491 12443 tablet_service.cc:1511] Processing CreateTablet for tablet 0533952f2edb40af8e517e228d720738 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:47.031824 12443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0533952f2edb40af8e517e228d720738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.031567 12590 tablet_service.cc:1511] Processing CreateTablet for tablet 02392cdd764f41cca809b8f14dc0ff1f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:47.004288 12444 tablet_service.cc:1511] Processing CreateTablet for tablet 1d02b1f993f04219ab72cd3d163a11f6 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:47.035481 12730 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:47.036047 12730 ts_tablet_manager.cc:1403] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.535s	user 0.024s	sys 0.002s
I20260709 13:19:47.045568 12596 tablet_service.cc:1511] Processing CreateTablet for tablet 878634ecebed436cab294749679d0254 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:47.048947 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d02b1f993f04219ab72cd3d163a11f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.049706 12448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41bc8bb09ea4170a53464bccb6477ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.052114 12727 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:47.054118 12593 tablet_service.cc:1511] Processing CreateTablet for tablet 937d94e615b2444c82beb63e8bf72d7f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:47.054988 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd04e41dc224298aa74af4ed0318c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.055527 12518 tablet_service.cc:1511] Processing CreateTablet for tablet 0533952f2edb40af8e517e228d720738 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:19:47.056946 12518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0533952f2edb40af8e517e228d720738. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.040975 12597 tablet_service.cc:1511] Processing CreateTablet for tablet 4185e974866b49798be93199dbf6a46d (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:47.059185 12594 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd7239741d241c5833b78180486ea66 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:47.051862 12592 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88422ad42d465fbb3161af884776f4 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:19:47.064611 12727 ts_tablet_manager.cc:1403] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.386s	user 0.019s	sys 0.033s
I20260709 13:19:47.076056 12589 tablet_service.cc:1511] Processing CreateTablet for tablet 1d02b1f993f04219ab72cd3d163a11f6 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:19:47.077116 12725 ts_tablet_manager.cc:1434] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.366s	user 0.011s	sys 0.011s
I20260709 13:19:47.076946 12442 tablet_service.cc:1511] Processing CreateTablet for tablet fa508c916de349f7978060020c80bd3d (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:47.078689 12442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa508c916de349f7978060020c80bd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.071753 12727 raft_consensus.cc:359] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.085542 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf1541d3e80425ea5524a9a73c92450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.087023 12663 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd7239741d241c5833b78180486ea66 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:47.088341 12663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd7239741d241c5833b78180486ea66. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:47.093304 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 79637us
I20260709 13:19:47.094849 12733 raft_consensus.cc:515] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:47.097694 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
W20260709 13:19:47.099093 12496 leader_election.cc:343] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.099715 12517 tablet_service.cc:1511] Processing CreateTablet for tablet 560aebc4cc8147368f02be5f1491f6fd (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:47.105808 12733 leader_election.cc:290] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:47.109855 12514 tablet_service.cc:1511] Processing CreateTablet for tablet 4185e974866b49798be93199dbf6a46d (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:47.111173 12730 raft_consensus.cc:359] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.111934 12590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02392cdd764f41cca809b8f14dc0ff1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.113852 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 02392cdd764f41cca809b8f14dc0ff1f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:47.016010 12533 raft_consensus.cc:2468] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:47.118466 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:47.119733 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:47.121706 12521 tablet_service.cc:1511] Processing CreateTablet for tablet faf1541d3e80425ea5524a9a73c92450 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:47.130986 12664 tablet_service.cc:1511] Processing CreateTablet for tablet 4185e974866b49798be93199dbf6a46d (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:19:47.135111 12441 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd04e41dc224298aa74af4ed0318c83 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:19:47.146314 12573 leader_election.cc:304] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:47.147730 12664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4185e974866b49798be93199dbf6a46d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:47.148211 12647 leader_election.cc:343] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.148692 12647 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:47.149403 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02392cdd764f41cca809b8f14dc0ff1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.150038 12771 raft_consensus.cc:2804] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.150543 12771 raft_consensus.cc:697] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:47.138010 12670 tablet_service.cc:1511] Processing CreateTablet for tablet fa508c916de349f7978060020c80bd3d (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:47.138978 12726 tablet_bootstrap.cc:654] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.151361 12771 consensus_queue.cc:237] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:47.153455 12740 raft_consensus.cc:2749] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.141244 12516 tablet_service.cc:1511] Processing CreateTablet for tablet 878634ecebed436cab294749679d0254 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:47.085563 12727 raft_consensus.cc:385] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.157481 12727 raft_consensus.cc:740] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.157773 12755 consensus_queue.cc:1048] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.161393 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878634ecebed436cab294749679d0254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.162253 12667 tablet_service.cc:1511] Processing CreateTablet for tablet 937d94e615b2444c82beb63e8bf72d7f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:47.162195 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:47.139575 12440 tablet_service.cc:1511] Processing CreateTablet for tablet faf1541d3e80425ea5524a9a73c92450 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:19:47.142158 12730 raft_consensus.cc:385] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.145444 12531 raft_consensus.cc:2468] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:47.090572 12515 tablet_service.cc:1511] Processing CreateTablet for tablet 8fd7239741d241c5833b78180486ea66 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:19:47.171380 12730 raft_consensus.cc:740] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.165493 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd7239741d241c5833b78180486ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.171015 12647 leader_election.cc:304] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:47.164193 12725 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:47.172942 12740 raft_consensus.cc:2804] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.173342 12740 raft_consensus.cc:493] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.173681 12740 raft_consensus.cc:3060] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.174239 12662 tablet_service.cc:1511] Processing CreateTablet for tablet 88ea4fda6fe7451c90f25fe181570e34 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:47.164916 12606 raft_consensus.cc:3060] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.179548 12589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d02b1f993f04219ab72cd3d163a11f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.183167 12727 consensus_queue.cc:260] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.187192 12727 ts_tablet_manager.cc:1434] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.005s
I20260709 13:19:47.187269 12730 consensus_queue.cc:260] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.189750 12730 ts_tablet_manager.cc:1434] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.153s	user 0.009s	sys 0.004s
I20260709 13:19:47.190745 12730 tablet_bootstrap.cc:492] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:47.165017 12667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937d94e615b2444c82beb63e8bf72d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.197520 12662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ea4fda6fe7451c90f25fe181570e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.199801 12665 tablet_service.cc:1511] Processing CreateTablet for tablet 8a98d51892474c3388c511ca2719ae45 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:47.220261 12517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560aebc4cc8147368f02be5f1491f6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.221518 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9742746d5449a9a172aee8c6d76947" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:47.245060 12755 consensus_queue.cc:1048] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:19:47.255281 12520 tablet_service.cc:1511] Processing CreateTablet for tablet 6c88422ad42d465fbb3161af884776f4 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:19:47.268257 12424 leader_election.cc:343] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.268808 12424 leader_election.cc:304] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:47.249419 12606 raft_consensus.cc:2468] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:47.262403 12595 tablet_service.cc:1511] Processing CreateTablet for tablet d17c9a7398774b5a85e6a2d1f1f48292 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:47.276075 12498 leader_election.cc:304] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:47.277468 12774 raft_consensus.cc:2804] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.243599 12597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4185e974866b49798be93199dbf6a46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.277733 12755 raft_consensus.cc:2749] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.219987 12725 tablet_bootstrap.cc:654] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.280946 12595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17c9a7398774b5a85e6a2d1f1f48292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.278142 12774 raft_consensus.cc:697] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:47.282249 12774 consensus_queue.cc:237] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:47.291376 12592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88422ad42d465fbb3161af884776f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.292582 12444 tablet_service.cc:1511] Processing CreateTablet for tablet 560aebc4cc8147368f02be5f1491f6fd (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:19:47.294293 12445 tablet_service.cc:1511] Processing CreateTablet for tablet 02392cdd764f41cca809b8f14dc0ff1f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:19:47.294844 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560aebc4cc8147368f02be5f1491f6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.295908 12727 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:47.307582 12588 tablet_service.cc:1511] Processing CreateTablet for tablet 1031c7d22c0645c0b997bb7c66e1f9a4 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:47.308941 12588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1031c7d22c0645c0b997bb7c66e1f9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.296386 12514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4185e974866b49798be93199dbf6a46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.296603 12446 tablet_service.cc:1511] Processing CreateTablet for tablet d17c9a7398774b5a85e6a2d1f1f48292 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:47.313678 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17c9a7398774b5a85e6a2d1f1f48292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.314332 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 937d94e615b2444c82beb63e8bf72d7f (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:19:47.253937 12439 tablet_service.cc:1511] Processing CreateTablet for tablet 878634ecebed436cab294749679d0254 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:19:47.314358 12727 tablet_bootstrap.cc:654] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.315564 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937d94e615b2444c82beb63e8bf72d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.315709 12439 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878634ecebed436cab294749679d0254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.317906 12440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf1541d3e80425ea5524a9a73c92450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.255290 12670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa508c916de349f7978060020c80bd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.303822 12522 tablet_service.cc:1511] Processing CreateTablet for tablet fa508c916de349f7978060020c80bd3d (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:19:47.351629 12666 tablet_service.cc:1511] Processing CreateTablet for tablet f8219316df3d4ad79c4fbe14bb77376b (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:47.342267 12593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 937d94e615b2444c82beb63e8bf72d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.345160 12441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd04e41dc224298aa74af4ed0318c83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.350096 12356 catalog_manager.cc:5697] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:47.363509 12445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02392cdd764f41cca809b8f14dc0ff1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.264381 12591 tablet_service.cc:1511] Processing CreateTablet for tablet 8a98d51892474c3388c511ca2719ae45 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:19:47.365125 12765 raft_consensus.cc:493] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.346264 12740 raft_consensus.cc:515] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.365691 12765 raft_consensus.cc:515] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.367913 12765 leader_election.cc:290] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:47.369052 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:47.369778 12531 raft_consensus.cc:3060] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.370083 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af86257960744ce4a2cfb315fb7d5138" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:47.369149 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:47.371564 12458 raft_consensus.cc:3060] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.245401 12671 tablet_service.cc:1511] Processing CreateTablet for tablet 1031c7d22c0645c0b997bb7c66e1f9a4 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:19:47.373335 12647 leader_election.cc:343] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.376466 12665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a98d51892474c3388c511ca2719ae45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.369657 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af86257960744ce4a2cfb315fb7d5138" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:47.385403 12442 tablet_service.cc:1511] Processing CreateTablet for tablet 8a98d51892474c3388c511ca2719ae45 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 13:19:47.386406 12644 leader_election.cc:343] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.386905 12644 leader_election.cc:304] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:47.387223 12442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a98d51892474c3388c511ca2719ae45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.387641 12590 tablet_service.cc:1511] Processing CreateTablet for tablet 8359fd6a469b4460a658e1646de646f8 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:47.345942 12515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fd7239741d241c5833b78180486ea66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.395704 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8219316df3d4ad79c4fbe14bb77376b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.369354 12740 leader_election.cc:290] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:47.400677 12726 tablet_bootstrap.cc:492] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:47.401263 12726 ts_tablet_manager.cc:1403] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.505s	user 0.018s	sys 0.014s
I20260709 13:19:47.404860 12765 raft_consensus.cc:2749] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.406787 12725 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:47.407322 12725 ts_tablet_manager.cc:1403] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.243s	user 0.015s	sys 0.003s
I20260709 13:19:47.408799 12447 tablet_service.cc:1511] Processing CreateTablet for tablet 8359fd6a469b4460a658e1646de646f8 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:47.409723 12590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8359fd6a469b4460a658e1646de646f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.410108 12447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8359fd6a469b4460a658e1646de646f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.369997 12443 tablet_service.cc:1511] Processing CreateTablet for tablet 88ea4fda6fe7451c90f25fe181570e34 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:47.412021 12443 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ea4fda6fe7451c90f25fe181570e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.414834 12448 tablet_service.cc:1511] Processing CreateTablet for tablet f8219316df3d4ad79c4fbe14bb77376b (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:47.433344 12516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878634ecebed436cab294749679d0254. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.433219 12671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1031c7d22c0645c0b997bb7c66e1f9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.404464 12726 raft_consensus.cc:359] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:47.466377 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:47.467334 12680 raft_consensus.cc:2393] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:47.454331 12591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a98d51892474c3388c511ca2719ae45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.454789 12522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa508c916de349f7978060020c80bd3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.452582 12726 raft_consensus.cc:385] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.477535 12496 leader_election.cc:304] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:47.481873 12448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8219316df3d4ad79c4fbe14bb77376b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.488895 12726 raft_consensus.cc:740] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
W20260709 13:19:47.491164 12423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 75801.5us
I20260709 13:19:47.541244 12668 tablet_service.cc:1511] Processing CreateTablet for tablet 86d028731950492fa2b549e869766512 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:47.542279 12596 tablet_service.cc:1511] Processing CreateTablet for tablet 86d028731950492fa2b549e869766512 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:47.543524 12596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d028731950492fa2b549e869766512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.549490 12726 consensus_queue.cc:260] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:47.551396 12726 ts_tablet_manager.cc:1434] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.150s	user 0.004s	sys 0.003s
I20260709 13:19:47.542658 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d028731950492fa2b549e869766512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.554977 12666 tablet_service.cc:1511] Processing CreateTablet for tablet 611f7e5c6d52455baebc4b6a0b73edd5 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:47.557695 12725 raft_consensus.cc:359] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:47.558754 12725 raft_consensus.cc:385] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.559096 12725 raft_consensus.cc:740] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.544536 12519 tablet_service.cc:1511] Processing CreateTablet for tablet d17c9a7398774b5a85e6a2d1f1f48292 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:19:47.539168 12520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c88422ad42d465fbb3161af884776f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.560220 12725 consensus_queue.cc:260] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:47.440696 12355 catalog_manager.cc:5697] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.506640 12458 raft_consensus.cc:2468] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:47.554808 12726 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:47.575683 12519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17c9a7398774b5a85e6a2d1f1f48292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.590139 12523 tablet_service.cc:1511] Processing CreateTablet for tablet 88ea4fda6fe7451c90f25fe181570e34 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:19:47.578573 12727 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:47.598663 12594 tablet_service.cc:1511] Processing CreateTablet for tablet ad1ae772aa48427189cff34a672ae7ea (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 13:19:47.569329 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 51478.8us
I20260709 13:19:47.607501 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611f7e5c6d52455baebc4b6a0b73edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.564790 12531 raft_consensus.cc:2468] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:47.618304 12727 ts_tablet_manager.cc:1403] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.323s	user 0.003s	sys 0.027s
I20260709 13:19:47.624575 12774 raft_consensus.cc:2749] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:47.566360 12589 tablet_service.cc:1511] Processing CreateTablet for tablet 611f7e5c6d52455baebc4b6a0b73edd5 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:47.573940 12440 tablet_service.cc:1511] Processing CreateTablet for tablet 86d028731950492fa2b549e869766512 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:19:47.636173 12730 tablet_bootstrap.cc:654] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.637616 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet faf1541d3e80425ea5524a9a73c92450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.642859 12594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1ae772aa48427189cff34a672ae7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.635129 12644 leader_election.cc:304] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:47.665548 12765 raft_consensus.cc:2804] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.666056 12765 raft_consensus.cc:697] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:47.666872 12765 consensus_queue.cc:237] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.667550 12727 raft_consensus.cc:359] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.668323 12727 raft_consensus.cc:385] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.669458 12725 ts_tablet_manager.cc:1434] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.262s	user 0.007s	sys 0.004s
I20260709 13:19:47.684391 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ea4fda6fe7451c90f25fe181570e34. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:19:47.692377 12570 consensus_peers.cc:597] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.668659 12727 raft_consensus.cc:740] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:47.710740 12725 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:47.726714 12772 consensus_queue.cc:1048] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:47.728802 12588 tablet_service.cc:1511] Processing CreateTablet for tablet 424acb25ab4a4395a267933873286ca0 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:47.728647 12597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34118 (request call id 32) took 1054 ms. Trace:
I20260709 13:19:47.730451 12597 rpcz_store.cc:276] 0709 13:19:46.674130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.038381 (+364251us) service_pool.cc:224] Handling call
0709 13:19:47.057588 (+ 19207us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.057670 (+    82us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.567132 (+509462us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.705158 (+138026us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.728583 (+ 23425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.732280 12441 tablet_service.cc:1511] Processing CreateTablet for tablet ad1ae772aa48427189cff34a672ae7ea (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:47.732993 12440 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d028731950492fa2b549e869766512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.739187 12669 tablet_service.cc:1511] Processing CreateTablet for tablet 424acb25ab4a4395a267933873286ca0 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:47.745153 12589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611f7e5c6d52455baebc4b6a0b73edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.752164 12666 tablet_service.cc:1511] Processing CreateTablet for tablet e3963dbc730145e2a64c4fac3f70c572 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:47.753784 12518 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 27) took 1066 ms. Trace:
I20260709 13:19:47.757021 12518 rpcz_store.cc:276] 0709 13:19:46.685227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.054540 (+369313us) service_pool.cc:224] Handling call
0709 13:19:47.056447 (+  1907us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.056586 (+   139us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.259915 (+203329us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.687700 (+427785us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.751326 (+ 63626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.763586 12515 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 29) took 1076 ms. Trace:
I20260709 13:19:47.764034 12515 rpcz_store.cc:276] 0709 13:19:46.686733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.089666 (+402933us) service_pool.cc:224] Handling call
0709 13:19:47.305934 (+216268us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b580067da98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b480831 00007fed7b45dac3 00007fed7b40c400 00007fed74891af4 00007fed74891a82 00007fed748919b1
0709 13:19:47.306106 (+   172us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.306224 (+   118us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.624852 (+318628us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.763112 (+138260us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.763521 (+   409us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100012288}
I20260709 13:19:47.765147 12446 tablet_service.cc:1511] Processing CreateTablet for tablet e3963dbc730145e2a64c4fac3f70c572 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:47.766834 12515 tablet_service.cc:1511] Processing CreateTablet for tablet 8359fd6a469b4460a658e1646de646f8 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:19:47.768132 12515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8359fd6a469b4460a658e1646de646f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.776021 12726 tablet_bootstrap.cc:654] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.765676 12727 consensus_queue.cc:260] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:47.784443 12727 ts_tablet_manager.cc:1434] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.149s	user 0.004s	sys 0.004s
I20260709 13:19:47.787117 12514 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 32) took 1098 ms. Trace:
I20260709 13:19:47.807009 12514 rpcz_store.cc:276] 0709 13:19:46.688804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.108807 (+420003us) service_pool.cc:224] Handling call
0709 13:19:47.214336 (+105529us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.220387 (+  6051us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.505367 (+284980us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.786627 (+281260us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.787052 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.812300 12514 tablet_service.cc:1511] Processing CreateTablet for tablet f8219316df3d4ad79c4fbe14bb77376b (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:19:47.813622 12514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8219316df3d4ad79c4fbe14bb77376b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.793684 12669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424acb25ab4a4395a267933873286ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.793327 12518 tablet_service.cc:1511] Processing CreateTablet for tablet 1031c7d22c0645c0b997bb7c66e1f9a4 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:19:47.803793 12588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424acb25ab4a4395a267933873286ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.804965 12730 tablet_bootstrap.cc:492] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:47.790856 12517 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 31) took 1102 ms. Trace:
I20260709 13:19:47.824522 12730 ts_tablet_manager.cc:1403] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.634s	user 0.016s	sys 0.020s
I20260709 13:19:47.844678 12441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1ae772aa48427189cff34a672ae7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.845567 12521 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 28) took 1159 ms. Trace:
I20260709 13:19:47.846024 12521 rpcz_store.cc:276] 0709 13:19:46.686063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.065875 (+379812us) service_pool.cc:224] Handling call
0709 13:19:47.213232 (+147357us) spinlock_profiling.cc:243] Waited 56.3 ms on lock 0x7b580067da98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b480831 00007fed7b45dac3 00007fed7b40c400 00007fed74891af4 00007fed74891a82 00007fed748919b1
0709 13:19:47.302054 (+ 88822us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b580067da98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed73327a5b 00007fed7c240c09 00007fed7b39aee0 00007fed7b480831 00007fed7b45dac3 00007fed7b40c400 00007fed74891af4 00007fed74891a82 00007fed748919b1
0709 13:19:47.337677 (+ 35623us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.337805 (+   128us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.736959 (+399154us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.844954 (+107995us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.845501 (+   547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150572032}
W20260709 13:19:47.847031 12496 consensus_peers.cc:597] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:47.849413 12520 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 33) took 1160 ms. Trace:
I20260709 13:19:47.849879 12520 rpcz_store.cc:276] 0709 13:19:46.689482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.140426 (+450944us) service_pool.cc:224] Handling call
0709 13:19:47.324208 (+183782us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.332071 (+  7863us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.757700 (+425629us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.836401 (+ 78701us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.849351 (+ 12950us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.850961 12355 catalog_manager.cc:5697] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:47.851732 12520 tablet_service.cc:1511] Processing CreateTablet for tablet 611f7e5c6d52455baebc4b6a0b73edd5 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:19:47.853422 12666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3963dbc730145e2a64c4fac3f70c572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.856956 12518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1031c7d22c0645c0b997bb7c66e1f9a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.823424 12517 rpcz_store.cc:276] 0709 13:19:46.688017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.098768 (+410751us) service_pool.cc:224] Handling call
0709 13:19:47.100625 (+  1857us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.100720 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.703999 (+603279us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.790359 (+ 86360us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.790794 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.866110 12523 tablet_service.cc:1511] Processing CreateTablet for tablet e3963dbc730145e2a64c4fac3f70c572 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:19:47.869711 12446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3963dbc730145e2a64c4fac3f70c572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.872121 12444 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43632 (request call id 31) took 1013 ms. Trace:
I20260709 13:19:47.872539 12444 rpcz_store.cc:276] 0709 13:19:46.858553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.291690 (+433137us) service_pool.cc:224] Handling call
0709 13:19:47.294310 (+  2620us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.294408 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.654580 (+360172us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.789256 (+134676us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.803270 (+ 14014us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5800000098. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed733281a2 00007fed7c269bb9 00007fed7b39ad88 00007fed7b461973 00007fed7b45d70f 00007fed7b45decd 00007fed7b40c400 00007fed74891af4 00007fed74891a82
0709 13:19:47.872060 (+ 68790us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26951424}
I20260709 13:19:47.874663 12445 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43632 (request call id 32) took 1015 ms. Trace:
I20260709 13:19:47.875283 12445 rpcz_store.cc:276] 0709 13:19:46.858891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.293220 (+434329us) service_pool.cc:224] Handling call
0709 13:19:47.338649 (+ 45429us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.347656 (+  9007us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.722160 (+374504us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.788214 (+ 66054us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.874582 (+ 86368us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.878336 12727 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:47.880541 12522 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 34) took 1103 ms. Trace:
I20260709 13:19:47.881052 12522 rpcz_store.cc:276] 0709 13:19:46.777195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.302824 (+525629us) service_pool.cc:224] Handling call
0709 13:19:47.337913 (+ 35089us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.347992 (+ 10079us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.775281 (+427289us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.863654 (+ 88373us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.880475 (+ 16821us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:19:47.867298 12520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 611f7e5c6d52455baebc4b6a0b73edd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.889526 12444 tablet_service.cc:1511] Processing CreateTablet for tablet 424acb25ab4a4395a267933873286ca0 (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:19:47.890911 12444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 424acb25ab4a4395a267933873286ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.891848 12516 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:35922 (request call id 30) took 1204 ms. Trace:
I20260709 13:19:47.900035 12774 consensus_queue.cc:1048] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:47.900138 12794 raft_consensus.cc:493] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:47.903228 12794 raft_consensus.cc:515] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:47.905954 12439 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:43632 (request call id 30) took 1047 ms. Trace:
I20260709 13:19:47.906569 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:47.907645 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:47.908188 12570 leader_election.cc:343] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.908288 12458 raft_consensus.cc:2468] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:47.910074 12570 leader_election.cc:304] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:47.892275 12516 rpcz_store.cc:276] 0709 13:19:46.687356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.090058 (+402702us) service_pool.cc:224] Handling call
0709 13:19:47.301406 (+211348us) spinlock_profiling.cc:243] Waited 45.2 ms on lock 0x7b580067da98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed73327a22 00007fed7c240c09 00007fed7b39aee0 00007fed7b480831 00007fed7b45dac3 00007fed7b40c400 00007fed74891af4 00007fed74891a82 00007fed748919b1
0709 13:19:47.334889 (+ 33483us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.337635 (+  2746us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.753268 (+415633us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.891336 (+138068us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.891787 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104001920}
I20260709 13:19:47.911355 12772 raft_consensus.cc:2804] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:47.911089 12794 leader_election.cc:290] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:47.911787 12772 raft_consensus.cc:493] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:47.912187 12772 raft_consensus.cc:3060] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.912525 12730 raft_consensus.cc:359] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:47.913583 12730 raft_consensus.cc:385] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:47.916379 12523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3963dbc730145e2a64c4fac3f70c572. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.913990 12730 raft_consensus.cc:740] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
W20260709 13:19:47.900622 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:47.931315 12772 raft_consensus.cc:515] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:47.949957 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:47.951211 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
W20260709 13:19:47.951464 12570 leader_election.cc:343] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:47.951822 12458 raft_consensus.cc:3060] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:47.914983 12439 rpcz_store.cc:276] 0709 13:19:46.858035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.252909 (+394874us) service_pool.cc:224] Handling call
0709 13:19:47.315265 (+ 62356us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.315358 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.766341 (+450983us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.783642 (+ 17301us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.905446 (+121804us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b5800000098. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327b71 00007fed733281a2 00007fed7c269bb9 00007fed7b39ad88 00007fed7b461973 00007fed7b45d70f 00007fed7b45decd 00007fed7b40c400 00007fed74891af4 00007fed74891a82
0709 13:19:47.905871 (+   425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41729280}
I20260709 13:19:47.954936 12521 tablet_service.cc:1511] Processing CreateTablet for tablet ad1ae772aa48427189cff34a672ae7ea (DEFAULT_TABLE table=test-workload [id=11b045c6e93540ff8f744e2c4bd72eef]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:19:47.955955 12521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad1ae772aa48427189cff34a672ae7ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:19:47.959582 12458 raft_consensus.cc:2468] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:47.961401 12570 leader_election.cc:304] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:47.962884 12771 raft_consensus.cc:2804] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:47.963443 12771 raft_consensus.cc:697] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:47.964257 12771 consensus_queue.cc:237] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:47.945880 12725 tablet_bootstrap.cc:654] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:47.965092 12730 consensus_queue.cc:260] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:47.967500 12730 ts_tablet_manager.cc:1434] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.132s	user 0.007s	sys 0.001s
I20260709 13:19:47.968881 12772 leader_election.cc:290] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:47.974576 12592 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:34118 (request call id 33) took 1276 ms. Trace:
I20260709 13:19:47.977691 12592 rpcz_store.cc:276] 0709 13:19:46.697805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:19:47.050946 (+353141us) service_pool.cc:224] Handling call
0709 13:19:47.161420 (+110474us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b5800561f98. stack: 00007fed7332d343 00007fed7332d240 00007fed72cbc1d4 00007fed7c9fa304 00007fed7c9fa299 00007fed731e7db1 00007fed73327e9c 00007fed73327a5b 00007fed7c240c09 00007fed7b39aee0 00007fed7b480831 00007fed7b45dac3 00007fed7b40c400 00007fed74891af4 00007fed74891a82 00007fed748919b1
0709 13:19:47.218110 (+ 56690us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:19:47.221147 (+  3037us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:19:47.608725 (+387578us) tablet_metadata.cc:665] Metadata flushed
0709 13:19:47.974102 (+365377us) tablet_replica.cc:206] Creating consensus instance
0709 13:19:47.974519 (+   417us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24859392}
I20260709 13:19:47.996024 12726 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.009737 12726 ts_tablet_manager.cc:1403] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.457s	user 0.021s	sys 0.019s
I20260709 13:19:47.997138 12727 tablet_bootstrap.cc:654] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.001922 12730 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:48.022014 12726 raft_consensus.cc:359] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.022867 12726 raft_consensus.cc:385] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.023185 12726 raft_consensus.cc:740] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.023316 12725 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.024022 12725 ts_tablet_manager.cc:1403] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.313s	user 0.024s	sys 0.003s
I20260709 13:19:48.024236 12726 consensus_queue.cc:260] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.027380 12726 ts_tablet_manager.cc:1434] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:19:48.027472 12725 raft_consensus.cc:359] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.028292 12725 raft_consensus.cc:385] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.028502 12725 raft_consensus.cc:740] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.032671 12353 catalog_manager.cc:5697] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.034898 12726 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.032748 12725 consensus_queue.cc:260] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.038117 12733 raft_consensus.cc:493] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.038671 12733 raft_consensus.cc:515] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.042492 12733 leader_election.cc:290] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.043129 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9742746d5449a9a172aee8c6d76947" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.044100 12607 raft_consensus.cc:2468] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:48.045469 12725 ts_tablet_manager.cc:1434] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.021s	user 0.001s	sys 0.009s
I20260709 13:19:48.045763 12498 leader_election.cc:304] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.046638 12725 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.047398 12733 raft_consensus.cc:2804] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.047832 12733 raft_consensus.cc:493] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.038065 12730 tablet_bootstrap.cc:654] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.042649 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9742746d5449a9a172aee8c6d76947" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.048885 12458 raft_consensus.cc:2468] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:48.048200 12733 raft_consensus.cc:3060] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.052692 12727 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.053252 12727 ts_tablet_manager.cc:1403] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.175s	user 0.014s	sys 0.009s
I20260709 13:19:48.058198 12733 raft_consensus.cc:515] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.059199 12727 raft_consensus.cc:359] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.059841 12774 raft_consensus.cc:493] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.060390 12726 tablet_bootstrap.cc:654] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.060684 12725 tablet_bootstrap.cc:654] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.060382 12774 raft_consensus.cc:515] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.062705 12774 leader_election.cc:290] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.062979 12730 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:48.063555 12730 ts_tablet_manager.cc:1403] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.002s
I20260709 13:19:48.064700 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6c218527eb41bea885fbf10aa66427" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.067178 12730 raft_consensus.cc:359] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.067094 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6c218527eb41bea885fbf10aa66427" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.060041 12727 raft_consensus.cc:385] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:48.067939 12496 leader_election.cc:343] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.068892 12727 raft_consensus.cc:740] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.069943 12727 consensus_queue.cc:260] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:48.070394 12498 leader_election.cc:343] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.070928 12498 leader_election.cc:304] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.071797 12774 raft_consensus.cc:2749] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.073937 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9742746d5449a9a172aee8c6d76947" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:48.074615 12458 raft_consensus.cc:3060] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.079175 12796 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.079895 12796 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.084213 12727 ts_tablet_manager.cc:1434] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:19:48.068027 12730 raft_consensus.cc:385] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.087543 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:48.089408 12424 leader_election.cc:343] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.084542 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.090939 12680 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:48.092564 12421 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:48.094208 12784 raft_consensus.cc:2804] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.094638 12784 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.094966 12784 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.095444 12727 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.095803 12730 raft_consensus.cc:740] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.097500 12730 consensus_queue.cc:260] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.099817 12730 ts_tablet_manager.cc:1434] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:19:48.101904 12796 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:48.104938 12730 tablet_bootstrap.cc:492] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:48.107066 12727 tablet_bootstrap.cc:654] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.112027 12730 tablet_bootstrap.cc:654] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.115307 12725 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.115955 12725 ts_tablet_manager.cc:1403] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.032s
I20260709 13:19:48.119331 12725 raft_consensus.cc:359] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.124363 12725 raft_consensus.cc:385] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.124673 12765 consensus_queue.cc:1048] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.126804 12727 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.127385 12727 ts_tablet_manager.cc:1403] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.001s
I20260709 13:19:48.128600 12457 raft_consensus.cc:3060] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.129598 12784 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.130919 12727 raft_consensus.cc:359] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.131695 12727 raft_consensus.cc:385] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.132023 12727 raft_consensus.cc:740] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.132746 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:48.124742 12725 raft_consensus.cc:740] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.133172 12727 consensus_queue.cc:260] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.134039 12725 consensus_queue.cc:260] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.136996 12680 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.145328 12727 ts_tablet_manager.cc:1434] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:19:48.148126 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9742746d5449a9a172aee8c6d76947" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:48.148272 12680 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:48.147162 12733 leader_election.cc:290] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.136605 12725 ts_tablet_manager.cc:1434] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.002s
I20260709 13:19:48.150432 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:48.151469 12725 tablet_bootstrap.cc:492] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.146093 12458 raft_consensus.cc:2468] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:48.148748 12607 raft_consensus.cc:3060] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.152837 12496 leader_election.cc:304] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.154414 12733 raft_consensus.cc:2804] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.155141 12733 raft_consensus.cc:697] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
W20260709 13:19:48.151636 12424 leader_election.cc:343] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.157377 12733 consensus_queue.cc:237] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.157785 12421 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:48.158741 12796 raft_consensus.cc:2804] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.159478 12796 raft_consensus.cc:697] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:48.159444 12607 raft_consensus.cc:2468] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:48.149434 12727 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.160697 12796 consensus_queue.cc:237] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.164350 12725 tablet_bootstrap.cc:654] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.149879 12784 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:48.171195 12772 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.169760 12730 tablet_bootstrap.cc:492] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:48.172367 12772 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.176360 12772 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:48.177534 12730 ts_tablet_manager.cc:1403] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.000s
I20260709 13:19:48.176606 12726 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.181844 12726 ts_tablet_manager.cc:1403] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.147s	user 0.064s	sys 0.054s
I20260709 13:19:48.182204 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.183120 12765 raft_consensus.cc:493] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.183785 12765 raft_consensus.cc:515] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.183961 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:19:48.186467 12570 leader_election.cc:343] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.187870 12765 leader_election.cc:290] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.189612 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9710dd994b40c18e7d33112d946085" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.196336 12726 raft_consensus.cc:359] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.197288 12726 raft_consensus.cc:385] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:48.197355 12570 leader_election.cc:343] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.197729 12726 raft_consensus.cc:740] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.197908 12570 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.203800 12772 raft_consensus.cc:2749] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.205475 12726 consensus_queue.cc:260] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.207674 12727 tablet_bootstrap.cc:654] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.210505 12726 ts_tablet_manager.cc:1434] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:19:48.217815 12726 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.222693 12354 catalog_manager.cc:5697] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.223680 12730 raft_consensus.cc:359] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.224416 12730 raft_consensus.cc:385] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.224710 12730 raft_consensus.cc:740] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.225570 12730 consensus_queue.cc:260] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.228507 12457 raft_consensus.cc:3060] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.219223 12765 consensus_queue.cc:1048] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:48.230188 12725 tablet_bootstrap.cc:492] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.230880 12725 ts_tablet_manager.cc:1403] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.080s	user 0.028s	sys 0.027s
I20260709 13:19:48.240986 12725 raft_consensus.cc:359] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.241693 12725 raft_consensus.cc:385] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.241962 12725 raft_consensus.cc:740] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.242645 12725 consensus_queue.cc:260] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.252233 12725 ts_tablet_manager.cc:1434] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:19:48.253661 12725 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.256660 12355 catalog_manager.cc:5697] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:48.264014 12726 tablet_bootstrap.cc:654] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.267261 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa9710dd994b40c18e7d33112d946085" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.269093 12646 leader_election.cc:304] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:48.270531 12765 raft_consensus.cc:2749] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.271108 12725 tablet_bootstrap.cc:654] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.272717 12727 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.273260 12727 ts_tablet_manager.cc:1403] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.124s	user 0.030s	sys 0.010s
I20260709 13:19:48.276206 12727 raft_consensus.cc:359] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.276930 12727 raft_consensus.cc:385] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.277204 12727 raft_consensus.cc:740] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.277976 12727 consensus_queue.cc:260] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.280002 12727 ts_tablet_manager.cc:1434] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:19:48.280967 12727 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.281498 12726 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.282122 12726 ts_tablet_manager.cc:1403] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.013s
I20260709 13:19:48.285209 12726 raft_consensus.cc:359] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.286264 12726 raft_consensus.cc:385] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.286557 12726 raft_consensus.cc:740] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.289044 12726 consensus_queue.cc:260] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.291504 12726 ts_tablet_manager.cc:1434] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:19:48.292754 12726 tablet_bootstrap.cc:492] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.294531 12727 tablet_bootstrap.cc:654] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.294965 12725 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.288334 12730 ts_tablet_manager.cc:1434] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 13:19:48.298533 12726 tablet_bootstrap.cc:654] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.298707 12730 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:48.302763 12725 ts_tablet_manager.cc:1403] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.005s
I20260709 13:19:48.308792 12730 tablet_bootstrap.cc:654] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.316458 12726 tablet_bootstrap.cc:492] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.317214 12726 ts_tablet_manager.cc:1403] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.011s
I20260709 13:19:48.319023 12725 raft_consensus.cc:359] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.319815 12725 raft_consensus.cc:385] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.320101 12725 raft_consensus.cc:740] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.321192 12725 consensus_queue.cc:260] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.324143 12726 raft_consensus.cc:359] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.326246 12727 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.326956 12727 ts_tablet_manager.cc:1403] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.010s
I20260709 13:19:48.329605 12727 raft_consensus.cc:359] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.330346 12727 raft_consensus.cc:385] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.330650 12727 raft_consensus.cc:740] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.331697 12727 consensus_queue.cc:260] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.333169 12725 ts_tablet_manager.cc:1434] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:19:48.333863 12727 ts_tablet_manager.cc:1434] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:48.334340 12725 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.330999 12726 raft_consensus.cc:385] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.335067 12726 raft_consensus.cc:740] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.335914 12726 consensus_queue.cc:260] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.337656 12765 raft_consensus.cc:493] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.338145 12765 raft_consensus.cc:515] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.340268 12765 leader_election.cc:290] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.341888 12725 tablet_bootstrap.cc:654] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.342712 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6c218527eb41bea885fbf10aa66427" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.343135 12726 ts_tablet_manager.cc:1434] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:19:48.341856 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6c218527eb41bea885fbf10aa66427" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.344002 12727 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.344139 12532 raft_consensus.cc:2468] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:48.346179 12647 leader_election.cc:304] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.347149 12765 raft_consensus.cc:2804] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.347549 12765 raft_consensus.cc:493] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.347879 12765 raft_consensus.cc:3060] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.350302 12680 raft_consensus.cc:3060] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.352300 12727 tablet_bootstrap.cc:654] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.343422 12607 raft_consensus.cc:2468] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:48.344780 12726 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.362310 12733 raft_consensus.cc:493] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.362954 12733 raft_consensus.cc:515] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.365550 12733 leader_election.cc:290] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:48.367087 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af86257960744ce4a2cfb315fb7d5138" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.367856 12457 raft_consensus.cc:2468] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:48.370162 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af86257960744ce4a2cfb315fb7d5138" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.370388 12496 leader_election.cc:304] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.370926 12681 raft_consensus.cc:2468] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:48.369976 12765 raft_consensus.cc:515] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.372726 12726 tablet_bootstrap.cc:654] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.373365 12733 raft_consensus.cc:2804] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.374841 12765 leader_election.cc:290] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.375705 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6c218527eb41bea885fbf10aa66427" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:48.375952 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc6c218527eb41bea885fbf10aa66427" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:48.376410 12532 raft_consensus.cc:3060] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.376562 12607 raft_consensus.cc:3060] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.374053 12733 raft_consensus.cc:493] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.378094 12733 raft_consensus.cc:3060] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.378268 12727 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.378894 12727 ts_tablet_manager.cc:1403] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.012s
I20260709 13:19:48.381575 12727 raft_consensus.cc:359] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.382367 12727 raft_consensus.cc:385] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.382687 12727 raft_consensus.cc:740] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.383476 12727 consensus_queue.cc:260] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.383930 12607 raft_consensus.cc:2468] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:48.385228 12646 leader_election.cc:304] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:48.386207 12765 raft_consensus.cc:2804] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.386170 12772 consensus_queue.cc:1048] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.387768 12765 raft_consensus.cc:697] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:48.388660 12765 consensus_queue.cc:237] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.394696 12727 ts_tablet_manager.cc:1434] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:19:48.404469 12727 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.344970 12730 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:48.405864 12730 ts_tablet_manager.cc:1403] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.107s	user 0.019s	sys 0.015s
I20260709 13:19:48.410715 12727 tablet_bootstrap.cc:654] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.412340 12356 catalog_manager.cc:5697] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.423552 12772 consensus_queue.cc:1048] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.424157 12725 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.424932 12725 ts_tablet_manager.cc:1403] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.091s	user 0.037s	sys 0.048s
I20260709 13:19:48.427585 12725 raft_consensus.cc:359] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.428233 12725 raft_consensus.cc:385] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.428485 12725 raft_consensus.cc:740] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.429288 12725 consensus_queue.cc:260] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.431528 12725 ts_tablet_manager.cc:1434] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 13:19:48.432647 12725 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.438242 12725 tablet_bootstrap.cc:654] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.452427 12727 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.453342 12727 ts_tablet_manager.cc:1403] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.049s	user 0.015s	sys 0.009s
I20260709 13:19:48.454917 12725 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.455451 12725 ts_tablet_manager.cc:1403] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 13:19:48.456573 12727 raft_consensus.cc:359] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.462016 12727 raft_consensus.cc:385] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.462306 12727 raft_consensus.cc:740] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.463251 12727 consensus_queue.cc:260] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.458071 12725 raft_consensus.cc:359] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.469617 12725 raft_consensus.cc:385] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.469960 12725 raft_consensus.cc:740] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.470741 12725 consensus_queue.cc:260] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.471473 12681 raft_consensus.cc:3060] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.473016 12725 ts_tablet_manager.cc:1434] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:19:48.474282 12725 tablet_bootstrap.cc:492] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.458613 12532 raft_consensus.cc:2468] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:48.459897 12730 raft_consensus.cc:359] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.479974 12730 raft_consensus.cc:385] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.484645 12730 raft_consensus.cc:740] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.484928 12733 raft_consensus.cc:515] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.485446 12730 consensus_queue.cc:260] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.480713 12725 tablet_bootstrap.cc:654] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.487854 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af86257960744ce4a2cfb315fb7d5138" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:48.488456 12680 raft_consensus.cc:3060] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.488646 12733 leader_election.cc:290] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:48.488813 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af86257960744ce4a2cfb315fb7d5138" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:48.489475 12458 raft_consensus.cc:3060] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.482201 12727 ts_tablet_manager.cc:1434] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 13:19:48.493716 12727 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.484164 12726 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.498234 12726 ts_tablet_manager.cc:1403] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.154s	user 0.028s	sys 0.050s
I20260709 13:19:48.494376 12680 raft_consensus.cc:2468] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:48.501950 12496 leader_election.cc:304] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.501300 12726 raft_consensus.cc:359] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.502969 12726 raft_consensus.cc:385] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.502827 12774 raft_consensus.cc:493] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.503572 12774 raft_consensus.cc:515] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.504339 12733 raft_consensus.cc:2804] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.505697 12774 leader_election.cc:290] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.506906 12772 raft_consensus.cc:493] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.506799 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9667dd4e5324ecda6b4dead6bff47de" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.507474 12772 raft_consensus.cc:515] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:48.508548 12498 leader_election.cc:343] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.509503 12772 leader_election.cc:290] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:48.510063 12726 raft_consensus.cc:740] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.510792 12726 consensus_queue.cc:260] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.512362 12726 ts_tablet_manager.cc:1434] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.002s
I20260709 13:19:48.512467 12679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9667dd4e5324ecda6b4dead6bff47de" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.513088 12730 ts_tablet_manager.cc:1434] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 13:19:48.514178 12730 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:48.514935 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b491a2c8e034b4198ba19e2c8fe49fc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.515573 12532 raft_consensus.cc:2468] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
W20260709 13:19:48.515975 12496 leader_election.cc:343] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.516651 12496 leader_election.cc:304] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.519119 12726 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.514935 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b491a2c8e034b4198ba19e2c8fe49fc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.520382 12457 raft_consensus.cc:2468] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:48.522128 12774 raft_consensus.cc:2749] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.519356 12573 leader_election.cc:304] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.524820 12772 raft_consensus.cc:2804] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.525259 12727 tablet_bootstrap.cc:654] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.525198 12772 raft_consensus.cc:493] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.525728 12772 raft_consensus.cc:3060] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.526839 12725 tablet_bootstrap.cc:492] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.527359 12725 ts_tablet_manager.cc:1403] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.002s
I20260709 13:19:48.497254 12458 raft_consensus.cc:2468] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:48.529383 12730 tablet_bootstrap.cc:654] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.530189 12725 raft_consensus.cc:359] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.531133 12725 raft_consensus.cc:385] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.531407 12725 raft_consensus.cc:740] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.532701 12725 consensus_queue.cc:260] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.534725 12725 ts_tablet_manager.cc:1434] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:19:48.531589 12726 tablet_bootstrap.cc:654] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.536484 12733 raft_consensus.cc:697] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:48.537424 12733 consensus_queue.cc:237] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.540212 12771 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.540715 12771 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.542888 12771 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:48.542786 12727 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.544898 12727 ts_tablet_manager.cc:1403] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 13:19:48.545678 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:19:48.548095 12570 leader_election.cc:343] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.547950 12727 raft_consensus.cc:359] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.548863 12727 raft_consensus.cc:385] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.549219 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.549170 12727 raft_consensus.cc:740] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
W20260709 13:19:48.550647 12570 leader_election.cc:343] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.551131 12570 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.551180 12727 consensus_queue.cc:260] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.552095 12771 raft_consensus.cc:2749] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:48.553762 12772 raft_consensus.cc:515] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.554915 12727 ts_tablet_manager.cc:1434] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:48.558583 12726 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.559082 12726 ts_tablet_manager.cc:1403] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.005s
I20260709 13:19:48.559470 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b491a2c8e034b4198ba19e2c8fe49fc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:48.560216 12458 raft_consensus.cc:3060] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.562083 12726 raft_consensus.cc:359] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.562754 12726 raft_consensus.cc:385] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.563023 12726 raft_consensus.cc:740] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.564257 12727 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.555614 12354 catalog_manager.cc:5697] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.570683 12730 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:48.571218 12730 ts_tablet_manager.cc:1403] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.001s
I20260709 13:19:48.572719 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b491a2c8e034b4198ba19e2c8fe49fc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:48.573551 12532 raft_consensus.cc:3060] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.575830 12796 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.576308 12796 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.577903 12725 tablet_bootstrap.cc:492] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.578344 12796 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.579274 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.579447 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.574915 12726 consensus_queue.cc:260] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.580106 12680 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:48.580050 12607 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:48.581509 12421 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:48.582296 12796 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.582650 12796 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.583086 12796 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.587442 12531 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.587917 12725 tablet_bootstrap.cc:654] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.590838 12796 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.602711 12733 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.603327 12733 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.574126 12730 raft_consensus.cc:359] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.604130 12730 raft_consensus.cc:385] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.604451 12730 raft_consensus.cc:740] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.605201 12730 consensus_queue.cc:260] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.607012 12726 ts_tablet_manager.cc:1434] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.001s
I20260709 13:19:48.608151 12726 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.610747 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.611471 12680 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:48.612828 12496 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.614058 12834 raft_consensus.cc:2804] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:48.614552 12730 ts_tablet_manager.cc:1434] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:19:48.614090 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.614745 12834 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.616564 12834 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:48.621348 12727 tablet_bootstrap.cc:654] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.624893 12730 tablet_bootstrap.cc:492] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:48.625735 12772 leader_election.cc:290] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:48.626523 12784 consensus_queue.cc:1048] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.624228 12834 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.631582 12784 consensus_queue.cc:1048] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.632099 12679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:48.632222 12834 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:48.634624 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:48.636094 12607 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.638267 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:48.640599 12531 raft_consensus.cc:1240] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Rejecting Update request from peer 6b0179dde0454d1e819be37e79c733af for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:19:48.641005 12796 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.643131 12726 tablet_bootstrap.cc:654] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.644433 12458 raft_consensus.cc:2468] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:48.614244 12733 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:48.650667 12607 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:48.645414 12785 consensus_queue.cc:1059] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:48.651567 12532 raft_consensus.cc:2468] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:48.652290 12785 raft_consensus.cc:3055] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:48.652413 12423 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:19:48.644714 12496 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.652951 12573 leader_election.cc:304] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.653875 12774 raft_consensus.cc:2749] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:19:48.654266 12772 raft_consensus.cc:2804] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.654778 12772 raft_consensus.cc:697] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:48.653467 12784 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:48.655622 12772 consensus_queue.cc:237] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.652707 12785 raft_consensus.cc:740] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:48.655963 12784 raft_consensus.cc:697] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:48.657464 12785 consensus_queue.cc:260] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.657501 12784 consensus_queue.cc:237] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.658727 12785 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:48.647032 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:48.663401 12681 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.666728 12733 consensus_queue.cc:1048] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:48.671476 12727 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.672130 12727 ts_tablet_manager.cc:1403] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.108s	user 0.012s	sys 0.000s
I20260709 13:19:48.676932 12727 raft_consensus.cc:359] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.677892 12725 tablet_bootstrap.cc:492] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.678743 12725 ts_tablet_manager.cc:1403] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.101s	user 0.028s	sys 0.023s
I20260709 13:19:48.682641 12725 raft_consensus.cc:359] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.683516 12725 raft_consensus.cc:385] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.683805 12725 raft_consensus.cc:740] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.662487 12730 tablet_bootstrap.cc:654] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.677882 12727 raft_consensus.cc:385] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.685168 12727 raft_consensus.cc:740] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.685982 12727 consensus_queue.cc:260] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.684569 12725 consensus_queue.cc:260] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.690546 12725 ts_tablet_manager.cc:1434] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:48.691800 12725 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.694672 12727 ts_tablet_manager.cc:1434] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 13:19:48.696036 12727 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.700845 12725 tablet_bootstrap.cc:654] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.711854 12727 tablet_bootstrap.cc:654] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.712193 12774 consensus_queue.cc:1048] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.701005 12681 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:48.714257 12726 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.714975 12726 ts_tablet_manager.cc:1403] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.107s	user 0.022s	sys 0.022s
I20260709 13:19:48.716315 12356 catalog_manager.cc:5697] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.718849 12726 raft_consensus.cc:359] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.727916 12726 raft_consensus.cc:385] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.728371 12726 raft_consensus.cc:740] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.720780 12353 catalog_manager.cc:5697] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:48.725028 12772 raft_consensus.cc:493] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.725724 12771 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.729300 12726 consensus_queue.cc:260] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.732257 12726 ts_tablet_manager.cc:1434] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:19:48.733355 12726 tablet_bootstrap.cc:492] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:48.739818 12726 tablet_bootstrap.cc:654] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.744343 12771 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.746980 12771 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:48.749814 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.760165 12532 raft_consensus.cc:2468] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:48.762058 12573 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.774173 12785 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.775803 12785 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.778002 12785 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.785933 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.790314 12532 raft_consensus.cc:2468] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:48.784915 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.791770 12606 raft_consensus.cc:2468] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:48.792786 12424 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:48.750576 12772 raft_consensus.cc:515] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.783051 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.795624 12785 raft_consensus.cc:2804] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.797309 12785 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.797648 12785 raft_consensus.cc:3060] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.799784 12772 leader_election.cc:290] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.800128 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9667dd4e5324ecda6b4dead6bff47de" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.800381 12772 raft_consensus.cc:2804] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.802102 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9667dd4e5324ecda6b4dead6bff47de" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.802754 12531 raft_consensus.cc:2468] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
W20260709 13:19:48.804039 12570 leader_election.cc:343] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.805568 12573 leader_election.cc:304] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.806628 12730 tablet_bootstrap.cc:492] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:48.807179 12730 ts_tablet_manager.cc:1403] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.008s
I20260709 13:19:48.810025 12730 raft_consensus.cc:359] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.810751 12730 raft_consensus.cc:385] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.811014 12730 raft_consensus.cc:740] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.811794 12730 consensus_queue.cc:260] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.816164 12785 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:48.818053 12457 raft_consensus.cc:2393] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:48.821198 12785 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:48.821885 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:48.824107 12765 raft_consensus.cc:493] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.824821 12765 raft_consensus.cc:515] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.825290 12794 raft_consensus.cc:2804] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.825762 12794 raft_consensus.cc:493] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.826088 12794 raft_consensus.cc:3060] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.827760 12765 leader_election.cc:290] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:48.830433 12785 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.830919 12785 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.831686 12730 ts_tablet_manager.cc:1434] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:19:48.832172 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835464d15acb4280aa3484ff857fbbd0" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.832737 12730 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:48.834273 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:48.833096 12785 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.834201 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.835031 12607 raft_consensus.cc:2468] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
W20260709 13:19:48.836004 12421 leader_election.cc:343] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:48.836730 12423 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:48.837862 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835464d15acb4280aa3484ff857fbbd0" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:48.820914 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:48.838603 12457 raft_consensus.cc:2468] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:48.832832 12531 raft_consensus.cc:2468] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:48.839725 12644 leader_election.cc:304] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:48.840492 12765 raft_consensus.cc:2804] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.840871 12765 raft_consensus.cc:493] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.841212 12765 raft_consensus.cc:3060] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.841619 12532 raft_consensus.cc:3060] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.842496 12730 tablet_bootstrap.cc:654] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:48.815833 12772 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.843225 12772 raft_consensus.cc:3060] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.847173 12785 raft_consensus.cc:2804] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:48.855912 12785 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:48.881166 12785 raft_consensus.cc:3060] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:48.900660 12814 consensus_queue.cc:1048] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:48.903725 12725 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:48.904248 12725 ts_tablet_manager.cc:1403] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.213s	user 0.047s	sys 0.023s
I20260709 13:19:48.930541 12727 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:48.931267 12727 ts_tablet_manager.cc:1403] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.235s	user 0.058s	sys 0.063s
I20260709 13:19:48.933391 12726 tablet_bootstrap.cc:492] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:48.933992 12726 ts_tablet_manager.cc:1403] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.201s	user 0.012s	sys 0.016s
I20260709 13:19:48.937311 12771 raft_consensus.cc:493] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:48.945384 12771 raft_consensus.cc:515] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:48.951699 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:48.955013 12727 raft_consensus.cc:359] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.955821 12727 raft_consensus.cc:385] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.956069 12727 raft_consensus.cc:740] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.959075 12727 consensus_queue.cc:260] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:48.973242 12771 leader_election.cc:290] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:48.974045 12725 raft_consensus.cc:359] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.974907 12725 raft_consensus.cc:385] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:48.975183 12725 raft_consensus.cc:740] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:48.975956 12725 consensus_queue.cc:260] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.978811 12725 ts_tablet_manager.cc:1434] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.009s
I20260709 13:19:48.982642 12727 ts_tablet_manager.cc:1434] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:19:48.984580 12727 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:48.989684 12853 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:48.984362 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 101889us
I20260709 13:19:48.990192 12853 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:48.992589 12725 tablet_bootstrap.cc:492] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:48.992241 12794 raft_consensus.cc:515] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.993767 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c20adb4d124ae681d4c43be777969e" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:48.987360 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c20adb4d124ae681d4c43be777969e" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:48.992209 12853 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:49.002852 12785 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.007150 12726 raft_consensus.cc:359] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.008030 12726 raft_consensus.cc:385] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.010407 12726 raft_consensus.cc:740] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.013710 12726 consensus_queue.cc:260] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:48.992126 12772 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.017776 12606 raft_consensus.cc:2393] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:49.018585 12726 ts_tablet_manager.cc:1434] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.003s
I20260709 13:19:49.019872 12730 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.020468 12730 ts_tablet_manager.cc:1403] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.188s	user 0.054s	sys 0.087s
I20260709 13:19:49.021179 12726 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.016927 12814 consensus_queue.cc:1048] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:49.018878 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.024114 12772 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.025719 12531 raft_consensus.cc:2468] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:49.028823 12733 consensus_queue.cc:1048] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.028470 12727 tablet_bootstrap.cc:654] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.010129 12532 raft_consensus.cc:2468] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:49.030275 12726 tablet_bootstrap.cc:654] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.036743 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.040954 12730 raft_consensus.cc:359] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.041930 12730 raft_consensus.cc:385] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.042233 12730 raft_consensus.cc:740] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.042905 12730 consensus_queue.cc:260] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.050232 12725 tablet_bootstrap.cc:654] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.036895 12573 leader_election.cc:304] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
W20260709 13:19:49.052086 12570 leader_election.cc:343] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.052577 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:49.053328 12681 raft_consensus.cc:3060] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.055711 12772 raft_consensus.cc:2804] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.056178 12772 raft_consensus.cc:493] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.056519 12772 raft_consensus.cc:3060] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.036548 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:49.057236 12606 raft_consensus.cc:3060] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:49.058723 12570 leader_election.cc:343] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.031666 12785 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.061672 12730 ts_tablet_manager.cc:1434] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 13:19:49.063051 12730 tablet_bootstrap.cc:492] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
W20260709 13:19:49.065297 12570 leader_election.cc:343] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.066249 12570 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:49.060642 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:49.069212 12853 raft_consensus.cc:2749] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.075098 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:49.075948 12532 raft_consensus.cc:2393] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:49.076993 12457 raft_consensus.cc:2393] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:49.078176 12424 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:49.045264 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9667dd4e5324ecda6b4dead6bff47de" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:49.079196 12530 raft_consensus.cc:3060] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.080013 12784 raft_consensus.cc:2804] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.069767 12794 leader_election.cc:290] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.082286 12765 raft_consensus.cc:515] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.084350 12765 leader_election.cc:290] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.080551 12784 raft_consensus.cc:697] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:49.085748 12784 consensus_queue.cc:237] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.087072 12730 tablet_bootstrap.cc:654] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.087934 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835464d15acb4280aa3484ff857fbbd0" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:49.088517 12532 raft_consensus.cc:3060] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.087033 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "835464d15acb4280aa3484ff857fbbd0" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:49.096717 12606 raft_consensus.cc:2468] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:49.106324 12570 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.111028 12423 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:19:49.109120 12457 raft_consensus.cc:3060] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.111963 12771 raft_consensus.cc:2749] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.108290 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9667dd4e5324ecda6b4dead6bff47de" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:49.113718 12680 raft_consensus.cc:3060] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.111963 12785 raft_consensus.cc:2804] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.114980 12785 raft_consensus.cc:697] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:49.115936 12785 consensus_queue.cc:237] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.121634 12772 raft_consensus.cc:515] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.123822 12772 leader_election.cc:290] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.125979 12774 consensus_queue.cc:1048] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.126456 12530 raft_consensus.cc:2468] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:49.127159 12727 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.128194 12727 ts_tablet_manager.cc:1403] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.145s	user 0.020s	sys 0.020s
I20260709 13:19:49.127496 12532 raft_consensus.cc:2468] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:49.126919 12679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c20adb4d124ae681d4c43be777969e" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:49.133075 12647 leader_election.cc:304] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:49.133737 12573 leader_election.cc:304] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:49.134181 12772 consensus_queue.cc:1048] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.134598 12794 raft_consensus.cc:2804] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.134785 12857 raft_consensus.cc:2804] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.135361 12794 raft_consensus.cc:697] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:49.135600 12857 raft_consensus.cc:697] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:49.136348 12794 consensus_queue.cc:237] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.136521 12857 consensus_queue.cc:237] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:19:49.133500 12570 leader_election.cc:343] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.147712 12680 raft_consensus.cc:2468] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:49.154911 12730 tablet_bootstrap.cc:492] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.155508 12730 ts_tablet_manager.cc:1403] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.003s
I20260709 13:19:49.155746 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c20adb4d124ae681d4c43be777969e" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:49.156395 12532 raft_consensus.cc:3060] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.161978 12355 catalog_manager.cc:5697] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.166769 12730 raft_consensus.cc:359] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.167472 12730 raft_consensus.cc:385] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.167737 12730 raft_consensus.cc:740] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.162745 12784 consensus_queue.cc:1048] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:19:49.168385 12730 consensus_queue.cc:260] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.172160 12796 consensus_queue.cc:1048] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.109714 12681 raft_consensus.cc:2468] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:49.131327 12727 raft_consensus.cc:359] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.177232 12727 raft_consensus.cc:385] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.177614 12730 ts_tablet_manager.cc:1434] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:19:49.179224 12727 raft_consensus.cc:740] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.181178 12727 consensus_queue.cc:260] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.179764 12730 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.193372 12726 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.194419 12726 ts_tablet_manager.cc:1403] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.175s	user 0.009s	sys 0.013s
I20260709 13:19:49.178601 12457 raft_consensus.cc:2468] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:49.203681 12725 tablet_bootstrap.cc:492] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.204145 12725 ts_tablet_manager.cc:1403] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.015s
I20260709 13:19:49.209995 12727 ts_tablet_manager.cc:1434] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.003s
I20260709 13:19:49.210958 12727 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.215749 12730 tablet_bootstrap.cc:654] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.219524 12727 tablet_bootstrap.cc:654] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.222924 12772 consensus_queue.cc:1048] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.226389 12725 raft_consensus.cc:359] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.227067 12725 raft_consensus.cc:385] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.227329 12725 raft_consensus.cc:740] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.228030 12725 consensus_queue.cc:260] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.236526 12726 raft_consensus.cc:359] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.237320 12726 raft_consensus.cc:385] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.237612 12726 raft_consensus.cc:740] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.237839 12725 ts_tablet_manager.cc:1434] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 13:19:49.238340 12726 consensus_queue.cc:260] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.240453 12353 catalog_manager.cc:5697] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.238826 12725 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.248178 12532 raft_consensus.cc:2468] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:49.241156 12726 ts_tablet_manager.cc:1434] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.002s
I20260709 13:19:49.254074 12726 tablet_bootstrap.cc:492] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.261726 12573 leader_election.cc:304] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:49.262583 12354 catalog_manager.cc:5697] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.263347 12853 raft_consensus.cc:2804] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.263983 12853 raft_consensus.cc:697] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:49.264859 12853 consensus_queue.cc:237] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.272536 12725 tablet_bootstrap.cc:654] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.276676 12726 tablet_bootstrap.cc:654] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.285591 12355 catalog_manager.cc:5697] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.287959 12794 raft_consensus.cc:493] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.288580 12794 raft_consensus.cc:515] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.291317 12794 leader_election.cc:290] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.292557 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:49.292469 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:19:49.294196 12573 leader_election.cc:343] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:49.294981 12570 leader_election.cc:343] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.295454 12570 leader_election.cc:304] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.301697 12730 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.302248 12730 ts_tablet_manager.cc:1403] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.032s
I20260709 13:19:49.303215 12727 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.303797 12727 ts_tablet_manager.cc:1403] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.020s
I20260709 13:19:49.305099 12730 raft_consensus.cc:359] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.305788 12730 raft_consensus.cc:385] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.306047 12730 raft_consensus.cc:740] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.296584 12794 raft_consensus.cc:2749] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.307051 12730 consensus_queue.cc:260] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.309463 12730 ts_tablet_manager.cc:1434] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:49.310350 12730 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.311369 12727 raft_consensus.cc:359] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.312328 12727 raft_consensus.cc:385] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.312683 12727 raft_consensus.cc:740] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.313640 12727 consensus_queue.cc:260] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.316895 12727 ts_tablet_manager.cc:1434] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:19:49.317926 12727 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.322252 12730 tablet_bootstrap.cc:654] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.324645 12727 tablet_bootstrap.cc:654] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.339542 12784 raft_consensus.cc:493] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.340337 12784 raft_consensus.cc:515] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.343477 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:49.343729 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:19:49.345209 12424 leader_election.cc:343] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.345882 12765 raft_consensus.cc:493] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:49.346504 12423 leader_election.cc:343] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.346989 12423 leader_election.cc:304] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.348049 12871 raft_consensus.cc:2749] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.346515 12765 raft_consensus.cc:515] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.350787 12355 catalog_manager.cc:5697] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.352258 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c20adb4d124ae681d4c43be777969e" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:49.353061 12530 raft_consensus.cc:2393] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:49.353804 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c20adb4d124ae681d4c43be777969e" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.354470 12765 leader_election.cc:290] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.354969 12784 leader_election.cc:290] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.356067 12646 leader_election.cc:304] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.356968 12765 raft_consensus.cc:3060] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.359357 12725 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.359982 12725 ts_tablet_manager.cc:1403] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.121s	user 0.015s	sys 0.000s
I20260709 13:19:49.362243 12727 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.362766 12727 ts_tablet_manager.cc:1403] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.008s
I20260709 13:19:49.363145 12725 raft_consensus.cc:359] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.363816 12725 raft_consensus.cc:385] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.364050 12725 raft_consensus.cc:740] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.364727 12725 consensus_queue.cc:260] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.365579 12727 raft_consensus.cc:359] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.366231 12727 raft_consensus.cc:385] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.366319 12726 tablet_bootstrap.cc:492] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.366524 12727 raft_consensus.cc:740] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.366937 12726 ts_tablet_manager.cc:1403] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.113s	user 0.017s	sys 0.007s
I20260709 13:19:49.367105 12765 raft_consensus.cc:2749] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.367362 12727 consensus_queue.cc:260] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.369879 12727 ts_tablet_manager.cc:1434] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:49.369707 12726 raft_consensus.cc:359] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.370489 12726 raft_consensus.cc:385] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.370886 12727 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.371012 12726 raft_consensus.cc:740] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.372617 12726 consensus_queue.cc:260] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.376964 12726 ts_tablet_manager.cc:1434] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:19:49.378264 12726 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.383687 12726 tablet_bootstrap.cc:654] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.388546 12774 raft_consensus.cc:493] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.389089 12774 raft_consensus.cc:515] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.390731 12727 tablet_bootstrap.cc:654] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.391362 12774 leader_election.cc:290] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.393208 12853 raft_consensus.cc:493] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.393865 12725 ts_tablet_manager.cc:1434] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:19:49.393790 12853 raft_consensus.cc:515] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.395519 12725 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.396862 12853 leader_election.cc:290] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.398469 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.399472 12457 raft_consensus.cc:2468] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:49.400981 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.401450 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:49.401813 12725 tablet_bootstrap.cc:654] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.402513 12727 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.403005 12727 ts_tablet_manager.cc:1403] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.007s
W20260709 13:19:49.403743 12496 leader_election.cc:343] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.406019 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.406700 12607 raft_consensus.cc:2468] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:49.407976 12498 leader_election.cc:304] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:49.409149 12774 raft_consensus.cc:2804] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.409539 12774 raft_consensus.cc:493] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.409906 12774 raft_consensus.cc:3060] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.412451 12727 raft_consensus.cc:359] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.413151 12727 raft_consensus.cc:385] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.402925 12570 leader_election.cc:304] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
W20260709 13:19:49.413995 12573 leader_election.cc:343] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.415136 12733 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.415637 12733 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.417665 12733 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:49.418375 12784 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.418884 12784 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.420300 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.420893 12784 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.420966 12681 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:49.422344 12496 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:49.423332 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.423907 12681 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:49.425060 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:49.425676 12530 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:49.426184 12774 raft_consensus.cc:515] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.425060 12421 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:49.427325 12784 raft_consensus.cc:2804] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.427788 12784 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.428272 12784 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.428908 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.429749 12733 raft_consensus.cc:2804] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.430172 12733 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.430505 12733 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.427644 12794 raft_consensus.cc:2804] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.433271 12794 raft_consensus.cc:493] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.433610 12794 raft_consensus.cc:3060] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.437171 12784 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.440165 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:49.442703 12607 raft_consensus.cc:3060] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.444943 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
W20260709 13:19:49.446440 12496 leader_election.cc:343] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.440603 12727 raft_consensus.cc:740] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.449676 12727 consensus_queue.cc:260] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.454097 12727 ts_tablet_manager.cc:1434] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:19:49.451419 12607 raft_consensus.cc:2468] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:49.455193 12794 raft_consensus.cc:515] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.456359 12498 leader_election.cc:304] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:49.457264 12834 raft_consensus.cc:2804] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.458907 12730 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.459503 12730 ts_tablet_manager.cc:1403] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.149s	user 0.025s	sys 0.003s
I20260709 13:19:49.463449 12727 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.467825 12457 raft_consensus.cc:2393] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:49.441816 12774 leader_election.cc:290] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.466161 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:49.468492 12681 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.473526 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:49.474277 12457 raft_consensus.cc:3060] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.478550 12681 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:49.480726 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:49.481455 12784 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.482779 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:49.483888 12794 leader_election.cc:290] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.490399 12726 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.484234 12733 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.490585 12421 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:49.491586 12530 raft_consensus.cc:2393] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:49.491917 12871 raft_consensus.cc:2804] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.492431 12871 raft_consensus.cc:697] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:49.493273 12871 consensus_queue.cc:237] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.494423 12733 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:49.496150 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:49.484512 12834 raft_consensus.cc:697] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:49.497421 12834 consensus_queue.cc:237] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:49.490376 12573 leader_election.cc:343] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.491256 12726 ts_tablet_manager.cc:1403] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.113s	user 0.039s	sys 0.067s
I20260709 13:19:49.487362 12457 raft_consensus.cc:2468] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:49.497655 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:49.505538 12681 raft_consensus.cc:2393] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:49.462309 12730 raft_consensus.cc:359] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.505990 12730 raft_consensus.cc:385] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.506292 12730 raft_consensus.cc:740] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.506774 12496 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:49.507656 12570 leader_election.cc:304] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.509305 12853 raft_consensus.cc:2804] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.509795 12853 raft_consensus.cc:697] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:49.510605 12853 consensus_queue.cc:237] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.512610 12785 consensus_queue.cc:1048] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.515331 12885 raft_consensus.cc:2749] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.517354 12730 consensus_queue.cc:260] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.517491 12726 raft_consensus.cc:359] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.518379 12726 raft_consensus.cc:385] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.518716 12726 raft_consensus.cc:740] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.519946 12726 consensus_queue.cc:260] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.520664 12730 ts_tablet_manager.cc:1434] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.002s
I20260709 13:19:49.521754 12730 tablet_bootstrap.cc:492] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.488517 12727 tablet_bootstrap.cc:654] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.522681 12726 ts_tablet_manager.cc:1434] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:19:49.523671 12726 tablet_bootstrap.cc:492] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.524441 12725 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.524927 12725 ts_tablet_manager.cc:1403] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.130s	user 0.032s	sys 0.047s
I20260709 13:19:49.531008 12784 consensus_queue.cc:1048] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:19:49.537712 12730 tablet_bootstrap.cc:654] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.537798 12785 consensus_queue.cc:1048] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.538391 12726 tablet_bootstrap.cc:654] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.540166 12354 catalog_manager.cc:5697] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.558692 12356 catalog_manager.cc:5697] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:49.544809 12725 raft_consensus.cc:359] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.563661 12725 raft_consensus.cc:385] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.551220 12796 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.564214 12796 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.566821 12796 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.549147 12355 catalog_manager.cc:5697] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.567713 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.569211 12725 raft_consensus.cc:740] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.569391 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.570047 12725 consensus_queue.cc:260] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.570442 12607 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:49.571911 12423 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:19:49.572924 12892 raft_consensus.cc:2804] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.568568 12681 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:49.572135 12725 ts_tablet_manager.cc:1434] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.000s
I20260709 13:19:49.577479 12892 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.579403 12892 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.581416 12726 tablet_bootstrap.cc:492] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.577509 12725 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.581940 12726 ts_tablet_manager.cc:1403] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.005s
I20260709 13:19:49.584859 12726 raft_consensus.cc:359] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.586331 12726 raft_consensus.cc:385] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.586961 12726 raft_consensus.cc:740] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.589161 12725 tablet_bootstrap.cc:654] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.590157 12726 consensus_queue.cc:260] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.591296 12730 tablet_bootstrap.cc:492] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.593107 12794 consensus_queue.cc:1048] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.598932 12765 consensus_queue.cc:1048] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.599532 12730 ts_tablet_manager.cc:1403] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.003s
I20260709 13:19:49.597301 12892 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.602551 12897 consensus_queue.cc:1048] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:49.603300 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:49.603869 12607 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.617482 12730 raft_consensus.cc:359] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.618289 12730 raft_consensus.cc:385] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.618561 12730 raft_consensus.cc:740] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.621068 12794 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.621752 12794 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.622648 12730 consensus_queue.cc:260] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.621083 12726 ts_tablet_manager.cc:1434] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.002s
I20260709 13:19:49.624609 12726 tablet_bootstrap.cc:492] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.625027 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.628367 12898 raft_consensus.cc:493] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.628983 12898 raft_consensus.cc:515] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:49.629225 12570 leader_election.cc:343] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.629601 12794 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.627694 12730 ts_tablet_manager.cc:1434] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:19:49.634004 12730 tablet_bootstrap.cc:492] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.636005 12853 consensus_queue.cc:1048] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.637136 12898 leader_election.cc:290] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.636138 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54686caf81d4b5b82fd2d32243d743a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:49.638573 12424 leader_election.cc:343] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.638757 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54686caf81d4b5b82fd2d32243d743a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.639892 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:49.640048 12423 leader_election.cc:343] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.641690 12423 leader_election.cc:304] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.642796 12898 raft_consensus.cc:2749] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.641057 12784 raft_consensus.cc:493] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.644364 12784 raft_consensus.cc:515] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.644848 12726 tablet_bootstrap.cc:654] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.651568 12607 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:49.652413 12784 leader_election.cc:290] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.648164 12730 tablet_bootstrap.cc:654] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.654078 12725 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.657208 12725 ts_tablet_manager.cc:1403] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.000s
I20260709 13:19:49.666844 12730 tablet_bootstrap.cc:492] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.667368 12730 ts_tablet_manager.cc:1403] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.005s
W20260709 13:19:49.668165 12573 leader_election.cc:343] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.668660 12573 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.668928 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a22d36ba14b48d9a8dfbc803ac44305" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.670151 12853 raft_consensus.cc:2749] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.671619 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a22d36ba14b48d9a8dfbc803ac44305" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:49.672931 12424 leader_election.cc:343] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.673913 12834 raft_consensus.cc:493] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.659168 12727 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.666301 12423 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:19:49.674428 12834 raft_consensus.cc:515] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:49.675534 12423 leader_election.cc:343] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.675982 12423 leader_election.cc:304] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.676484 12834 leader_election.cc:290] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.677165 12784 raft_consensus.cc:2749] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.678038 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.678882 12457 raft_consensus.cc:2393] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:49.680105 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:49.680652 12681 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.681015 12892 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.681066 12730 raft_consensus.cc:359] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.680753 12725 raft_consensus.cc:359] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.678110 12727 ts_tablet_manager.cc:1403] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.215s	user 0.012s	sys 0.001s
I20260709 13:19:49.675887 12898 raft_consensus.cc:2804] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.685654 12725 raft_consensus.cc:385] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.686024 12725 raft_consensus.cc:740] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.686813 12725 consensus_queue.cc:260] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.688339 12727 raft_consensus.cc:359] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.685966 12898 raft_consensus.cc:697] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:49.689043 12727 raft_consensus.cc:385] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.689546 12727 raft_consensus.cc:740] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.689072 12730 raft_consensus.cc:385] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.690372 12727 consensus_queue.cc:260] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.689942 12898 consensus_queue.cc:237] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.691223 12730 raft_consensus.cc:740] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.691972 12730 consensus_queue.cc:260] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.692999 12727 ts_tablet_manager.cc:1434] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:19:49.688872 12725 ts_tablet_manager.cc:1434] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:19:49.693989 12727 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.694392 12725 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.695777 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.697248 12726 tablet_bootstrap.cc:492] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.698416 12726 ts_tablet_manager.cc:1403] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.005s
I20260709 13:19:49.700100 12853 raft_consensus.cc:493] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.703991 12853 raft_consensus.cc:515] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.706540 12853 leader_election.cc:290] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:49.707120 12765 consensus_queue.cc:1048] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.708047 12725 tablet_bootstrap.cc:654] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.709638 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.710078 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:49.711308 12570 leader_election.cc:343] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:49.713371 12570 leader_election.cc:343] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.713881 12570 leader_election.cc:304] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:49.717115 12853 raft_consensus.cc:2749] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.719162 12725 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.719599 12725 ts_tablet_manager.cc:1403] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.005s
I20260709 13:19:49.721750 12681 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:49.701748 12498 leader_election.cc:304] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:49.702109 12727 tablet_bootstrap.cc:654] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.702234 12726 raft_consensus.cc:359] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.723016 12726 raft_consensus.cc:385] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.723290 12726 raft_consensus.cc:740] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.723949 12726 consensus_queue.cc:260] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.725652 12726 ts_tablet_manager.cc:1434] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:19:49.726394 12834 raft_consensus.cc:3060] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.726666 12726 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.703413 12730 ts_tablet_manager.cc:1434] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:19:49.729055 12730 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.734655 12834 raft_consensus.cc:2749] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.735772 12730 tablet_bootstrap.cc:654] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.737421 12727 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.737885 12727 ts_tablet_manager.cc:1403] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.000s
I20260709 13:19:49.741163 12727 raft_consensus.cc:359] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.741864 12727 raft_consensus.cc:385] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.742177 12727 raft_consensus.cc:740] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.742522 12726 tablet_bootstrap.cc:654] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.742964 12727 consensus_queue.cc:260] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.722229 12725 raft_consensus.cc:359] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.744953 12725 raft_consensus.cc:385] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.745280 12727 ts_tablet_manager.cc:1434] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:49.745240 12725 raft_consensus.cc:740] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.746685 12727 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.746611 12725 consensus_queue.cc:260] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.748695 12725 ts_tablet_manager.cc:1434] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:19:49.750051 12725 tablet_bootstrap.cc:492] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.753091 12727 tablet_bootstrap.cc:654] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.757032 12356 catalog_manager.cc:5697] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:49.757869 12726 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.759822 12726 ts_tablet_manager.cc:1403] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 13:19:49.761950 12765 raft_consensus.cc:493] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.762247 12730 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.762748 12730 ts_tablet_manager.cc:1403] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:19:49.762509 12765 raft_consensus.cc:515] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.764623 12765 leader_election.cc:290] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.765666 12730 raft_consensus.cc:359] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.766377 12730 raft_consensus.cc:385] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.766614 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.767470 12606 raft_consensus.cc:2393] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:49.768894 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:49.766647 12730 raft_consensus.cc:740] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.770351 12730 consensus_queue.cc:260] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.771977 12725 tablet_bootstrap.cc:654] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.772533 12730 ts_tablet_manager.cc:1434] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:49.773572 12730 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.770722 12726 raft_consensus.cc:359] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.775234 12726 raft_consensus.cc:385] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.775516 12726 raft_consensus.cc:740] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.776978 12726 consensus_queue.cc:260] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.778679 12647 leader_election.cc:304] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.781363 12765 raft_consensus.cc:3060] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.782115 12726 ts_tablet_manager.cc:1434] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:19:49.783162 12726 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.785688 12794 consensus_queue.cc:1048] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.787724 12892 raft_consensus.cc:493] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.788475 12892 raft_consensus.cc:515] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.789322 12726 tablet_bootstrap.cc:654] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.790530 12892 leader_election.cc:290] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:49.793327 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:49.795011 12424 leader_election.cc:343] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.797360 12771 consensus_queue.cc:1048] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:49.787828 12730 tablet_bootstrap.cc:654] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.797489 12765 raft_consensus.cc:2749] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.804877 12726 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.805353 12726 ts_tablet_manager.cc:1403] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 13:19:49.808015 12726 raft_consensus.cc:359] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.810946 12727 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.811503 12727 ts_tablet_manager.cc:1403] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.003s
I20260709 13:19:49.814194 12727 raft_consensus.cc:359] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.815862 12727 raft_consensus.cc:385] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.816231 12727 raft_consensus.cc:740] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.815109 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.808663 12726 raft_consensus.cc:385] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.817449 12726 raft_consensus.cc:740] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
W20260709 13:19:49.817903 12421 leader_election.cc:343] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.818398 12421 leader_election.cc:304] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:49.818245 12726 consensus_queue.cc:260] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.819224 12892 raft_consensus.cc:2749] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:49.820370 12726 ts_tablet_manager.cc:1434] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:19:49.820004 12727 consensus_queue.cc:260] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.818257 12725 tablet_bootstrap.cc:492] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.821270 12725 ts_tablet_manager.cc:1403] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.008s
I20260709 13:19:49.822623 12727 ts_tablet_manager.cc:1434] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:19:49.824368 12727 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.824154 12725 raft_consensus.cc:359] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.824841 12725 raft_consensus.cc:385] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.825114 12725 raft_consensus.cc:740] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.825850 12725 consensus_queue.cc:260] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.827325 12726 tablet_bootstrap.cc:492] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.829725 12725 ts_tablet_manager.cc:1434] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:49.830735 12725 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.832753 12727 tablet_bootstrap.cc:654] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.837499 12730 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.837956 12730 ts_tablet_manager.cc:1403] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.065s	user 0.004s	sys 0.006s
I20260709 13:19:49.840484 12730 raft_consensus.cc:359] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.841152 12730 raft_consensus.cc:385] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.841410 12730 raft_consensus.cc:740] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.842599 12725 tablet_bootstrap.cc:654] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.845038 12727 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.845506 12726 tablet_bootstrap.cc:654] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.845588 12727 ts_tablet_manager.cc:1403] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:19:49.846774 12730 consensus_queue.cc:260] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.849205 12730 ts_tablet_manager.cc:1434] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:19:49.848841 12727 raft_consensus.cc:359] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.849754 12727 raft_consensus.cc:385] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.850108 12727 raft_consensus.cc:740] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.850215 12730 tablet_bootstrap.cc:492] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.857111 12730 tablet_bootstrap.cc:654] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.857681 12727 consensus_queue.cc:260] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.860929 12726 tablet_bootstrap.cc:492] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:49.861773 12727 ts_tablet_manager.cc:1434] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:49.871088 12727 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.863971 12725 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:49.864413 12834 raft_consensus.cc:493] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.873185 12725 ts_tablet_manager.cc:1403] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.000s
I20260709 13:19:49.873384 12834 raft_consensus.cc:515] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.875911 12834 leader_election.cc:290] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.876173 12725 raft_consensus.cc:359] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.867971 12730 tablet_bootstrap.cc:492] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.876916 12727 tablet_bootstrap.cc:654] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.877707 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a22d36ba14b48d9a8dfbc803ac44305" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.879762 12834 raft_consensus.cc:493] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.880036 12730 ts_tablet_manager.cc:1403] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 13:19:49.880385 12834 raft_consensus.cc:515] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:49.881462 12498 leader_election.cc:343] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.883425 12730 raft_consensus.cc:359] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.879524 12726 ts_tablet_manager.cc:1403] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.006s
I20260709 13:19:49.884130 12730 raft_consensus.cc:385] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.884446 12730 raft_consensus.cc:740] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.878189 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a22d36ba14b48d9a8dfbc803ac44305" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.885651 12730 consensus_queue.cc:260] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.885691 12456 raft_consensus.cc:2468] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:49.887795 12730 ts_tablet_manager.cc:1434] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:19:49.889768 12496 leader_election.cc:304] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:49.890237 12726 raft_consensus.cc:359] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.890568 12774 raft_consensus.cc:2804] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.876950 12725 raft_consensus.cc:385] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.891018 12774 raft_consensus.cc:493] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.891456 12774 raft_consensus.cc:3060] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.891731 12730 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.892093 12727 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.892639 12727 ts_tablet_manager.cc:1403] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:19:49.896057 12727 raft_consensus.cc:359] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.897264 12727 raft_consensus.cc:385] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.897753 12727 raft_consensus.cc:740] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.898675 12727 consensus_queue.cc:260] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.890934 12726 raft_consensus.cc:385] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.899933 12726 raft_consensus.cc:740] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.900687 12726 consensus_queue.cc:260] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:49.901726 12727 ts_tablet_manager.cc:1434] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:19:49.902863 12726 ts_tablet_manager.cc:1434] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:19:49.903103 12727 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.899500 12730 tablet_bootstrap.cc:654] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.909897 12725 raft_consensus.cc:740] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.910153 12727 tablet_bootstrap.cc:654] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.910797 12725 consensus_queue.cc:260] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.912700 12726 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:49.914677 12834 leader_election.cc:290] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:49.917158 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:49.917856 12681 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:49.918172 12726 tablet_bootstrap.cc:654] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.919198 12496 leader_election.cc:304] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:49.910452 12765 raft_consensus.cc:493] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:49.921335 12765 raft_consensus.cc:515] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.925046 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b322fccf59456095cd4773a162b412" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:49.925439 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b322fccf59456095cd4773a162b412" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.925709 12456 raft_consensus.cc:2468] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:49.925942 12765 leader_election.cc:290] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:49.926636 12607 raft_consensus.cc:2468] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:49.927146 12725 ts_tablet_manager.cc:1434] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:19:49.927628 12644 leader_election.cc:304] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:49.884370 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:49.928484 12606 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:49.929472 12765 raft_consensus.cc:2804] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.929878 12765 raft_consensus.cc:493] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.930199 12765 raft_consensus.cc:3060] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.932754 12834 raft_consensus.cc:2804] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:49.933251 12834 raft_consensus.cc:493] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:49.933614 12834 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.921312 12727 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:49.935848 12727 ts_tablet_manager.cc:1403] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 13:19:49.936750 12730 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:49.937278 12730 ts_tablet_manager.cc:1403] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.004s
I20260709 13:19:49.939880 12730 raft_consensus.cc:359] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.945432 12730 raft_consensus.cc:385] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.938668 12727 raft_consensus.cc:359] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.945732 12730 raft_consensus.cc:740] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.945885 12727 raft_consensus.cc:385] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:49.946237 12727 raft_consensus.cc:740] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:49.946467 12730 consensus_queue.cc:260] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.944093 12765 raft_consensus.cc:515] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.950906 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b322fccf59456095cd4773a162b412" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:49.951514 12456 raft_consensus.cc:3060] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.952316 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b322fccf59456095cd4773a162b412" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:49.952602 12730 ts_tablet_manager.cc:1434] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 13:19:49.953933 12730 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:49.954767 12606 raft_consensus.cc:3060] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.956054 12725 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:49.946995 12727 consensus_queue.cc:260] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:49.967840 12727 ts_tablet_manager.cc:1434] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:19:49.966261 12765 leader_election.cc:290] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:49.968894 12727 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:49.969605 12774 raft_consensus.cc:515] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:49.971753 12774 leader_election.cc:290] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:49.972435 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a22d36ba14b48d9a8dfbc803ac44305" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:49.973543 12457 raft_consensus.cc:3060] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:49.976029 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a22d36ba14b48d9a8dfbc803ac44305" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:49.976955 12727 tablet_bootstrap.cc:654] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:49.977761 12498 leader_election.cc:343] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:49.979637 12606 raft_consensus.cc:2468] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:49.982306 12725 tablet_bootstrap.cc:654] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.983631 12646 leader_election.cc:304] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:49.985980 12765 raft_consensus.cc:2804] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:49.989277 12730 tablet_bootstrap.cc:654] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:49.990684 12765 raft_consensus.cc:697] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:49.991544 12765 consensus_queue.cc:237] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:49.997124 12857 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.008332 12892 raft_consensus.cc:493] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.009020 12892 raft_consensus.cc:515] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.026340 12898 raft_consensus.cc:493] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.027839 12898 raft_consensus.cc:515] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.028375 12726 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:50.029013 12726 ts_tablet_manager.cc:1403] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.117s	user 0.019s	sys 0.009s
I20260709 13:19:50.010605 12857 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.033670 12733 consensus_queue.cc:1048] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:19:50.060096 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.036669 12784 consensus_queue.cc:1048] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:19:50.032555 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.059983 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:50.045380 12853 consensus_queue.cc:1048] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:19:50.063472 12774 raft_consensus.cc:493] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.067051 12774 raft_consensus.cc:515] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.046283 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.032680 12726 raft_consensus.cc:359] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.068056 12726 raft_consensus.cc:385] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.068368 12726 raft_consensus.cc:740] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.043844 12892 leader_election.cc:290] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:19:50.069190 12644 leader_election.cc:343] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.069509 12726 consensus_queue.cc:260] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.048564 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:50.064121 12421 leader_election.cc:343] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.042526 12727 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:50.072089 12356 catalog_manager.cc:5697] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.078907 12727 ts_tablet_manager.cc:1403] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.110s	user 0.025s	sys 0.028s
I20260709 13:19:50.045682 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.052942 12898 leader_election.cc:290] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:50.070170 12456 raft_consensus.cc:2468] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:50.074793 12857 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:50.076997 12606 raft_consensus.cc:2468] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
W20260709 13:19:50.089747 12424 leader_election.cc:343] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.090220 12424 leader_election.cc:304] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
W20260709 13:19:50.088794 12647 leader_election.cc:343] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.076745 12834 raft_consensus.cc:515] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.095098 12647 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:50.096271 12765 raft_consensus.cc:2749] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.085757 12681 raft_consensus.cc:2468] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:50.083928 12457 raft_consensus.cc:2468] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.103464 12730 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:50.104197 12730 ts_tablet_manager.cc:1403] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.150s	user 0.024s	sys 0.031s
I20260709 13:19:50.104666 12774 leader_election.cc:290] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:50.105370 12423 leader_election.cc:304] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
W20260709 13:19:50.096735 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:50.100667 12892 raft_consensus.cc:2749] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.116428 12727 raft_consensus.cc:359] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.107132 12930 raft_consensus.cc:493] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.120190 12726 ts_tablet_manager.cc:1434] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.011s
I20260709 13:19:50.120602 12930 raft_consensus.cc:515] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.122797 12930 leader_election.cc:290] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.110661 12898 raft_consensus.cc:2804] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.123456 12898 raft_consensus.cc:493] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.123790 12898 raft_consensus.cc:3060] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.125907 12834 leader_election.cc:290] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:50.127086 12726 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:50.127406 12725 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:50.127928 12725 ts_tablet_manager.cc:1403] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.013s
I20260709 13:19:50.141889 12857 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:19:50.142519 12857 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.142920 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.143625 12681 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:50.144749 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.117894 12727 raft_consensus.cc:385] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.119854 12496 leader_election.cc:304] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:50.146852 12730 raft_consensus.cc:359] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.160701 12730 raft_consensus.cc:385] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.149417 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.162708 12456 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:19:50.164192 12644 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:50.165197 12765 raft_consensus.cc:2804] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:50.165570 12765 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:19:50.165978 12765 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:50.173839 12730 raft_consensus.cc:740] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.175122 12730 consensus_queue.cc:260] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.175323 12765 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.178960 12730 ts_tablet_manager.cc:1434] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:19:50.149547 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.149845 12853 raft_consensus.cc:493] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.149931 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:50.150715 12934 raft_consensus.cc:2804] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.181063 12853 raft_consensus.cc:515] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.151197 12834 consensus_queue.cc:1048] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.152446 12725 raft_consensus.cc:359] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.182236 12725 raft_consensus.cc:385] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.182503 12725 raft_consensus.cc:740] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.183410 12853 leader_election.cc:290] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.153836 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:50.184983 12678 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.152359 12784 consensus_queue.cc:1048] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:50.188676 12606 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.189671 12834 raft_consensus.cc:493] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.190452 12784 consensus_queue.cc:1048] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.158375 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:50.147811 12857 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:50.190476 12834 raft_consensus.cc:515] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.183208 12725 consensus_queue.cc:260] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.193074 12725 ts_tablet_manager.cc:1434] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:19:50.194164 12725 tablet_bootstrap.cc:492] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:50.180599 12457 raft_consensus.cc:2468] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:50.181370 12934 raft_consensus.cc:697] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:50.191712 12531 raft_consensus.cc:2393] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:50.198120 12934 consensus_queue.cc:237] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.147761 12496 leader_election.cc:304] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
W20260709 13:19:50.203497 12498 leader_election.cc:343] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:50.203608 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 55929.4us
I20260709 13:19:50.204851 12930 raft_consensus.cc:2804] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.205287 12930 raft_consensus.cc:493] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.205668 12930 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.207036 12834 leader_election.cc:290] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:50.208686 12771 consensus_queue.cc:1048] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.214556 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54686caf81d4b5b82fd2d32243d743a" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.215415 12605 raft_consensus.cc:2468] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:50.217307 12834 raft_consensus.cc:493] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.220628 12725 tablet_bootstrap.cc:654] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.221158 12498 leader_election.cc:304] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.226006 12733 raft_consensus.cc:2804] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.226430 12733 raft_consensus.cc:493] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.226771 12733 raft_consensus.cc:3060] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:50.228863 12397 log.cc:927] Time spent T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d: Append to log took a long time: real 0.137s	user 0.004s	sys 0.000s
I20260709 13:19:50.151693 12726 tablet_bootstrap.cc:654] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.249183 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.251243 12730 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:50.256173 12892 consensus_queue.cc:1048] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.263191 12730 tablet_bootstrap.cc:654] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.265257 12679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.266806 12727 raft_consensus.cc:740] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.218583 12834 raft_consensus.cc:515] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.271901 12727 consensus_queue.cc:260] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.278556 12727 ts_tablet_manager.cc:1434] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.199s	user 0.007s	sys 0.000s
I20260709 13:19:50.300225 12730 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:50.300999 12730 ts_tablet_manager.cc:1403] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.008s
I20260709 13:19:50.303211 12726 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:50.304105 12726 ts_tablet_manager.cc:1403] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.177s	user 0.011s	sys 0.004s
W20260709 13:19:50.286376 12570 leader_election.cc:343] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.308913 12496 leader_election.cc:304] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.316540 12678 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.319480 12898 raft_consensus.cc:515] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.321451 12941 raft_consensus.cc:2804] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.321959 12941 raft_consensus.cc:493] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.322296 12941 raft_consensus.cc:3060] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.322991 12727 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:19:50.326642 12496 leader_election.cc:343] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.326853 12606 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.327813 12496 leader_election.cc:304] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.304782 12857 raft_consensus.cc:493] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.328550 12857 raft_consensus.cc:515] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.330571 12943 raft_consensus.cc:2804] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.331063 12857 leader_election.cc:290] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.332908 12834 leader_election.cc:290] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:50.331101 12943 raft_consensus.cc:697] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:50.339586 12727 tablet_bootstrap.cc:654] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:50.307314 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 75387.7us
I20260709 13:19:50.307822 12765 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:19:50.311014 12424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 152572us
I20260709 13:19:50.355382 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54686caf81d4b5b82fd2d32243d743a" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.360684 12725 tablet_bootstrap.cc:492] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:50.364136 12725 ts_tablet_manager.cc:1403] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.010s
I20260709 13:19:50.365823 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.340348 12943 consensus_queue.cc:237] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.384298 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:50.385295 12733 raft_consensus.cc:515] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.368918 12457 raft_consensus.cc:2468] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:50.371647 12930 raft_consensus.cc:515] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.401542 12935 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:50.409956 12646 leader_election.cc:343] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.425940 12733 leader_election.cc:290] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:50.422459 12935 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.427768 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:50.428437 12681 raft_consensus.cc:3060] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.433198 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.434289 12898 leader_election.cc:290] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:50.422940 12725 raft_consensus.cc:359] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.435227 12725 raft_consensus.cc:385] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.435518 12725 raft_consensus.cc:740] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.441301 12725 consensus_queue.cc:260] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.443727 12730 raft_consensus.cc:359] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.444372 12725 ts_tablet_manager.cc:1434] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:19:50.444635 12730 raft_consensus.cc:385] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.445176 12730 raft_consensus.cc:740] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.428480 12935 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:50.445601 12725 tablet_bootstrap.cc:492] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:50.447027 12726 raft_consensus.cc:359] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.447963 12726 raft_consensus.cc:385] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.448289 12726 raft_consensus.cc:740] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.447233 12730 consensus_queue.cc:260] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.449281 12726 consensus_queue.cc:260] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.450922 12730 ts_tablet_manager.cc:1434] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.150s	user 0.006s	sys 0.001s
I20260709 13:19:50.452152 12730 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:50.451938 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:50.452903 12532 raft_consensus.cc:2393] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:50.462218 12730 tablet_bootstrap.cc:654] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.467387 12681 raft_consensus.cc:2468] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:50.467710 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.468482 12457 raft_consensus.cc:2468] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:50.469048 12421 leader_election.cc:304] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:50.474984 12726 ts_tablet_manager.cc:1434] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.171s	user 0.007s	sys 0.002s
I20260709 13:19:50.476294 12726 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:50.482223 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.480844 12898 raft_consensus.cc:2804] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.483170 12898 raft_consensus.cc:697] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:50.484684 12857 consensus_queue.cc:1048] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:19:50.488852 12496 leader_election.cc:343] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.490191 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:50.490985 12678 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.491386 12898 consensus_queue.cc:237] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.494064 12930 leader_election.cc:290] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:50.508358 12725 tablet_bootstrap.cc:654] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:50.509784 12498 leader_election.cc:343] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.526749 12950 raft_consensus.cc:493] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.527534 12950 raft_consensus.cc:515] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.530112 12950 leader_election.cc:290] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.531097 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.531896 12607 raft_consensus.cc:2468] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:50.533484 12646 leader_election.cc:304] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:50.534663 12950 raft_consensus.cc:2804] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.535110 12950 raft_consensus.cc:493] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.535521 12950 raft_consensus.cc:3060] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.545934 12354 catalog_manager.cc:5697] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.538564 12498 leader_election.cc:304] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:50.554275 12943 raft_consensus.cc:2749] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.555132 12730 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:50.555887 12730 ts_tablet_manager.cc:1403] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.104s	user 0.036s	sys 0.044s
I20260709 13:19:50.550679 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.566392 12941 raft_consensus.cc:515] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.569469 12941 leader_election.cc:290] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.571298 12679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
W20260709 13:19:50.554411 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 44658.8us
I20260709 13:19:50.565675 12678 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.590586 12727 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:50.591632 12727 ts_tablet_manager.cc:1403] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.269s	user 0.011s	sys 0.007s
I20260709 13:19:50.598547 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:50.604393 12605 raft_consensus.cc:3060] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:50.589888 12496 leader_election.cc:343] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.609916 12496 leader_election.cc:304] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.611456 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:50.612123 12730 raft_consensus.cc:359] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.611392 12943 raft_consensus.cc:2804] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.612685 12730 raft_consensus.cc:385] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.613437 12726 tablet_bootstrap.cc:654] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.618669 12730 raft_consensus.cc:740] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.619959 12730 consensus_queue.cc:260] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.631776 12730 ts_tablet_manager.cc:1434] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 13:19:50.639055 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:50.639844 12604 raft_consensus.cc:2468] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
W20260709 13:19:50.641530 12570 leader_election.cc:343] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.642051 12570 leader_election.cc:304] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:50.642872 12605 raft_consensus.cc:2468] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:50.644169 12853 raft_consensus.cc:2749] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:50.642203 12871 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.645447 12871 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.645771 12644 leader_election.cc:304] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:50.647172 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54686caf81d4b5b82fd2d32243d743a" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
W20260709 13:19:50.647349 12424 leader_election.cc:343] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.647773 12607 raft_consensus.cc:3060] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.648190 12456 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:19:50.648533 12947 raft_consensus.cc:2804] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.648977 12947 raft_consensus.cc:493] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.649303 12947 raft_consensus.cc:3060] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.649466 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:50.650200 12531 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:50.653031 12424 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.654697 12950 raft_consensus.cc:515] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.654934 12354 catalog_manager.cc:5697] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.656162 12784 raft_consensus.cc:2804] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.629947 12943 raft_consensus.cc:697] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:50.656596 12784 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.659956 12784 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.659849 12943 consensus_queue.cc:237] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.647709 12871 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:50.669850 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d54686caf81d4b5b82fd2d32243d743a" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:50.670631 12455 raft_consensus.cc:3060] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.671169 12644 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:50.672079 12857 raft_consensus.cc:2804] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:50.673283 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:50.672537 12857 raft_consensus.cc:697] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:50.669925 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:50.675892 12458 raft_consensus.cc:3060] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.681617 12730 tablet_bootstrap.cc:492] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:50.658324 12950 leader_election.cc:290] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.687441 12353 catalog_manager.cc:5697] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.674983 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.690981 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:50.695310 12605 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.695932 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:50.696573 12603 raft_consensus.cc:3060] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:50.698976 12498 consensus_peers.cc:597] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:50.696319 12725 tablet_bootstrap.cc:492] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:50.702689 12725 ts_tablet_manager.cc:1403] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.257s	user 0.038s	sys 0.004s
I20260709 13:19:50.703874 12605 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.675117 12857 consensus_queue.cc:237] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.706142 12725 raft_consensus.cc:359] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.709751 12725 raft_consensus.cc:385] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.710022 12725 raft_consensus.cc:740] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.673307 12423 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:50.713553 12940 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.712971 12725 consensus_queue.cc:260] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.692444 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.717031 12940 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:19:50.718065 12423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 44860.3us
I20260709 13:19:50.718612 12898 raft_consensus.cc:2804] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.726972 12898 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.727355 12898 raft_consensus.cc:3060] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.727852 12726 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:50.728492 12726 ts_tablet_manager.cc:1403] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.252s	user 0.014s	sys 0.021s
I20260709 13:19:50.731518 12726 raft_consensus.cc:359] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.732209 12726 raft_consensus.cc:385] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.732543 12726 raft_consensus.cc:740] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.734256 12603 raft_consensus.cc:2468] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
W20260709 13:19:50.725117 12421 leader_election.cc:343] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.725387 12940 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.734072 12726 consensus_queue.cc:260] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.723155 12727 raft_consensus.cc:359] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.736881 12727 raft_consensus.cc:385] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.736284 12950 consensus_queue.cc:1048] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:50.737176 12727 raft_consensus.cc:740] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.739182 12727 consensus_queue.cc:260] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.736394 12607 raft_consensus.cc:2468] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.742408 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:50.744313 12730 tablet_bootstrap.cc:654] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.744807 12455 raft_consensus.cc:2468] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
W20260709 13:19:50.736459 12644 leader_election.cc:343] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.754381 12947 raft_consensus.cc:515] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.756008 12646 leader_election.cc:304] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:50.755332 12784 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.757349 12951 raft_consensus.cc:2804] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.757844 12951 raft_consensus.cc:697] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:50.758684 12951 consensus_queue.cc:237] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.759239 12498 leader_election.cc:304] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.760836 12947 leader_election.cc:290] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:50.761518 12458 raft_consensus.cc:2468] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:50.762676 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:50.762677 12940 raft_consensus.cc:2804] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.763880 12940 raft_consensus.cc:697] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:50.764078 12727 ts_tablet_manager.cc:1434] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.172s	user 0.006s	sys 0.001s
W20260709 13:19:50.764500 12421 leader_election.cc:343] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:50.755221 12644 leader_election.cc:343] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.762801 12725 ts_tablet_manager.cc:1434] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:19:50.766073 12725 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:50.766806 12726 ts_tablet_manager.cc:1434] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:19:50.765130 12727 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:50.769433 12726 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:50.772507 12940 consensus_queue.cc:237] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.773669 12784 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:50.777206 12947 raft_consensus.cc:493] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:50.778103 12947 raft_consensus.cc:515] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.780334 12947 leader_election.cc:290] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:50.781311 12898 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.781970 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:50.782730 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.783025 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:50.782788 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:50.785909 12530 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:50.789467 12647 leader_election.cc:343] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.800722 12454 raft_consensus.cc:2410] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:19:50.806011 12353 catalog_manager.cc:5697] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.807236 12530 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
W20260709 13:19:50.807909 12646 leader_election.cc:343] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:50.810536 12496 leader_election.cc:304] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:50.814277 12424 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:50.814849 12943 consensus_queue.cc:1048] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.816030 12898 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:50.816259 12784 raft_consensus.cc:2804] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.814412 12930 raft_consensus.cc:2804] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.816975 12784 raft_consensus.cc:697] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:50.817329 12930 raft_consensus.cc:697] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:50.818040 12784 consensus_queue.cc:237] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.818231 12930 consensus_queue.cc:237] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.819262 12726 tablet_bootstrap.cc:654] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.819585 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:50.820259 12458 raft_consensus.cc:3060] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.822384 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:50.823035 12533 raft_consensus.cc:3060] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.829607 12533 raft_consensus.cc:2468] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:50.812057 12730 tablet_bootstrap.cc:492] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:50.831723 12730 ts_tablet_manager.cc:1403] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.150s	user 0.016s	sys 0.015s
I20260709 13:19:50.831789 12458 raft_consensus.cc:2468] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:50.833237 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:50.832536 12424 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:50.834254 12496 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:50.835583 12730 raft_consensus.cc:359] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.835902 12354 catalog_manager.cc:5697] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.854882 12730 raft_consensus.cc:385] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.855252 12730 raft_consensus.cc:740] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.854056 12727 tablet_bootstrap.cc:654] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.856830 12730 consensus_queue.cc:260] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:50.842772 12725 tablet_bootstrap.cc:654] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.860250 12930 raft_consensus.cc:2749] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:19:50.861244 12354 catalog_manager.cc:5697] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.855125 12455 raft_consensus.cc:2468] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:50.860674 12898 raft_consensus.cc:2804] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.865366 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:50.865836 12898 raft_consensus.cc:697] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:50.866003 12607 raft_consensus.cc:3060] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.866737 12898 consensus_queue.cc:237] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:50.870440 12644 leader_election.cc:304] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:50.872203 12951 raft_consensus.cc:2804] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:50.872675 12951 raft_consensus.cc:697] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:50.873472 12951 consensus_queue.cc:237] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:50.878351 12730 ts_tablet_manager.cc:1434] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.001s
I20260709 13:19:50.880033 12730 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:50.877959 12353 catalog_manager.cc:5697] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:50.881570 12353 catalog_manager.cc:5697] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.894836 12726 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:50.895512 12726 ts_tablet_manager.cc:1403] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.008s
I20260709 13:19:50.897689 12730 tablet_bootstrap.cc:654] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:50.901223 12930 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.902881 12871 consensus_queue.cc:1048] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.895406 12644 leader_election.cc:304] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:50.923918 12947 raft_consensus.cc:2804] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:50.924369 12947 raft_consensus.cc:493] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:50.924716 12947 raft_consensus.cc:3060] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:50.947446 12607 raft_consensus.cc:2468] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:50.950757 12726 raft_consensus.cc:359] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.951609 12726 raft_consensus.cc:385] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:50.951882 12726 raft_consensus.cc:740] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:50.954126 12930 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:50.966491 12726 consensus_queue.cc:260] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:50.976224 12726 ts_tablet_manager.cc:1434] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.005s
I20260709 13:19:50.907183 12356 catalog_manager.cc:5697] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:50.979678 12730 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:51.052786 12784 raft_consensus.cc:493] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.061561 12727 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:51.065919 12725 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:50.980450 12947 raft_consensus.cc:515] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.094082 12784 raft_consensus.cc:515] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.096840 12726 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:51.095474 12725 ts_tablet_manager.cc:1403] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.330s	user 0.010s	sys 0.050s
I20260709 13:19:51.102043 12730 ts_tablet_manager.cc:1403] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.222s	user 0.030s	sys 0.016s
I20260709 13:19:51.102377 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:51.095255 12727 ts_tablet_manager.cc:1403] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.330s	user 0.012s	sys 0.007s
I20260709 13:19:51.106496 12725 raft_consensus.cc:359] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.166772 12725 raft_consensus.cc:385] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.169612 12725 raft_consensus.cc:740] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.107165 12947 leader_election.cc:290] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:51.171953 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
W20260709 13:19:51.107784 12647 leader_election.cc:343] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:51.175917 12647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 68319.4us
I20260709 13:19:51.176134 12857 raft_consensus.cc:493] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.177778 12772 raft_consensus.cc:493] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.178642 12772 raft_consensus.cc:515] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.182160 12772 leader_election.cc:290] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:51.176507 12454 raft_consensus.cc:3060] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.183691 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:51.186987 12857 raft_consensus.cc:515] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.188531 12726 tablet_bootstrap.cc:654] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.107189 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:51.105646 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:51.163785 12784 leader_election.cc:290] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:51.198503 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:51.199815 12533 raft_consensus.cc:2468] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:51.202883 12857 leader_election.cc:290] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:51.204325 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:51.204576 12871 consensus_queue.cc:1048] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.205395 12606 raft_consensus.cc:2468] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:51.207404 12646 leader_election.cc:304] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:51.190598 12680 raft_consensus.cc:2468] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:51.216398 12857 raft_consensus.cc:2804] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.194887 12725 consensus_queue.cc:260] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.217658 12772 raft_consensus.cc:493] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.217581 12573 leader_election.cc:304] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:51.218303 12772 raft_consensus.cc:515] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.219290 12771 raft_consensus.cc:2804] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.219730 12771 raft_consensus.cc:493] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.220124 12771 raft_consensus.cc:3060] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.224283 12772 leader_election.cc:290] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:51.230360 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:51.232980 12730 raft_consensus.cc:359] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.234681 12857 raft_consensus.cc:493] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.235217 12857 raft_consensus.cc:3060] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:51.236107 12421 leader_election.cc:343] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.242039 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:51.244833 12941 consensus_queue.cc:1048] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.245250 12530 raft_consensus.cc:2468] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:51.234596 12730 raft_consensus.cc:385] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.250099 12784 consensus_queue.cc:1048] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.250373 12730 raft_consensus.cc:740] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.251981 12730 consensus_queue.cc:260] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.253590 12730 ts_tablet_manager.cc:1434] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.151s	user 0.007s	sys 0.005s
I20260709 13:19:51.255390 12725 ts_tablet_manager.cc:1434] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.156s	user 0.010s	sys 0.014s
I20260709 13:19:51.245090 12727 raft_consensus.cc:359] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.257735 12727 raft_consensus.cc:385] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.258023 12727 raft_consensus.cc:740] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.258781 12727 consensus_queue.cc:260] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.259516 12730 tablet_bootstrap.cc:492] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:51.263011 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:51.264067 12458 raft_consensus.cc:2393] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:51.269724 12726 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:51.270339 12726 ts_tablet_manager.cc:1403] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.000s
I20260709 13:19:51.255570 12771 raft_consensus.cc:515] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.282058 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:51.282189 12533 raft_consensus.cc:1275] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.286319 12454 raft_consensus.cc:2468] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:51.284793 12726 raft_consensus.cc:359] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.288947 12726 raft_consensus.cc:385] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.289290 12726 raft_consensus.cc:740] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.289052 12771 leader_election.cc:290] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:51.290076 12726 consensus_queue.cc:260] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.294834 12726 ts_tablet_manager.cc:1434] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:19:51.296514 12726 tablet_bootstrap.cc:492] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:51.297061 12725 tablet_bootstrap.cc:492] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:51.282863 12730 tablet_bootstrap.cc:654] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.304450 12726 tablet_bootstrap.cc:654] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.306981 12857 raft_consensus.cc:515] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.308030 12680 raft_consensus.cc:2393] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:51.308173 12730 tablet_bootstrap.cc:492] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:51.308791 12730 ts_tablet_manager.cc:1403] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.000s
I20260709 13:19:51.309700 12570 leader_election.cc:304] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:51.311211 12772 raft_consensus.cc:3060] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.312235 12730 raft_consensus.cc:359] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.313050 12730 raft_consensus.cc:385] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.313328 12730 raft_consensus.cc:740] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.313548 12727 ts_tablet_manager.cc:1434] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.208s	user 0.010s	sys 0.002s
I20260709 13:19:51.314949 12730 consensus_queue.cc:260] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.317868 12730 ts_tablet_manager.cc:1434] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:19:51.319186 12730 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:51.319897 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:51.320605 12533 raft_consensus.cc:3060] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.322961 12772 raft_consensus.cc:2749] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.324121 12726 tablet_bootstrap.cc:492] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:51.324697 12726 ts_tablet_manager.cc:1403] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.006s
I20260709 13:19:51.325524 12730 tablet_bootstrap.cc:654] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.327797 12726 raft_consensus.cc:359] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.328522 12726 raft_consensus.cc:385] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.328820 12726 raft_consensus.cc:740] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.329382 12726 consensus_queue.cc:260] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.330619 12951 consensus_queue.cc:1048] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.331745 12730 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:51.332252 12730 ts_tablet_manager.cc:1403] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:19:51.336576 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:51.339246 12930 consensus_queue.cc:1048] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.340090 12454 raft_consensus.cc:1275] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:19:51.336525 12730 raft_consensus.cc:359] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.344228 12730 raft_consensus.cc:385] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.336288 12354 catalog_manager.cc:5697] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:51.343479 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:51.344650 12730 raft_consensus.cc:740] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.345132 12727 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:51.345539 12730 consensus_queue.cc:260] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.347925 12730 ts_tablet_manager.cc:1434] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:19:51.348294 12951 raft_consensus.cc:493] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.349087 12730 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:51.348829 12951 raft_consensus.cc:515] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.351080 12951 leader_election.cc:290] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:51.356773 12726 ts_tablet_manager.cc:1434] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:19:51.356130 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:51.358158 12726 tablet_bootstrap.cc:492] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:51.362104 12677 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:51.344281 12423 leader_election.cc:343] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:51.369594 12935 consensus_queue.cc:1048] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:19:51.381096 12423 leader_election.cc:304] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:51.380519 12356 catalog_manager.cc:5697] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.382658 12935 raft_consensus.cc:2749] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.373337 12930 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.384464 12930 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.387109 12930 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:51.389859 12857 leader_election.cc:290] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:51.392531 12784 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.394265 12730 tablet_bootstrap.cc:654] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.363687 12951 consensus_queue.cc:1048] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:19:51.394213 12784 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.401470 12533 raft_consensus.cc:2468] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:51.403507 12644 leader_election.cc:304] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:51.405982 12725 tablet_bootstrap.cc:654] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.409394 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f232fdc7c0e4d8190333cff24352967" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:51.410257 12607 raft_consensus.cc:2393] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:51.413966 12727 tablet_bootstrap.cc:654] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.416666 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:51.418077 12680 raft_consensus.cc:2468] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:51.427176 12573 leader_election.cc:304] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
W20260709 13:19:51.428004 12644 consensus_peers.cc:597] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:51.428514 12771 raft_consensus.cc:2804] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.429250 12857 consensus_queue.cc:1048] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.429394 12814 consensus_queue.cc:1048] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.429266 12771 raft_consensus.cc:697] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:51.431627 12771 consensus_queue.cc:237] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.437517 12726 tablet_bootstrap.cc:654] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.417141 12951 raft_consensus.cc:2804] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.416342 12930 consensus_queue.cc:1048] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:19:51.440582 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:51.441505 12455 raft_consensus.cc:2393] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:51.441461 12496 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:51.446592 12940 raft_consensus.cc:2804] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.452500 12940 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.452898 12940 raft_consensus.cc:3060] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.454391 12784 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:51.443377 12951 raft_consensus.cc:697] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:51.460834 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:51.461632 12680 raft_consensus.cc:2468] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:51.461613 12646 leader_election.cc:304] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:51.466483 12421 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:51.468339 12871 consensus_queue.cc:1048] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.469854 12947 raft_consensus.cc:2749] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.470810 12857 consensus_queue.cc:1048] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:51.471294 12935 raft_consensus.cc:2804] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.486338 12935 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.493947 12935 raft_consensus.cc:3060] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.505861 12930 raft_consensus.cc:493] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.506430 12930 raft_consensus.cc:515] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.508517 12930 leader_election.cc:290] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:51.508854 12678 raft_consensus.cc:3060] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.485767 12951 consensus_queue.cc:237] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.533998 12857 raft_consensus.cc:493] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.547952 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:51.559201 12725 tablet_bootstrap.cc:492] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:51.559805 12725 ts_tablet_manager.cc:1403] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.263s	user 0.018s	sys 0.007s
I20260709 13:19:51.560316 12644 leader_election.cc:304] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:51.578984 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:19:51.585426 12989 log.cc:927] Time spent T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:19:51.560921 12857 raft_consensus.cc:515] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.602066 12727 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:51.602648 12727 ts_tablet_manager.cc:1403] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.258s	user 0.009s	sys 0.010s
I20260709 13:19:51.605065 12871 consensus_queue.cc:1048] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.607120 12730 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:51.607710 12730 ts_tablet_manager.cc:1403] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.259s	user 0.018s	sys 0.008s
I20260709 13:19:51.607373 12941 consensus_queue.cc:1048] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:51.607151 12943 consensus_queue.cc:1048] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:19:51.601449 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:51.614353 12677 raft_consensus.cc:2468] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:51.620689 12730 raft_consensus.cc:359] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.648862 12730 raft_consensus.cc:385] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.649453 12730 raft_consensus.cc:740] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.623128 12725 raft_consensus.cc:359] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.653155 12725 raft_consensus.cc:385] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.653520 12725 raft_consensus.cc:740] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.647046 12727 raft_consensus.cc:359] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.654536 12727 raft_consensus.cc:385] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.654945 12727 raft_consensus.cc:740] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.639936 12857 leader_election.cc:290] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:51.628122 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:51.646045 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:51.677928 12529 raft_consensus.cc:2468] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:51.644634 12940 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.683619 12940 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:51.684500 12533 raft_consensus.cc:2393] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:51.685269 12647 leader_election.cc:304] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:51.689390 12725 consensus_queue.cc:260] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.691570 12951 raft_consensus.cc:2804] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.690003 12352 catalog_manager.cc:5697] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:51.640905 12496 leader_election.cc:304] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:51.700575 12727 consensus_queue.cc:260] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.703053 12814 raft_consensus.cc:2749] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.701292 12602 raft_consensus.cc:2468] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:51.701504 12930 raft_consensus.cc:2804] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:51.705543 12930 raft_consensus.cc:493] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.705914 12930 raft_consensus.cc:3060] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.694329 12951 raft_consensus.cc:493] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:51.699204 12354 catalog_manager.cc:5697] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:51.695843 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 55129.4us
I20260709 13:19:51.723258 12730 consensus_queue.cc:260] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.724584 12940 raft_consensus.cc:493] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.725876 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:51.733861 12930 raft_consensus.cc:515] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.750351 12726 tablet_bootstrap.cc:492] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:51.752611 12935 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:19:51.756625 12424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 53904.2us
I20260709 13:19:51.769330 12458 raft_consensus.cc:2393] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:51.757867 12727 ts_tablet_manager.cc:1434] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.155s	user 0.007s	sys 0.002s
I20260709 13:19:51.767463 12726 ts_tablet_manager.cc:1403] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.410s	user 0.033s	sys 0.016s
I20260709 13:19:51.763034 12951 raft_consensus.cc:3060] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.792742 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:51.798243 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:51.799080 12678 raft_consensus.cc:3060] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.774942 12605 raft_consensus.cc:2468] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:51.779052 12935 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:51.766683 12940 raft_consensus.cc:515] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:51.821272 12730 ts_tablet_manager.cc:1434] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.213s	user 0.007s	sys 0.005s
I20260709 13:19:51.823500 12727 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:51.821200 12726 raft_consensus.cc:359] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.824889 12726 raft_consensus.cc:385] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.825117 12726 raft_consensus.cc:740] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.835482 12725 ts_tablet_manager.cc:1434] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.275s	user 0.009s	sys 0.009s
I20260709 13:19:51.835362 12726 consensus_queue.cc:260] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:51.837652 12421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 79887.3us
I20260709 13:19:51.824079 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:51.849049 12730 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:51.850606 12725 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:51.851431 12726 ts_tablet_manager.cc:1434] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.002s
I20260709 13:19:51.854565 12726 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:51.859344 12532 raft_consensus.cc:2393] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:51.861580 12940 leader_election.cc:290] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:51.869340 12730 tablet_bootstrap.cc:654] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.871860 12943 consensus_queue.cc:1048] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:51.871918 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:51.877482 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:51.885262 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e8e4aa584954c6cb3fb640e00299a4e" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:51.886140 12458 raft_consensus.cc:2393] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:51.891734 12421 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:51.893567 12930 leader_election.cc:290] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:51.896301 12727 tablet_bootstrap.cc:654] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.899245 13012 raft_consensus.cc:2749] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.906210 12726 tablet_bootstrap.cc:654] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.917171 12951 raft_consensus.cc:515] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:51.924707 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 50291.2us
I20260709 13:19:51.926508 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:51.927165 12606 raft_consensus.cc:3060] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.927428 12678 raft_consensus.cc:2468] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:51.930090 12725 tablet_bootstrap.cc:654] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:51.933629 12951 leader_election.cc:290] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:51.934864 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:51.938561 12606 raft_consensus.cc:2468] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:51.949208 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:51.950109 12529 raft_consensus.cc:2393] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:51.949235 12726 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:51.950886 12726 ts_tablet_manager.cc:1403] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.005s
I20260709 13:19:51.951422 12647 leader_election.cc:304] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:51.946350 12730 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:51.952554 12730 ts_tablet_manager.cc:1403] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.110s	user 0.014s	sys 0.005s
I20260709 13:19:51.953291 12951 raft_consensus.cc:2749] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:51.947237 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1950837058f4c6da84a2dec12b369e2" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:51.955643 12678 raft_consensus.cc:2393] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:51.957706 12498 leader_election.cc:304] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:51.959807 13014 raft_consensus.cc:2804] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:51.955350 12730 raft_consensus.cc:359] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.960803 13014 raft_consensus.cc:697] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:51.961257 12730 raft_consensus.cc:385] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.961632 12730 raft_consensus.cc:740] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.960374 12726 raft_consensus.cc:359] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:51.963395 12726 raft_consensus.cc:385] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.950778 12496 leader_election.cc:304] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:51.964576 12726 raft_consensus.cc:740] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.962137 13014 consensus_queue.cc:237] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:51.962363 12730 consensus_queue.cc:260] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.970894 12726 consensus_queue.cc:260] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:51.977635 12725 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:51.977893 12943 raft_consensus.cc:3060] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:51.978426 12725 ts_tablet_manager.cc:1403] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.007s
I20260709 13:19:51.973670 12730 ts_tablet_manager.cc:1434] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:19:51.982757 12730 tablet_bootstrap.cc:492] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:51.985635 12935 raft_consensus.cc:493] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:51.986312 12935 raft_consensus.cc:515] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:51.988540 12951 consensus_queue.cc:1048] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:51.990849 12725 raft_consensus.cc:359] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:51.991986 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:51.988747 12935 leader_election.cc:290] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:51.996280 12725 raft_consensus.cc:385] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:51.997380 12725 raft_consensus.cc:740] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:51.999099 12725 consensus_queue.cc:260] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.008605 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.003345 12943 raft_consensus.cc:2749] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.010526 12421 leader_election.cc:304] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:52.012810 12935 raft_consensus.cc:2749] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.017372 12725 ts_tablet_manager.cc:1434] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.003s
I20260709 13:19:52.024885 12725 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
W20260709 13:19:52.018239 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 67581.5us
I20260709 13:19:52.029047 12496 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:52.034468 12730 tablet_bootstrap.cc:654] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.037351 12726 ts_tablet_manager.cc:1434] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.003s
I20260709 13:19:52.038506 12726 tablet_bootstrap.cc:492] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.038707 13005 consensus_queue.cc:1048] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.040126 12725 tablet_bootstrap.cc:654] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.044593 12943 raft_consensus.cc:2804] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.045202 12943 raft_consensus.cc:697] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:52.049796 12943 consensus_queue.cc:237] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.037380 12353 catalog_manager.cc:5697] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.061313 12951 consensus_queue.cc:1048] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.062009 12853 consensus_queue.cc:1048] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:52.077827 12727 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.078408 12727 ts_tablet_manager.cc:1403] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.289s	user 0.043s	sys 0.018s
I20260709 13:19:52.086292 12730 tablet_bootstrap.cc:492] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:52.086891 12730 ts_tablet_manager.cc:1403] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.104s	user 0.021s	sys 0.006s
I20260709 13:19:52.091645 12727 raft_consensus.cc:359] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.092383 12727 raft_consensus.cc:385] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.092644 12727 raft_consensus.cc:740] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.103047 12726 tablet_bootstrap.cc:654] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.107105 12730 raft_consensus.cc:359] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.107807 12730 raft_consensus.cc:385] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.108076 12730 raft_consensus.cc:740] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.109027 12727 consensus_queue.cc:260] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.111784 12727 ts_tablet_manager.cc:1434] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.002s
I20260709 13:19:52.108724 12730 consensus_queue.cc:260] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.123200 12951 raft_consensus.cc:493] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.123693 12951 raft_consensus.cc:515] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.125743 12951 leader_election.cc:290] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:52.129297 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.130525 12725 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.131073 12725 ts_tablet_manager.cc:1403] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.106s	user 0.026s	sys 0.001s
W20260709 13:19:52.131356 12646 leader_election.cc:343] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.132578 12730 ts_tablet_manager.cc:1434] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:19:52.135226 12730 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:52.136649 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.133874 12725 raft_consensus.cc:359] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.138402 12725 raft_consensus.cc:385] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.138705 12727 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.138716 12725 raft_consensus.cc:740] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.139835 12725 consensus_queue.cc:260] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:52.140954 12647 leader_election.cc:343] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.141422 12647 leader_election.cc:304] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:52.142197 12730 tablet_bootstrap.cc:654] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.142647 12725 ts_tablet_manager.cc:1434] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:19:52.144052 12725 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.145840 12727 tablet_bootstrap.cc:654] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.150956 12725 tablet_bootstrap.cc:654] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.154189 12730 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:52.154949 12730 ts_tablet_manager.cc:1403] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:19:52.157505 12943 raft_consensus.cc:493] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.158465 12943 raft_consensus.cc:515] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.142848 12951 raft_consensus.cc:2749] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.161119 12943 leader_election.cc:290] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:52.163236 12730 raft_consensus.cc:359] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.163921 12730 raft_consensus.cc:385] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.164171 12730 raft_consensus.cc:740] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.164875 12730 consensus_queue.cc:260] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.166356 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937d94e615b2444c82beb63e8bf72d7f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.167810 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937d94e615b2444c82beb63e8bf72d7f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.168473 12727 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.168735 12730 ts_tablet_manager.cc:1434] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.007s
I20260709 13:19:52.168995 12727 ts_tablet_manager.cc:1403] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.008s
I20260709 13:19:52.161875 12352 catalog_manager.cc:5697] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:52.169945 12730 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
W20260709 13:19:52.169379 12498 leader_election.cc:343] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:52.174705 12496 leader_election.cc:343] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.172561 12727 raft_consensus.cc:359] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.175374 12727 raft_consensus.cc:385] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.175660 12727 raft_consensus.cc:740] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.176530 12727 consensus_queue.cc:260] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.177274 12730 tablet_bootstrap.cc:654] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.178184 12496 leader_election.cc:304] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:52.179175 12943 raft_consensus.cc:2749] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.188597 12726 tablet_bootstrap.cc:492] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.189271 12726 ts_tablet_manager.cc:1403] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.004s
I20260709 13:19:52.190032 12727 ts_tablet_manager.cc:1434] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:19:52.191118 12606 raft_consensus.cc:3060] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.192106 12726 raft_consensus.cc:359] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.192854 12726 raft_consensus.cc:385] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.193123 12726 raft_consensus.cc:740] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.193933 12726 consensus_queue.cc:260] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.201009 12727 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.201834 12726 ts_tablet_manager.cc:1434] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:19:52.203203 12726 tablet_bootstrap.cc:492] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.209301 12726 tablet_bootstrap.cc:654] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.214594 12726 tablet_bootstrap.cc:492] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.215090 12726 ts_tablet_manager.cc:1403] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:19:52.217006 12727 tablet_bootstrap.cc:654] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.218559 12730 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:52.220527 12730 ts_tablet_manager.cc:1403] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.009s
I20260709 13:19:52.219591 12951 raft_consensus.cc:493] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.222612 12951 raft_consensus.cc:515] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.219694 12725 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.223765 12725 ts_tablet_manager.cc:1403] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.004s
I20260709 13:19:52.225754 12951 leader_election.cc:290] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.226068 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.226612 12730 raft_consensus.cc:359] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.227285 12730 raft_consensus.cc:385] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:19:52.227427 12646 leader_election.cc:343] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.227607 12730 raft_consensus.cc:740] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.228538 12730 consensus_queue.cc:260] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.230059 12725 raft_consensus.cc:359] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.230728 12730 ts_tablet_manager.cc:1434] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:19:52.231833 12730 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:52.231527 12726 raft_consensus.cc:359] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.232196 12726 raft_consensus.cc:385] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.232460 12726 raft_consensus.cc:740] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.233275 12726 consensus_queue.cc:260] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.230764 12725 raft_consensus.cc:385] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.234684 12725 raft_consensus.cc:740] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.235396 12726 ts_tablet_manager.cc:1434] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:19:52.236521 12726 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.235440 12725 consensus_queue.cc:260] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.238751 13006 raft_consensus.cc:493] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.239215 13006 raft_consensus.cc:515] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.241503 13006 leader_election.cc:290] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.242838 12726 tablet_bootstrap.cc:654] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.244191 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.244871 12678 raft_consensus.cc:2468] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:52.246235 12570 leader_election.cc:304] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:52.247267 13006 raft_consensus.cc:2804] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.248893 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:52.254000 13006 raft_consensus.cc:493] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.250329 12458 raft_consensus.cc:3060] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.251456 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:52.249687 12857 raft_consensus.cc:493] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.255942 12857 raft_consensus.cc:515] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
W20260709 13:19:52.256525 12570 leader_election.cc:343] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.257225 12726 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.257409 13006 raft_consensus.cc:3060] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.257740 12726 ts_tablet_manager.cc:1403] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:19:52.258858 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:19:52.260118 12644 leader_election.cc:343] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.260661 12644 leader_election.cc:304] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
W20260709 13:19:52.260746 12646 leader_election.cc:343] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.262295 12951 raft_consensus.cc:2749] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.265729 12857 leader_election.cc:290] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.277370 12725 ts_tablet_manager.cc:1434] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.001s
I20260709 13:19:52.278836 12725 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.286690 12726 raft_consensus.cc:359] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.287403 12726 raft_consensus.cc:385] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.287657 12726 raft_consensus.cc:740] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.290758 12730 tablet_bootstrap.cc:654] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.293898 12935 raft_consensus.cc:493] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.303109 12935 raft_consensus.cc:515] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.309455 13006 raft_consensus.cc:515] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.310407 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.303555 12725 tablet_bootstrap.cc:654] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.288427 12726 consensus_queue.cc:260] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.318069 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:52.308617 12935 leader_election.cc:290] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:52.313443 12529 raft_consensus.cc:2468] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:52.342092 12730 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:52.342684 12730 ts_tablet_manager.cc:1403] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.006s
I20260709 13:19:52.343704 12726 ts_tablet_manager.cc:1434] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 13:19:52.349609 12424 leader_election.cc:304] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:52.352258 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.353025 12606 raft_consensus.cc:2468] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
W20260709 13:19:52.364255 12644 leader_election.cc:343] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.367641 12727 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.368399 12727 ts_tablet_manager.cc:1403] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.168s	user 0.038s	sys 0.064s
I20260709 13:19:52.362205 12871 raft_consensus.cc:2804] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.369729 12871 raft_consensus.cc:493] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.370141 12871 raft_consensus.cc:3060] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.371445 12727 raft_consensus.cc:359] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.372241 12727 raft_consensus.cc:385] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.372570 12727 raft_consensus.cc:740] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.372924 12644 leader_election.cc:304] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:52.373328 12727 consensus_queue.cc:260] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.374225 12951 raft_consensus.cc:2749] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.363519 12935 raft_consensus.cc:493] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.375763 12935 raft_consensus.cc:515] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.376603 12727 ts_tablet_manager.cc:1434] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:19:52.377843 12935 leader_election.cc:290] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:52.379590 12727 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.395758 12727 tablet_bootstrap.cc:654] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.399722 13012 raft_consensus.cc:493] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.404150 13012 raft_consensus.cc:515] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.404170 12930 consensus_queue.cc:1048] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:19:52.420356 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:52.421000 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.422627 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.415257 13012 leader_election.cc:290] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:52.415026 12857 raft_consensus.cc:493] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.424661 12423 leader_election.cc:343] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.422602 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.424479 12871 raft_consensus.cc:515] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.425390 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:52.426096 12678 raft_consensus.cc:3060] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.427263 12725 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.427774 12725 ts_tablet_manager.cc:1403] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.010s
I20260709 13:19:52.424659 12857 raft_consensus.cc:515] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.430141 12857 leader_election.cc:290] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.430723 12725 raft_consensus.cc:359] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.431465 12725 raft_consensus.cc:385] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.431730 12725 raft_consensus.cc:740] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.431701 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:52.430900 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:52.434576 12730 raft_consensus.cc:359] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.435187 12606 raft_consensus.cc:3060] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:52.413801 12421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 60664.7us
I20260709 13:19:52.434410 12458 raft_consensus.cc:2468] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:52.435281 12730 raft_consensus.cc:385] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.436652 12730 raft_consensus.cc:740] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.437471 12644 leader_election.cc:304] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:52.437201 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.439436 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.440274 12943 consensus_queue.cc:1048] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:19:52.440814 12646 leader_election.cc:343] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:52.441250 12421 leader_election.cc:343] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.443066 12727 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.443557 12727 ts_tablet_manager.cc:1403] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.004s
I20260709 13:19:52.443333 12725 consensus_queue.cc:260] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.445245 12726 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.437312 12730 consensus_queue.cc:260] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.451150 12725 ts_tablet_manager.cc:1434] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.004s
I20260709 13:19:52.444048 12857 raft_consensus.cc:2804] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.452801 12730 ts_tablet_manager.cc:1434] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.110s	user 0.008s	sys 0.000s
I20260709 13:19:52.454630 12730 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:52.453565 12857 raft_consensus.cc:493] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.455687 12857 raft_consensus.cc:3060] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.457588 13006 leader_election.cc:290] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.444670 12871 leader_election.cc:290] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:52.461814 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:52.462999 12727 raft_consensus.cc:359] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.463806 12727 raft_consensus.cc:385] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.464111 12727 raft_consensus.cc:740] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.461880 12606 raft_consensus.cc:2468] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:52.466044 12727 consensus_queue.cc:260] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.467892 12727 ts_tablet_manager.cc:1434] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:19:52.471573 12423 leader_election.cc:304] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
W20260709 13:19:52.473183 12570 leader_election.cc:343] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.473536 13041 raft_consensus.cc:2804] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.474105 12727 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.474072 13041 raft_consensus.cc:697] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:52.474908 12943 raft_consensus.cc:493] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.475489 12940 raft_consensus.cc:493] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:52.475983 12424 leader_election.cc:343] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.475572 12943 raft_consensus.cc:515] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.476125 12940 raft_consensus.cc:515] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.476451 12424 leader_election.cc:304] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
W20260709 13:19:52.477648 12424 leader_election.cc:343] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.475062 13041 consensus_queue.cc:237] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.478068 12424 leader_election.cc:304] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:52.478790 12935 raft_consensus.cc:2749] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.479400 12935 raft_consensus.cc:2749] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.479714 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.487355 12940 leader_election.cc:290] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:52.480438 12680 raft_consensus.cc:2468] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:52.493150 12496 leader_election.cc:304] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:52.489308 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.495563 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:52.496656 12529 raft_consensus.cc:3060] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.484673 12943 leader_election.cc:290] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:19:52.498407 12496 leader_election.cc:343] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.499114 12943 raft_consensus.cc:2804] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.499518 12943 raft_consensus.cc:493] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.499859 12943 raft_consensus.cc:3060] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.502318 12941 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.504257 12725 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.505330 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:19:52.507361 12498 leader_election.cc:343] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.507594 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:52.507863 12498 leader_election.cc:304] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:52.510201 13013 raft_consensus.cc:2749] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.512318 12941 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.516189 12941 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.519733 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:52.521286 12496 leader_election.cc:343] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.521574 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:19:52.512339 12498 leader_election.cc:343] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.526336 12951 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.526866 12951 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.529920 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:52.531749 12644 leader_election.cc:343] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.492367 12678 raft_consensus.cc:2468] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:52.540858 12726 tablet_bootstrap.cc:654] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.537849 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.543506 12532 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:52.538249 12680 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:52.545816 12570 leader_election.cc:304] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:52.547504 12496 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:52.551339 12355 catalog_manager.cc:5697] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.536005 12951 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:52.553560 12647 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:52.555346 13009 raft_consensus.cc:2804] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.555719 13009 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.552230 13013 raft_consensus.cc:2804] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.556093 13009 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.556360 13013 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.556983 13013 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.558101 12772 raft_consensus.cc:2804] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.558642 12772 raft_consensus.cc:697] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:52.559460 12772 consensus_queue.cc:237] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.559657 12857 raft_consensus.cc:515] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.564509 13009 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.555830 12725 tablet_bootstrap.cc:654] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.576401 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:52.577544 12935 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.578028 12935 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.575663 12529 raft_consensus.cc:2468] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:52.579655 12941 consensus_queue.cc:1048] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.579972 12935 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:19:52.584367 12646 leader_election.cc:343] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.582264 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.586673 12680 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:52.587728 12421 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:52.589757 12871 raft_consensus.cc:2804] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.590121 12871 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.590449 12871 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.539296 12943 raft_consensus.cc:515] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.593677 13014 consensus_queue.cc:1048] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:52.602348 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
W20260709 13:19:52.604310 12644 leader_election.cc:343] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.605679 13009 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:52.596899 12727 tablet_bootstrap.cc:654] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.612313 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.613045 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:52.624392 12455 raft_consensus.cc:3060] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.608646 12857 leader_election.cc:290] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.631801 12352 catalog_manager.cc:5697] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.639040 12943 leader_election.cc:290] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:19:52.639629 12424 leader_election.cc:343] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.641563 12871 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.643646 12871 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:52.621945 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:52.645264 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:52.646008 12678 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.653704 12730 tablet_bootstrap.cc:654] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.658206 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:52.659893 12678 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:52.661973 12421 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:52.623131 13013 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.655609 12455 raft_consensus.cc:2468] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:52.671897 13041 raft_consensus.cc:2804] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.672492 12529 raft_consensus.cc:2393] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:52.673172 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:52.672426 13041 raft_consensus.cc:697] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:52.675107 13041 consensus_queue.cc:237] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.675740 12726 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.676323 12726 ts_tablet_manager.cc:1403] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.260s	user 0.014s	sys 0.003s
I20260709 13:19:52.679116 12726 raft_consensus.cc:359] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.679764 12726 raft_consensus.cc:385] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.680011 12726 raft_consensus.cc:740] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.680634 12726 consensus_queue.cc:260] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.682683 12726 ts_tablet_manager.cc:1434] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:19:52.683643 12726 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.686405 12647 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:52.686833 13013 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.687659 13009 raft_consensus.cc:2749] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 13:19:52.688832 12498 leader_election.cc:343] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.690882 12727 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.691246 12727 ts_tablet_manager.cc:1403] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.222s	user 0.012s	sys 0.004s
I20260709 13:19:52.700101 12644 leader_election.cc:304] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:52.701404 12857 raft_consensus.cc:2804] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.701870 12857 raft_consensus.cc:697] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:52.702636 12857 consensus_queue.cc:237] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.705295 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:52.706096 12676 raft_consensus.cc:2393] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:52.709436 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:52.709904 12726 tablet_bootstrap.cc:654] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:52.693070 12424 leader_election.cc:343] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.710096 12677 raft_consensus.cc:3060] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.718263 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:52.728001 12730 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:52.728457 12730 ts_tablet_manager.cc:1403] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.274s	user 0.020s	sys 0.000s
W20260709 13:19:52.727512 12496 leader_election.cc:343] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.737215 12496 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:52.738181 12943 raft_consensus.cc:2749] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.743024 12727 raft_consensus.cc:359] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.743710 12727 raft_consensus.cc:385] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.743976 12727 raft_consensus.cc:740] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.746275 12677 raft_consensus.cc:2468] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:52.750872 12356 catalog_manager.cc:5697] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.754968 12727 consensus_queue.cc:260] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.757691 12496 leader_election.cc:304] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:52.758558 12943 raft_consensus.cc:2804] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.759035 12943 raft_consensus.cc:697] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:52.759866 12943 consensus_queue.cc:237] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.769820 12727 ts_tablet_manager.cc:1434] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.005s
I20260709 13:19:52.771589 12727 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.772547 12725 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.773165 12725 ts_tablet_manager.cc:1403] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.293s	user 0.010s	sys 0.014s
I20260709 13:19:52.774019 12730 raft_consensus.cc:359] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.774755 12730 raft_consensus.cc:385] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.775018 12730 raft_consensus.cc:740] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.776278 12725 raft_consensus.cc:359] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.777025 12725 raft_consensus.cc:385] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.777571 12725 raft_consensus.cc:740] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.779315 12727 tablet_bootstrap.cc:654] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.780227 12355 catalog_manager.cc:5697] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.784013 12726 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.784554 12726 ts_tablet_manager.cc:1403] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.009s
I20260709 13:19:52.787745 12730 consensus_queue.cc:260] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.786180 12725 consensus_queue.cc:260] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.794026 12725 ts_tablet_manager.cc:1434] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:19:52.795619 12725 tablet_bootstrap.cc:492] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.795756 12726 raft_consensus.cc:359] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.797226 12726 raft_consensus.cc:385] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.797533 12726 raft_consensus.cc:740] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.798223 12726 consensus_queue.cc:260] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.800550 12726 ts_tablet_manager.cc:1434] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:19:52.802430 12355 catalog_manager.cc:5697] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:52.808650 12726 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.811367 12730 ts_tablet_manager.cc:1434] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 13:19:52.812794 12730 tablet_bootstrap.cc:492] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:52.820063 12726 tablet_bootstrap.cc:654] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.820856 12730 tablet_bootstrap.cc:654] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.824410 12725 tablet_bootstrap.cc:654] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.831234 12726 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.831835 12726 ts_tablet_manager.cc:1403] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:19:52.834791 12726 raft_consensus.cc:359] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.835532 12726 raft_consensus.cc:385] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.835803 12726 raft_consensus.cc:740] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.838078 12726 consensus_queue.cc:260] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.839433 12725 tablet_bootstrap.cc:492] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.839994 12725 ts_tablet_manager.cc:1403] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.010s
I20260709 13:19:52.840225 12726 ts_tablet_manager.cc:1434] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:19:52.841276 12726 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.842996 12725 raft_consensus.cc:359] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.843712 12725 raft_consensus.cc:385] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.844046 12725 raft_consensus.cc:740] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.844872 12725 consensus_queue.cc:260] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.847041 12725 ts_tablet_manager.cc:1434] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:19:52.847851 12726 tablet_bootstrap.cc:654] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.848181 12725 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.853142 13006 raft_consensus.cc:493] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.853711 13006 raft_consensus.cc:515] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.854446 12725 tablet_bootstrap.cc:654] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.856582 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.857299 12678 raft_consensus.cc:2468] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:52.858345 12570 leader_election.cc:304] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:52.858801 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:52.859174 12853 raft_consensus.cc:2804] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:52.859611 12853 raft_consensus.cc:493] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:52.859927 12853 raft_consensus.cc:3060] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:52.861560 12570 leader_election.cc:343] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.863727 12725 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.864205 12725 ts_tablet_manager.cc:1403] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 13:19:52.864359 13006 leader_election.cc:290] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.861788 12726 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.869144 12726 ts_tablet_manager.cc:1403] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.007s
I20260709 13:19:52.871268 12727 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.871853 12730 tablet_bootstrap.cc:492] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:52.871793 12727 ts_tablet_manager.cc:1403] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.100s	user 0.014s	sys 0.005s
I20260709 13:19:52.872395 12730 ts_tablet_manager.cc:1403] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.000s
I20260709 13:19:52.874878 12727 raft_consensus.cc:359] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.875128 12730 raft_consensus.cc:359] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.875741 12730 raft_consensus.cc:385] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.872125 12726 raft_consensus.cc:359] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.876093 12730 raft_consensus.cc:740] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.875999 12727 raft_consensus.cc:385] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.876675 12727 raft_consensus.cc:740] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.877544 12727 consensus_queue.cc:260] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.878726 12725 raft_consensus.cc:359] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.879575 12725 raft_consensus.cc:385] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.879925 12725 raft_consensus.cc:740] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.880749 12725 consensus_queue.cc:260] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.880424 12730 consensus_queue.cc:260] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.883123 12725 ts_tablet_manager.cc:1434] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:19:52.876567 12726 raft_consensus.cc:385] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.883626 12726 raft_consensus.cc:740] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.885978 12726 consensus_queue.cc:260] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:52.888654 12730 ts_tablet_manager.cc:1434] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:19:52.879779 12727 ts_tablet_manager.cc:1434] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:19:52.889890 12726 ts_tablet_manager.cc:1434] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:19:52.890502 12727 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.892463 12726 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:52.884311 12725 tablet_bootstrap.cc:492] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.894620 12730 tablet_bootstrap.cc:492] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:52.899667 12725 tablet_bootstrap.cc:654] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.909116 12772 raft_consensus.cc:493] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.909974 12772 raft_consensus.cc:515] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.912083 12772 leader_election.cc:290] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.915314 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:52.876083 12853 raft_consensus.cc:515] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.917325 12727 tablet_bootstrap.cc:654] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.918632 12853 leader_election.cc:290] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:52.919219 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:52.919802 12677 raft_consensus.cc:3060] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.916018 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:52.924857 12454 raft_consensus.cc:2393] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:52.925994 12570 leader_election.cc:304] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:52.926618 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:52.927455 12853 raft_consensus.cc:3060] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:52.928210 12726 tablet_bootstrap.cc:654] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.932946 13041 consensus_queue.cc:1048] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:52.936252 12677 raft_consensus.cc:2468] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
W20260709 13:19:52.932631 12570 leader_election.cc:343] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.947337 12725 tablet_bootstrap.cc:492] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:52.940645 12853 raft_consensus.cc:2749] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.944561 12730 tablet_bootstrap.cc:654] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.949455 12570 leader_election.cc:304] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:19:52.947868 12725 ts_tablet_manager.cc:1403] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 13:19:52.950825 12853 raft_consensus.cc:2804] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:52.951565 12853 raft_consensus.cc:697] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:52.953022 12935 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.953509 12935 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.954841 12725 raft_consensus.cc:359] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.955564 12725 raft_consensus.cc:385] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.955935 12725 raft_consensus.cc:740] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.956141 12727 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:52.956612 12727 ts_tablet_manager.cc:1403] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.000s
I20260709 13:19:52.957080 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.957432 12935 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:52.956565 12725 consensus_queue.cc:260] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:52.958449 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:19:52.958562 12424 leader_election.cc:343] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.952447 12853 consensus_queue.cc:237] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
W20260709 13:19:52.960001 12423 leader_election.cc:343] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:52.960266 12725 ts_tablet_manager.cc:1434] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 13:19:52.960404 12423 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:52.961190 12935 raft_consensus.cc:2749] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.961428 12725 tablet_bootstrap.cc:492] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:52.964102 12727 raft_consensus.cc:359] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.964818 12727 raft_consensus.cc:385] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:52.965099 12727 raft_consensus.cc:740] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:52.965982 12727 consensus_queue.cc:260] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:52.967939 12725 tablet_bootstrap.cc:654] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.969792 12727 ts_tablet_manager.cc:1434] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:19:52.970924 12727 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:52.977089 12727 tablet_bootstrap.cc:654] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:52.969691 12726 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:52.984936 12726 ts_tablet_manager.cc:1403] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.005s
I20260709 13:19:52.986660 12772 raft_consensus.cc:493] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:52.987206 12772 raft_consensus.cc:515] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:52.996625 12772 leader_election.cc:290] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:52.997815 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:52.998346 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
W20260709 13:19:53.000000 12573 leader_election.cc:343] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.000013 12725 tablet_bootstrap.cc:492] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:53.000403 12935 consensus_queue.cc:1048] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.001863 12725 ts_tablet_manager.cc:1403] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.041s	user 0.000s	sys 0.015s
W20260709 13:19:53.000520 12570 leader_election.cc:343] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.003150 12570 leader_election.cc:304] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:53.004262 12772 raft_consensus.cc:2749] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:52.999564 12352 catalog_manager.cc:5697] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.017017 12726 raft_consensus.cc:359] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.017792 12726 raft_consensus.cc:385] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.018064 12726 raft_consensus.cc:740] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.018172 12853 raft_consensus.cc:493] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.018796 12853 raft_consensus.cc:515] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.019411 12725 raft_consensus.cc:359] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.020077 12725 raft_consensus.cc:385] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.020329 12725 raft_consensus.cc:740] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.021795 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:53.022441 12532 raft_consensus.cc:2468] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:53.022984 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.023530 12727 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:53.024057 12727 ts_tablet_manager.cc:1403] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.003s
I20260709 13:19:53.020961 12725 consensus_queue.cc:260] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:53.025722 12570 leader_election.cc:343] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.026762 12727 raft_consensus.cc:359] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.027386 12727 raft_consensus.cc:385] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.027488 12725 ts_tablet_manager.cc:1434] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 13:19:53.027683 12727 raft_consensus.cc:740] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.028411 12573 leader_election.cc:304] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:53.029398 12772 raft_consensus.cc:2804] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.029788 12772 raft_consensus.cc:493] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.030084 12772 raft_consensus.cc:3060] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.030593 12727 consensus_queue.cc:260] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.034040 12727 ts_tablet_manager.cc:1434] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:19:53.035900 12727 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:53.041437 12727 tablet_bootstrap.cc:654] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.042713 12725 tablet_bootstrap.cc:492] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:53.043149 12857 raft_consensus.cc:493] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.043622 12857 raft_consensus.cc:515] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.044612 12853 leader_election.cc:290] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.045782 12857 leader_election.cc:290] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.059651 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:53.061869 12647 leader_election.cc:343] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.064538 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:19:53.065912 12646 leader_election.cc:343] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.066377 12646 leader_election.cc:304] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:53.067654 12857 raft_consensus.cc:2749] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.068740 13006 raft_consensus.cc:493] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.069269 13006 raft_consensus.cc:515] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.071282 13006 leader_election.cc:290] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.072314 12730 tablet_bootstrap.cc:492] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:53.072885 12730 ts_tablet_manager.cc:1403] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.178s	user 0.051s	sys 0.022s
I20260709 13:19:53.073483 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:53.073750 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.021016 12726 consensus_queue.cc:260] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:53.074837 12573 leader_election.cc:343] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.075893 12730 raft_consensus.cc:359] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.076570 12726 ts_tablet_manager.cc:1434] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:19:53.076828 12730 raft_consensus.cc:385] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.077173 12730 raft_consensus.cc:740] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
W20260709 13:19:53.077942 12570 leader_election.cc:343] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.078018 12730 consensus_queue.cc:260] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.078508 12570 leader_election.cc:304] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:53.079770 12725 tablet_bootstrap.cc:654] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.080113 13006 raft_consensus.cc:2749] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.077836 12529 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.086957 12730 ts_tablet_manager.cc:1434] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:19:53.093885 12730 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:53.099582 12935 consensus_queue.cc:1048] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.107528 12772 raft_consensus.cc:515] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.115502 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:53.115890 12772 leader_election.cc:290] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.116482 12533 raft_consensus.cc:3060] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.118606 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
W20260709 13:19:53.120052 12570 leader_election.cc:343] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.123842 12533 raft_consensus.cc:2468] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:53.109766 12726 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:53.125174 12573 leader_election.cc:304] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:53.126318 12772 raft_consensus.cc:2804] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.126451 12727 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:53.127105 12727 ts_tablet_manager.cc:1403] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.091s	user 0.033s	sys 0.015s
I20260709 13:19:53.127745 12730 tablet_bootstrap.cc:654] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.128316 12935 raft_consensus.cc:493] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.142822 12935 raft_consensus.cc:515] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.143401 12726 tablet_bootstrap.cc:654] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.149940 12935 leader_election.cc:290] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.155800 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.159626 12454 raft_consensus.cc:3060] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.131161 12727 raft_consensus.cc:359] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.160388 12727 raft_consensus.cc:385] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.139295 13009 consensus_queue.cc:1048] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.164981 12727 raft_consensus.cc:740] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.166391 13009 raft_consensus.cc:493] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.166213 12727 consensus_queue.cc:260] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.168658 12727 ts_tablet_manager.cc:1434] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.006s
I20260709 13:19:53.178793 12727 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:53.171033 13041 consensus_queue.cc:1048] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:53.182788 13075 consensus_queue.cc:1048] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.183015 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.166996 13009 raft_consensus.cc:515] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.169169 12772 raft_consensus.cc:697] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:53.214603 12678 raft_consensus.cc:2393] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:53.215023 12727 tablet_bootstrap.cc:654] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.214846 12772 consensus_queue.cc:237] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.216900 12730 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:53.217411 12730 ts_tablet_manager.cc:1403] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.124s	user 0.031s	sys 0.022s
I20260709 13:19:53.219545 13009 leader_election.cc:290] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.222831 13009 consensus_queue.cc:1048] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.225745 12943 raft_consensus.cc:493] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.220212 12730 raft_consensus.cc:359] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.226573 12421 leader_election.cc:304] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:53.226343 12943 raft_consensus.cc:515] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.226409 12730 raft_consensus.cc:385] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.228025 13013 raft_consensus.cc:493] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.228252 12730 raft_consensus.cc:740] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.228984 12935 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.228569 13013 raft_consensus.cc:515] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.229463 12935 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.229696 12730 consensus_queue.cc:260] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.231352 13013 leader_election.cc:290] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:53.231482 12935 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:53.228443 12943 leader_election.cc:290] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.233335 12730 ts_tablet_manager.cc:1434] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:19:53.233546 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.237898 12680 raft_consensus.cc:2468] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:53.238709 12730 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:53.236956 12871 raft_consensus.cc:493] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.239302 12496 leader_election.cc:304] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.238830 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937d94e615b2444c82beb63e8bf72d7f" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.240123 12605 raft_consensus.cc:2468] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:53.240950 12943 raft_consensus.cc:2804] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.241401 12943 raft_consensus.cc:493] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.241773 12943 raft_consensus.cc:3060] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:53.234270 12498 consensus_peers.cc:597] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:53.239840 12871 raft_consensus.cc:515] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.245862 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.246558 12458 raft_consensus.cc:2468] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:53.248965 12871 leader_election.cc:290] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.249670 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937d94e615b2444c82beb63e8bf72d7f" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:53.250337 12532 raft_consensus.cc:2468] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 0.
I20260709 13:19:53.251096 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:53.251848 12533 raft_consensus.cc:2393] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:53.251858 12951 raft_consensus.cc:493] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.252466 12951 raft_consensus.cc:515] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.254498 12647 leader_election.cc:304] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.250226 12730 tablet_bootstrap.cc:654] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.260351 12857 raft_consensus.cc:2804] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.261796 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.137702 12725 tablet_bootstrap.cc:492] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:53.265226 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.282065 12676 raft_consensus.cc:2393] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:19:53.283049 12725 ts_tablet_manager.cc:1403] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.241s	user 0.010s	sys 0.001s
I20260709 13:19:53.285977 12725 raft_consensus.cc:359] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.328236 12725 raft_consensus.cc:385] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.266176 12943 raft_consensus.cc:515] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.274514 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.279120 13013 raft_consensus.cc:493] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.329295 13013 raft_consensus.cc:515] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.331079 12943 leader_election.cc:290] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:53.288040 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:53.267628 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.288424 12857 raft_consensus.cc:493] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.333141 12857 raft_consensus.cc:3060] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.336192 13040 raft_consensus.cc:2749] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.296669 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.299923 12496 leader_election.cc:304] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.310041 12730 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:53.317445 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.331310 13013 leader_election.cc:290] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:53.337880 12730 ts_tablet_manager.cc:1403] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.020s
I20260709 13:19:53.338270 13013 raft_consensus.cc:2804] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.338722 13013 raft_consensus.cc:493] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.339061 13013 raft_consensus.cc:3060] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.340718 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.340822 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:53.340965 12730 raft_consensus.cc:359] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.341706 12730 raft_consensus.cc:385] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.341710 12680 raft_consensus.cc:3060] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.342113 12730 raft_consensus.cc:740] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
W20260709 13:19:53.342352 12496 leader_election.cc:343] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.342864 12730 consensus_queue.cc:260] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.287191 12951 leader_election.cc:290] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:19:53.332640 12647 leader_election.cc:343] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.320039 12356 catalog_manager.cc:5697] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:53.328687 12725 raft_consensus.cc:740] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.345809 12725 consensus_queue.cc:260] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.348315 12725 ts_tablet_manager.cc:1434] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.065s	user 0.005s	sys 0.000s
I20260709 13:19:53.294167 12421 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
W20260709 13:19:53.351712 12496 leader_election.cc:343] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.350924 12680 raft_consensus.cc:2468] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:53.352362 13040 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.354709 12496 leader_election.cc:304] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.356482 13087 raft_consensus.cc:2804] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:53.352036 12421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 57976us
I20260709 13:19:53.358853 13087 raft_consensus.cc:697] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:53.359848 13087 consensus_queue.cc:237] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:19:53.367808 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 50712.1us
I20260709 13:19:53.376502 12725 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
W20260709 13:19:53.379122 12498 leader_election.cc:343] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:53.376850 12421 leader_election.cc:343] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.376492 12727 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:53.379994 12727 ts_tablet_manager.cc:1403] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.202s	user 0.045s	sys 0.050s
I20260709 13:19:53.382831 12727 raft_consensus.cc:359] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.383582 12727 raft_consensus.cc:385] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.383850 12727 raft_consensus.cc:740] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.384408 12727 consensus_queue.cc:260] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.392374 12725 tablet_bootstrap.cc:654] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.401409 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:53.403095 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.403707 12454 raft_consensus.cc:2468] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
W20260709 13:19:53.405869 12644 leader_election.cc:343] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:53.406369 12423 leader_election.cc:343] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.406863 12935 raft_consensus.cc:493] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.407196 12772 consensus_queue.cc:1048] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.407503 12935 raft_consensus.cc:515] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.396559 12726 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:53.409818 12726 ts_tablet_manager.cc:1403] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.300s	user 0.030s	sys 0.019s
I20260709 13:19:53.410007 13093 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.410553 13093 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:53.411152 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.411963 12677 raft_consensus.cc:2393] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:53.409765 12935 leader_election.cc:290] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.396996 12727 ts_tablet_manager.cc:1434] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:19:53.396847 13013 raft_consensus.cc:515] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.413607 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.414369 12727 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:19:53.414937 12646 leader_election.cc:343] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.415089 13013 leader_election.cc:290] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
W20260709 13:19:53.400875 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 46268.4us
I20260709 13:19:53.401278 13040 raft_consensus.cc:2749] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.416183 13093 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:53.415081 12644 leader_election.cc:304] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:53.406850 12423 leader_election.cc:304] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:53.418179 12951 raft_consensus.cc:2749] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.418780 13040 raft_consensus.cc:2749] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.419040 12772 raft_consensus.cc:493] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.418618 12726 raft_consensus.cc:359] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.417995 12857 raft_consensus.cc:515] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.423141 12772 raft_consensus.cc:515] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.424855 12857 leader_election.cc:290] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.425159 12772 leader_election.cc:290] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:53.423162 12726 raft_consensus.cc:385] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.425621 12726 raft_consensus.cc:740] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.426745 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:53.426273 12726 consensus_queue.cc:260] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.428321 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937d94e615b2444c82beb63e8bf72d7f" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:53.428925 12529 raft_consensus.cc:3060] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.429848 12726 ts_tablet_manager.cc:1434] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:19:53.430871 12726 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:53.432907 13013 raft_consensus.cc:493] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.433481 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.433424 13013 raft_consensus.cc:515] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.438964 13013 leader_election.cc:290] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.438859 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
W20260709 13:19:53.440284 12498 leader_election.cc:343] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.441501 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.442165 12604 raft_consensus.cc:2468] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:53.444751 12498 leader_election.cc:304] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.442312 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4185e974866b49798be93199dbf6a46d" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:53.423650 12725 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:53.445786 13013 raft_consensus.cc:2804] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.446800 13013 raft_consensus.cc:493] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.447232 13013 raft_consensus.cc:3060] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:53.447431 12496 leader_election.cc:343] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.448323 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.448443 12496 leader_election.cc:304] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:53.436645 12726 tablet_bootstrap.cc:654] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.451946 12930 raft_consensus.cc:2804] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.446259 12680 raft_consensus.cc:2393] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:53.452335 12930 raft_consensus.cc:493] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.452735 12727 tablet_bootstrap.cc:654] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.455890 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:53.456583 12725 ts_tablet_manager.cc:1403] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.008s
I20260709 13:19:53.452914 12930 raft_consensus.cc:3060] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.453781 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "937d94e615b2444c82beb63e8bf72d7f" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:53.453980 12570 leader_election.cc:304] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
W20260709 13:19:53.466581 12644 leader_election.cc:343] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.480937 12644 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:53.481812 12951 raft_consensus.cc:2749] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.444712 12529 raft_consensus.cc:2468] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:53.458606 12423 leader_election.cc:304] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:53.484145 12456 raft_consensus.cc:3060] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.484745 13092 raft_consensus.cc:3060] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.484889 12604 raft_consensus.cc:3060] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.489077 12772 raft_consensus.cc:3060] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.489316 12647 leader_election.cc:304] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.492695 13093 raft_consensus.cc:2804] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.493186 13093 raft_consensus.cc:697] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:53.494829 13093 consensus_queue.cc:237] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:53.496028 12725 raft_consensus.cc:359] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.496748 12725 raft_consensus.cc:385] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.497061 12725 raft_consensus.cc:740] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.500216 12725 consensus_queue.cc:260] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:53.502177 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 48296.2us
I20260709 13:19:53.510468 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.510546 13092 raft_consensus.cc:2749] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.512609 13013 raft_consensus.cc:515] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.525981 12356 catalog_manager.cc:5697] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:53.546672 13006 consensus_queue.cc:1048] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.554421 12772 raft_consensus.cc:2749] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:53.482772 12943 consensus_queue.cc:1048] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:19:53.564926 12725 ts_tablet_manager.cc:1434] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:19:53.568869 12727 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:53.569139 12604 raft_consensus.cc:2468] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:53.569581 12727 ts_tablet_manager.cc:1403] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.004s
I20260709 13:19:53.571655 12930 raft_consensus.cc:515] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.573746 12727 raft_consensus.cc:359] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.577288 12727 raft_consensus.cc:385] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.577963 12727 raft_consensus.cc:740] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.579226 12727 consensus_queue.cc:260] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.576917 12730 ts_tablet_manager.cc:1434] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.239s	user 0.033s	sys 0.041s
I20260709 13:19:53.582810 12726 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:53.583513 12726 ts_tablet_manager.cc:1403] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.153s	user 0.018s	sys 0.004s
I20260709 13:19:53.595111 13097 raft_consensus.cc:493] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:53.595846 13097 raft_consensus.cc:515] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.598855 13097 leader_election.cc:290] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.600178 12727 ts_tablet_manager.cc:1434] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:19:53.565809 13013 leader_election.cc:290] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.612120 12730 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:53.613858 12725 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
W20260709 13:19:53.584893 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 99685.7us
W20260709 13:19:53.626997 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:53.628883 12727 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:53.641407 12930 leader_election.cc:290] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:53.641842 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:53.645833 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8359fd6a469b4460a658e1646de646f8" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:53.646636 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8359fd6a469b4460a658e1646de646f8" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:53.647289 12605 raft_consensus.cc:2468] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:53.642475 12607 raft_consensus.cc:3060] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:53.649273 12496 leader_election.cc:343] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.646677 12455 raft_consensus.cc:2468] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:53.651965 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:53.652586 12454 raft_consensus.cc:3060] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.646260 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:53.653235 12496 leader_election.cc:304] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.653416 12453 raft_consensus.cc:3060] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.654018 12930 raft_consensus.cc:2804] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:53.654507 12930 raft_consensus.cc:493] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:53.654846 12930 raft_consensus.cc:3060] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.656397 12676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:53.657778 13075 consensus_queue.cc:1048] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.662709 12930 raft_consensus.cc:515] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.665658 12930 leader_election.cc:290] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:53.628468 12456 raft_consensus.cc:2468] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:53.666985 12454 raft_consensus.cc:2468] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:53.668292 12730 tablet_bootstrap.cc:654] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.668558 12496 leader_election.cc:304] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:53.669384 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8359fd6a469b4460a658e1646de646f8" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:53.669708 12496 leader_election.cc:304] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.670073 12454 raft_consensus.cc:3060] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.670471 12943 raft_consensus.cc:2804] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.670604 12930 raft_consensus.cc:2804] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.671058 12943 raft_consensus.cc:697] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:53.671219 12930 raft_consensus.cc:697] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:53.672057 12930 consensus_queue.cc:237] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.672880 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8359fd6a469b4460a658e1646de646f8" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:53.673596 12605 raft_consensus.cc:3060] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:53.671968 12943 consensus_queue.cc:237] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:53.677616 12496 leader_election.cc:343] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:53.683275 12772 consensus_queue.cc:1048] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:53.665958 12727 tablet_bootstrap.cc:654] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:53.670433 12607 raft_consensus.cc:2468] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:53.696094 12498 leader_election.cc:304] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:53.696983 13087 raft_consensus.cc:2804] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:53.697578 13087 raft_consensus.cc:697] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:53.698539 13087 consensus_queue.cc:237] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:53.768486 12726 raft_consensus.cc:359] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.769191 12726 raft_consensus.cc:385] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:53.769464 12726 raft_consensus.cc:740] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:53.779693 12726 consensus_queue.cc:260] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:53.785868 12453 raft_consensus.cc:2468] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:53.814384 12726 ts_tablet_manager.cc:1434] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.230s	user 0.010s	sys 0.001s
I20260709 13:19:53.799041 12605 raft_consensus.cc:2468] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:53.830857 12726 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:53.850896 12725 tablet_bootstrap.cc:654] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:53.841254 12570 consensus_peers.cc:597] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd -> Peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Couldn't send request to peer e42f0f6820a54d65880b5a40d1e1d4e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:53.884593 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 49002.5us
I20260709 13:19:54.014148 12726 tablet_bootstrap.cc:654] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:54.015513 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 130123us
I20260709 13:19:54.024633 12730 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:54.025374 12730 ts_tablet_manager.cc:1403] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.416s	user 0.019s	sys 0.006s
I20260709 13:19:54.032327 12727 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:54.033015 12727 ts_tablet_manager.cc:1403] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.408s	user 0.024s	sys 0.017s
W20260709 13:19:54.013751 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 137895us
I20260709 13:19:54.049433 12352 catalog_manager.cc:5697] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 1 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } }
W20260709 13:19:54.067233 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 218593us
I20260709 13:19:54.073309 12727 raft_consensus.cc:359] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.077555 12727 raft_consensus.cc:385] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.077796 12727 raft_consensus.cc:740] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.079051 12727 consensus_queue.cc:260] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.086208 12727 ts_tablet_manager.cc:1434] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.053s	user 0.002s	sys 0.004s
I20260709 13:19:54.083439 12943 raft_consensus.cc:493] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.096875 12727 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:19:54.101135 13114 log.cc:927] Time spent T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:19:54.102826 12454 raft_consensus.cc:2468] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:54.096596 12943 raft_consensus.cc:515] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.159101 12726 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:54.159751 12726 ts_tablet_manager.cc:1403] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.332s	user 0.005s	sys 0.027s
I20260709 13:19:54.171759 12725 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:54.172395 12725 ts_tablet_manager.cc:1403] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.560s	user 0.025s	sys 0.011s
W20260709 13:19:54.174516 12424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 53938.2us
I20260709 13:19:54.177006 13040 raft_consensus.cc:493] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.177440 12726 raft_consensus.cc:359] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.179324 12726 raft_consensus.cc:385] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.179628 12726 raft_consensus.cc:740] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.183471 12726 consensus_queue.cc:260] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.148710 12943 leader_election.cc:290] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:54.177466 13040 raft_consensus.cc:515] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.188443 13040 leader_election.cc:290] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:54.192307 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:54.194329 12726 ts_tablet_manager.cc:1434] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:19:54.192570 12496 leader_election.cc:304] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:54.202378 12730 raft_consensus.cc:359] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.206008 12730 raft_consensus.cc:385] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.206377 12730 raft_consensus.cc:740] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.204087 13093 consensus_queue.cc:1048] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:19:54.211813 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:54.210333 13110 raft_consensus.cc:2804] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.222777 12730 consensus_queue.cc:260] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.203495 12452 raft_consensus.cc:3060] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.230674 12726 tablet_bootstrap.cc:492] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:54.232909 13108 consensus_queue.cc:1048] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:19:54.227815 13110 raft_consensus.cc:697] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:54.235499 13110 consensus_queue.cc:237] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.237574 12725 raft_consensus.cc:359] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.238461 12725 raft_consensus.cc:385] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.238720 12725 raft_consensus.cc:740] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.243897 12725 consensus_queue.cc:260] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.245306 12730 ts_tablet_manager.cc:1434] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.220s	user 0.008s	sys 0.001s
I20260709 13:19:54.263000 12857 consensus_queue.cc:1048] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:54.271287 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:54.272101 12680 raft_consensus.cc:2393] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:19:54.274029 12726 tablet_bootstrap.cc:654] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:54.247651 12496 leader_election.cc:343] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.271307 12727 tablet_bootstrap.cc:654] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:54.280447 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 85727.1us
I20260709 13:19:54.290313 12730 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
W20260709 13:19:54.295122 12496 leader_election.cc:343] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.296177 12496 leader_election.cc:304] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:54.296873 12725 ts_tablet_manager.cc:1434] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.124s	user 0.008s	sys 0.002s
I20260709 13:19:54.279047 13111 consensus_queue.cc:1048] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:19:54.316449 13087 raft_consensus.cc:2749] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.321214 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:54.334725 12498 consensus_peers.cc:597] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:54.348788 12730 tablet_bootstrap.cc:654] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:54.376662 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 76761.1us
W20260709 13:19:54.379442 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 67869.9us
I20260709 13:19:54.387840 12680 raft_consensus.cc:3060] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:54.380617 12573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 59872.7us
W20260709 13:19:54.414505 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 75204.6us
I20260709 13:19:54.419122 12424 leader_election.cc:304] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:54.421181 13092 raft_consensus.cc:2749] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.415450 13097 consensus_queue.cc:1048] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:19:54.425496 12726 tablet_bootstrap.cc:492] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:54.425935 12725 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:54.426028 12726 ts_tablet_manager.cc:1403] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.196s	user 0.014s	sys 0.013s
I20260709 13:19:54.460623 13091 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.461280 13091 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.463572 13091 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:54.465646 12727 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:54.466233 12727 ts_tablet_manager.cc:1403] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.370s	user 0.018s	sys 0.003s
I20260709 13:19:54.460734 13123 consensus_queue.cc:1048] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:19:54.472370 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:54.473088 12453 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:54.474812 12644 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:54.476082 13143 raft_consensus.cc:2804] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:54.476558 13143 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.476897 13143 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.480633 12727 raft_consensus.cc:359] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.484577 12727 raft_consensus.cc:385] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.485625 12727 raft_consensus.cc:740] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.486580 12727 consensus_queue.cc:260] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.489928 12727 ts_tablet_manager.cc:1434] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:19:54.494972 12726 raft_consensus.cc:359] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:54.496981 12726 raft_consensus.cc:385] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.497249 12726 raft_consensus.cc:740] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.497869 12726 consensus_queue.cc:260] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:54.505062 12943 consensus_queue.cc:1048] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.508344 12725 tablet_bootstrap.cc:654] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.495159 12727 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:54.528903 12726 ts_tablet_manager.cc:1434] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.000s
I20260709 13:19:54.537307 12730 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:54.537997 12730 ts_tablet_manager.cc:1403] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.254s	user 0.018s	sys 0.006s
I20260709 13:19:54.563843 13085 raft_consensus.cc:493] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.564510 13085 raft_consensus.cc:515] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.566741 13085 leader_election.cc:290] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:54.568101 12726 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:54.579092 13143 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.583257 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:54.605908 12352 catalog_manager.cc:5697] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.610067 12352 catalog_manager.cc:5697] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:54.611598 12730 raft_consensus.cc:359] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.612185 12352 catalog_manager.cc:5697] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:54.613112 12730 raft_consensus.cc:385] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.613616 12730 raft_consensus.cc:740] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.616811 12730 consensus_queue.cc:260] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.608299 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:54.610720 12943 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.621496 12943 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.623495 12943 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:54.626521 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:54.627179 12607 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:54.630179 12647 leader_election.cc:304] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:54.621055 13101 consensus_queue.cc:1048] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:19:54.636960 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:54.637746 12532 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:19:54.641620 12498 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:54.643211 13101 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.643586 13101 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.643667 12726 tablet_bootstrap.cc:654] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.643944 13101 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.649313 13143 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:54.658389 13089 raft_consensus.cc:493] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.658902 13089 raft_consensus.cc:515] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:54.662493 12725 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:54.663226 12725 ts_tablet_manager.cc:1403] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.238s	user 0.020s	sys 0.010s
I20260709 13:19:54.663611 13089 leader_election.cc:290] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:54.666327 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:54.666703 13101 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.667959 12725 raft_consensus.cc:359] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.668640 12725 raft_consensus.cc:385] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.668910 12725 raft_consensus.cc:740] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.669227 13101 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:54.670060 12727 tablet_bootstrap.cc:654] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.672396 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:54.673084 12606 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.675949 12725 consensus_queue.cc:260] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
W20260709 13:19:54.677785 12646 leader_election.cc:343] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.676029 12730 ts_tablet_manager.cc:1434] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.001s
I20260709 13:19:54.679611 12730 tablet_bootstrap.cc:492] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:54.681089 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:54.681759 12458 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:54.683207 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:54.683845 12527 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.684949 12457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:54.685587 12457 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.678643 12725 ts_tablet_manager.cc:1434] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:19:54.693662 12606 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:54.694969 12498 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:54.698540 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:54.705402 12725 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:54.708923 13093 raft_consensus.cc:2749] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:54.705168 13148 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:54.728689 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:54.727463 13108 consensus_queue.cc:1048] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:54.726401 13115 raft_consensus.cc:493] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:54.745081 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:19:54.726579 12647 leader_election.cc:343] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.731417 12935 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.736359 12725 tablet_bootstrap.cc:654] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.751210 13101 raft_consensus.cc:493] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.732595 12457 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:54.752753 12453 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.760249 13041 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:54.763729 13041 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.755028 13137 consensus_queue.cc:1048] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:19:54.757828 13115 raft_consensus.cc:515] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.768308 13115 leader_election.cc:290] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:54.758006 13101 raft_consensus.cc:515] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:54.755831 12935 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:54.772922 12458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:54.773804 12458 raft_consensus.cc:2468] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:54.753964 12647 leader_election.cc:304] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:54.749954 12527 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:19:54.774947 13093 raft_consensus.cc:2749] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:54.776417 12570 leader_election.cc:304] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:19:54.753603 13148 raft_consensus.cc:697] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:54.777609 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:54.778347 13148 consensus_queue.cc:237] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.778980 13115 raft_consensus.cc:2804] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.796388 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:54.797185 12605 raft_consensus.cc:2468] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:54.798748 13101 leader_election.cc:290] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:54.806381 12727 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:54.806929 12727 ts_tablet_manager.cc:1403] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.312s	user 0.010s	sys 0.009s
I20260709 13:19:54.799918 12730 tablet_bootstrap.cc:654] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:54.800346 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:54.800733 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:54.789836 13115 raft_consensus.cc:493] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.812124 12498 leader_election.cc:304] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:54.801188 12935 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:19:54.791409 12647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 64869.4us
I20260709 13:19:54.798822 12605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:54.811976 12680 raft_consensus.cc:2468] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:54.817447 13137 raft_consensus.cc:2804] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.803380 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:19:54.821717 12496 leader_election.cc:343] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.815219 13115 raft_consensus.cc:3060] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.823284 13137 raft_consensus.cc:493] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.836975 13137 raft_consensus.cc:3060] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.826247 12675 raft_consensus.cc:2468] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:54.830642 12453 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
W20260709 13:19:54.832154 12423 leader_election.cc:343] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.834730 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:54.842242 12644 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:54.842813 12603 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:54.843196 13143 raft_consensus.cc:2804] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:54.844295 12423 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:54.843747 13143 raft_consensus.cc:697] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:19:54.847069 13118 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:19:54.847445 13118 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.818269 13041 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:54.847468 13143 consensus_queue.cc:237] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.848934 13118 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.871429 12726 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:54.872012 12726 ts_tablet_manager.cc:1403] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.331s	user 0.033s	sys 0.009s
I20260709 13:19:54.849972 12421 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:54.875447 13041 raft_consensus.cc:2804] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:54.875926 13041 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:54.878002 12725 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:54.878566 12725 ts_tablet_manager.cc:1403] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.182s	user 0.021s	sys 0.004s
I20260709 13:19:54.876334 13041 raft_consensus.cc:3060] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.888851 12726 raft_consensus.cc:359] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.889696 12726 raft_consensus.cc:385] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.889971 12726 raft_consensus.cc:740] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.884439 13137 raft_consensus.cc:515] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:54.901002 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
W20260709 13:19:54.903961 12496 leader_election.cc:343] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:54.907949 12726 consensus_queue.cc:260] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.912794 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:54.914886 12603 raft_consensus.cc:3060] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:54.917582 12726 ts_tablet_manager.cc:1434] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:19:54.906303 13137 leader_election.cc:290] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:54.918210 12727 raft_consensus.cc:359] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.925300 12727 raft_consensus.cc:385] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.925566 12727 raft_consensus.cc:740] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.929036 12725 raft_consensus.cc:359] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.930437 12725 raft_consensus.cc:385] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.930821 12725 raft_consensus.cc:740] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:54.936877 12727 consensus_queue.cc:260] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:54.948124 13118 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:54.954522 13118 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:54.956708 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:54.957370 12607 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:54.958145 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:54.989432 12727 ts_tablet_manager.cc:1434] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.182s	user 0.011s	sys 0.000s
I20260709 13:19:54.990150 12726 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:54.990624 12727 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:54.994659 12730 tablet_bootstrap.cc:492] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:55.028988 12730 ts_tablet_manager.cc:1403] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.350s	user 0.010s	sys 0.019s
I20260709 13:19:55.009537 13110 raft_consensus.cc:493] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.034265 13110 raft_consensus.cc:515] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.036388 13110 leader_election.cc:290] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:55.039999 12730 raft_consensus.cc:359] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.022922 12603 raft_consensus.cc:2468] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:55.044245 12730 raft_consensus.cc:385] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:54.987931 12725 consensus_queue.cc:260] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.045241 12498 leader_election.cc:304] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:55.045992 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:55.027559 12727 tablet_bootstrap.cc:654] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.046810 12675 raft_consensus.cc:2468] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 0.
I20260709 13:19:55.047058 13110 raft_consensus.cc:2804] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.047597 13110 raft_consensus.cc:697] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:55.000751 13115 raft_consensus.cc:515] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.042428 12726 tablet_bootstrap.cc:654] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.048633 13110 consensus_queue.cc:237] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.043766 12607 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:19:55.044528 12730 raft_consensus.cc:740] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.049851 12496 leader_election.cc:304] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:55.050870 13115 leader_election.cc:290] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:55.051128 13137 raft_consensus.cc:2804] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.051517 13137 raft_consensus.cc:493] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.051822 13137 raft_consensus.cc:3060] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.046362 12725 ts_tablet_manager.cc:1434] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.003s
I20260709 13:19:55.050679 12730 consensus_queue.cc:260] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.053162 12725 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:55.056931 12730 ts_tablet_manager.cc:1434] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:19:55.058007 12730 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:55.064910 12725 tablet_bootstrap.cc:654] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.061195 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:55.069135 12675 raft_consensus.cc:3060] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.064949 13137 raft_consensus.cc:515] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.074069 13137 leader_election.cc:290] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:55.074967 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:55.075645 12677 raft_consensus.cc:3060] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.022167 13041 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.079483 12727 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:55.079679 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:55.080070 12727 ts_tablet_manager.cc:1403] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.009s
I20260709 13:19:55.080374 12680 raft_consensus.cc:3060] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.082927 12677 raft_consensus.cc:2468] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:19:55.082971 12727 raft_consensus.cc:359] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.083837 12727 raft_consensus.cc:385] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.084662 12496 leader_election.cc:304] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:55.084800 12727 raft_consensus.cc:740] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.088471 12726 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:55.090240 12726 ts_tablet_manager.cc:1403] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.154s	user 0.008s	sys 0.004s
I20260709 13:19:55.091674 12675 raft_consensus.cc:2468] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:55.085477 13137 raft_consensus.cc:2804] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.075680 12356 catalog_manager.cc:5697] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 2, leader changed from <none> to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.093092 13137 raft_consensus.cc:697] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:55.093286 12570 leader_election.cc:304] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:55.094174 13115 raft_consensus.cc:2804] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.094048 13137 consensus_queue.cc:237] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.094674 13115 raft_consensus.cc:697] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:55.097290 13115 consensus_queue.cc:237] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.099732 12727 consensus_queue.cc:260] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.104400 12727 ts_tablet_manager.cc:1434] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 13:19:55.104292 12680 raft_consensus.cc:2468] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:55.096679 12726 raft_consensus.cc:359] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.135109 12726 raft_consensus.cc:385] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.135429 12726 raft_consensus.cc:740] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.135888 12421 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:55.107822 12730 tablet_bootstrap.cc:654] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.108300 12727 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:55.138475 13118 raft_consensus.cc:2804] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.139001 13118 raft_consensus.cc:697] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:55.139806 13118 consensus_queue.cc:237] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.139912 12354 catalog_manager.cc:5697] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } }
I20260709 13:19:55.143296 12727 tablet_bootstrap.cc:654] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.109031 12456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:55.116667 13093 raft_consensus.cc:493] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.145128 13093 raft_consensus.cc:515] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.146431 12677 raft_consensus.cc:3060] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.147547 13093 leader_election.cc:290] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:55.149199 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:55.084901 13041 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:55.129042 12423 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:55.136111 12726 consensus_queue.cc:260] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.152124 12726 ts_tablet_manager.cc:1434] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:19:55.152521 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8fd7239741d241c5833b78180486ea66" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:55.153050 12726 tablet_bootstrap.cc:492] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: Bootstrap starting.
I20260709 13:19:55.154402 12646 leader_election.cc:304] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:55.105968 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:55.191363 12456 raft_consensus.cc:3060] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.181376 13041 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:19:55.194048 12352 catalog_manager.cc:5697] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.198839 12452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:55.203184 12726 tablet_bootstrap.cc:654] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.185756 12935 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:55.208851 12423 leader_election.cc:343] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.207643 13041 raft_consensus.cc:697] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:55.214603 12355 catalog_manager.cc:5697] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:55.212823 12453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:55.235793 12456 raft_consensus.cc:2468] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:55.212510 13041 consensus_queue.cc:237] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.213163 12935 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.240260 12935 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:55.242852 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:55.243235 12730 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:55.243741 12730 ts_tablet_manager.cc:1403] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.186s	user 0.017s	sys 0.023s
I20260709 13:19:55.243654 12527 raft_consensus.cc:2468] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:55.252697 12725 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:55.253304 12725 ts_tablet_manager.cc:1403] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.200s	user 0.029s	sys 0.026s
I20260709 13:19:55.256140 12725 raft_consensus.cc:359] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.256961 12607 raft_consensus.cc:1240] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Rejecting Update request from peer edb4d71736c5490ab4008aa30a223e25 for earlier term 1. Current term is 2. Ops: []
I20260709 13:19:55.257732 12725 raft_consensus.cc:385] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.258148 12725 raft_consensus.cc:740] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.258988 12424 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:55.258886 12725 consensus_queue.cc:260] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.260201 12935 raft_consensus.cc:2804] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.260576 12935 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.260936 12935 raft_consensus.cc:3060] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.261567 12725 ts_tablet_manager.cc:1434] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:19:55.263437 12725 tablet_bootstrap.cc:492] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:55.266232 13123 consensus_queue.cc:1059] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.267095 13123 raft_consensus.cc:3055] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:19:55.267437 13123 raft_consensus.cc:740] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:19:55.268153 13123 consensus_queue.cc:260] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.264883 12730 raft_consensus.cc:359] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.275841 12730 raft_consensus.cc:385] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.276422 12730 raft_consensus.cc:740] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
W20260709 13:19:55.274453 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 48145.3us
I20260709 13:19:55.274447 13131 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.277657 13131 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.280488 13131 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:55.287412 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:55.288254 12527 raft_consensus.cc:2468] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:55.290535 12725 tablet_bootstrap.cc:654] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
W20260709 13:19:55.288538 12496 leader_election.cc:343] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:19:55.293411 12496 leader_election.cc:343] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:55.287817 13123 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:19:55.298847 12730 consensus_queue.cc:260] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.309795 12573 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:55.311022 13131 raft_consensus.cc:2804] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.311462 13131 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.311895 13131 raft_consensus.cc:3060] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.311983 12726 tablet_bootstrap.cc:492] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: No bootstrap required, opened a new log
I20260709 13:19:55.321434 12726 ts_tablet_manager.cc:1403] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: Time spent bootstrapping tablet: real 0.169s	user 0.010s	sys 0.013s
I20260709 13:19:55.309095 12454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:55.338954 12935 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.311486 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:55.377777 12730 ts_tablet_manager.cc:1434] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.134s	user 0.012s	sys 0.054s
I20260709 13:19:55.381906 12727 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:55.382481 12727 ts_tablet_manager.cc:1403] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.274s	user 0.015s	sys 0.011s
W20260709 13:19:55.387960 12647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 104637us
I20260709 13:19:55.391950 12935 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:55.320745 13131 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.393077 12730 tablet_bootstrap.cc:492] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:55.394232 13131 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:55.385248 12454 raft_consensus.cc:2393] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:55.396117 13118 raft_consensus.cc:493] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.396639 13118 raft_consensus.cc:515] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.399637 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:55.399937 12730 tablet_bootstrap.cc:654] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.400269 12527 raft_consensus.cc:3060] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.400638 12602 raft_consensus.cc:2393] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 1: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:19:55.404634 12726 raft_consensus.cc:359] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.405045 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:55.405393 12726 raft_consensus.cc:385] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.405754 12726 raft_consensus.cc:740] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.400019 12450 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:19:55.407941 12727 raft_consensus.cc:359] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.381304 13093 raft_consensus.cc:2749] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.410492 13118 leader_election.cc:290] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:55.411365 12726 consensus_queue.cc:260] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.415230 12725 tablet_bootstrap.cc:492] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:55.408646 12727 raft_consensus.cc:385] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.422324 12725 ts_tablet_manager.cc:1403] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.159s	user 0.019s	sys 0.002s
I20260709 13:19:55.422617 12727 raft_consensus.cc:740] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.427091 12727 consensus_queue.cc:260] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.429322 12727 ts_tablet_manager.cc:1434] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.002s
I20260709 13:19:55.430341 12727 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:19:55.431715 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:55.432422 12677 raft_consensus.cc:2468] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:55.437453 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:55.438179 12528 raft_consensus.cc:2468] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:55.460673 12726 ts_tablet_manager.cc:1434] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: Time spent starting tablet: real 0.133s	user 0.006s	sys 0.001s
I20260709 13:19:55.464537 12725 raft_consensus.cc:359] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:19:55.464753 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 160434us
I20260709 13:19:55.450819 12424 leader_election.cc:304] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:19:55.465520 12725 raft_consensus.cc:385] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.475955 12725 raft_consensus.cc:740] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.453265 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:55.477286 13041 raft_consensus.cc:2804] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.479569 13041 raft_consensus.cc:493] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.479907 13041 raft_consensus.cc:3060] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.480086 12725 consensus_queue.cc:260] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.495560 12451 raft_consensus.cc:1275] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 13:19:55.503664 12421 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 55683.5us
I20260709 13:19:55.514081 12352 catalog_manager.cc:5697] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:55.516412 12727 tablet_bootstrap.cc:654] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.516247 13101 consensus_queue.cc:1048] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.522559 12527 raft_consensus.cc:2468] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:55.530615 13115 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.531934 12772 raft_consensus.cc:493] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.532439 12772 raft_consensus.cc:515] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.534260 13041 raft_consensus.cc:515] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.531272 13115 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.557199 13115 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:55.557731 13115 consensus_queue.cc:1048] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:55.561769 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:55.562582 12677 raft_consensus.cc:2393] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:55.548040 12772 leader_election.cc:290] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:55.552521 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:55.564426 12681 raft_consensus.cc:2468] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:55.567852 12570 leader_election.cc:304] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
W20260709 13:19:55.571427 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 86895.9us
I20260709 13:19:55.573109 12573 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:55.574091 12772 raft_consensus.cc:2804] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:55.574864 12772 raft_consensus.cc:493] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:55.574977 13131 raft_consensus.cc:2749] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.568809 12451 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:55.582072 12424 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:55.583025 12772 raft_consensus.cc:3060] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.584398 12570 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:55.587432 12725 ts_tablet_manager.cc:1434] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.165s	user 0.009s	sys 0.001s
I20260709 13:19:55.591763 13119 raft_consensus.cc:2804] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.595579 12725 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:55.598556 13119 raft_consensus.cc:697] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:55.601673 12532 raft_consensus.cc:1275] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:55.597612 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:55.601997 13119 consensus_queue.cc:237] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.614598 12772 raft_consensus.cc:515] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.606722 12725 tablet_bootstrap.cc:654] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.592063 13115 raft_consensus.cc:3060] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.608305 12681 raft_consensus.cc:3060] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.632051 12772 leader_election.cc:290] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:55.633309 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:55.634088 12680 raft_consensus.cc:3060] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.637518 12730 tablet_bootstrap.cc:492] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:55.637995 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:55.638722 12528 raft_consensus.cc:2468] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 0.
I20260709 13:19:55.638060 12730 ts_tablet_manager.cc:1403] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.245s	user 0.021s	sys 0.031s
W20260709 13:19:55.644230 12496 consensus_peers.cc:597] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 -> Peer e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371): Couldn't send request to peer e42f0f6820a54d65880b5a40d1e1d4e2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:55.645610 12730 raft_consensus.cc:359] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.646284 12730 raft_consensus.cc:385] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.646540 12730 raft_consensus.cc:740] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.659225 12354 catalog_manager.cc:5697] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } }
I20260709 13:19:55.660781 12730 consensus_queue.cc:260] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.674211 12680 raft_consensus.cc:2468] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:55.635828 13041 leader_election.cc:290] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:55.676142 12570 leader_election.cc:304] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:55.682312 12730 ts_tablet_manager.cc:1434] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:19:55.683118 12772 raft_consensus.cc:2804] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.685514 12772 raft_consensus.cc:697] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:19:55.673138 12528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:55.687779 12528 raft_consensus.cc:3060] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.686298 12772 consensus_queue.cc:237] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.660946 13148 consensus_queue.cc:1048] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:19:55.694734 12532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "611f7e5c6d52455baebc4b6a0b73edd5" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:19:55.695400 12532 raft_consensus.cc:3060] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:55.678165 13183 consensus_queue.cc:1048] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:19:55.724128 12727 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: No bootstrap required, opened a new log
I20260709 13:19:55.725224 12727 ts_tablet_manager.cc:1403] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.295s	user 0.017s	sys 0.017s
I20260709 13:19:55.743552 12681 raft_consensus.cc:2468] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:55.747272 12532 raft_consensus.cc:2468] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:19:55.748342 13129 consensus_queue.cc:1048] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:19:55.750790 13182 consensus_queue.cc:1048] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:19:55.737587 13143 raft_consensus.cc:493] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:55.751740 12527 raft_consensus.cc:1275] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:19:55.757241 12527 pending_rounds.cc:85] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: Aborting all ops after (but not including) 0
I20260709 13:19:55.757472 12527 pending_rounds.cc:107] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:19:55.757754 12527 raft_consensus.cc:2889] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:19:55.755734 13196 consensus_queue.cc:1048] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:19:55.752856 12450 raft_consensus.cc:3060] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:55.769011 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 68429.7us
I20260709 13:19:55.769719 13143 raft_consensus.cc:515] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:19:55.776942 13041 consensus_queue.cc:1048] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:19:55.800161 12730 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: Bootstrap starting.
I20260709 13:19:55.847543 12421 leader_election.cc:304] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:55.851903 12727 raft_consensus.cc:359] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.853389 13129 raft_consensus.cc:2804] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:19:55.852608 12727 raft_consensus.cc:385] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.855172 12727 raft_consensus.cc:740] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.855821 12727 consensus_queue.cc:260] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:55.853955 13129 raft_consensus.cc:697] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:55.873363 13129 consensus_queue.cc:237] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:55.859109 12528 raft_consensus.cc:2468] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
I20260709 13:19:55.881313 12725 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:55.884608 12725 ts_tablet_manager.cc:1403] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.289s	user 0.011s	sys 0.014s
W20260709 13:19:55.892910 13201 log.cc:927] Time spent T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:19:55.894184 12730 tablet_bootstrap.cc:654] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:55.880386 13115 raft_consensus.cc:2749] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:55.952445 13143 leader_election.cc:290] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:55.980079 12725 raft_consensus.cc:359] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.983755 12602 raft_consensus.cc:1275] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:19:55.987006 12725 raft_consensus.cc:385] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:55.994385 12725 raft_consensus.cc:740] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:55.995137 12725 consensus_queue.cc:260] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:55.998909 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:56.010134 12727 ts_tablet_manager.cc:1434] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.284s	user 0.023s	sys 0.039s
W20260709 13:19:56.018741 12423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 51609.2us
I20260709 13:19:56.021464 12725 ts_tablet_manager.cc:1434] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.001s
W20260709 13:19:56.023448 12404 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:19:56.022962 12355 catalog_manager.cc:5697] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.024274 13119 raft_consensus.cc:493] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.035173 12529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:56.098307 12730 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: No bootstrap required, opened a new log
I20260709 13:19:56.098912 12730 ts_tablet_manager.cc:1403] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent bootstrapping tablet: real 0.299s	user 0.033s	sys 0.019s
W20260709 13:19:56.102762 12423 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 76679us
I20260709 13:19:56.043452 13119 raft_consensus.cc:515] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:19:56.114100 13206 log.cc:927] Time spent T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:19:56.119069 13215 consensus_queue.cc:1048] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.119226 13210 consensus_queue.cc:1048] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.133081 13212 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:56.133602 13212 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.135010 13196 raft_consensus.cc:493] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:19:56.152966 12424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 63727.4us
I20260709 13:19:56.200878 13196 raft_consensus.cc:515] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:19:56.277704 13219 log.cc:927] Time spent T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:19:56.282136 12730 raft_consensus.cc:359] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.283011 12730 raft_consensus.cc:385] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.283316 12730 raft_consensus.cc:740] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.284185 12730 consensus_queue.cc:260] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.287467 12730 ts_tablet_manager.cc:1434] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: Time spent starting tablet: real 0.188s	user 0.008s	sys 0.000s
I20260709 13:19:56.297132 13196 leader_election.cc:290] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:56.297911 13212 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:56.302129 12647 leader_election.cc:304] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:56.304643 13180 raft_consensus.cc:2749] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.307240 12606 raft_consensus.cc:3060] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.345355 13119 leader_election.cc:290] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:56.345551 13225 consensus_queue.cc:1048] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.350292 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:56.351027 12680 raft_consensus.cc:2468] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 0.
I20260709 13:19:56.358727 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:56.372332 13198 consensus_queue.cc:1048] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.373697 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:56.380055 12452 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:56.385370 12675 raft_consensus.cc:3060] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:19:56.387627 12423 leader_election.cc:343] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.388989 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:56.398993 13218 consensus_queue.cc:1048] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.403968 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:56.405388 13198 consensus_queue.cc:1048] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.407999 12421 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:19:56.410411 12725 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd: Bootstrap starting.
I20260709 13:19:56.411145 13118 raft_consensus.cc:2804] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:19:56.411545 13118 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:19:56.411868 13118 raft_consensus.cc:3060] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.413370 13208 consensus_queue.cc:1048] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.413741 13225 consensus_queue.cc:1048] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:56.414698 12421 leader_election.cc:304] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:56.424423 12725 tablet_bootstrap.cc:654] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd: Neither blocks nor log segments found. Creating new log.
I20260709 13:19:56.426774 13230 raft_consensus.cc:2749] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:56.441898 12573 leader_election.cc:304] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:56.448431 12772 raft_consensus.cc:2749] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:56.456074 13118 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.460516 13118 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:56.472975 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:19:56.489585 12680 raft_consensus.cc:3060] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:56.484506 12352 catalog_manager.cc:5697] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 0 to 1, leader changed from <none> to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 1 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.522500 12680 raft_consensus.cc:2468] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 1.
W20260709 13:19:56.527592 13244 log.cc:927] Time spent T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:19:56.544261 12421 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:19:56.548264 13041 raft_consensus.cc:2804] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:19:56.660672 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 85846.8us
I20260709 13:19:56.662467 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:19:56.666100 12355 catalog_manager.cc:5697] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:19:56.674531 13041 raft_consensus.cc:697] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:19:56.680117 13041 consensus_queue.cc:237] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.688951 12725 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd: No bootstrap required, opened a new log
I20260709 13:19:56.689518 12725 ts_tablet_manager.cc:1403] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd: Time spent bootstrapping tablet: real 0.279s	user 0.033s	sys 0.026s
I20260709 13:19:56.693152 12355 catalog_manager.cc:5697] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
W20260709 13:19:56.708899 12424 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 155572us
I20260709 13:19:56.709520 12725 raft_consensus.cc:359] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.710273 12725 raft_consensus.cc:385] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:19:56.710537 12725 raft_consensus.cc:740] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Initialized, Role: FOLLOWER
I20260709 13:19:56.711251 12725 consensus_queue.cc:260] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:56.733704 13208 consensus_queue.cc:1048] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:19:56.767104 12725 ts_tablet_manager.cc:1434] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
W20260709 13:19:56.767616 12423 leader_election.cc:343] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:19:56.871572 12356 catalog_manager.cc:5697] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } }
I20260709 13:19:56.918524 12355 catalog_manager.cc:5697] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 1 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:19:57.169508 13194 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:19:57.170073 13194 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:57.171717 13194 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:19:57.172787 12673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:57.173098 12455 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:19:57.173507 12673 raft_consensus.cc:2393] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 1: Already voted for candidate 6b0179dde0454d1e819be37e79c733af in this term.
I20260709 13:19:57.174862 12570 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:57.175843 13194 raft_consensus.cc:3060] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:19:57.182411 13194 raft_consensus.cc:2749] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:19:57.245721 13208 consensus_queue.cc:1048] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:57.258466 13208 consensus_queue.cc:1048] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:19:59.113775  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
W20260709 13:19:59.192955 12644 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 516 similar messages]
W20260709 13:19:59.244927 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 52015.4us
W20260709 13:19:59.249770 12644 consensus_peers.cc:597] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.259007 12644 consensus_peers.cc:597] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.264647 12644 consensus_peers.cc:597] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.265271 12644 consensus_peers.cc:597] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.265787 12644 consensus_peers.cc:597] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.278131 12496 consensus_peers.cc:597] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.282793 12496 consensus_peers.cc:597] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.283422 12496 consensus_peers.cc:597] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.283982 12496 consensus_peers.cc:597] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.288246 12496 consensus_peers.cc:597] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.288854 12496 consensus_peers.cc:597] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.289410 12496 consensus_peers.cc:597] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.290141 12496 consensus_peers.cc:597] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.290665 12496 consensus_peers.cc:597] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.291675 12496 consensus_peers.cc:597] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.292249 12496 consensus_peers.cc:597] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.292805 12496 consensus_peers.cc:597] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.328644 13271 raft_consensus.cc:493] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be08affc17214c5081ca9d2d19f0c1bd)
I20260709 13:19:59.329246 13271 raft_consensus.cc:515] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:59.331537 13271 leader_election.cc:290] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:59.338637 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc6e30caa094ccea21a8d8063628ac6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:19:59.346467 12644 consensus_peers.cc:597] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.347621 13276 raft_consensus.cc:493] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edb4d71736c5490ab4008aa30a223e25)
I20260709 13:19:59.348202 13276 raft_consensus.cc:515] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:19:59.350232 12644 consensus_peers.cc:597] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.350564 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffc6e30caa094ccea21a8d8063628ac6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:59.354413 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:59.355912 12423 leader_election.cc:304] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:59.356791 13271 raft_consensus.cc:2749] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:59.350274 13276 leader_election.cc:290] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:19:59.359939 12644 consensus_peers.cc:597] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.367619 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:59.374825 12424 leader_election.cc:304] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:59.378067 13278 raft_consensus.cc:2749] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:19:59.391844 12570 consensus_peers.cc:597] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.393558 12570 consensus_peers.cc:597] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.394447 12570 consensus_peers.cc:597] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.394556 13275 raft_consensus.cc:493] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader be08affc17214c5081ca9d2d19f0c1bd)
W20260709 13:19:59.396402 12570 consensus_peers.cc:597] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.398630 12570 consensus_peers.cc:597] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.399137 12570 consensus_peers.cc:597] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:19:59.400301 12570 consensus_peers.cc:597] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.395157 13275 raft_consensus.cc:515] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:59.412401 13275 leader_election.cc:290] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:59.416213 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:59.417968 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a98d51892474c3388c511ca2719ae45" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:59.419641 12423 leader_election.cc:304] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
W20260709 13:19:59.418228 12496 consensus_peers.cc:597] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.420997 13275 raft_consensus.cc:2749] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:59.450783  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:19:59.451790  2851 tablet_replica.cc:333] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.452642  2851 raft_consensus.cc:2243] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.453704  2851 raft_consensus.cc:2272] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.455730  2851 tablet_replica.cc:333] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.456346  2851 raft_consensus.cc:2243] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.457113  2851 raft_consensus.cc:2272] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.458913  2851 tablet_replica.cc:333] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.459540  2851 raft_consensus.cc:2243] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.459970  2851 raft_consensus.cc:2272] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.461772  2851 tablet_replica.cc:333] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.462677  2851 raft_consensus.cc:2243] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.463351  2851 raft_consensus.cc:2272] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.468062  2851 tablet_replica.cc:333] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.469034  2851 raft_consensus.cc:2243] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.469581  2851 raft_consensus.cc:2272] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.472487  2851 tablet_replica.cc:333] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.473330  2851 raft_consensus.cc:2243] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.474211  2851 raft_consensus.cc:2272] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.476366  2851 tablet_replica.cc:333] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.477051  2851 raft_consensus.cc:2243] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.477450  2851 raft_consensus.cc:2272] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.479497  2851 tablet_replica.cc:333] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.479622 13275 raft_consensus.cc:493] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edb4d71736c5490ab4008aa30a223e25)
I20260709 13:19:59.480278  2851 raft_consensus.cc:2243] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.480157 13275 raft_consensus.cc:515] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:59.480856  2851 raft_consensus.cc:2272] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.482342 13275 leader_election.cc:290] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:59.483096 13271 raft_consensus.cc:493] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e42f0f6820a54d65880b5a40d1e1d4e2)
I20260709 13:19:59.483096  2851 tablet_replica.cc:333] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.483431 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:59.484025 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:59.483805 13271 raft_consensus.cc:515] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:19:59.484575  2851 raft_consensus.cc:2243] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.485217  2851 raft_consensus.cc:2272] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.485600 12424 leader_election.cc:304] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:59.486724 13275 raft_consensus.cc:2749] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:59.487629  2851 tablet_replica.cc:333] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.487900 13271 leader_election.cc:290] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:19:59.488060 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:59.488504  2851 raft_consensus.cc:2243] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.489174  2851 raft_consensus.cc:2272] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.489216 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad8fad451d52413fbe9076d53d09eb19" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:59.490494 12421 leader_election.cc:304] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:19:59.491627  2851 tablet_replica.cc:333] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.491658 13271 raft_consensus.cc:2749] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:59.492551  2851 raft_consensus.cc:2243] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.492980  2851 raft_consensus.cc:2272] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.494686  2851 tablet_replica.cc:333] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.495527  2851 raft_consensus.cc:2243] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.496104  2851 raft_consensus.cc:2272] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.498289  2851 tablet_replica.cc:333] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.498354 13271 raft_consensus.cc:493] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edb4d71736c5490ab4008aa30a223e25)
I20260709 13:19:59.498931  2851 raft_consensus.cc:2243] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.498868 13271 raft_consensus.cc:515] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:19:59.499449  2851 raft_consensus.cc:2272] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.500622 13271 leader_election.cc:290] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:19:59.501766 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:19:59.501781 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:59.502496  2851 tablet_replica.cc:333] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.503366  2851 raft_consensus.cc:2243] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.503624 12424 leader_election.cc:304] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:59.504390  2851 raft_consensus.cc:2272] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.504949 13271 raft_consensus.cc:2749] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:59.506781  2851 tablet_replica.cc:333] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.507364  2851 raft_consensus.cc:2243] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.507769  2851 raft_consensus.cc:2272] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.509611  2851 tablet_replica.cc:333] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.510141  2851 raft_consensus.cc:2243] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.510824  2851 raft_consensus.cc:2272] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.512605  2851 tablet_replica.cc:333] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.513167  2851 raft_consensus.cc:2243] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.513859  2851 raft_consensus.cc:2272] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.515697  2851 tablet_replica.cc:333] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.516243  2851 raft_consensus.cc:2243] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.516630  2851 raft_consensus.cc:2272] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.518029 13271 raft_consensus.cc:493] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (detected failure of leader edb4d71736c5490ab4008aa30a223e25)
I20260709 13:19:59.518678 13271 raft_consensus.cc:515] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:19:59.519374  2851 tablet_replica.cc:333] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.520218  2851 raft_consensus.cc:2243] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.521018 13271 leader_election.cc:290] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:19:59.521260  2851 raft_consensus.cc:2272] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.521992 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:19:59.522629 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:19:59.523895 12424 leader_election.cc:304] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:19:59.524580 13275 raft_consensus.cc:2749] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:19:59.524942  2851 tablet_replica.cc:333] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.525642  2851 raft_consensus.cc:2243] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.526350  2851 raft_consensus.cc:2272] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.529227  2851 tablet_replica.cc:333] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.529907  2851 raft_consensus.cc:2243] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.530768  2851 raft_consensus.cc:2272] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.532970  2851 tablet_replica.cc:333] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.533537  2851 raft_consensus.cc:2243] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.534296  2851 raft_consensus.cc:2272] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.536931  2851 tablet_replica.cc:333] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.537622  2851 raft_consensus.cc:2243] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.538704  2851 raft_consensus.cc:2272] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.540993  2851 tablet_replica.cc:333] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.541746  2851 raft_consensus.cc:2243] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.542230  2851 raft_consensus.cc:2272] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.544986  2851 tablet_replica.cc:333] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.545688  2851 raft_consensus.cc:2243] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.546317  2851 raft_consensus.cc:2272] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.548446  2851 tablet_replica.cc:333] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.549129  2851 raft_consensus.cc:2243] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.549996  2851 raft_consensus.cc:2272] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.551841  2851 tablet_replica.cc:333] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.552397  2851 raft_consensus.cc:2243] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.552852  2851 raft_consensus.cc:2272] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.554641  2851 tablet_replica.cc:333] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.555194  2851 raft_consensus.cc:2243] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.555609  2851 raft_consensus.cc:2272] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.557403  2851 tablet_replica.cc:333] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.558036  2851 raft_consensus.cc:2243] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.558452  2851 raft_consensus.cc:2272] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.560243  2851 tablet_replica.cc:333] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.560812  2851 raft_consensus.cc:2243] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.561213  2851 raft_consensus.cc:2272] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.563369  2851 tablet_replica.cc:333] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.563894  2851 raft_consensus.cc:2243] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.564414  2851 raft_consensus.cc:2272] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.567250  2851 tablet_replica.cc:333] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.567967  2851 raft_consensus.cc:2243] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.568549  2851 raft_consensus.cc:2272] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.571360  2851 tablet_replica.cc:333] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.571979  2851 raft_consensus.cc:2243] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.572455  2851 raft_consensus.cc:2272] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.574620  2851 tablet_replica.cc:333] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.575522  2851 raft_consensus.cc:2243] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.576699  2851 raft_consensus.cc:2272] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.579288  2851 tablet_replica.cc:333] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.579934  2851 raft_consensus.cc:2243] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.580973  2851 raft_consensus.cc:2272] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.583551  2851 tablet_replica.cc:333] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.584307  2851 raft_consensus.cc:2243] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.584836  2851 raft_consensus.cc:2272] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.587200  2851 tablet_replica.cc:333] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.587803  2851 raft_consensus.cc:2243] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.588274  2851 raft_consensus.cc:2272] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.590642  2851 tablet_replica.cc:333] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.591367  2851 raft_consensus.cc:2243] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.592425  2851 raft_consensus.cc:2272] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.595049  2851 tablet_replica.cc:333] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.595765  2851 raft_consensus.cc:2243] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.596242  2851 raft_consensus.cc:2272] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.598227  2851 tablet_replica.cc:333] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.598912  2851 raft_consensus.cc:2243] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.599882  2851 raft_consensus.cc:2272] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.602352  2851 tablet_replica.cc:333] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.602906  2851 raft_consensus.cc:2243] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:19:59.603686  2851 raft_consensus.cc:2272] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.606426  2851 tablet_replica.cc:333] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.607115  2851 raft_consensus.cc:2243] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.607620  2851 raft_consensus.cc:2272] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.610176  2851 tablet_replica.cc:333] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.610847  2851 raft_consensus.cc:2243] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.611315  2851 raft_consensus.cc:2272] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.614168  2851 tablet_replica.cc:333] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.614838  2851 raft_consensus.cc:2243] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.615396  2851 raft_consensus.cc:2272] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:19:59.618777  2851 tablet_replica.cc:333] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: stopping tablet replica
I20260709 13:19:59.619467  2851 raft_consensus.cc:2243] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:19:59.619972  2851 raft_consensus.cc:2272] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:19:59.664631 12644 consensus_peers.cc:597] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:19:59.713495  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:19:59.806123  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:19:59.821822 13291 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:59.824466  2851 server_base.cc:1061] running on GCE node
W20260709 13:19:59.826261 13288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:19:59.828917 13289 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:19:59.832083  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:19:59.832396  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:19:59.832633  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603199832606 us; error 0 us; skew 500 ppm
I20260709 13:19:59.833577  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:19:59.838732  2851 webserver.cc:533] Webserver started at http://127.2.200.193:45915/ using document root <none> and password file <none>
I20260709 13:19:59.839478  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:19:59.839735  2851 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:19:59.844563  2851 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:19:59.853714 13296 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:19:59.854988  2851 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:19:59.855414  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "6b0179dde0454d1e819be37e79c733af"
format_stamp: "Formatted at 2026-07-09 13:19:44 on dist-test-slave-108k"
I20260709 13:19:59.855839  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:19:59.875044  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:19:59.877580  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:19:59.879948  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:19:59.886511 13303 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:20:00.142086  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:20:00.142378  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.257s	user 0.009s	sys 0.000s
I20260709 13:20:00.142643  2851 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:20:00.148696 13303 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.163326 13303 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.164047 13303 tablet_bootstrap.cc:492] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.164655 13303 ts_tablet_manager.cc:1403] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:20:00.167258 13303 raft_consensus.cc:359] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.167914 13303 raft_consensus.cc:740] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.168576 13303 consensus_queue.cc:260] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.171232 13303 ts_tablet_manager.cc:1434] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:00.172055 13303 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.187954 13303 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.188906 13303 tablet_bootstrap.cc:492] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.189543 13303 ts_tablet_manager.cc:1403] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:20:00.191927 13303 raft_consensus.cc:359] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.192579 13303 raft_consensus.cc:740] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.193226 13303 consensus_queue.cc:260] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.194973 13303 ts_tablet_manager.cc:1434] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:00.195739 13303 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.210183 13303 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.211076 13303 tablet_bootstrap.cc:492] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.211714 13303 ts_tablet_manager.cc:1403] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:20:00.214107 13303 raft_consensus.cc:359] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.214747 13303 raft_consensus.cc:740] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.215502 13303 consensus_queue.cc:260] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.217631 13303 ts_tablet_manager.cc:1434] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:00.218374 13303 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:20:00.228519 12554 debug-util.cc:398] Leaking SignalData structure 0x7b080021faa0 after lost signal to thread 2854
W20260709 13:20:00.230007 12554 debug-util.cc:398] Leaking SignalData structure 0x7b08001d8a20 after lost signal to thread 12390
W20260709 13:20:00.233035 12554 debug-util.cc:398] Leaking SignalData structure 0x7b08003862e0 after lost signal to thread 12557
W20260709 13:20:00.234498 12554 debug-util.cc:398] Leaking SignalData structure 0x7b080022b060 after lost signal to thread 12631
W20260709 13:20:00.235906 12554 debug-util.cc:398] Leaking SignalData structure 0x7b080014e720 after lost signal to thread 12705
I20260709 13:20:00.246634 13303 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.247617 13303 tablet_bootstrap.cc:492] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.248256 13303 ts_tablet_manager.cc:1403] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.004s
I20260709 13:20:00.251013 13303 raft_consensus.cc:359] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.253013 13303 raft_consensus.cc:740] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.253722 13303 consensus_queue.cc:260] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.256959 13303 ts_tablet_manager.cc:1434] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 13:20:00.258229 13303 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.290908 13303 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.293803 13303 tablet_bootstrap.cc:492] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.294535 13303 ts_tablet_manager.cc:1403] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.019s
I20260709 13:20:00.297961 13303 raft_consensus.cc:359] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.298751 13303 raft_consensus.cc:740] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.299841 13303 consensus_queue.cc:260] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.302599 13303 ts_tablet_manager.cc:1434] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:00.303455 13303 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.344010 13303 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.345184 13303 tablet_bootstrap.cc:492] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.345887 13303 ts_tablet_manager.cc:1403] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.016s
I20260709 13:20:00.348428 13303 raft_consensus.cc:359] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.349146 13303 raft_consensus.cc:740] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.349892 13303 consensus_queue.cc:260] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.352799 13303 ts_tablet_manager.cc:1434] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:00.353610 13303 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.380923 13303 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.381860 13303 tablet_bootstrap.cc:492] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.382503 13303 ts_tablet_manager.cc:1403] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
I20260709 13:20:00.385412 13303 raft_consensus.cc:359] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.387249 13303 raft_consensus.cc:740] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.387934 13303 consensus_queue.cc:260] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.389936 13303 ts_tablet_manager.cc:1434] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:00.390868 13303 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.417677 13303 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.418615 13303 tablet_bootstrap.cc:492] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.419234 13303 ts_tablet_manager.cc:1403] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.008s
I20260709 13:20:00.421597 13303 raft_consensus.cc:359] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.422259 13303 raft_consensus.cc:740] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.423233 13303 consensus_queue.cc:260] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.425351 13303 ts_tablet_manager.cc:1434] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:00.426152 13303 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.438064  2851 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:20:00.438474  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.296s	user 0.261s	sys 0.008s
I20260709 13:20:00.449682 13303 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.450680 13303 tablet_bootstrap.cc:492] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.452538 13303 ts_tablet_manager.cc:1403] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.008s
I20260709 13:20:00.455243 13303 raft_consensus.cc:359] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.455886 13303 raft_consensus.cc:740] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.456640 13303 consensus_queue.cc:260] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.460580 13303 ts_tablet_manager.cc:1434] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:20:00.461709 13303 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.497830 13303 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.499063 13303 tablet_bootstrap.cc:492] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.500072 13303 ts_tablet_manager.cc:1403] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.039s	user 0.027s	sys 0.003s
I20260709 13:20:00.502673 13303 raft_consensus.cc:359] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.503366 13303 raft_consensus.cc:740] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.504158 13303 consensus_queue.cc:260] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.509366 13303 ts_tablet_manager.cc:1434] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:20:00.510229 13303 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.535905 13303 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.536955 13303 tablet_bootstrap.cc:492] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.537614 13303 ts_tablet_manager.cc:1403] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.008s
I20260709 13:20:00.540284 13303 raft_consensus.cc:359] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.541023 13303 raft_consensus.cc:740] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.542236 13303 consensus_queue.cc:260] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.544476 13303 ts_tablet_manager.cc:1434] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:00.546510 13303 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.568878 13303 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.570008 13303 tablet_bootstrap.cc:492] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.570647 13303 ts_tablet_manager.cc:1403] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.000s
I20260709 13:20:00.573984 13303 raft_consensus.cc:359] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.574674 13303 raft_consensus.cc:740] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.575484 13303 consensus_queue.cc:260] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.577845 13303 ts_tablet_manager.cc:1434] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:00.578640 13303 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.603127 13303 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.604009 13303 tablet_bootstrap.cc:492] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.604737 13303 ts_tablet_manager.cc:1403] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.007s
I20260709 13:20:00.607234 13303 raft_consensus.cc:359] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.607923 13303 raft_consensus.cc:740] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.608803 13303 consensus_queue.cc:260] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.611213 13303 ts_tablet_manager.cc:1434] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:20:00.612037 13303 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.635895 13303 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.637012 13303 tablet_bootstrap.cc:492] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.637710 13303 ts_tablet_manager.cc:1403] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 13:20:00.642716 13303 raft_consensus.cc:359] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.643462 13303 raft_consensus.cc:740] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.644340 13303 consensus_queue.cc:260] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.646740 13303 ts_tablet_manager.cc:1434] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:00.647606 13303 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.677606 13303 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.678640 13303 tablet_bootstrap.cc:492] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.679347 13303 ts_tablet_manager.cc:1403] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.008s
I20260709 13:20:00.683604 13303 raft_consensus.cc:359] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.684670 13303 raft_consensus.cc:740] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.685943 13303 consensus_queue.cc:260] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.688412 13303 ts_tablet_manager.cc:1434] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:00.689225 13303 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.693475 13262 raft_consensus.cc:493] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.694159 13262 raft_consensus.cc:515] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.696415 13262 leader_election.cc:290] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.696954 13317 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.705861 13317 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:00.708496 12570 leader_election.cc:336] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.709064 13317 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.710227 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.712271 12573 leader_election.cc:304] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:00.714740 13317 raft_consensus.cc:2749] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.716878 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:20:00.717566 12570 leader_election.cc:336] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.718638 12573 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:00.723632 13317 raft_consensus.cc:2749] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:00.741525 13317 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.742126 13317 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.743932 13304 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.744503 13304 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.746537 13304 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.744414 13317 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.749514 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.750943 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
W20260709 13:20:00.762825 12570 leader_election.cc:336] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.763415 12570 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:00.767685 13303 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:20:00.772699 12570 leader_election.cc:336] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.773380 13304 raft_consensus.cc:2749] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.774561 12570 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:00.776170 13317 raft_consensus.cc:2749] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.785090 13101 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.785792 13101 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.792407 13189 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.793056 13189 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.793498 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:00.794286 13273 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.792001 13101 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:00.794821 13273 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.792418 13269 raft_consensus.cc:493] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.796010 13269 raft_consensus.cc:515] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.796406 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:00.797008 12607 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 2.
I20260709 13:20:00.797386 13304 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.797808 13255 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.795204 13189 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:00.797987 13304 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.799069 13303 tablet_bootstrap.cc:492] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.799598 13189 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.799827 13303 ts_tablet_manager.cc:1403] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.111s	user 0.017s	sys 0.000s
I20260709 13:20:00.800299 13255 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.802655 13255 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:00.803736 13266 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.802999 13303 raft_consensus.cc:359] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.804726 13303 raft_consensus.cc:740] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:00.804594 13266 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.805140 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.805678 13303 consensus_queue.cc:260] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.808260 13303 ts_tablet_manager.cc:1434] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:00.808470 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:00.809131 12607 raft_consensus.cc:2468] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:00.809587 13303 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:00.810290 12646 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:00.800096 13189 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.798144 12498 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:00.814678 13101 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:00.815024 13101 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.815348 13101 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:00.815472 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:20:00.816179 12570 leader_election.cc:336] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.816637 12570 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:00.818023 13317 raft_consensus.cc:2749] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.821458 13266 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.822104 13266 raft_consensus.cc:2804] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:00.831845 13266 raft_consensus.cc:493] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.835780 13266 raft_consensus.cc:3060] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:00.828285 12644 leader_election.cc:336] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:00.838593 12644 leader_election.cc:336] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:00.839087 12644 leader_election.cc:336] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.823509 13269 leader_election.cc:290] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:20:00.831135 12496 leader_election.cc:336] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.800005 13304 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.831967 13101 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.835037 13317 raft_consensus.cc:493] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.852252 13317 raft_consensus.cc:515] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.821379 13273 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.853876 12496 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:00.854943 13255 raft_consensus.cc:2749] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.858134 13317 leader_election.cc:290] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.836598 13189 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
W20260709 13:20:00.861202 12646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 50984.4us
I20260709 13:20:00.864477 13317 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.865121 13317 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.867416 13317 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.867734 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.869570 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.871677 13317 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.871860 12647 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:00.873225 12647 leader_election.cc:304] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:00.874015 13304 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.872303 13317 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.874539 13304 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.877086 13304 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.878513 13273 raft_consensus.cc:2749] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.884938 13273 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.885439 13273 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.879142 13269 raft_consensus.cc:2749] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.872586 13101 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:00.881501 13317 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.888875 13273 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:20:00.882009 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 50903.8us
I20260709 13:20:00.877614 13304 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.889501 13348 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.889720 13304 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:00.890080 13348 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.891955 13348 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.895315 13317 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.895887 13317 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.897874 13317 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
W20260709 13:20:00.899581 12570 leader_election.cc:336] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:00.900146 12570 leader_election.cc:336] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:00.903362 12570 leader_election.cc:336] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:00.903833 12570 leader_election.cc:336] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.905380 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.906093 12525 raft_consensus.cc:2468] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:20:00.907446 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.908133 12525 raft_consensus.cc:2468] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:20:00.908396 13269 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.909559 13269 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.892021 13304 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.914228 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:00.914862 12601 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:00.916196 13269 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.916531 12646 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
W20260709 13:20:00.917328 12570 leader_election.cc:336] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.917718 13304 raft_consensus.cc:493] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.918147 13269 raft_consensus.cc:2804] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:00.918591 13269 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.918262 13304 raft_consensus.cc:515] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:00.918967 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.920594 13304 leader_election.cc:290] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:20:00.917852 12570 leader_election.cc:336] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.924799 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:00.925535 12601 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:20:00.930042 12570 leader_election.cc:336] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.934617 13348 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
W20260709 13:20:00.934800 12496 leader_election.cc:336] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.935232 13348 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:20:00.936980 12644 leader_election.cc:336] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:00.938127 13346 raft_consensus.cc:493] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.938647 13346 raft_consensus.cc:515] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:00.939632 13273 raft_consensus.cc:493] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.940143 13273 raft_consensus.cc:515] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.940649 13346 leader_election.cc:290] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:00.937821 13348 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.942778 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.943426 12677 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:20:00.946686 13303 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:00.947621 13303 tablet_bootstrap.cc:492] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:00.948342 13303 ts_tablet_manager.cc:1403] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.139s	user 0.013s	sys 0.005s
I20260709 13:20:00.947522 13273 leader_election.cc:290] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.949210 13346 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.950888 12573 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:00.952034 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.952577 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.953665 12677 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:20:00.949790 13346 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:00.955379 13273 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.952096 12573 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:00.956405 13273 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:00.958410 13317 raft_consensus.cc:2804] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:00.958971 13317 raft_consensus.cc:493] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.959331 13317 raft_consensus.cc:3060] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:00.959658 13273 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.918984 13269 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:00.953858 12525 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:00.963330 12673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.965930 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.985523 12675 raft_consensus.cc:2468] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:20:00.962874 12573 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:00.986773 13262 raft_consensus.cc:2749] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:00.988386 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:00.989091 12602 raft_consensus.cc:2468] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:00.990061 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:00.990178 12646 leader_election.cc:304] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:00.990672 12604 raft_consensus.cc:2468] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:00.960489 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:00.969587 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:00.954814 13304 raft_consensus.cc:2804] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:00.971416 13346 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:00.993481 13304 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.994204 12570 leader_election.cc:304] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:00.994642 13304 raft_consensus.cc:3060] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:00.992710 12527 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:01.000674 13349 raft_consensus.cc:2804] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.002274 13349 raft_consensus.cc:493] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.005252 13349 raft_consensus.cc:3060] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:00.978259 13317 raft_consensus.cc:515] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.008693 13304 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.010082 13317 leader_election.cc:290] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:01.010667 13304 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:00.975488 12601 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 3.
I20260709 13:20:00.979223 13303 raft_consensus.cc:359] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.013350 13303 raft_consensus.cc:740] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.014091 13303 consensus_queue.cc:260] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.016161 13303 ts_tablet_manager.cc:1434] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.001s
I20260709 13:20:00.979521 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:01.016549 13348 raft_consensus.cc:493] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.017373 13303 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:01.017216 13348 raft_consensus.cc:515] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.019981 13348 leader_election.cc:290] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:01.021731 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:01.022356 12606 raft_consensus.cc:2468] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:20:01.023658 12498 leader_election.cc:304] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.024427 13348 raft_consensus.cc:2804] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:00.973771 13347 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.990998 13273 raft_consensus.cc:2804] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.024816 13348 raft_consensus.cc:493] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:00.992101 12646 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:00.971833 13356 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.025229 13348 raft_consensus.cc:3060] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.025622 13356 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.027793 13356 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.025158 13273 raft_consensus.cc:493] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.029047 12681 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 1.
I20260709 13:20:01.029851 12498 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:00.979763 13266 raft_consensus.cc:515] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.030712 13101 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:01.031154 13101 raft_consensus.cc:697] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:01.031863 13101 consensus_queue.cc:237] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.033749 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:01.034245 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d028731950492fa2b549e869766512" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.034404 12606 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:01.034807 12604 raft_consensus.cc:3060] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:00.978754 12496 leader_election.cc:336] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.038539 12646 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:01.038429 12496 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:01.039834 13358 raft_consensus.cc:2804] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.040285 13358 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.032352 13266 leader_election.cc:290] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.042137 13346 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.042804 13346 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.043354 13346 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.043797 13189 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.044358 13189 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.040673 13358 raft_consensus.cc:3060] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.046446 13189 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:01.048004 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:01.041128 13350 raft_consensus.cc:2749] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.048646 12601 raft_consensus.cc:2468] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:20:01.006855 12647 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.050009 12647 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:01.050371 12498 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.051141 13356 raft_consensus.cc:2804] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.051642 13356 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.052057 13356 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.028681 13273 raft_consensus.cc:3060] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.055560 12570 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:01.057382 13362 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.057791 13362 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.058208 13362 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.059087 13350 raft_consensus.cc:2804] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.059525 13350 raft_consensus.cc:493] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.059855 13350 raft_consensus.cc:3060] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.004509 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:20:01.041769 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 63169.4us
W20260709 13:20:01.084755 12644 leader_election.cc:336] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.085314 13347 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.104751 13358 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.084064 12355 catalog_manager.cc:5697] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 2 to 3, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.087591 13266 raft_consensus.cc:2804] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.090235 13362 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.096155 13348 raft_consensus.cc:515] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:01.097414 12570 leader_election.cc:336] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.097929 12604 raft_consensus.cc:2468] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
W20260709 13:20:01.110782 12570 leader_election.cc:336] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.096318 13269 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.100221 13350 raft_consensus.cc:515] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:01.108642 12573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 121038us
W20260709 13:20:01.097193 12644 leader_election.cc:336] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.111933 12646 leader_election.cc:304] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:01.107556 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:01.115289 13101 raft_consensus.cc:493] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.116052 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:01.104363 13349 raft_consensus.cc:515] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:01.120105 13366 raft_consensus.cc:2804] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.123152 13366 raft_consensus.cc:697] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:01.124627 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad1ae772aa48427189cff34a672ae7ea" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:01.125284 12527 raft_consensus.cc:3060] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.127022 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:01.127736 12681 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:20:01.124055 13366 consensus_queue.cc:237] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.110535 13266 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.135334 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.134863 13303 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.150709 12607 raft_consensus.cc:2393] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 2: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:20:01.151805 13303 tablet_bootstrap.cc:492] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:01.129436 13362 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.145186 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.147627 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:01.152204 12606 raft_consensus.cc:3060] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.149151 13266 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.130741 13348 leader_election.cc:290] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:01.129601 13358 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.120721 13101 raft_consensus.cc:515] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.134802 12601 raft_consensus.cc:2468] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 1.
I20260709 13:20:01.157423 12646 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:01.151948 13350 leader_election.cc:290] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:01.155800 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bdb79ea7d064a729a9a450e5ca8045f" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.158396 13358 raft_consensus.cc:2804] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.121078 12531 raft_consensus.cc:3060] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.146528 13347 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.158495 12607 raft_consensus.cc:3060] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.153313 12604 raft_consensus.cc:3060] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.153256 13303 ts_tablet_manager.cc:1403] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.136s	user 0.030s	sys 0.012s
I20260709 13:20:01.157614 13101 leader_election.cc:290] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
W20260709 13:20:01.140478 12570 leader_election.cc:336] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.113471 13273 raft_consensus.cc:515] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.172120 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc3b8ac766444654ab744eef004d23cb" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:01.172708 12680 raft_consensus.cc:3060] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.162175 13358 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.151842 13349 leader_election.cc:290] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:01.144486 12527 raft_consensus.cc:2468] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:01.185213 12677 raft_consensus.cc:2393] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:01.184494 12673 raft_consensus.cc:2393] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:01.193678 12531 raft_consensus.cc:2468] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:01.195883 12680 raft_consensus.cc:2468] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:01.189054 13303 raft_consensus.cc:359] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.201974 13303 raft_consensus.cc:740] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.203807 12607 raft_consensus.cc:2468] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 2.
W20260709 13:20:01.204516 12573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 85415.4us
I20260709 13:20:01.198171 12606 raft_consensus.cc:2468] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 2.
I20260709 13:20:01.202772 12570 leader_election.cc:304] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:01.202788 13303 consensus_queue.cc:260] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.209161 13303 ts_tablet_manager.cc:1434] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:20:01.209874 13273 leader_election.cc:290] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.211614 13303 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:01.197098 13358 raft_consensus.cc:3060] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.214537 13266 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.219820 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49a785fe68e845f4bdbac514c3f8efcf" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.218230 13266 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:01.220858 12607 raft_consensus.cc:3060] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.226287 12573 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:01.230541 13362 raft_consensus.cc:2804] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.225508 13317 raft_consensus.cc:2804] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.231076 13362 raft_consensus.cc:697] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:01.231534 13317 raft_consensus.cc:697] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:01.232241 13362 consensus_queue.cc:237] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.223225 12570 leader_election.cc:304] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:01.232350 13317 consensus_queue.cc:237] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:20:01.227886 12644 leader_election.cc:336] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.254664 12644 leader_election.cc:336] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.222581 12604 raft_consensus.cc:2468] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
W20260709 13:20:01.259020 12644 leader_election.cc:336] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.262755 12644 leader_election.cc:304] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:01.261966 13269 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.262143 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.262620 13356 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.263741 12606 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:01.264529 12644 leader_election.cc:336] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.265129 13269 raft_consensus.cc:2749] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:01.268021 12644 leader_election.cc:336] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.268514 12644 leader_election.cc:336] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.270051 12646 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:01.263447 13346 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
W20260709 13:20:01.270520 12644 leader_election.cc:336] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.271095 12681 raft_consensus.cc:2393] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate be08affc17214c5081ca9d2d19f0c1bd in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:01.271250 13269 raft_consensus.cc:2804] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.272007 13269 raft_consensus.cc:697] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:01.260890 13358 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.270349 12606 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:01.274223 13358 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.274595 12646 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:01.268754 13356 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:01.275307 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.275771 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:01.276557 12606 raft_consensus.cc:2393] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 2: Already voted for candidate be08affc17214c5081ca9d2d19f0c1bd in this term.
I20260709 13:20:01.275923 12604 raft_consensus.cc:3060] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.278298 13372 raft_consensus.cc:2804] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.279134 13372 raft_consensus.cc:697] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
W20260709 13:20:01.281272 12644 leader_election.cc:336] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.330662 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 49247us
W20260709 13:20:01.331275 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 107979us
W20260709 13:20:01.334326 12573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 107973us
I20260709 13:20:01.335767 12573 leader_election.cc:304] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:01.205602 12496 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
W20260709 13:20:01.338272 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 132633us
I20260709 13:20:01.220999 12498 leader_election.cc:304] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.338879 12570 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:01.339694 13189 raft_consensus.cc:2804] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.340548 13189 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.341187 13189 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:01.340381 12498 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.195:45643, user_credentials={real_user=slave}} blocked reactor thread for 119263us
W20260709 13:20:01.331787 12644 consensus_peers.cc:597] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:01.343580 12498 leader_election.cc:304] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.278683 13269 consensus_queue.cc:237] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.347095 13317 raft_consensus.cc:2804] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.347456 13306 raft_consensus.cc:493] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.348716 13349 raft_consensus.cc:2749] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.348508 13306 raft_consensus.cc:515] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.349273 13255 raft_consensus.cc:2804] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.326822 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:01.349985 13317 raft_consensus.cc:697] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
W20260709 13:20:01.343469 12644 leader_election.cc:336] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.354188 12644 leader_election.cc:336] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.342371 13101 raft_consensus.cc:2804] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.283988 13303 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.280920 13372 consensus_queue.cc:237] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.279036 13346 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.350003 13255 raft_consensus.cc:697] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:01.390036 13255 consensus_queue.cc:237] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.391264 12607 raft_consensus.cc:2468] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:01.363554 13101 raft_consensus.cc:697] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:01.369390 12496 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.352424 13317 consensus_queue.cc:237] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.397895 13306 leader_election.cc:290] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:01.394523 13368 raft_consensus.cc:2749] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.401878 13303 tablet_bootstrap.cc:492] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:01.403602 13303 ts_tablet_manager.cc:1403] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.192s	user 0.023s	sys 0.002s
I20260709 13:20:01.408473 13101 consensus_queue.cc:237] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:01.412432 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 48618.2us
W20260709 13:20:01.416612 12573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:35029, user_credentials={real_user=slave}} blocked reactor thread for 81115.9us
I20260709 13:20:01.422094 13350 raft_consensus.cc:2804] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.422631 13350 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.423125 13350 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.426945 12646 leader_election.cc:304] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:01.429293 12354 catalog_manager.cc:5697] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 2 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.433176 13346 raft_consensus.cc:2804] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.438014 12604 raft_consensus.cc:2468] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:01.438218 13346 raft_consensus.cc:697] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:01.454371 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
W20260709 13:20:01.419772 12570 leader_election.cc:336] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.424320 13189 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:20:01.457051 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 43634.1us
W20260709 13:20:01.472596 12644 leader_election.cc:336] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.476917 12527 raft_consensus.cc:2393] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:20:01.478235 13189 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.465329 13346 consensus_queue.cc:237] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:01.491544 12646 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:01.493309 13372 raft_consensus.cc:2804] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:01.494246 13372 raft_consensus.cc:697] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:01.495625 13372 consensus_queue.cc:237] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
W20260709 13:20:01.497807 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 78136.7us
I20260709 13:20:01.488200 13303 raft_consensus.cc:359] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.501818 13303 raft_consensus.cc:740] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
W20260709 13:20:01.511844 13385 log.cc:927] Time spent T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.002s
I20260709 13:20:01.518396 12647 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:01.520938 13356 raft_consensus.cc:2749] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.521873 12570 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:01.531567 12496 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.540829 13360 raft_consensus.cc:2749] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:01.551492 12644 leader_election.cc:336] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.557379 12644 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:01.564065 13269 raft_consensus.cc:2749] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.564109 13388 raft_consensus.cc:2804] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.563334 12354 catalog_manager.cc:5697] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 2 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.565783 13388 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.566386 13388 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.566890 12354 catalog_manager.cc:5697] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 2 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:01.539182 13303 consensus_queue.cc:260] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.585593 13303 ts_tablet_manager.cc:1434] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.182s	user 0.006s	sys 0.010s
I20260709 13:20:01.587280 13303 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:20:01.590049 12644 leader_election.cc:336] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.593029 12644 consensus_peers.cc:597] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.597683 12644 consensus_peers.cc:597] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:01.570317 13350 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.599885 12531 raft_consensus.cc:2393] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e42f0f6820a54d65880b5a40d1e1d4e2 in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:20:01.600971 13350 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.609061 12647 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
W20260709 13:20:01.608438 12644 consensus_peers.cc:597] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.611694 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 79012.4us
I20260709 13:20:01.617390 13306 raft_consensus.cc:493] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.618373 13306 raft_consensus.cc:515] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.615267 13346 raft_consensus.cc:2749] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:20:01.640949 12570 consensus_peers.cc:597] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:01.628659 13306 leader_election.cc:290] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:01.660264 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:01.661758 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:01.661971 12607 raft_consensus.cc:1275] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:01.652794 12354 catalog_manager.cc:5697] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.663868 13366 consensus_queue.cc:1048] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:01.656525 13306 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.666875 13306 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.669818 13306 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:01.671267 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:01.672156 12527 raft_consensus.cc:2393] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:20:01.677385 12354 catalog_manager.cc:5697] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.679162 12355 catalog_manager.cc:5697] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.681988 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "878634ecebed436cab294749679d0254" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:01.683100 12355 catalog_manager.cc:5697] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.684934 13299 leader_election.cc:304] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:01.689950 13306 raft_consensus.cc:2749] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.674940 13388 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.692620 13388 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:01.693840 12355 catalog_manager.cc:5697] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:01.710000 12644 consensus_peers.cc:597] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.712703 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 43597.8us
W20260709 13:20:01.716749 12496 leader_election.cc:336] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.717763 12496 leader_election.cc:336] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.713546 12355 catalog_manager.cc:5697] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:01.719975 12355 catalog_manager.cc:5697] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:01.719010 12496 leader_election.cc:336] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.731810 12570 consensus_peers.cc:597] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:01.734694 12570 consensus_peers.cc:597] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.744975 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c27a8f81e2943eb9cf5ee3dd7577d88" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:01.747733 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:01.750428 12681 raft_consensus.cc:2393] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
W20260709 13:20:01.753299 12570 consensus_peers.cc:597] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:01.753553 13297 leader_election.cc:304] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:01.757452 13306 raft_consensus.cc:2749] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.784372 13297 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:01.798532 13306 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:01.806087 12644 consensus_peers.cc:597] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.821969 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:01.822806 12681 raft_consensus.cc:2468] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 1.
I20260709 13:20:01.823038 13303 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:01.825017 13303 tablet_bootstrap.cc:492] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:01.825491 13306 raft_consensus.cc:2749] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:01.825743 13303 ts_tablet_manager.cc:1403] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.239s	user 0.013s	sys 0.028s
I20260709 13:20:01.831562 13303 raft_consensus.cc:359] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.832666 13303 raft_consensus.cc:740] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:01.833510 13303 consensus_queue.cc:260] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:20:01.840190 12496 leader_election.cc:336] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.844941 12604 raft_consensus.cc:1275] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:01.841504 13303 ts_tablet_manager.cc:1434] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 13:20:01.845875 12570 consensus_peers.cc:597] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.846156 13303 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:01.849907 13350 consensus_queue.cc:1048] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:01.851490 12496 leader_election.cc:336] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.853158 12681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:01.853926 12681 raft_consensus.cc:2393] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
W20260709 13:20:01.854810 12496 leader_election.cc:336] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:01.863641 12606 raft_consensus.cc:1275] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:01.865139 13346 consensus_queue.cc:1048] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:01.867066 12674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:01.868021 12674 raft_consensus.cc:2393] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate edb4d71736c5490ab4008aa30a223e25 in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:01.871716 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:01.872577 12675 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.888217 12496 leader_election.cc:304] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:01.888473 12602 raft_consensus.cc:1275] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:01.893594 13395 raft_consensus.cc:2804] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:01.894049 13395 raft_consensus.cc:493] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:01.894413 13395 raft_consensus.cc:3060] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.897167 12525 raft_consensus.cc:1275] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:01.899753 12602 raft_consensus.cc:1275] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:01.896944 13388 consensus_queue.cc:1048] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:01.901382 13349 consensus_queue.cc:1048] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:01.909813 13388 consensus_queue.cc:1048] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:01.906131 13395 raft_consensus.cc:515] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:01.913395 13395 leader_election.cc:290] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
W20260709 13:20:01.919132 12496 leader_election.cc:336] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.920193 12496 leader_election.cc:336] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.925416 12644 consensus_peers.cc:597] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.927971 13306 raft_consensus.cc:493] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.939311 13306 raft_consensus.cc:515] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:01.941721 13306 leader_election.cc:290] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:01.942430 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:20:01.931561 12496 leader_election.cc:336] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.957060 12496 leader_election.cc:336] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.957612 12496 consensus_peers.cc:597] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:01.958108 12496 leader_election.cc:336] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.958562 12496 leader_election.cc:336] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:01.966759 12496 consensus_peers.cc:597] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:01.983168 12604 raft_consensus.cc:1275] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:01.977039 13306 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:01.993073 12496 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:01.981582 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3963dbc730145e2a64c4fac3f70c572" candidate_uuid: "edb4d71736c5490ab4008aa30a223e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:01.994930 12680 raft_consensus.cc:3060] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:01.996867 12496 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.000207 13101 raft_consensus.cc:2749] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.009505 12674 raft_consensus.cc:1275] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.013131 13369 raft_consensus.cc:2749] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.009716 12601 raft_consensus.cc:1275] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.004458 13306 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.057461 12680 raft_consensus.cc:2468] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 2.
I20260709 13:20:02.023443 13368 consensus_queue.cc:1048] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:20:02.112571 13303 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:02.036922 12675 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate edb4d71736c5490ab4008aa30a223e25 in term 2.
W20260709 13:20:02.132284 12644 consensus_peers.cc:597] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.136917 13421 raft_consensus.cc:493] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.065169 13356 consensus_queue.cc:1048] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.071s
I20260709 13:20:02.140424 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaa0adc1589a4002b4c0544f03a1ef2f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.137629 13421 raft_consensus.cc:515] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:02.155191 13427 raft_consensus.cc:493] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:02.155503 12644 consensus_peers.cc:597] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.158264 13421 leader_election.cc:290] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:02.158888 13421 raft_consensus.cc:493] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.159381 13421 raft_consensus.cc:515] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.160097 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:02.161139 13427 raft_consensus.cc:515] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:02.162981 12644 consensus_peers.cc:597] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:02.163329 13306 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:02.163925 13306 raft_consensus.cc:493] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.164515 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:20:02.171187 12644 consensus_peers.cc:597] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.171802 12644 consensus_peers.cc:597] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.173077 13303 tablet_bootstrap.cc:492] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:02.173887 13303 ts_tablet_manager.cc:1403] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.328s	user 0.019s	sys 0.049s
I20260709 13:20:02.173679 13427 leader_election.cc:290] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:02.179293 13303 raft_consensus.cc:359] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.179979 13303 raft_consensus.cc:740] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:02.164410 13306 raft_consensus.cc:515] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.189263 13306 leader_election.cc:290] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:02.189826 13303 consensus_queue.cc:260] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.194705 13303 ts_tablet_manager.cc:1434] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 13:20:02.194933 13427 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.196184 13303 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:02.195995 13427 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.197984 13421 leader_election.cc:290] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:20:02.198643 12644 consensus_peers.cc:597] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.199471 12644 consensus_peers.cc:597] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.228660 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.232172 12602 raft_consensus.cc:1275] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.233332 13427 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:02.245453 13434 consensus_queue.cc:1048] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:20:02.247557 12530 raft_consensus.cc:1275] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:02.249890 12570 consensus_peers.cc:597] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.250761 12570 consensus_peers.cc:597] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.251191 12570 consensus_peers.cc:597] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.251293 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 250306us
I20260709 13:20:02.255488 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:02.252511 12496 leader_election.cc:304] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:02.258262 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.261385 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.262670 12496 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:02.266933 13350 raft_consensus.cc:2804] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.267863 13350 raft_consensus.cc:697] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:02.268819 13350 consensus_queue.cc:237] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.272377 13360 consensus_queue.cc:1048] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.273766 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4f0e015fd1245df8b4f7ac03925ae09" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.276562 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.263538 13369 raft_consensus.cc:2804] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:02.278164 13369 raft_consensus.cc:697] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Becoming Leader. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:02.279021 13369 consensus_queue.cc:237] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.305564 13299 leader_election.cc:304] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.306476 13297 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.307476 13427 raft_consensus.cc:493] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.308107 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.308208 13427 raft_consensus.cc:515] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.311236 13439 raft_consensus.cc:2749] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.312175 13439 raft_consensus.cc:2749] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.313098 13439 raft_consensus.cc:493] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.316840 13439 raft_consensus.cc:515] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.317459 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:02.319180 13439 leader_election.cc:290] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:02.315943 13427 leader_election.cc:290] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:02.320896 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:02.321020 13427 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.325048 13427 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.331051 12606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.335031 12677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa508c916de349f7978060020c80bd3d" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.336009 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "424acb25ab4a4395a267933873286ca0" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.337031 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0533952f2edb40af8e517e228d720738" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.307551 13299 leader_election.cc:304] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.339479 12601 raft_consensus.cc:2393] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:02.340078 13439 raft_consensus.cc:2749] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.340947 13439 raft_consensus.cc:493] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.341358 13299 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.342216 13306 raft_consensus.cc:493] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.342829 13306 raft_consensus.cc:515] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.345314 13306 leader_election.cc:290] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:02.341588 13439 raft_consensus.cc:515] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.348132 13439 leader_election.cc:290] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
W20260709 13:20:02.351679 12570 consensus_peers.cc:597] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.360339 13297 leader_election.cc:304] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.364219 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8219316df3d4ad79c4fbe14bb77376b" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.364853 12673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.366175 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b322fccf59456095cd4773a162b412" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.367218 13306 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.367770 13306 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.369997 13306 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:02.371552 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
W20260709 13:20:02.377856 12496 leader_election.cc:336] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:02.378579 13435 raft_consensus.cc:2749] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.379397 13435 raft_consensus.cc:2749] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.381722 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47b322fccf59456095cd4773a162b412" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.380815 12601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41bc8bb09ea4170a53464bccb6477ba" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.390254 13299 leader_election.cc:304] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.393393 13299 leader_election.cc:304] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.394229 13439 raft_consensus.cc:2749] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.394681 13299 leader_election.cc:304] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.394886 13439 raft_consensus.cc:2749] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.395709 13439 raft_consensus.cc:3060] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.396191 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:02.397418 13297 leader_election.cc:304] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.398216 13306 raft_consensus.cc:2749] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.398738 12675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.399505 12675 raft_consensus.cc:2393] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:20:02.399682 13297 leader_election.cc:304] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.400419 13306 raft_consensus.cc:2749] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.400746 12673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.402999 13297 leader_election.cc:304] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.387751 13427 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:02.412056 13306 raft_consensus.cc:2749] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.408591 12355 catalog_manager.cc:5697] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.422276 13297 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.426064 13439 raft_consensus.cc:2749] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.430895 12355 catalog_manager.cc:5697] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 reported cstate change: term changed from 1 to 2, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to edb4d71736c5490ab4008aa30a223e25 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "edb4d71736c5490ab4008aa30a223e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:02.430927 13439 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.435443 13306 raft_consensus.cc:493] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.435983 13306 raft_consensus.cc:515] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.439069 13297 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.441519 13306 leader_election.cc:290] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:02.441371 13346 consensus_queue.cc:1048] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.443455 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:02.444205 12604 raft_consensus.cc:2393] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:02.445559 12673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bea13bfc0b6042faac37932e2b31c21a" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.448266 13306 raft_consensus.cc:2749] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:02.451122 13297 leader_election.cc:304] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.456980 13306 raft_consensus.cc:3060] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:02.454869 12496 consensus_peers.cc:597] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.458415 12496 consensus_peers.cc:597] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.458993 12496 consensus_peers.cc:597] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:02.467451 12570 consensus_peers.cc:597] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.467851 13303 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:20:02.468209 12496 consensus_peers.cc:597] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.468708 12496 consensus_peers.cc:597] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.469256 12496 consensus_peers.cc:597] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.469727 12496 consensus_peers.cc:597] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.473486 12496 consensus_peers.cc:597] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.485437 13427 raft_consensus.cc:493] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.486037 13427 raft_consensus.cc:515] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:02.486972 13306 raft_consensus.cc:2749] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.487867 13439 raft_consensus.cc:2749] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.488253 13427 leader_election.cc:290] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:02.489470 12673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.491119 12607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd04e41dc224298aa74af4ed0318c83" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
W20260709 13:20:02.493796 12496 consensus_peers.cc:597] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.498821 13299 leader_election.cc:304] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:02.500490 13427 raft_consensus.cc:2749] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.468828 13303 tablet_bootstrap.cc:492] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:02.507687 13303 ts_tablet_manager.cc:1403] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.312s	user 0.017s	sys 0.008s
I20260709 13:20:02.518734 13303 raft_consensus.cc:359] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.519898 13303 raft_consensus.cc:740] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:02.521126 13303 consensus_queue.cc:260] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.524006 13303 ts_tablet_manager.cc:1434] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 13:20:02.525261 13303 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:20:02.527781 12496 consensus_peers.cc:597] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.528203 12496 consensus_peers.cc:597] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.534382 12496 consensus_peers.cc:597] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:02.546000 12496 consensus_peers.cc:597] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.608697 13303 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:02.609705 13303 tablet_bootstrap.cc:492] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:02.610332 13303 ts_tablet_manager.cc:1403] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.000s
I20260709 13:20:02.612859 13303 raft_consensus.cc:359] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:02.616303 13303 raft_consensus.cc:740] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:02.617486 13303 consensus_queue.cc:260] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:02.627600 13464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:34251 every 8 connection(s)
I20260709 13:20:02.628250  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:34251
I20260709 13:20:02.627121 13303 ts_tablet_manager.cc:1434] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:20:02.629781 13303 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:02.688726 12673 raft_consensus.cc:1275] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.690799 13369 consensus_queue.cc:1048] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.697727 13427 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:02.698305 13427 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:02.700551 13427 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:02.702553 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:02.703393 12533 raft_consensus.cc:2393] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate edb4d71736c5490ab4008aa30a223e25 in this term.
I20260709 13:20:02.703933 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" is_pre_election: true
I20260709 13:20:02.704730 12680 raft_consensus.cc:2393] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6b0179dde0454d1e819be37e79c733af in current term 2: Already voted for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in this term.
I20260709 13:20:02.706295 13297 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af; no voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:02.708289 13427 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.720719 13382 raft_consensus.cc:3060] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.733130 13427 raft_consensus.cc:2749] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:02.744386 13303 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:02.765817 13303 tablet_bootstrap.cc:492] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:02.766351 13303 ts_tablet_manager.cc:1403] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.137s	user 0.015s	sys 0.008s
I20260709 13:20:02.780831 12680 raft_consensus.cc:1275] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.782680 13369 consensus_queue.cc:1048] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.788620 13364 raft_consensus.cc:3060] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.790939 13357 raft_consensus.cc:1275] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:02.791862 13355 raft_consensus.cc:3060] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.792205 13303 raft_consensus.cc:359] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:02.799295 13303 raft_consensus.cc:740] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:02.800199 13303 consensus_queue.cc:260] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:02.804129 13303 ts_tablet_manager.cc:1434] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:20:02.805202 13303 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:20:02.818066 12496 consensus_peers.cc:597] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:02.819124 13424 consensus_queue.cc:1048] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:02.832221 13353 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:02.902356 13364 raft_consensus.cc:1275] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Refusing update from remote peer edb4d71736c5490ab4008aa30a223e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:20:03.044315 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 162505us
W20260709 13:20:03.071610 13478 log.cc:927] Time spent T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 13:20:03.093919 13303 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.107722 13346 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.129070 13303 tablet_bootstrap.cc:492] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:03.130268 13303 ts_tablet_manager.cc:1403] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.325s	user 0.020s	sys 0.020s
W20260709 13:20:03.134927 12570 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 86534.1us
I20260709 13:20:03.154913 13303 raft_consensus.cc:359] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:03.155946 13303 raft_consensus.cc:740] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.159291 13303 consensus_queue.cc:260] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
W20260709 13:20:03.178953 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 133324us
I20260709 13:20:03.180081 13303 ts_tablet_manager.cc:1434] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:20:03.138533 13346 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:03.183503 13346 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:03.186153 13465 heartbeater.cc:344] Connected to a master server at 127.2.200.254:41609
I20260709 13:20:03.186755 13465 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:03.187894 13465 heartbeater.cc:507] Master 127.2.200.254:41609 requested a full tablet report, sending...
W20260709 13:20:03.198760 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 66649us
I20260709 13:20:03.205332 12600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd" is_pre_election: true
I20260709 13:20:03.239880 13303 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:03.252501 12600 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:03.320106 13481 consensus_queue.cc:1048] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
W20260709 13:20:03.328325 12644 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:34251, user_credentials={real_user=slave}} blocked reactor thread for 68331.9us
I20260709 13:20:03.342450 13381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:20:03.351778 13498 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.352387 13498 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:03.354929 13498 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:03.362279 12646 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:03.364549 13498 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:03.364959 13498 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.365279 13498 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.407874 13303 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.408906 13303 tablet_bootstrap.cc:492] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:03.410027 13303 ts_tablet_manager.cc:1403] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.211s	user 0.032s	sys 0.017s
W20260709 13:20:03.409835 12644 leader_election.cc:343] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:03.415530 13303 raft_consensus.cc:359] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:03.416247 13303 raft_consensus.cc:740] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.418936 13303 consensus_queue.cc:260] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:03.421932 13303 ts_tablet_manager.cc:1434] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:20:03.422834 13303 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:03.511590 12530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:03.512214 12530 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:03.489969 13498 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:03.519413 13498 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:03.520442 12604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:03.521129 12604 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.528309 12647 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:03.529191 13346 raft_consensus.cc:2804] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:03.529556 13346 raft_consensus.cc:493] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.529903 13346 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.535189 13352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:20:03.535881 13371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:20:03.539105 13371 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.545322 13352 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:03.554548 13366 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:03.571476 13366 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:03.575496 12604 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:03.569789 12355 ts_manager.cc:194] Re-registered known tserver with Master: 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:03.577514 13366 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:20:03.599848 12496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.196:34371, user_credentials={real_user=slave}} blocked reactor thread for 144036us
I20260709 13:20:03.598749 12646 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:03.604131 13366 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:03.610258 13366 raft_consensus.cc:697] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:03.588563 13346 raft_consensus.cc:515] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:03.613909 13366 consensus_queue.cc:237] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:03.618700 13346 leader_election.cc:290] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:03.616899 13303 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.621009 13303 tablet_bootstrap.cc:492] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:03.621806 13303 ts_tablet_manager.cc:1403] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.199s	user 0.011s	sys 0.012s
I20260709 13:20:03.625602 13303 raft_consensus.cc:359] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:03.626863 13352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:20:03.617041 13355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af" is_pre_election: true
I20260709 13:20:03.634528 13355 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:03.633827 13352 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.638463 13303 raft_consensus.cc:740] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.640466 12531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25" is_pre_election: true
I20260709 13:20:03.641180 12531 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:03.642045 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "faf1541d3e80425ea5524a9a73c92450" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:03.642666 12525 raft_consensus.cc:3060] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.643177 13303 consensus_queue.cc:260] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:03.645581 12644 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:03.646894 13346 raft_consensus.cc:2804] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:20:03.647284 13346 raft_consensus.cc:493] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:03.647609 13346 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.647825 13303 ts_tablet_manager.cc:1434] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:20:03.648729 13303 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:03.661339 13352 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:03.669763 13346 raft_consensus.cc:515] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:03.685910 13355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6b0179dde0454d1e819be37e79c733af"
I20260709 13:20:03.692094 12644 leader_election.cc:304] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:03.698565 12525 raft_consensus.cc:2468] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:03.698520 13366 raft_consensus.cc:2804] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:03.704619 13366 raft_consensus.cc:697] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:03.705866 13366 consensus_queue.cc:237] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:03.708437 13371 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:03.688686 13355 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.733413 13346 leader_election.cc:290] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Requested vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:03.740782 13355 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:03.742328 12644 leader_election.cc:304] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:03.743213 13346 raft_consensus.cc:2804] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:03.743927 13346 raft_consensus.cc:697] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:03.745852 13346 consensus_queue.cc:237] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:03.748471 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3ed01e93b104e1a8816c0965b585db1" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:03.749082 12533 raft_consensus.cc:3060] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:03.756248 12533 raft_consensus.cc:2468] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:03.759473 12354 catalog_manager.cc:5697] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 3, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 3 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.802596 12355 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39884
I20260709 13:20:03.805477 13303 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.813838 13465 heartbeater.cc:499] Master 127.2.200.254:41609 was elected leader, sending a full tablet report...
I20260709 13:20:03.842280 13303 tablet_bootstrap.cc:492] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:03.843631 13303 ts_tablet_manager.cc:1403] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.018s
W20260709 13:20:03.874783 12644 consensus_peers.cc:597] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:03.877648 13303 raft_consensus.cc:359] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:03.879690 13303 raft_consensus.cc:740] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.880790 13303 consensus_queue.cc:260] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:03.901134 13303 ts_tablet_manager.cc:1434] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.057s	user 0.011s	sys 0.000s
I20260709 13:20:03.902077 13303 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:03.925282 13303 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.926347 13303 tablet_bootstrap.cc:492] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:03.926964 13303 ts_tablet_manager.cc:1403] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:20:03.930102 13303 raft_consensus.cc:359] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:03.930770 13303 raft_consensus.cc:740] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.931406 13303 consensus_queue.cc:260] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
W20260709 13:20:03.933357 12644 consensus_peers.cc:597] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:03.933524 13303 ts_tablet_manager.cc:1434] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:20:03.934424 13303 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:03.969117 13303 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:03.970101 13303 tablet_bootstrap.cc:492] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:03.970731 13303 ts_tablet_manager.cc:1403] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.004s
I20260709 13:20:03.972160 12355 catalog_manager.cc:5697] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 3, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 3 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.973858 13303 raft_consensus.cc:359] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:03.974565 13303 raft_consensus.cc:740] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:03.974069 12355 catalog_manager.cc:5697] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 3, leader changed from 6b0179dde0454d1e819be37e79c733af (127.2.200.193) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 3 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:03.975500 13303 consensus_queue.cc:260] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:03.977839 13303 ts_tablet_manager.cc:1434] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:20:03.978593 13303 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.003736 13303 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.004688 13303 tablet_bootstrap.cc:492] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.005329 13303 ts_tablet_manager.cc:1403] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.008s
I20260709 13:20:04.007779 13303 raft_consensus.cc:359] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.008440 13303 raft_consensus.cc:740] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.009156 13303 consensus_queue.cc:260] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.011231 13303 ts_tablet_manager.cc:1434] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:04.011977 13303 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.047672 13303 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.048615 13303 tablet_bootstrap.cc:492] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.049316 13303 ts_tablet_manager.cc:1403] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.020s
I20260709 13:20:04.052297 13303 raft_consensus.cc:359] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.053042 13303 raft_consensus.cc:740] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.053721 13303 consensus_queue.cc:260] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.056784 13303 ts_tablet_manager.cc:1434] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:04.057564 13303 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:20:04.064934 12570 consensus_peers.cc:597] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:04.072821 13303 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.073721 13303 tablet_bootstrap.cc:492] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.074388 13303 ts_tablet_manager.cc:1403] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:20:04.076737 13355 raft_consensus.cc:1275] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:04.077205 13303 raft_consensus.cc:359] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.077903 13303 raft_consensus.cc:740] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.078586 13303 consensus_queue.cc:260] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.078785 13428 consensus_queue.cc:1048] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:04.080602 13303 ts_tablet_manager.cc:1434] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:04.081380 13303 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.096221 13303 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.097219 13303 tablet_bootstrap.cc:492] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.097900 13303 ts_tablet_manager.cc:1403] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:20:04.101362 13303 raft_consensus.cc:359] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.102036 13303 raft_consensus.cc:740] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.103653 13303 consensus_queue.cc:260] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.106711 13303 ts_tablet_manager.cc:1434] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:20:04.107393 12599 raft_consensus.cc:1275] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:04.107772 13303 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.113729 13500 consensus_queue.cc:1048] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:04.137432 13367 raft_consensus.cc:1275] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:04.142316 13498 consensus_queue.cc:1048] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:04.168008 13352 raft_consensus.cc:3060] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:04.177217 12496 consensus_peers.cc:597] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:20:04.213222 12527 raft_consensus.cc:1275] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:04.215387 13498 consensus_queue.cc:1048] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:04.219485 12527 raft_consensus.cc:1275] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:04.224826 13366 consensus_queue.cc:1048] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:04.317330 13371 raft_consensus.cc:1275] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:04.319159 13509 consensus_queue.cc:1048] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:04.383888 13303 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.385123 13303 tablet_bootstrap.cc:492] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.385964 13303 ts_tablet_manager.cc:1403] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.278s	user 0.061s	sys 0.062s
I20260709 13:20:04.387987 13303 raft_consensus.cc:359] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.388509 13303 raft_consensus.cc:740] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.389169 13303 consensus_queue.cc:260] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.390877 13303 ts_tablet_manager.cc:1434] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:20:04.391603 13303 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.411988 13303 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.412863 13303 tablet_bootstrap.cc:492] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.413483 13303 ts_tablet_manager.cc:1403] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 13:20:04.415823 13303 raft_consensus.cc:359] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.416483 13303 raft_consensus.cc:740] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.417155 13303 consensus_queue.cc:260] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.419147 13303 ts_tablet_manager.cc:1434] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:04.420463 13303 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.441532 13303 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.442509 13303 tablet_bootstrap.cc:492] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.443164 13303 ts_tablet_manager.cc:1403] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 13:20:04.445127 13303 raft_consensus.cc:359] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.445634 13303 raft_consensus.cc:740] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.446163 13303 consensus_queue.cc:260] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.447687 13303 ts_tablet_manager.cc:1434] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:04.449033 13303 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.466457 13303 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.467386 13303 tablet_bootstrap.cc:492] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.468015 13303 ts_tablet_manager.cc:1403] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 13:20:04.470561 13303 raft_consensus.cc:359] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.471449 13303 raft_consensus.cc:740] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.473085 13303 consensus_queue.cc:260] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.475287 13303 ts_tablet_manager.cc:1434] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:20:04.476902 13303 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.492388 13303 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.493379 13303 tablet_bootstrap.cc:492] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.494091 13303 ts_tablet_manager.cc:1403] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:20:04.500238 13367 raft_consensus.cc:3060] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.513708 13303 raft_consensus.cc:359] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:04.516994 12496 consensus_peers.cc:597] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:04.525408 13303 raft_consensus.cc:740] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.526213 13303 consensus_queue.cc:260] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.528584 13303 ts_tablet_manager.cc:1434] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:20:04.529778 13303 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.549511 13355 raft_consensus.cc:3060] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.558482 13371 raft_consensus.cc:3060] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:04.602191 13303 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.603233 13303 tablet_bootstrap.cc:492] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.603912 13303 ts_tablet_manager.cc:1403] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.074s	user 0.009s	sys 0.011s
I20260709 13:20:04.606482 13303 raft_consensus.cc:359] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.607125 13303 raft_consensus.cc:740] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.614145 13303 consensus_queue.cc:260] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
W20260709 13:20:04.645545 12644 consensus_peers.cc:597] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:04.645618 13303 ts_tablet_manager.cc:1434] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:20:04.655591 13303 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
W20260709 13:20:04.658208 12496 consensus_peers.cc:597] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:04.737932 13303 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.738957 13303 tablet_bootstrap.cc:492] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.739701 13303 ts_tablet_manager.cc:1403] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.003s
I20260709 13:20:04.742460 13303 raft_consensus.cc:359] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.743193 13303 raft_consensus.cc:740] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.743906 13303 consensus_queue.cc:260] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.746166 13303 ts_tablet_manager.cc:1434] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:04.747812 13303 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.771087 13303 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.772223 13303 tablet_bootstrap.cc:492] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.772938 13303 ts_tablet_manager.cc:1403] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:20:04.778999 13303 raft_consensus.cc:359] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.786864 13303 raft_consensus.cc:740] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.787577 13303 consensus_queue.cc:260] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.795794 13303 ts_tablet_manager.cc:1434] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:20:04.796512 13303 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.811640 13303 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.812397 13303 tablet_bootstrap.cc:492] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.813079 13303 ts_tablet_manager.cc:1403] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:20:04.818971 13303 raft_consensus.cc:359] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.819792 13303 raft_consensus.cc:740] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.820739 13303 consensus_queue.cc:260] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:04.824393 13303 ts_tablet_manager.cc:1434] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:04.825696 13303 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.845456 13303 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.846426 13303 tablet_bootstrap.cc:492] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.847121 13303 ts_tablet_manager.cc:1403] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:20:04.850018 13303 raft_consensus.cc:359] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.850680 13303 raft_consensus.cc:740] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.851354 13303 consensus_queue.cc:260] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:04.853467 13303 ts_tablet_manager.cc:1434] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:04.854645 13303 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Bootstrap starting.
I20260709 13:20:04.885109 13303 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:04.885887 13303 tablet_bootstrap.cc:492] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Bootstrap complete.
I20260709 13:20:04.886428 13303 ts_tablet_manager.cc:1403] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.011s
I20260709 13:20:04.889155 13303 raft_consensus.cc:359] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.890765 13303 raft_consensus.cc:740] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Initialized, Role: FOLLOWER
I20260709 13:20:04.891439 13303 consensus_queue.cc:260] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:04.893705 13303 ts_tablet_manager.cc:1434] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:04.950665 13352 raft_consensus.cc:3060] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:05.212467 13352 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:12.716181  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:12.778909 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:12.779651 12680 raft_consensus.cc:606] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:12.782503 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:12.782986 12680 raft_consensus.cc:606] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:12.785396 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53c73e9183b4401b8f75411b63878062"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:12.785998 12680 raft_consensus.cc:606] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:12.798074 13568 raft_consensus.cc:993] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:12.799080 13346 raft_consensus.cc:1081] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:12.800791 13367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53c73e9183b4401b8f75411b63878062"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37790
I20260709 13:20:12.801355 13367 raft_consensus.cc:493] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.801702 13367 raft_consensus.cc:3060] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.801779 12599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54cd9a065a174d478feebb6406e59340"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:42298
I20260709 13:20:12.802393 12599 raft_consensus.cc:606] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:12.805645 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:12.806116 12680 raft_consensus.cc:606] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:12.813385 13367 raft_consensus.cc:515] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:12.816318 13367 leader_election.cc:290] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:12.817718 12674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:12.818688 12674 raft_consensus.cc:3055] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.818954 12674 raft_consensus.cc:740] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:12.820008 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53c73e9183b4401b8f75411b63878062" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:12.819975 12674 consensus_queue.cc:260] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:12.820794 12527 raft_consensus.cc:3060] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.825078 12674 raft_consensus.cc:3060] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.843696 12674 raft_consensus.cc:2468] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:12.844259 12533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:12.844941 12533 raft_consensus.cc:606] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:12.846406 13297 leader_election.cc:304] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:12.846804  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:20:12.847620 12527 raft_consensus.cc:2468] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:12.851706  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:12.865162 13588 raft_consensus.cc:2804] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:12.866875 13588 raft_consensus.cc:697] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:12.867805 13588 consensus_queue.cc:237] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:12.882896 12356 catalog_manager.cc:5697] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:12.982525 13564 raft_consensus.cc:993] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:12.983052 13564 raft_consensus.cc:1081] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:12.984659 12602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:34144
I20260709 13:20:12.985137 12602 raft_consensus.cc:493] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:12.985442 12602 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.995891 12602 raft_consensus.cc:515] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:12.997983 12602 leader_election.cc:290] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:12.998800 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:12.998982 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:12.999508 12527 raft_consensus.cc:3055] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:12.999644 12680 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:12.999902 12527 raft_consensus.cc:740] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:13.000839 12527 consensus_queue.cc:260] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:13.002511 12527 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.007458 12680 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:13.010864 12570 leader_election.cc:304] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:13.011130 12527 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:13.012374 13586 raft_consensus.cc:2804] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.015338 13586 raft_consensus.cc:697] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:13.016323 13586 consensus_queue.cc:237] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:13.031183 12356 catalog_manager.cc:5697] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 2 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.140322 13346 raft_consensus.cc:993] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.141000 13598 raft_consensus.cc:1081] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.142731 13367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37790
I20260709 13:20:13.143182 13367 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.143450 13367 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.148870 13367 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.150579 13367 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:13.151505 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:13.152138 12602 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.152055 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae14799191e4d7a994bf30ffcf750dc" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:13.152733 12680 raft_consensus.cc:3055] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:13.153054 12680 raft_consensus.cc:740] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:13.153777 12680 consensus_queue.cc:260] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.155534 12680 raft_consensus.cc:3060] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.161554 12602 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:13.163163 13299 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:20:13.163416 12680 raft_consensus.cc:2468] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:13.164225 13588 raft_consensus.cc:2804] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:13.165082 13588 raft_consensus.cc:697] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:13.165926 13588 consensus_queue.cc:237] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.178901 12356 catalog_manager.cc:5697] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 2 to 3, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 3 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.201484 13346 raft_consensus.cc:993] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.201978 13568 raft_consensus.cc:1081] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.203771 13352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37790
I20260709 13:20:13.204276 13352 raft_consensus.cc:493] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.204619 13352 raft_consensus.cc:3060] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.211923 13352 raft_consensus.cc:515] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.214423 13352 leader_election.cc:290] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:13.214361 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:13.215045 12603 raft_consensus.cc:3060] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.215037 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d02b1f993f04219ab72cd3d163a11f6" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:13.215802 12680 raft_consensus.cc:3055] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.216109 12680 raft_consensus.cc:740] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:13.217180 12680 consensus_queue.cc:260] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.218549 12680 raft_consensus.cc:3060] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.222074 12603 raft_consensus.cc:2468] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:13.223253 13299 leader_election.cc:304] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:20:13.223902 13588 raft_consensus.cc:2804] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.224280 13588 raft_consensus.cc:697] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:13.225183 13588 consensus_queue.cc:237] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.227154 12680 raft_consensus.cc:2468] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:13.239262 12356 catalog_manager.cc:5697] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.283723 13587 raft_consensus.cc:993] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.284268 13586 raft_consensus.cc:1081] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.286127 13352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54cd9a065a174d478feebb6406e59340"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37792
I20260709 13:20:13.286690 13352 raft_consensus.cc:493] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.287022 13352 raft_consensus.cc:3060] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.292232 13352 raft_consensus.cc:515] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.293735 13352 leader_election.cc:290] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:13.294406 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:13.294754 12674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cd9a065a174d478feebb6406e59340" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:13.295019 12602 raft_consensus.cc:3055] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:13.295318 12674 raft_consensus.cc:3060] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.295337 12602 raft_consensus.cc:740] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:13.296792 12602 consensus_queue.cc:260] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.298331 12602 raft_consensus.cc:3060] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:13.304734 12674 raft_consensus.cc:2468] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:13.305792 13297 leader_election.cc:304] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:13.306834 13588 raft_consensus.cc:2804] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:13.307343 13588 raft_consensus.cc:697] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:13.307994 12602 raft_consensus.cc:2468] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:13.308357 13588 consensus_queue.cc:237] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:13.316380 13346 raft_consensus.cc:993] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.317020 13346 raft_consensus.cc:1081] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:13.318666 13352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37790
I20260709 13:20:13.319237 13352 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:13.319576 13352 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.320367 12356 catalog_manager.cc:5697] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:13.327104 13352 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:13.329195 13352 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:13.329890 12674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:13.330524 12674 raft_consensus.cc:3055] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:13.330818 12674 raft_consensus.cc:740] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:13.331614 12674 consensus_queue.cc:260] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:13.332417 12674 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.333568 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61a0977d71c94c28a715e132c73798ad" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:13.334134 12527 raft_consensus.cc:3060] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:13.340005 12674 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:13.341085 12527 raft_consensus.cc:2468] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:13.341231 13297 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:13.342128 13588 raft_consensus.cc:2804] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:13.342641 13588 raft_consensus.cc:697] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:13.344739 13588 consensus_queue.cc:237] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:13.357071 12356 catalog_manager.cc:5697] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 2 to 3, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 3 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:13.420704 12674 raft_consensus.cc:1275] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.421862 13588 consensus_queue.cc:1048] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.426025 12527 raft_consensus.cc:1275] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.427474 13588 consensus_queue.cc:1048] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.454332 12674 raft_consensus.cc:1275] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.459276 12527 raft_consensus.cc:1275] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.459185 13587 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:13.462044 13587 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.631889 12603 raft_consensus.cc:1275] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.633185 13588 consensus_queue.cc:1048] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.643729 12680 raft_consensus.cc:1275] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.646431 13588 consensus_queue.cc:1048] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.720997 12603 raft_consensus.cc:1275] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.722797 13589 consensus_queue.cc:1048] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.737401 12680 raft_consensus.cc:1275] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.738875 13607 consensus_queue.cc:1048] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:13.771098 12680 raft_consensus.cc:1275] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.772516 13607 consensus_queue.cc:1048] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:13.777582 12533 raft_consensus.cc:1275] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.778832 13607 consensus_queue.cc:1048] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.785959 12603 raft_consensus.cc:1275] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:13.788544 13614 consensus_queue.cc:1048] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:13.841339 12680 raft_consensus.cc:1275] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:13.846565 13614 consensus_queue.cc:1048] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:13.854552  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.904395  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:13.939707 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:13.940236 12527 raft_consensus.cc:606] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:13.943707 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:13.944190 12527 raft_consensus.cc:606] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:13.946810 12602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
mode: GRACEFUL
new_leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
 from {username='slave'} at 127.0.0.1:42298
I20260709 13:20:13.947300 12602 raft_consensus.cc:606] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Received request to transfer leadership to TS e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:13.950352 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:13.950867 12527 raft_consensus.cc:606] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:13.953239 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:13.953833 12527 raft_consensus.cc:606] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:13.955037  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:13.956844  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:14.011899 13597 raft_consensus.cc:993] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:14.012473 13597 raft_consensus.cc:1081] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:14.020301 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37804
I20260709 13:20:14.021436 13355 raft_consensus.cc:493] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.021832 13355 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:14.023245 13576 raft_consensus.cc:993] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:14.023802 13576 raft_consensus.cc:1081] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:14.025804 13352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37804
I20260709 13:20:14.026355 13352 raft_consensus.cc:493] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.026695 13352 raft_consensus.cc:3060] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.029980 13612 raft_consensus.cc:993] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: : Instructing follower e42f0f6820a54d65880b5a40d1e1d4e2 to start an election
I20260709 13:20:14.030541 13586 raft_consensus.cc:1081] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Signalling peer e42f0f6820a54d65880b5a40d1e1d4e2 to start an election
I20260709 13:20:14.032078 12680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
 from {username='slave'} at 127.0.0.1:46986
I20260709 13:20:14.032594 12680 raft_consensus.cc:493] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.032955 12680 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.033437 13355 raft_consensus.cc:515] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:14.033363 13352 raft_consensus.cc:515] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:14.035992 12674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:14.036414 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ebd5e8c4c884c419dacec563c1e30ac" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:14.037029 12533 raft_consensus.cc:3055] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.035991 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:14.036542 12674 raft_consensus.cc:3060] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.037787 12527 raft_consensus.cc:3055] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:14.038157 12527 raft_consensus.cc:740] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:14.038890 12527 consensus_queue.cc:260] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:14.039881 12527 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:14.040190 13355 leader_election.cc:290] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 4 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:14.041157 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17c9a7398774b5a85e6a2d1f1f48292" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:14.042724 12602 raft_consensus.cc:3060] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:14.039467 12680 raft_consensus.cc:515] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:14.041887 12533 raft_consensus.cc:740] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:14.044553 12533 consensus_queue.cc:260] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:14.045707 12533 raft_consensus.cc:3060] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.045897 12674 raft_consensus.cc:2468] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:14.046818 12527 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 4.
I20260709 13:20:14.047324 13297 leader_election.cc:304] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:14.042261 13352 leader_election.cc:290] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:14.048202 13300 leader_election.cc:304] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:14.048466 13607 raft_consensus.cc:2804] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.049012 13607 raft_consensus.cc:697] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:14.049206 13614 raft_consensus.cc:2804] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:14.049772 13614 raft_consensus.cc:697] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 4 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:14.049981 13607 consensus_queue.cc:237] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:14.050736 12680 leader_election.cc:290] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:14.052237 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:14.052846 12603 raft_consensus.cc:3055] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:14.052744 13614 consensus_queue.cc:237] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:14.053386 12603 raft_consensus.cc:740] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:14.054205 12603 consensus_queue.cc:260] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:14.055044 12603 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.055228 12533 raft_consensus.cc:2468] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:14.055480 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:14.056099 12525 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:14.063144 12603 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:14.064590 12646 leader_election.cc:304] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:14.065616 13568 raft_consensus.cc:2804] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:14.066082 13568 raft_consensus.cc:697] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:14.066900 13568 consensus_queue.cc:237] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:14.068338 12602 raft_consensus.cc:2468] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 4.
I20260709 13:20:14.071918 12525 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:14.072690 12527 raft_consensus.cc:1240] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Rejecting Update request from peer be08affc17214c5081ca9d2d19f0c1bd for earlier term 2. Current term is 3. Ops: []
I20260709 13:20:14.078760 12355 catalog_manager.cc:5697] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 2 to 3, leader changed from be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 3 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:14.082054 12356 catalog_manager.cc:5697] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.083670 12356 catalog_manager.cc:5697] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 3 to 4, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 4 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.107088 13597 raft_consensus.cc:993] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:14.107906 13616 raft_consensus.cc:1081] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:14.109535 13352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37804
I20260709 13:20:14.110112 13352 raft_consensus.cc:493] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.110431 13352 raft_consensus.cc:3060] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.117113 13352 raft_consensus.cc:515] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:14.119740 13352 leader_election.cc:290] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:14.120077 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:14.120622 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88ea4fda6fe7451c90f25fe181570e34" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:14.120795 12680 raft_consensus.cc:3060] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.121163 12525 raft_consensus.cc:3055] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.122059 12525 raft_consensus.cc:740] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:14.123292 12525 consensus_queue.cc:260] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:14.125370 12525 raft_consensus.cc:3060] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.129959 12680 raft_consensus.cc:2468] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:14.131172 13297 leader_election.cc:304] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:14.132426 12525 raft_consensus.cc:2468] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:14.132628 13607 raft_consensus.cc:2804] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.133634 13607 raft_consensus.cc:697] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:14.134517 13607 consensus_queue.cc:237] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:14.145654 12356 catalog_manager.cc:5697] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.226833 13576 raft_consensus.cc:993] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:14.227528 13616 raft_consensus.cc:1081] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:14.229254 12602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:34144
I20260709 13:20:14.229787 12602 raft_consensus.cc:493] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:14.230080 12602 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.238601 12602 raft_consensus.cc:515] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:14.241017 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:14.241394 12674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:14.241676 12527 raft_consensus.cc:3055] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:14.241976 12674 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.242003 12527 raft_consensus.cc:740] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:14.242990 12527 consensus_queue.cc:260] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:14.244091 12527 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:14.240525 12602 leader_election.cc:290] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:14.250659 12674 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:14.251569 12527 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:14.251802 12570 leader_election.cc:304] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:14.253176 13586 raft_consensus.cc:2804] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:14.253640 13586 raft_consensus.cc:697] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:14.254483 13586 consensus_queue.cc:237] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:14.266001 12356 catalog_manager.cc:5697] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 2 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:14.432510 12680 raft_consensus.cc:1275] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.434173 13589 consensus_queue.cc:1048] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.445381 12527 raft_consensus.cc:1275] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.446830 13589 consensus_queue.cc:1048] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.479508 12525 raft_consensus.cc:1275] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:14.481001 13589 consensus_queue.cc:1048] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:14.483430 12602 raft_consensus.cc:1275] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.485376 13631 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:14.495685 12602 raft_consensus.cc:1275] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:14.497184 13588 consensus_queue.cc:1048] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:14.499384 12525 raft_consensus.cc:1275] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:14.502563 13631 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:14.704686 12527 raft_consensus.cc:1275] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.706504 13588 consensus_queue.cc:1048] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.721832 12678 raft_consensus.cc:1275] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.723172 13588 consensus_queue.cc:1048] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.758490 12527 raft_consensus.cc:1275] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.760134 13586 consensus_queue.cc:1048] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.771947 12678 raft_consensus.cc:1275] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:14.777469 13586 consensus_queue.cc:1048] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:14.957839  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.003852  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:15.048014 12602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:42298
I20260709 13:20:15.048525 12602 raft_consensus.cc:606] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:15.051192 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:15.051674 12527 raft_consensus.cc:606] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:15.054107 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:15.054647 12527 raft_consensus.cc:606] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:15.057540 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:15.058211 12527 raft_consensus.cc:606] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:15.059087 13644 raft_consensus.cc:993] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:15.059821 13586 raft_consensus.cc:1081] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:15.061250 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:15.061419 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37792
I20260709 13:20:15.061959 12680 raft_consensus.cc:606] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Received request to transfer leadership to TS be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:15.062067 13355 raft_consensus.cc:493] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.062453 13355 raft_consensus.cc:3060] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.063282  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:20:15.064564  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:15.068365 13355 raft_consensus.cc:515] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:15.070240 13355 leader_election.cc:290] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:15.088307 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:15.089025 12602 raft_consensus.cc:3055] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:15.089316 12602 raft_consensus.cc:740] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:15.090068 12602 consensus_queue.cc:260] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:15.091138 12602 raft_consensus.cc:3060] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.095329 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02392cdd764f41cca809b8f14dc0ff1f" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:15.096204 12680 raft_consensus.cc:3060] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.112087 12602 raft_consensus.cc:2468] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:15.112077 12680 raft_consensus.cc:2468] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:15.114292 13299 leader_election.cc:304] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:20:15.115293 13588 raft_consensus.cc:2804] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:15.115996 13588 raft_consensus.cc:697] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:15.117002 13588 consensus_queue.cc:237] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:15.126893 12355 catalog_manager.cc:5697] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:15.247727 13616 raft_consensus.cc:993] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:15.248234 13616 raft_consensus.cc:1081] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:15.249799 12602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:34144
I20260709 13:20:15.250322 12602 raft_consensus.cc:493] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.250648 12602 raft_consensus.cc:3060] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.258497 12602 raft_consensus.cc:515] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.260301 12602 leader_election.cc:290] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:15.261060 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:15.261703 12525 raft_consensus.cc:3055] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:15.261523 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c8c719430c241dc9304ef2ebd8df639" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:15.262267 12525 raft_consensus.cc:740] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:15.262537 12680 raft_consensus.cc:3060] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.263080 12525 consensus_queue.cc:260] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.264240 12525 raft_consensus.cc:3060] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.272063 12680 raft_consensus.cc:2468] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:15.273196 12570 leader_election.cc:304] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:15.274133 13587 raft_consensus.cc:2804] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:15.274646 13587 raft_consensus.cc:697] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:15.275039 12525 raft_consensus.cc:2468] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 2.
I20260709 13:20:15.275552 13587 consensus_queue.cc:237] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.284961 12355 catalog_manager.cc:5697] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 2 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:15.337990 13576 raft_consensus.cc:993] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:15.338692 13576 raft_consensus.cc:1081] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:15.340183 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37804
I20260709 13:20:15.340799 13355 raft_consensus.cc:493] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.341097 13355 raft_consensus.cc:3060] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.347250 13355 raft_consensus.cc:515] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:15.348598 13355 leader_election.cc:290] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:15.349427 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:15.349556 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c88422ad42d465fbb3161af884776f4" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:15.350104 12525 raft_consensus.cc:3055] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:15.350188 12602 raft_consensus.cc:3060] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.350385 12525 raft_consensus.cc:740] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:15.351166 12525 consensus_queue.cc:260] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:15.352401 12525 raft_consensus.cc:3060] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.357677 12602 raft_consensus.cc:2468] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:15.359234 13299 leader_election.cc:304] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:20:15.359995 12525 raft_consensus.cc:2468] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:15.360256 13614 raft_consensus.cc:2804] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:15.360924 13614 raft_consensus.cc:697] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:15.361900 13614 consensus_queue.cc:237] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:15.375331 12355 catalog_manager.cc:5697] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:15.497378 13568 raft_consensus.cc:993] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:15.497851 13631 raft_consensus.cc:1081] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Signalling peer be08affc17214c5081ca9d2d19f0c1bd to start an election
I20260709 13:20:15.499363 12602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
 from {username='slave'} at 127.0.0.1:44594
I20260709 13:20:15.499816 12602 raft_consensus.cc:493] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.500095 12602 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:15.505193 12602 raft_consensus.cc:515] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.507839 12602 leader_election.cc:290] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 4 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:15.508356 12525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:15.509029 12525 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:15.509145 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c94ecddd09134d23b4cf3abd9a7a5f31" candidate_uuid: "be08affc17214c5081ca9d2d19f0c1bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:15.510637 12678 raft_consensus.cc:3055] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:15.510947 12678 raft_consensus.cc:740] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:15.511996 12678 consensus_queue.cc:260] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.513479 12678 raft_consensus.cc:3060] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:15.515457 12525 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 4.
I20260709 13:20:15.516680 12573 leader_election.cc:304] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:15.517373 13586 raft_consensus.cc:2804] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:15.517875 13586 raft_consensus.cc:697] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 4 LEADER]: Becoming Leader. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:15.518646 13586 consensus_queue.cc:237] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.520898 12678 raft_consensus.cc:2468] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be08affc17214c5081ca9d2d19f0c1bd in term 4.
I20260709 13:20:15.530982 12355 catalog_manager.cc:5697] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd reported cstate change: term changed from 3 to 4, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195). New cstate: current_term: 4 leader_uuid: "be08affc17214c5081ca9d2d19f0c1bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:15.559170 13576 raft_consensus.cc:993] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower e42f0f6820a54d65880b5a40d1e1d4e2 to start an election
I20260709 13:20:15.559640 13616 raft_consensus.cc:1081] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Signalling peer e42f0f6820a54d65880b5a40d1e1d4e2 to start an election
I20260709 13:20:15.561996 12678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
 from {username='slave'} at 127.0.0.1:59430
I20260709 13:20:15.562531 12678 raft_consensus.cc:493] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:15.562800 12678 raft_consensus.cc:3060] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.567677 12678 raft_consensus.cc:515] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.569205 12678 leader_election.cc:290] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:15.570711 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:15.570735 12602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1031c7d22c0645c0b997bb7c66e1f9a4" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:15.571450 12527 raft_consensus.cc:3055] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:15.571538 12602 raft_consensus.cc:3060] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.571801 12527 raft_consensus.cc:740] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:15.572698 12527 consensus_queue.cc:260] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.575197 12527 raft_consensus.cc:3060] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:15.577155 12602 raft_consensus.cc:2468] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:15.578598 12646 leader_election.cc:304] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: be08affc17214c5081ca9d2d19f0c1bd, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:15.579538 13631 raft_consensus.cc:2804] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:15.580659 13631 raft_consensus.cc:697] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:15.581898 13631 consensus_queue.cc:237] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:15.583164 12527 raft_consensus.cc:2468] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 2.
I20260709 13:20:15.585541 12603 raft_consensus.cc:1275] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.586990 13614 consensus_queue.cc:1048] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:15.595492 12355 catalog_manager.cc:5697] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 1 to 2, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 2 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:15.612223 12678 raft_consensus.cc:1275] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.614022 13607 consensus_queue.cc:1048] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:15.716266 12680 raft_consensus.cc:1275] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.717592 13586 consensus_queue.cc:1048] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.726732 12525 raft_consensus.cc:1275] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.728206 13644 consensus_queue.cc:1048] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.767798 12602 raft_consensus.cc:1275] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.769140 13607 consensus_queue.cc:1048] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.780730 12525 raft_consensus.cc:1275] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.783109 13614 consensus_queue.cc:1048] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.921348 12527 raft_consensus.cc:1275] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:15.922600 13586 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:15.933274 12680 raft_consensus.cc:1275] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Refusing update from remote peer be08affc17214c5081ca9d2d19f0c1bd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:15.934660 13644 consensus_queue.cc:1048] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:15.968099 12527 raft_consensus.cc:1275] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.969544 13568 consensus_queue.cc:1048] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:15.981513 12603 raft_consensus.cc:1275] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:15.983042 13668 consensus_queue.cc:1048] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:16.065442  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.110256  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:16.148833 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:16.149432 12680 raft_consensus.cc:606] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:16.153443 12603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:42298
I20260709 13:20:16.154269 12603 raft_consensus.cc:606] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:16.158458 12527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "722f7ee62121485b869fb4f23af88977"
dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:57630
I20260709 13:20:16.159073 12527 raft_consensus.cc:606] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:16.162160 12603 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416"
dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
mode: GRACEFUL
new_leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
 from {username='slave'} at 127.0.0.1:42298
I20260709 13:20:16.162740 12603 raft_consensus.cc:606] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Received request to transfer leadership to TS e42f0f6820a54d65880b5a40d1e1d4e2
I20260709 13:20:16.164017  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:20:16.165360  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:16.346202 13576 raft_consensus.cc:993] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:16.346858 13655 raft_consensus.cc:1081] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:16.348970 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "722f7ee62121485b869fb4f23af88977"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37804
I20260709 13:20:16.349654 13355 raft_consensus.cc:493] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.349995 13355 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.356953 13355 raft_consensus.cc:515] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:16.359687 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:16.359897 13355 leader_election.cc:290] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:16.360284 12680 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.361936 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "722f7ee62121485b869fb4f23af88977" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:16.362391 12527 raft_consensus.cc:3055] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:16.362607 12527 raft_consensus.cc:740] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: edb4d71736c5490ab4008aa30a223e25, State: Running, Role: LEADER
I20260709 13:20:16.363261 12527 consensus_queue.cc:260] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:16.364290 12527 raft_consensus.cc:3060] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.366600 13586 raft_consensus.cc:993] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:16.367147 13644 raft_consensus.cc:1081] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:16.367769 12680 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:16.368804 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37792
I20260709 13:20:16.369035 13297 leader_election.cc:304] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 
I20260709 13:20:16.369392 13355 raft_consensus.cc:493] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.369828 13355 raft_consensus.cc:3060] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.369951 13588 raft_consensus.cc:2804] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:16.370553 13588 raft_consensus.cc:697] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:16.371382 13588 consensus_queue.cc:237] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:16.375113 12527 raft_consensus.cc:2468] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:16.377810 13355 raft_consensus.cc:515] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:16.380501 13355 leader_election.cc:290] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:16.381706 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:16.382336 12603 raft_consensus.cc:3055] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:16.382546 12603 raft_consensus.cc:740] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:16.383200 12603 consensus_queue.cc:260] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:16.383581 12527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dffa974b56c4c00a103f46b509f5965" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:16.384168 12527 raft_consensus.cc:3060] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.384244 12603 raft_consensus.cc:3060] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:16.399456 12527 raft_consensus.cc:2468] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:16.397858 12356 catalog_manager.cc:5697] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 2 to 3, leader changed from edb4d71736c5490ab4008aa30a223e25 (127.2.200.194) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 3 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.400749 13300 leader_election.cc:304] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:16.401983 12603 raft_consensus.cc:2468] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 2.
I20260709 13:20:16.402539 13588 raft_consensus.cc:2804] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:16.403077 13588 raft_consensus.cc:697] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:16.403931 13588 consensus_queue.cc:237] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } }
I20260709 13:20:16.420410 12356 catalog_manager.cc:5697] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 1 to 2, leader changed from be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 2 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:16.477619 13586 raft_consensus.cc:993] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: : Instructing follower e42f0f6820a54d65880b5a40d1e1d4e2 to start an election
I20260709 13:20:16.478233 13644 raft_consensus.cc:1081] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Signalling peer e42f0f6820a54d65880b5a40d1e1d4e2 to start an election
I20260709 13:20:16.480013 12680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
 from {username='slave'} at 127.0.0.1:46986
I20260709 13:20:16.481015 12680 raft_consensus.cc:493] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.481370 12680 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.490900 12680 raft_consensus.cc:515] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:16.493651 12680 leader_election.cc:290] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Requested vote from peers edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029), be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643)
I20260709 13:20:16.495410 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:16.495684 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcedc26f17ec4b449603d23a954af416" candidate_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:16.495985 12603 raft_consensus.cc:3055] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:16.496313 12533 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.496321 12603 raft_consensus.cc:740] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be08affc17214c5081ca9d2d19f0c1bd, State: Running, Role: LEADER
I20260709 13:20:16.497305 12603 consensus_queue.cc:260] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:16.498451 12603 raft_consensus.cc:3060] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:16.504089 12533 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:16.505383 12603 raft_consensus.cc:2468] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e42f0f6820a54d65880b5a40d1e1d4e2 in term 3.
I20260709 13:20:16.505491 12647 leader_election.cc:304] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:16.506363 13631 raft_consensus.cc:2804] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:16.506814 13631 raft_consensus.cc:697] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Leader. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:16.507570 13631 consensus_queue.cc:237] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } }
I20260709 13:20:16.517242 12356 catalog_manager.cc:5697] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 reported cstate change: term changed from 2 to 3, leader changed from be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195) to e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196). New cstate: current_term: 3 leader_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.727324 13631 raft_consensus.cc:993] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:16.727836 13668 raft_consensus.cc:1081] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:16.729331 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37790
I20260709 13:20:16.729805 13355 raft_consensus.cc:493] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:16.730142 13355 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:16.736541 13355 raft_consensus.cc:515] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:16.738670 13355 leader_election.cc:290] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 4 election: Requested vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371)
I20260709 13:20:16.739295 12603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "be08affc17214c5081ca9d2d19f0c1bd"
I20260709 13:20:16.739912 12603 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:16.739810 12678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b594978646c4c39afe3c9f91baad874" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:16.740505 12678 raft_consensus.cc:3055] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:16.740868 12678 raft_consensus.cc:740] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:16.741640 12678 consensus_queue.cc:260] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:16.742969 12678 raft_consensus.cc:3060] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:16.747018 12603 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 4.
I20260709 13:20:16.748637 13299 leader_election.cc:304] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd; no voters: 
I20260709 13:20:16.749734 13588 raft_consensus.cc:2804] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:16.750432 13588 raft_consensus.cc:697] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 4 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:16.751307 13588 consensus_queue.cc:237] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:16.760502 12678 raft_consensus.cc:2468] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 4.
I20260709 13:20:16.772274 12355 catalog_manager.cc:5697] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 3 to 4, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 4 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:16.816226 12678 raft_consensus.cc:1275] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:16.817368 13588 consensus_queue.cc:1048] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:16.830914 12533 raft_consensus.cc:1275] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:16.832446 13607 consensus_queue.cc:1048] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:16.961956 12533 raft_consensus.cc:1275] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.963475 13588 consensus_queue.cc:1048] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:16.973186 12603 raft_consensus.cc:1275] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:16.974520 13607 consensus_queue.cc:1048] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:16.983834 12602 raft_consensus.cc:1275] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:16.985304 13631 consensus_queue.cc:1048] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:17.020177 12527 raft_consensus.cc:1275] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer e42f0f6820a54d65880b5a40d1e1d4e2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:17.025346 13691 consensus_queue.cc:1048] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:17.166326  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.220680  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:17.228811 12602 raft_consensus.cc:1275] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:17.230255 13614 consensus_queue.cc:1048] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:17.232633 12680 raft_consensus.cc:1275] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:17.234162 13588 consensus_queue.cc:1048] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:17.275209 12680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd"
dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
mode: GRACEFUL
new_leader_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:58050
I20260709 13:20:17.275818 12680 raft_consensus.cc:606] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Received request to transfer leadership to TS 6b0179dde0454d1e819be37e79c733af
I20260709 13:20:17.279558  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:20:17.281580  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:17.657133 13691 raft_consensus.cc:993] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: : Instructing follower 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:17.657608 13695 raft_consensus.cc:1081] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Signalling peer 6b0179dde0454d1e819be37e79c733af to start an election
I20260709 13:20:17.659694 13355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd"
dest_uuid: "6b0179dde0454d1e819be37e79c733af"
 from {username='slave'} at 127.0.0.1:37790
I20260709 13:20:17.660291 13355 raft_consensus.cc:493] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:17.660645 13355 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:17.667819 13355 raft_consensus.cc:515] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:17.669956 13355 leader_election.cc:290] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Requested vote from peers e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196:34371), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:17.670238 12680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2"
I20260709 13:20:17.670434 12533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560aebc4cc8147368f02be5f1491f6fd" candidate_uuid: "6b0179dde0454d1e819be37e79c733af" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "edb4d71736c5490ab4008aa30a223e25"
I20260709 13:20:17.670869 12680 raft_consensus.cc:3055] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:17.671010 12533 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:17.671241 12680 raft_consensus.cc:740] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e42f0f6820a54d65880b5a40d1e1d4e2, State: Running, Role: LEADER
I20260709 13:20:17.672042 12680 consensus_queue.cc:260] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:17.673197 12680 raft_consensus.cc:3060] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:17.676823 12533 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:17.677881 13300 leader_election.cc:304] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25; no voters: 
I20260709 13:20:17.678735 12680 raft_consensus.cc:2468] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b0179dde0454d1e819be37e79c733af in term 3.
I20260709 13:20:17.678841 13614 raft_consensus.cc:2804] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:17.679600 13614 raft_consensus.cc:697] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Becoming Leader. State: Replica: 6b0179dde0454d1e819be37e79c733af, State: Running, Role: LEADER
I20260709 13:20:17.680429 13614 consensus_queue.cc:237] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:17.692494 12356 catalog_manager.cc:5697] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af reported cstate change: term changed from 2 to 3, leader changed from e42f0f6820a54d65880b5a40d1e1d4e2 (127.2.200.196) to 6b0179dde0454d1e819be37e79c733af (127.2.200.193). New cstate: current_term: 3 leader_uuid: "6b0179dde0454d1e819be37e79c733af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:18.187928 12678 raft_consensus.cc:1275] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:18.189234 13588 consensus_queue.cc:1048] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:18.205078 12533 raft_consensus.cc:1275] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Refusing update from remote peer 6b0179dde0454d1e819be37e79c733af: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:18.208724 13614 consensus_queue.cc:1048] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [LEADER]: Connected to new peer: Peer: permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:18.282588  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:18.325038  2851 tablet_server.cc:179] TabletServer@127.2.200.193:34251 shutting down...
I20260709 13:20:18.361027  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:18.362216  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.363044  2851 raft_consensus.cc:2243] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.363821  2851 raft_consensus.cc:2272] T 02392cdd764f41cca809b8f14dc0ff1f P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.366526  2851 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:18.366768 12496 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 264 similar messages]
I20260709 13:20:18.367262  2851 raft_consensus.cc:2243] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.368311  2851 raft_consensus.cc:2272] T 88ea4fda6fe7451c90f25fe181570e34 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.369912 12496 consensus_peers.cc:597] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.370808  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.371600  2851 raft_consensus.cc:2243] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.372044  2851 raft_consensus.cc:2272] T 49a785fe68e845f4bdbac514c3f8efcf P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.382323 12496 consensus_peers.cc:597] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.383546  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.384377  2851 raft_consensus.cc:2243] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.385181  2851 raft_consensus.cc:2272] T d17c9a7398774b5a85e6a2d1f1f48292 P 6b0179dde0454d1e819be37e79c733af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.387631  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.388185  2851 raft_consensus.cc:2243] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.388677  2851 raft_consensus.cc:2272] T 8a98d51892474c3388c511ca2719ae45 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.391558  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.392164  2851 raft_consensus.cc:2243] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.393159  2851 raft_consensus.cc:2272] T 560aebc4cc8147368f02be5f1491f6fd P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.393348 12644 consensus_peers.cc:597] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.395704  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.396541  2851 raft_consensus.cc:2243] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.397380  2851 raft_consensus.cc:2272] T 6c88422ad42d465fbb3161af884776f4 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.399667  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.400319  2851 raft_consensus.cc:2243] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.400707  2851 raft_consensus.cc:2272] T 7a22d36ba14b48d9a8dfbc803ac44305 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.403733  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.404966  2851 raft_consensus.cc:2243] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.405550  2851 raft_consensus.cc:2272] T 86d028731950492fa2b549e869766512 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.408653  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.409360  2851 raft_consensus.cc:2243] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.409852  2851 raft_consensus.cc:2272] T 2bdb79ea7d064a729a9a450e5ca8045f P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.412603  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.413647  2851 raft_consensus.cc:2243] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.414202  2851 raft_consensus.cc:2272] T ffc6e30caa094ccea21a8d8063628ac6 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.415010 12496 consensus_peers.cc:597] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.417928  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.418911  2851 raft_consensus.cc:2243] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.419947  2851 raft_consensus.cc:2272] T 1b594978646c4c39afe3c9f91baad874 P 6b0179dde0454d1e819be37e79c733af [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.422695  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.423537  2851 raft_consensus.cc:2243] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.424312  2851 raft_consensus.cc:2272] T 54cd9a065a174d478feebb6406e59340 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.427153  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.428004  2851 raft_consensus.cc:2243] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.428887  2851 raft_consensus.cc:2272] T 2dffa974b56c4c00a103f46b509f5965 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.429867 12570 consensus_peers.cc:597] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.431236  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.431893  2851 raft_consensus.cc:2243] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.432301  2851 raft_consensus.cc:2272] T ad1ae772aa48427189cff34a672ae7ea P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.435065  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.435714  2851 raft_consensus.cc:2243] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.436177  2851 raft_consensus.cc:2272] T 0533952f2edb40af8e517e228d720738 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.438781  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.439463  2851 raft_consensus.cc:2243] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.439935  2851 raft_consensus.cc:2272] T 835464d15acb4280aa3484ff857fbbd0 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.442341  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.442909  2851 raft_consensus.cc:2243] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.443312  2851 raft_consensus.cc:2272] T ad8fad451d52413fbe9076d53d09eb19 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.445407  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.446076  2851 raft_consensus.cc:2243] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.446800  2851 raft_consensus.cc:2272] T 7c9742746d5449a9a172aee8c6d76947 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.449606  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.450232  2851 raft_consensus.cc:2243] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.450672  2851 raft_consensus.cc:2272] T faf1541d3e80425ea5524a9a73c92450 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.452741  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.453439  2851 raft_consensus.cc:2243] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.453953  2851 raft_consensus.cc:2272] T bea13bfc0b6042faac37932e2b31c21a P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.456799  2851 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:18.457244 12644 consensus_peers.cc:597] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.457469  2851 raft_consensus.cc:2243] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.458062  2851 raft_consensus.cc:2272] T e3963dbc730145e2a64c4fac3f70c572 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.461071  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.462037  2851 raft_consensus.cc:2243] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.463083  2851 raft_consensus.cc:2272] T 61a0977d71c94c28a715e132c73798ad P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.465674  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.466331  2851 raft_consensus.cc:2243] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.466969  2851 raft_consensus.cc:2272] T b3ed01e93b104e1a8816c0965b585db1 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.469434  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.470021  2851 raft_consensus.cc:2243] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.470403  2851 raft_consensus.cc:2272] T f8219316df3d4ad79c4fbe14bb77376b P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.473035  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.473573  2851 raft_consensus.cc:2243] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:18.473951 12570 consensus_peers.cc:597] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.473992  2851 raft_consensus.cc:2272] T a41bc8bb09ea4170a53464bccb6477ba P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.476408  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.477171  2851 raft_consensus.cc:2243] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.477684  2851 raft_consensus.cc:2272] T 3e8e4aa584954c6cb3fb640e00299a4e P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.480012  2851 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:18.480283 12496 consensus_peers.cc:597] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.480854  2851 raft_consensus.cc:2243] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.481737  2851 raft_consensus.cc:2272] T 5ebd5e8c4c884c419dacec563c1e30ac P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.484171  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.485055  2851 raft_consensus.cc:2243] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.485554  2851 raft_consensus.cc:2272] T aaa0adc1589a4002b4c0544f03a1ef2f P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.488065 12644 consensus_peers.cc:597] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.488638  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.489604  2851 raft_consensus.cc:2243] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.490118  2851 raft_consensus.cc:2272] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.491595 12570 consensus_peers.cc:597] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.492981  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.493723  2851 raft_consensus.cc:2243] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.494174  2851 raft_consensus.cc:2272] T 1cd04e41dc224298aa74af4ed0318c83 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.496217  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.496719  2851 raft_consensus.cc:2243] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.497447  2851 raft_consensus.cc:2272] T 2ae14799191e4d7a994bf30ffcf750dc P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.499389  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.499913  2851 raft_consensus.cc:2243] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.500312  2851 raft_consensus.cc:2272] T dc3b8ac766444654ab744eef004d23cb P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.502444  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.502962  2851 raft_consensus.cc:2243] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.503396  2851 raft_consensus.cc:2272] T a4f0e015fd1245df8b4f7ac03925ae09 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.506047  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.506708  2851 raft_consensus.cc:2243] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.507750  2851 raft_consensus.cc:2272] T 1d02b1f993f04219ab72cd3d163a11f6 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.509668  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.510169  2851 raft_consensus.cc:2243] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.510857  2851 raft_consensus.cc:2272] T 722f7ee62121485b869fb4f23af88977 P 6b0179dde0454d1e819be37e79c733af [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.512727  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.513265  2851 raft_consensus.cc:2243] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.513613  2851 raft_consensus.cc:2272] T 47b322fccf59456095cd4773a162b412 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.515537  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.516022  2851 raft_consensus.cc:2243] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.516352  2851 raft_consensus.cc:2272] T d54686caf81d4b5b82fd2d32243d743a P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.518754  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.519270  2851 raft_consensus.cc:2243] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.519658  2851 raft_consensus.cc:2272] T 878634ecebed436cab294749679d0254 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.521875  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.522353  2851 raft_consensus.cc:2243] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.522724  2851 raft_consensus.cc:2272] T fa508c916de349f7978060020c80bd3d P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.525077  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.525558  2851 raft_consensus.cc:2243] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.526429  2851 raft_consensus.cc:2272] T 53c73e9183b4401b8f75411b63878062 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.529064  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.529608  2851 raft_consensus.cc:2243] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.530026  2851 raft_consensus.cc:2272] T 8359fd6a469b4460a658e1646de646f8 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.531762 12570 consensus_peers.cc:597] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.532656  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.533530  2851 raft_consensus.cc:2243] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.534047  2851 raft_consensus.cc:2272] T af86257960744ce4a2cfb315fb7d5138 P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.538022  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.538863  2851 raft_consensus.cc:2243] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.539357  2851 raft_consensus.cc:2272] T 0b491a2c8e034b4198ba19e2c8fe49fc P 6b0179dde0454d1e819be37e79c733af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.542546  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:18.543288  2851 raft_consensus.cc:2243] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.544081  2851 raft_consensus.cc:2272] T 424acb25ab4a4395a267933873286ca0 P 6b0179dde0454d1e819be37e79c733af [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.551124 12570 consensus_peers.cc:597] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.569692 12496 consensus_peers.cc:597] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.569902 12644 consensus_peers.cc:597] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.582937 12496 consensus_peers.cc:597] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.584523 12496 consensus_peers.cc:597] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.609403 12496 connection.cc:573] client connection to 127.2.200.193:34251 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:20:18.615403 12496 consensus_peers.cc:597] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.619542 12496 consensus_peers.cc:597] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.626401  2851 tablet_server.cc:196] TabletServer@127.2.200.193:34251 shutdown complete.
W20260709 13:20:18.677321 12496 consensus_peers.cc:597] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.682771 12570 consensus_peers.cc:597] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.691937 12496 consensus_peers.cc:597] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.698328 12644 consensus_peers.cc:597] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.698927 12644 consensus_peers.cc:597] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.699354 12644 consensus_peers.cc:597] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.701897 12644 consensus_peers.cc:597] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.717708 12644 consensus_peers.cc:597] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.752161  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
W20260709 13:20:18.764587 12573 consensus_peers.cc:597] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:18.773388 12496 consensus_peers.cc:597] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.798100  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:18.799458  2851 tablet_replica.cc:333] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.800349  2851 raft_consensus.cc:2243] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.800987  2851 raft_consensus.cc:2272] T d17c9a7398774b5a85e6a2d1f1f48292 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.802207 12644 consensus_peers.cc:597] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.803480  2851 tablet_replica.cc:333] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.804226  2851 raft_consensus.cc:2243] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.804687  2851 raft_consensus.cc:2272] T 88ea4fda6fe7451c90f25fe181570e34 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.806746  2851 tablet_replica.cc:333] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.807291  2851 raft_consensus.cc:2243] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.807698  2851 raft_consensus.cc:2272] T 6c88422ad42d465fbb3161af884776f4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.809757  2851 tablet_replica.cc:333] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.810459  2851 raft_consensus.cc:2243] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.810873  2851 raft_consensus.cc:2272] T 560aebc4cc8147368f02be5f1491f6fd P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.813732  2851 tablet_replica.cc:333] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.814332  2851 raft_consensus.cc:2243] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.815124  2851 raft_consensus.cc:2272] T 4185e974866b49798be93199dbf6a46d P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.817168  2851 tablet_replica.cc:333] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.817723  2851 raft_consensus.cc:2243] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.818284  2851 raft_consensus.cc:2272] T 8fd7239741d241c5833b78180486ea66 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.820294  2851 tablet_replica.cc:333] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.820863  2851 raft_consensus.cc:2243] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.821285  2851 raft_consensus.cc:2272] T 937d94e615b2444c82beb63e8bf72d7f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.823643  2851 tablet_replica.cc:333] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.824440  2851 raft_consensus.cc:2243] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.825079  2851 raft_consensus.cc:2272] T 611f7e5c6d52455baebc4b6a0b73edd5 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.827104  2851 tablet_replica.cc:333] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.827701  2851 raft_consensus.cc:2243] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.828152  2851 raft_consensus.cc:2272] T 3e8e4aa584954c6cb3fb640e00299a4e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.830106  2851 tablet_replica.cc:333] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.830631  2851 raft_consensus.cc:2243] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.831017  2851 raft_consensus.cc:2272] T 5ebd5e8c4c884c419dacec563c1e30ac P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.833101  2851 tablet_replica.cc:333] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.833792  2851 raft_consensus.cc:2243] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.834291  2851 raft_consensus.cc:2272] T a4f0e015fd1245df8b4f7ac03925ae09 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.836961  2851 tablet_replica.cc:333] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.837585  2851 raft_consensus.cc:2243] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.837987  2851 raft_consensus.cc:2272] T fcedc26f17ec4b449603d23a954af416 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.838119 12496 consensus_peers.cc:597] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.839754  2851 tablet_replica.cc:333] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.840374  2851 raft_consensus.cc:2243] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.840816  2851 raft_consensus.cc:2272] T 5f232fdc7c0e4d8190333cff24352967 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.843050  2851 tablet_replica.cc:333] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.843595  2851 raft_consensus.cc:2243] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.843979  2851 raft_consensus.cc:2272] T 2c8c719430c241dc9304ef2ebd8df639 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.845937  2851 tablet_replica.cc:333] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.846524  2851 raft_consensus.cc:2243] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.846925  2851 raft_consensus.cc:2272] T 722f7ee62121485b869fb4f23af88977 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.849124  2851 tablet_replica.cc:333] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.850117  2851 raft_consensus.cc:2243] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.850636  2851 raft_consensus.cc:2272] T ad1ae772aa48427189cff34a672ae7ea P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.853444  2851 tablet_replica.cc:333] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.854393  2851 raft_consensus.cc:2243] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.854882  2851 raft_consensus.cc:2272] T 1031c7d22c0645c0b997bb7c66e1f9a4 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.857295 12647 consensus_peers.cc:597] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.857470  2851 tablet_replica.cc:333] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.858484  2851 raft_consensus.cc:2243] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.859503  2851 raft_consensus.cc:2272] T 0533952f2edb40af8e517e228d720738 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.862680  2851 tablet_replica.cc:333] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.863819  2851 raft_consensus.cc:2243] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.864351  2851 raft_consensus.cc:2272] T 835464d15acb4280aa3484ff857fbbd0 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.866914  2851 tablet_replica.cc:333] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.867786  2851 raft_consensus.cc:2243] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.868325  2851 raft_consensus.cc:2272] T f9667dd4e5324ecda6b4dead6bff47de P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.871224  2851 tablet_replica.cc:333] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.872007  2851 raft_consensus.cc:2243] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.872874  2851 raft_consensus.cc:2272] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.874199 12644 consensus_peers.cc:597] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.875524  2851 tablet_replica.cc:333] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.876492  2851 raft_consensus.cc:2243] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.877127  2851 raft_consensus.cc:2272] T 01c20adb4d124ae681d4c43be777969e P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.880410  2851 tablet_replica.cc:333] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
W20260709 13:20:18.880975 12570 consensus_peers.cc:597] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd -> Peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Couldn't send request to peer 6b0179dde0454d1e819be37e79c733af. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.881335  2851 raft_consensus.cc:2243] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.882639  2851 raft_consensus.cc:2272] T fa508c916de349f7978060020c80bd3d P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.885510 12573 consensus_peers.cc:597] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.885974  2851 tablet_replica.cc:333] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.887225  2851 raft_consensus.cc:2243] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.887841  2851 raft_consensus.cc:2272] T aa9710dd994b40c18e7d33112d946085 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.891067  2851 tablet_replica.cc:333] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.891855  2851 raft_consensus.cc:2243] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.892709  2851 raft_consensus.cc:2272] T e3963dbc730145e2a64c4fac3f70c572 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.895848  2851 tablet_replica.cc:333] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.896502  2851 raft_consensus.cc:2243] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.896996  2851 raft_consensus.cc:2272] T 61a0977d71c94c28a715e132c73798ad P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.898975  2851 tablet_replica.cc:333] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.899554  2851 raft_consensus.cc:2243] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.900369  2851 raft_consensus.cc:2272] T 7a22d36ba14b48d9a8dfbc803ac44305 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.902973  2851 tablet_replica.cc:333] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.903659  2851 raft_consensus.cc:2243] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.904961  2851 raft_consensus.cc:2272] T 2bdb79ea7d064a729a9a450e5ca8045f P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.908577  2851 tablet_replica.cc:333] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
W20260709 13:20:18.908911 12573 consensus_peers.cc:597] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.909404  2851 raft_consensus.cc:2243] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.909955  2851 raft_consensus.cc:2272] T faf1541d3e80425ea5524a9a73c92450 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.911949  2851 tablet_replica.cc:333] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.912451  2851 raft_consensus.cc:2243] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.913254  2851 raft_consensus.cc:2272] T 7c9742746d5449a9a172aee8c6d76947 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.915508  2851 tablet_replica.cc:333] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.916055  2851 raft_consensus.cc:2243] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.916887  2851 raft_consensus.cc:2272] T c1950837058f4c6da84a2dec12b369e2 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.919543  2851 tablet_replica.cc:333] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.920048  2851 raft_consensus.cc:2243] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.920578  2851 raft_consensus.cc:2272] T fc6c218527eb41bea885fbf10aa66427 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.923187  2851 tablet_replica.cc:333] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.923725  2851 raft_consensus.cc:2243] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.924492  2851 raft_consensus.cc:2272] T 8359fd6a469b4460a658e1646de646f8 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.927223  2851 tablet_replica.cc:333] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.927781  2851 raft_consensus.cc:2243] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.928234  2851 raft_consensus.cc:2272] T 0b491a2c8e034b4198ba19e2c8fe49fc P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.930279  2851 tablet_replica.cc:333] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.930737  2851 raft_consensus.cc:2243] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.931111  2851 raft_consensus.cc:2272] T 53c73e9183b4401b8f75411b63878062 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.933071  2851 tablet_replica.cc:333] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.933581  2851 raft_consensus.cc:2243] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.934423  2851 raft_consensus.cc:2272] T af86257960744ce4a2cfb315fb7d5138 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.936359  2851 tablet_replica.cc:333] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.936911  2851 raft_consensus.cc:2243] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.937744  2851 raft_consensus.cc:2272] T aaa0adc1589a4002b4c0544f03a1ef2f P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.940819  2851 tablet_replica.cc:333] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.941418  2851 raft_consensus.cc:2243] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.941840  2851 raft_consensus.cc:2272] T ffc6e30caa094ccea21a8d8063628ac6 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.943964  2851 tablet_replica.cc:333] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.944449  2851 raft_consensus.cc:2243] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.944903  2851 raft_consensus.cc:2272] T c94ecddd09134d23b4cf3abd9a7a5f31 P edb4d71736c5490ab4008aa30a223e25 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.946818  2851 tablet_replica.cc:333] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.947299  2851 raft_consensus.cc:2243] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.947690  2851 raft_consensus.cc:2272] T 2dffa974b56c4c00a103f46b509f5965 P edb4d71736c5490ab4008aa30a223e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.949545  2851 tablet_replica.cc:333] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.950183  2851 raft_consensus.cc:2243] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.951023  2851 raft_consensus.cc:2272] T f8219316df3d4ad79c4fbe14bb77376b P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.952979  2851 tablet_replica.cc:333] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.953433  2851 raft_consensus.cc:2243] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:18.953828  2851 raft_consensus.cc:2272] T b3ed01e93b104e1a8816c0965b585db1 P edb4d71736c5490ab4008aa30a223e25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:18.956249  2851 tablet_replica.cc:333] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
I20260709 13:20:18.956939  2851 raft_consensus.cc:2243] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:18.957821 12573 consensus_peers.cc:597] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.957988  2851 raft_consensus.cc:2272] T 878634ecebed436cab294749679d0254 P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.960543 12647 consensus_peers.cc:597] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.960835  2851 tablet_replica.cc:333] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25: stopping tablet replica
W20260709 13:20:18.961144 12647 consensus_peers.cc:597] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:18.961499  2851 raft_consensus.cc:2243] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:18.962658  2851 raft_consensus.cc:2272] T d54686caf81d4b5b82fd2d32243d743a P edb4d71736c5490ab4008aa30a223e25 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:18.966523 12647 consensus_peers.cc:597] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.027714 12573 consensus_peers.cc:597] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.062263 12573 consensus_peers.cc:597] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.076354  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
W20260709 13:20:19.094949 12573 consensus_peers.cc:597] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.121515 12647 consensus_peers.cc:597] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.152781  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
W20260709 13:20:19.159677 12647 consensus_peers.cc:597] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.191263 12573 consensus_peers.cc:597] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.197961 12646 consensus_peers.cc:597] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.206595 12646 consensus_peers.cc:597] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.214463  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:19.215692  2851 tablet_replica.cc:333] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.216655  2851 raft_consensus.cc:2243] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.217267  2851 raft_consensus.cc:2272] T 424acb25ab4a4395a267933873286ca0 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.217301 12647 consensus_peers.cc:597] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.220214  2851 tablet_replica.cc:333] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.221396  2851 raft_consensus.cc:2243] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.221974  2851 raft_consensus.cc:2272] T 6c88422ad42d465fbb3161af884776f4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.224479  2851 tablet_replica.cc:333] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.225383  2851 raft_consensus.cc:2243] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.227520  2851 raft_consensus.cc:2272] T 611f7e5c6d52455baebc4b6a0b73edd5 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.230506  2851 tablet_replica.cc:333] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.231328  2851 raft_consensus.cc:2243] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.231885  2851 raft_consensus.cc:2272] T 86d028731950492fa2b549e869766512 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.233403 12573 consensus_peers.cc:597] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.234887  2851 tablet_replica.cc:333] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.235909  2851 raft_consensus.cc:2243] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.237032  2851 raft_consensus.cc:2272] T 8a98d51892474c3388c511ca2719ae45 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.240607  2851 tablet_replica.cc:333] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.241515  2851 raft_consensus.cc:2243] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.242066  2851 raft_consensus.cc:2272] T d17c9a7398774b5a85e6a2d1f1f48292 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.245185  2851 tablet_replica.cc:333] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
W20260709 13:20:19.246114 12573 consensus_peers.cc:597] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.246810  2851 raft_consensus.cc:2243] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:19.247376 12647 consensus_peers.cc:597] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.247430  2851 raft_consensus.cc:2272] T 937d94e615b2444c82beb63e8bf72d7f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.250094  2851 tablet_replica.cc:333] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.250645  2851 raft_consensus.cc:2243] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.251045  2851 raft_consensus.cc:2272] T 4185e974866b49798be93199dbf6a46d P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.252985  2851 tablet_replica.cc:333] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.253513  2851 raft_consensus.cc:2243] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.254356  2851 raft_consensus.cc:2272] T 8fd7239741d241c5833b78180486ea66 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.265820 12573 consensus_peers.cc:597] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.266147  2851 tablet_replica.cc:333] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.267084  2851 raft_consensus.cc:2243] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.267620  2851 raft_consensus.cc:2272] T 02392cdd764f41cca809b8f14dc0ff1f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.268106 12573 consensus_peers.cc:597] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd -> Peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Couldn't send request to peer edb4d71736c5490ab4008aa30a223e25. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.270372  2851 tablet_replica.cc:333] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.271194  2851 raft_consensus.cc:2243] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.272153  2851 raft_consensus.cc:2272] T 1cd04e41dc224298aa74af4ed0318c83 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.274926  2851 tablet_replica.cc:333] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.275705  2851 raft_consensus.cc:2243] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.276433  2851 raft_consensus.cc:2272] T ad1ae772aa48427189cff34a672ae7ea P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.279850  2851 tablet_replica.cc:333] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.280639  2851 raft_consensus.cc:2243] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.281397  2851 raft_consensus.cc:2272] T 1031c7d22c0645c0b997bb7c66e1f9a4 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.284035  2851 tablet_replica.cc:333] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.284823  2851 raft_consensus.cc:2243] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.285312  2851 raft_consensus.cc:2272] T 0533952f2edb40af8e517e228d720738 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.287442  2851 tablet_replica.cc:333] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.287988  2851 raft_consensus.cc:2243] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.288509  2851 raft_consensus.cc:2272] T 7a22d36ba14b48d9a8dfbc803ac44305 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.290979  2851 tablet_replica.cc:333] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.291710  2851 raft_consensus.cc:2243] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.292197  2851 raft_consensus.cc:2272] T fcedc26f17ec4b449603d23a954af416 P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.294205  2851 tablet_replica.cc:333] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.294694  2851 raft_consensus.cc:2243] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.295452  2851 raft_consensus.cc:2272] T 5f232fdc7c0e4d8190333cff24352967 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.297384  2851 tablet_replica.cc:333] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.297873  2851 raft_consensus.cc:2243] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.298244  2851 raft_consensus.cc:2272] T 47b322fccf59456095cd4773a162b412 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.300046  2851 tablet_replica.cc:333] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.300532  2851 raft_consensus.cc:2243] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.300925  2851 raft_consensus.cc:2272] T c1950837058f4c6da84a2dec12b369e2 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.302683  2851 tablet_replica.cc:333] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.303324  2851 raft_consensus.cc:2243] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.303696  2851 raft_consensus.cc:2272] T fc6c218527eb41bea885fbf10aa66427 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.305797  2851 tablet_replica.cc:333] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.306468  2851 raft_consensus.cc:2243] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.306907  2851 raft_consensus.cc:2272] T 49a785fe68e845f4bdbac514c3f8efcf P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.308844  2851 tablet_replica.cc:333] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.309340  2851 raft_consensus.cc:2243] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.309772  2851 raft_consensus.cc:2272] T 1d02b1f993f04219ab72cd3d163a11f6 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.311590  2851 tablet_replica.cc:333] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.312146  2851 raft_consensus.cc:2243] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.312965  2851 raft_consensus.cc:2272] T dc3b8ac766444654ab744eef004d23cb P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.314971  2851 tablet_replica.cc:333] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.315632  2851 raft_consensus.cc:2243] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.316421  2851 raft_consensus.cc:2272] T a4f0e015fd1245df8b4f7ac03925ae09 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.319048  2851 tablet_replica.cc:333] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.319802  2851 raft_consensus.cc:2243] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.320660  2851 raft_consensus.cc:2272] T 2c8c719430c241dc9304ef2ebd8df639 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.323139  2851 tablet_replica.cc:333] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.323669  2851 raft_consensus.cc:2243] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.324110  2851 raft_consensus.cc:2272] T 2ae14799191e4d7a994bf30ffcf750dc P be08affc17214c5081ca9d2d19f0c1bd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.326188  2851 tablet_replica.cc:333] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.326728  2851 raft_consensus.cc:2243] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.327708  2851 raft_consensus.cc:2272] T f9667dd4e5324ecda6b4dead6bff47de P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.329846  2851 tablet_replica.cc:333] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.330396  2851 raft_consensus.cc:2243] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.330783  2851 raft_consensus.cc:2272] T 54cd9a065a174d478feebb6406e59340 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.332973  2851 tablet_replica.cc:333] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.333494  2851 raft_consensus.cc:2243] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.333899  2851 raft_consensus.cc:2272] T 1b594978646c4c39afe3c9f91baad874 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.336010  2851 tablet_replica.cc:333] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.336810  2851 raft_consensus.cc:2243] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.337364  2851 raft_consensus.cc:2272] T 2bdb79ea7d064a729a9a450e5ca8045f P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.339900  2851 tablet_replica.cc:333] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.340458  2851 raft_consensus.cc:2243] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.340960  2851 raft_consensus.cc:2272] T ad8fad451d52413fbe9076d53d09eb19 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.344607  2851 tablet_replica.cc:333] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.345315  2851 raft_consensus.cc:2243] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.345834  2851 raft_consensus.cc:2272] T 7c9742746d5449a9a172aee8c6d76947 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.348038  2851 tablet_replica.cc:333] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.348532  2851 raft_consensus.cc:2243] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.348934  2851 raft_consensus.cc:2272] T bea13bfc0b6042faac37932e2b31c21a P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.350867  2851 tablet_replica.cc:333] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.351372  2851 raft_consensus.cc:2243] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.352159  2851 raft_consensus.cc:2272] T ffc6e30caa094ccea21a8d8063628ac6 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.354197  2851 tablet_replica.cc:333] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.354702  2851 raft_consensus.cc:2243] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.355458  2851 raft_consensus.cc:2272] T c94ecddd09134d23b4cf3abd9a7a5f31 P be08affc17214c5081ca9d2d19f0c1bd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.357435  2851 tablet_replica.cc:333] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.357964  2851 raft_consensus.cc:2243] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.358345  2851 raft_consensus.cc:2272] T 2dffa974b56c4c00a103f46b509f5965 P be08affc17214c5081ca9d2d19f0c1bd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.360093  2851 tablet_replica.cc:333] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.360581  2851 raft_consensus.cc:2243] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.361002  2851 raft_consensus.cc:2272] T a41bc8bb09ea4170a53464bccb6477ba P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.362877  2851 tablet_replica.cc:333] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.363463  2851 raft_consensus.cc:2243] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.363881  2851 raft_consensus.cc:2272] T aaa0adc1589a4002b4c0544f03a1ef2f P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.365829  2851 tablet_replica.cc:333] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.366318  2851 raft_consensus.cc:2243] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.366730  2851 raft_consensus.cc:2272] T 878634ecebed436cab294749679d0254 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.368703  2851 tablet_replica.cc:333] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.369278  2851 raft_consensus.cc:2243] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.369689  2851 raft_consensus.cc:2272] T d54686caf81d4b5b82fd2d32243d743a P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.371505  2851 tablet_replica.cc:333] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.372006  2851 raft_consensus.cc:2243] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.372399  2851 raft_consensus.cc:2272] T 8359fd6a469b4460a658e1646de646f8 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.374245  2851 tablet_replica.cc:333] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.374684  2851 raft_consensus.cc:2243] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.375458  2851 raft_consensus.cc:2272] T 0b491a2c8e034b4198ba19e2c8fe49fc P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.377501  2851 tablet_replica.cc:333] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.377964  2851 raft_consensus.cc:2243] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.378693  2851 raft_consensus.cc:2272] T 01c20adb4d124ae681d4c43be777969e P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.380641  2851 tablet_replica.cc:333] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd: stopping tablet replica
I20260709 13:20:19.381085  2851 raft_consensus.cc:2243] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.381790  2851 raft_consensus.cc:2272] T aa9710dd994b40c18e7d33112d946085 P be08affc17214c5081ca9d2d19f0c1bd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.391707 12646 consensus_peers.cc:597] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.426985 13719 raft_consensus.cc:493] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:19.427759 13719 raft_consensus.cc:515] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:19.430424 13719 leader_election.cc:290] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
W20260709 13:20:19.436510 12646 leader_election.cc:336] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:20:19.437042 12644 leader_election.cc:336] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:19.437182 12646 consensus_peers.cc:597] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.437520 12644 leader_election.cc:304] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:19.438378 13707 raft_consensus.cc:2749] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:19.451226 12646 consensus_peers.cc:597] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:19.456390 12646 consensus_peers.cc:597] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.461678  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
W20260709 13:20:19.472561 12646 consensus_peers.cc:597] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.521792 13707 raft_consensus.cc:493] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:19.522497 13707 raft_consensus.cc:515] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:19.524920 13707 leader_election.cc:290] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
W20260709 13:20:19.530432 12644 leader_election.cc:336] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:19.530905 12646 leader_election.cc:336] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111)
I20260709 13:20:19.531311 12646 leader_election.cc:304] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:19.532064 13707 raft_consensus.cc:2749] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:20:19.544953 12646 consensus_peers.cc:597] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.555810 13707 raft_consensus.cc:493] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:19.556447 13707 raft_consensus.cc:515] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be08affc17214c5081ca9d2d19f0c1bd" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 45643 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } }
I20260709 13:20:19.558573 13707 leader_election.cc:290] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643), 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251)
I20260709 13:20:19.561632  2851 tablet_server.cc:179] TabletServer@127.2.200.196:0 shutting down...
I20260709 13:20:19.561874 13707 raft_consensus.cc:493] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:19.563105 13707 raft_consensus.cc:515] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
W20260709 13:20:19.563211 12646 leader_election.cc:336] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111)
I20260709 13:20:19.564827 13707 leader_election.cc:290] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
W20260709 13:20:19.567655 12644 leader_election.cc:336] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:19.568157 12644 leader_election.cc:304] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, be08affc17214c5081ca9d2d19f0c1bd
I20260709 13:20:19.569104 13707 raft_consensus.cc:2749] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:20:19.571669 12647 leader_election.cc:336] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111)
W20260709 13:20:19.572460 12644 leader_election.cc:336] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
I20260709 13:20:19.572847 12644 leader_election.cc:304] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:19.573575 13707 raft_consensus.cc:2749] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:20:19.608500  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:19.609735  2851 tablet_replica.cc:333] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.610610  2851 raft_consensus.cc:2243] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.611761  2851 raft_consensus.cc:2272] T 424acb25ab4a4395a267933873286ca0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.613288 12646 consensus_peers.cc:597] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.614979  2851 tablet_replica.cc:333] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.615693  2851 raft_consensus.cc:2243] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.616139  2851 raft_consensus.cc:2272] T 8a98d51892474c3388c511ca2719ae45 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.618857  2851 tablet_replica.cc:333] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.619665  2851 raft_consensus.cc:2243] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.620688  2851 raft_consensus.cc:2272] T 86d028731950492fa2b549e869766512 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.623211  2851 tablet_replica.cc:333] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.623937  2851 raft_consensus.cc:2243] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.624929  2851 raft_consensus.cc:2272] T 937d94e615b2444c82beb63e8bf72d7f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.627302  2851 tablet_replica.cc:333] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.627948  2851 raft_consensus.cc:2243] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.628423  2851 raft_consensus.cc:2272] T 88ea4fda6fe7451c90f25fe181570e34 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.630858  2851 tablet_replica.cc:333] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.631536  2851 raft_consensus.cc:2243] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.632005  2851 raft_consensus.cc:2272] T 02392cdd764f41cca809b8f14dc0ff1f P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.634054  2851 tablet_replica.cc:333] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.634814  2851 raft_consensus.cc:2243] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.635321  2851 raft_consensus.cc:2272] T 560aebc4cc8147368f02be5f1491f6fd P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.637887  2851 tablet_replica.cc:333] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.638772  2851 raft_consensus.cc:2243] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.639357  2851 raft_consensus.cc:2272] T 8fd7239741d241c5833b78180486ea66 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.642066  2851 tablet_replica.cc:333] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.642915  2851 raft_consensus.cc:2243] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:20:19.643121 12646 consensus_peers.cc:597] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.643392  2851 raft_consensus.cc:2272] T 4185e974866b49798be93199dbf6a46d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.645538  2851 tablet_replica.cc:333] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.646070  2851 raft_consensus.cc:2243] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.646423  2851 raft_consensus.cc:2272] T 1cd04e41dc224298aa74af4ed0318c83 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.648465  2851 tablet_replica.cc:333] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.649065  2851 raft_consensus.cc:2243] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.649446  2851 raft_consensus.cc:2272] T f8219316df3d4ad79c4fbe14bb77376b P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.651384  2851 tablet_replica.cc:333] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.652067  2851 raft_consensus.cc:2243] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.652943  2851 raft_consensus.cc:2272] T b3ed01e93b104e1a8816c0965b585db1 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.656124  2851 tablet_replica.cc:333] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.657100  2851 raft_consensus.cc:2243] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.658210  2851 raft_consensus.cc:2272] T faf1541d3e80425ea5524a9a73c92450 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.660857  2851 tablet_replica.cc:333] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.661535  2851 raft_consensus.cc:2243] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.662560  2851 raft_consensus.cc:2272] T ad8fad451d52413fbe9076d53d09eb19 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.664964  2851 tablet_replica.cc:333] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.665624  2851 raft_consensus.cc:2243] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.666067  2851 raft_consensus.cc:2272] T c1950837058f4c6da84a2dec12b369e2 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.668017  2851 tablet_replica.cc:333] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.668706  2851 raft_consensus.cc:2243] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.670038  2851 raft_consensus.cc:2272] T fc6c218527eb41bea885fbf10aa66427 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.672533  2851 tablet_replica.cc:333] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.673641  2851 raft_consensus.cc:2243] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.674706  2851 raft_consensus.cc:2272] T 49a785fe68e845f4bdbac514c3f8efcf P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.677423  2851 tablet_replica.cc:333] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.678028  2851 raft_consensus.cc:2243] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.678817  2851 raft_consensus.cc:2272] T fcedc26f17ec4b449603d23a954af416 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.680824  2851 tablet_replica.cc:333] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.681388  2851 raft_consensus.cc:2243] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.682255  2851 raft_consensus.cc:2272] T a41bc8bb09ea4170a53464bccb6477ba P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.684213  2851 tablet_replica.cc:333] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.684792  2851 raft_consensus.cc:2243] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.685215  2851 raft_consensus.cc:2272] T 611f7e5c6d52455baebc4b6a0b73edd5 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.687166  2851 tablet_replica.cc:333] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.687812  2851 raft_consensus.cc:2243] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.688601  2851 raft_consensus.cc:2272] T 3e8e4aa584954c6cb3fb640e00299a4e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.690587  2851 tablet_replica.cc:333] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.691138  2851 raft_consensus.cc:2243] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.691560  2851 raft_consensus.cc:2272] T 5ebd5e8c4c884c419dacec563c1e30ac P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.693429  2851 tablet_replica.cc:333] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.693969  2851 raft_consensus.cc:2243] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.694382  2851 raft_consensus.cc:2272] T c94ecddd09134d23b4cf3abd9a7a5f31 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.696257  2851 tablet_replica.cc:333] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.696909  2851 raft_consensus.cc:2243] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.697502  2851 raft_consensus.cc:2272] T 2c8c719430c241dc9304ef2ebd8df639 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.700237  2851 tablet_replica.cc:333] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.700831  2851 raft_consensus.cc:2243] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.701252  2851 raft_consensus.cc:2272] T 2ae14799191e4d7a994bf30ffcf750dc P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.702452 12646 consensus_peers.cc:597] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 -> Peer be08affc17214c5081ca9d2d19f0c1bd (127.2.200.195:45643): Couldn't send request to peer be08affc17214c5081ca9d2d19f0c1bd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.195:45643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:19.703997  2851 tablet_replica.cc:333] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.704932  2851 raft_consensus.cc:2243] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.705480  2851 raft_consensus.cc:2272] T 5f232fdc7c0e4d8190333cff24352967 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.707829  2851 tablet_replica.cc:333] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.708434  2851 raft_consensus.cc:2243] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.709353  2851 raft_consensus.cc:2272] T 47b322fccf59456095cd4773a162b412 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.711475  2851 tablet_replica.cc:333] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.712039  2851 raft_consensus.cc:2243] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.712482  2851 raft_consensus.cc:2272] T 722f7ee62121485b869fb4f23af88977 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.714983  2851 tablet_replica.cc:333] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.715741  2851 raft_consensus.cc:2243] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.716200  2851 raft_consensus.cc:2272] T f9667dd4e5324ecda6b4dead6bff47de P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.718727  2851 tablet_replica.cc:333] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.719049 13707 raft_consensus.cc:493] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6b0179dde0454d1e819be37e79c733af)
I20260709 13:20:19.719281  2851 raft_consensus.cc:2243] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.719542 13707 raft_consensus.cc:515] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b0179dde0454d1e819be37e79c733af" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 34251 } } peers { permanent_uuid: "e42f0f6820a54d65880b5a40d1e1d4e2" member_type: VOTER last_known_addr { host: "127.2.200.196" port: 34371 } } peers { permanent_uuid: "edb4d71736c5490ab4008aa30a223e25" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 35029 } }
I20260709 13:20:19.720213  2851 raft_consensus.cc:2272] T 1031c7d22c0645c0b997bb7c66e1f9a4 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.721421 13707 leader_election.cc:290] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251), edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029)
I20260709 13:20:19.722738  2851 tablet_replica.cc:333] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.723683  2851 raft_consensus.cc:2243] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.724668  2851 raft_consensus.cc:2272] T 835464d15acb4280aa3484ff857fbbd0 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:19.725008 12644 leader_election.cc:336] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6b0179dde0454d1e819be37e79c733af (127.2.200.193:34251): Network error: Client connection negotiation failed: client connection to 127.2.200.193:34251: connect: Connection refused (error 111)
W20260709 13:20:19.726563 12647 leader_election.cc:336] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer edb4d71736c5490ab4008aa30a223e25 (127.2.200.194:35029): Network error: Client connection negotiation failed: client connection to 127.2.200.194:35029: connect: Connection refused (error 111)
I20260709 13:20:19.727131  2851 tablet_replica.cc:333] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.727006 12647 leader_election.cc:304] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e42f0f6820a54d65880b5a40d1e1d4e2; no voters: 6b0179dde0454d1e819be37e79c733af, edb4d71736c5490ab4008aa30a223e25
I20260709 13:20:19.727747 13707 raft_consensus.cc:2749] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:20:19.728030  2851 raft_consensus.cc:2243] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.728817  2851 raft_consensus.cc:2272] T 54cd9a065a174d478feebb6406e59340 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.730935  2851 tablet_replica.cc:333] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.731472  2851 raft_consensus.cc:2243] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.731869  2851 raft_consensus.cc:2272] T 1b594978646c4c39afe3c9f91baad874 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.733991  2851 tablet_replica.cc:333] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.734506  2851 raft_consensus.cc:2243] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.734885  2851 raft_consensus.cc:2272] T af86257960744ce4a2cfb315fb7d5138 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.736745  2851 tablet_replica.cc:333] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.737301  2851 raft_consensus.cc:2243] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.737697  2851 raft_consensus.cc:2272] T 53c73e9183b4401b8f75411b63878062 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.739787  2851 tablet_replica.cc:333] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.740428  2851 raft_consensus.cc:2243] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.741374  2851 raft_consensus.cc:2272] T bea13bfc0b6042faac37932e2b31c21a P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.743252  2851 tablet_replica.cc:333] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.743753  2851 raft_consensus.cc:2243] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.744351  2851 raft_consensus.cc:2272] T 8c27a8f81e2943eb9cf5ee3dd7577d88 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.746551  2851 tablet_replica.cc:333] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.747087  2851 raft_consensus.cc:2243] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.747501  2851 raft_consensus.cc:2272] T 01c20adb4d124ae681d4c43be777969e P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.749701  2851 tablet_replica.cc:333] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.750214  2851 raft_consensus.cc:2243] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.750684  2851 raft_consensus.cc:2272] T e3963dbc730145e2a64c4fac3f70c572 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.753017  2851 tablet_replica.cc:333] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.753506  2851 raft_consensus.cc:2243] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.753892  2851 raft_consensus.cc:2272] T 61a0977d71c94c28a715e132c73798ad P e42f0f6820a54d65880b5a40d1e1d4e2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.756027  2851 tablet_replica.cc:333] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.756682  2851 raft_consensus.cc:2243] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.757175  2851 raft_consensus.cc:2272] T fa508c916de349f7978060020c80bd3d P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.760088  2851 tablet_replica.cc:333] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.760706  2851 raft_consensus.cc:2243] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.761335  2851 raft_consensus.cc:2272] T aa9710dd994b40c18e7d33112d946085 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.763435  2851 tablet_replica.cc:333] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.763903  2851 raft_consensus.cc:2243] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.764292  2851 raft_consensus.cc:2272] T 1d02b1f993f04219ab72cd3d163a11f6 P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.766304  2851 tablet_replica.cc:333] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2: stopping tablet replica
I20260709 13:20:19.766736  2851 raft_consensus.cc:2243] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:19.767148  2851 raft_consensus.cc:2272] T dc3b8ac766444654ab744eef004d23cb P e42f0f6820a54d65880b5a40d1e1d4e2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.848388  2851 tablet_server.cc:196] TabletServer@127.2.200.196:0 shutdown complete.
I20260709 13:20:19.919193  2851 master.cc:562] Master@127.2.200.254:41609 shutting down...
I20260709 13:20:19.947503  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:19.948236  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:19.948565  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4006fd8b490c4d738902da4b5d80981d: stopping tablet replica
I20260709 13:20:19.971971  2851 master.cc:584] Master@127.2.200.254:41609 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35336 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:20:20.069362  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:35059
I20260709 13:20:20.070793  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.077435 13722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.077666 13723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.079108 13725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.080034  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:20.081337  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.081547  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.081677  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603220081666 us; error 0 us; skew 500 ppm
I20260709 13:20:20.082216  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.085121  2851 webserver.cc:533] Webserver started at http://127.2.200.254:42661/ using document root <none> and password file <none>
I20260709 13:20:20.085587  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.085741  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.085960  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.086995  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "d0456b3d397e4e919b4b680eebf21ab7"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.091480  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:20.095191 13730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.096083  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:20.096391  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "d0456b3d397e4e919b4b680eebf21ab7"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.096650  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.119964  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.121740  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.168503  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:35059
I20260709 13:20:20.168613 13781 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:35059 every 8 connection(s)
I20260709 13:20:20.172395 13782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.185628 13782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7: Bootstrap starting.
I20260709 13:20:20.190511 13782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.195060 13782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7: No bootstrap required, opened a new log
I20260709 13:20:20.197314 13782 raft_consensus.cc:359] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0456b3d397e4e919b4b680eebf21ab7" member_type: VOTER }
I20260709 13:20:20.197703 13782 raft_consensus.cc:385] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.197947 13782 raft_consensus.cc:740] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0456b3d397e4e919b4b680eebf21ab7, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.198442 13782 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0456b3d397e4e919b4b680eebf21ab7" member_type: VOTER }
I20260709 13:20:20.198863 13782 raft_consensus.cc:399] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:20.199059 13782 raft_consensus.cc:493] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:20.199255 13782 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:20.204036 13782 raft_consensus.cc:515] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0456b3d397e4e919b4b680eebf21ab7" member_type: VOTER }
I20260709 13:20:20.204644 13782 leader_election.cc:304] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0456b3d397e4e919b4b680eebf21ab7; no voters: 
I20260709 13:20:20.205811 13782 leader_election.cc:290] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:20.206230 13785 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:20.207510 13785 raft_consensus.cc:697] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 1 LEADER]: Becoming Leader. State: Replica: d0456b3d397e4e919b4b680eebf21ab7, State: Running, Role: LEADER
I20260709 13:20:20.208175 13785 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0456b3d397e4e919b4b680eebf21ab7" member_type: VOTER }
I20260709 13:20:20.208829 13782 sys_catalog.cc:565] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:20.216075 13787 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0456b3d397e4e919b4b680eebf21ab7. Latest consensus state: current_term: 1 leader_uuid: "d0456b3d397e4e919b4b680eebf21ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0456b3d397e4e919b4b680eebf21ab7" member_type: VOTER } }
I20260709 13:20:20.216157 13786 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0456b3d397e4e919b4b680eebf21ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0456b3d397e4e919b4b680eebf21ab7" member_type: VOTER } }
I20260709 13:20:20.217126 13787 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:20.217463 13786 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:20.219308 13794 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:20.225848 13794 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:20.227011  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:20.235059 13794 catalog_manager.cc:1383] Generated new cluster ID: d8b75e65c94d4e389b35bccec8487649
I20260709 13:20:20.235369 13794 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:20.256349 13794 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:20.257747 13794 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:20.274220 13794 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7: Generated new TSK 0
I20260709 13:20:20.274950 13794 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:20.294394  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.302194 13803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.303367 13804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.305171 13806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.305789  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:20.307087  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.307319  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.307499  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603220307476 us; error 0 us; skew 500 ppm
I20260709 13:20:20.308132  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.311163  2851 webserver.cc:533] Webserver started at http://127.2.200.193:42285/ using document root <none> and password file <none>
I20260709 13:20:20.311707  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.311872  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.312144  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.313261  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "c5d61903be094928a2734135c78bfc38"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.318349  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:20.322538 13811 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.323405  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:20:20.323794  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "c5d61903be094928a2734135c78bfc38"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.324241  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.338436  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.339635  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.341204  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.343659  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.343851  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.344087  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.344245  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.397553  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:36167
I20260709 13:20:20.397621 13873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:36167 every 8 connection(s)
I20260709 13:20:20.402774  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.410980 13878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.412297 13879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.415835  2851 server_base.cc:1061] running on GCE node
W20260709 13:20:20.416116 13882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.416733 13874 heartbeater.cc:344] Connected to a master server at 127.2.200.254:35059
I20260709 13:20:20.417150 13874 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.417544  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.417912  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.417851 13874 heartbeater.cc:507] Master 127.2.200.254:35059 requested a full tablet report, sending...
I20260709 13:20:20.418432  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603220418404 us; error 0 us; skew 500 ppm
I20260709 13:20:20.419497  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.421083 13747 ts_manager.cc:194] Registered new tserver with Master: c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167)
I20260709 13:20:20.423326  2851 webserver.cc:533] Webserver started at http://127.2.200.194:36569/ using document root <none> and password file <none>
I20260709 13:20:20.424095  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.424322  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.424475 13747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53116
I20260709 13:20:20.424656  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.426147  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.432111  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:20:20.436499 13886 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.437587  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:20.437906  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.438153  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.464196  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.465502  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.467202  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.470149  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.470453  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.470882  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.471109  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.516983  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:46343
I20260709 13:20:20.517100 13948 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:46343 every 8 connection(s)
I20260709 13:20:20.522133  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:20.530206 13953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:20.530330 13952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.535406  2851 server_base.cc:1061] running on GCE node
W20260709 13:20:20.535276 13955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:20.536736 13949 heartbeater.cc:344] Connected to a master server at 127.2.200.254:35059
I20260709 13:20:20.537307 13949 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.537516  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:20.537825  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:20.537985  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603220537970 us; error 0 us; skew 500 ppm
I20260709 13:20:20.538282 13949 heartbeater.cc:507] Master 127.2.200.254:35059 requested a full tablet report, sending...
I20260709 13:20:20.538748  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:20.540889 13747 ts_manager.cc:194] Registered new tserver with Master: 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:20.542579  2851 webserver.cc:533] Webserver started at http://127.2.200.195:44751/ using document root <none> and password file <none>
I20260709 13:20:20.542706 13747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53124
I20260709 13:20:20.543223  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:20.543465  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:20.543789  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:20.545058  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "b59180b0156f41ca8fb678a29b0815ff"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.550431  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:20:20.554054 13960 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.555069  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:20:20.555399  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "b59180b0156f41ca8fb678a29b0815ff"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:20.555670  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:20.574172  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:20.575397  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:20.577018  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:20.579231  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:20.579440  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.579667  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:20.579814  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:20.625276  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:34205
I20260709 13:20:20.625344 14022 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:34205 every 8 connection(s)
I20260709 13:20:20.640184 14023 heartbeater.cc:344] Connected to a master server at 127.2.200.254:35059
I20260709 13:20:20.640558 14023 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:20.641287 14023 heartbeater.cc:507] Master 127.2.200.254:35059 requested a full tablet report, sending...
I20260709 13:20:20.643163 13747 ts_manager.cc:194] Registered new tserver with Master: b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:20.643867  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014887061s
I20260709 13:20:20.644716 13747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53134
I20260709 13:20:20.674031 13747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53144:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:20.677074 13747 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:20.753389 13988 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7c31df5e5a44f0b73052328097db6c (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:20.754873 13988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7c31df5e5a44f0b73052328097db6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.755210 13984 tablet_service.cc:1511] Processing CreateTablet for tablet 3929623d2d02465a8838f133336d7585 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:20.758091 13987 tablet_service.cc:1511] Processing CreateTablet for tablet b2f80638fa9f4e1eb2f5bd5b1e03bd37 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:20.758970 13983 tablet_service.cc:1511] Processing CreateTablet for tablet eea1cada60a14052a0a9afbd9284ebc5 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:20.760268 13986 tablet_service.cc:1511] Processing CreateTablet for tablet de1ba631650848269a3b412eb33fa082 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:20.762023 13985 tablet_service.cc:1511] Processing CreateTablet for tablet bf8d79643d7d43c5893cd4385c145911 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:20.763262 13982 tablet_service.cc:1511] Processing CreateTablet for tablet c5e9a88861274cd48b4346ea3601bdbc (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:20.757082 13984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3929623d2d02465a8838f133336d7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.766793 13986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de1ba631650848269a3b412eb33fa082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.767514 13981 tablet_service.cc:1511] Processing CreateTablet for tablet b77b1535c9a745959ace811c22343da1 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:20.769093 13985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8d79643d7d43c5893cd4385c145911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.769773 13981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77b1535c9a745959ace811c22343da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.770404 13987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f80638fa9f4e1eb2f5bd5b1e03bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.772706 13982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e9a88861274cd48b4346ea3601bdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.777156 13983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea1cada60a14052a0a9afbd9284ebc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.784680 13980 tablet_service.cc:1511] Processing CreateTablet for tablet fde16174377d4429bc4f4a6966a810ef (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:20.786132 13980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde16174377d4429bc4f4a6966a810ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.791400 13979 tablet_service.cc:1511] Processing CreateTablet for tablet 7bca3db3c481482d82efc43ff5ae3c6c (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:20.792835 13979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bca3db3c481482d82efc43ff5ae3c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.827948 14037 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:20.828919 13839 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7c31df5e5a44f0b73052328097db6c (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:20.830323 13839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7c31df5e5a44f0b73052328097db6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.831717 13838 tablet_service.cc:1511] Processing CreateTablet for tablet b2f80638fa9f4e1eb2f5bd5b1e03bd37 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:20.833134 13838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f80638fa9f4e1eb2f5bd5b1e03bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.839354 13835 tablet_service.cc:1511] Processing CreateTablet for tablet 3929623d2d02465a8838f133336d7585 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:20.838157 14037 tablet_bootstrap.cc:654] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.843232 13833 tablet_service.cc:1511] Processing CreateTablet for tablet c5e9a88861274cd48b4346ea3601bdbc (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:20.845573 13832 tablet_service.cc:1511] Processing CreateTablet for tablet b77b1535c9a745959ace811c22343da1 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:20.841944 13834 tablet_service.cc:1511] Processing CreateTablet for tablet eea1cada60a14052a0a9afbd9284ebc5 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:20.838017 13836 tablet_service.cc:1511] Processing CreateTablet for tablet bf8d79643d7d43c5893cd4385c145911 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:20.848564 13835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3929623d2d02465a8838f133336d7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.851759 13833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e9a88861274cd48b4346ea3601bdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.849921 13837 tablet_service.cc:1511] Processing CreateTablet for tablet de1ba631650848269a3b412eb33fa082 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:20.852571 13834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea1cada60a14052a0a9afbd9284ebc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.850385 13831 tablet_service.cc:1511] Processing CreateTablet for tablet fde16174377d4429bc4f4a6966a810ef (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:20.855036 13830 tablet_service.cc:1511] Processing CreateTablet for tablet 7bca3db3c481482d82efc43ff5ae3c6c (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:20.861129 13830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bca3db3c481482d82efc43ff5ae3c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.869588 13837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de1ba631650848269a3b412eb33fa082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.872212 13836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8d79643d7d43c5893cd4385c145911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.874658 13831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde16174377d4429bc4f4a6966a810ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.877550 13832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77b1535c9a745959ace811c22343da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.894389 13909 tablet_service.cc:1511] Processing CreateTablet for tablet eea1cada60a14052a0a9afbd9284ebc5 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:20:20.895902 13909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eea1cada60a14052a0a9afbd9284ebc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.896508 13914 tablet_service.cc:1511] Processing CreateTablet for tablet 2d7c31df5e5a44f0b73052328097db6c (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:20:20.897922 13914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d7c31df5e5a44f0b73052328097db6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.898180 13908 tablet_service.cc:1511] Processing CreateTablet for tablet c5e9a88861274cd48b4346ea3601bdbc (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:20:20.899492 13908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5e9a88861274cd48b4346ea3601bdbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.900578 13913 tablet_service.cc:1511] Processing CreateTablet for tablet b2f80638fa9f4e1eb2f5bd5b1e03bd37 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:20:20.902058 13913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2f80638fa9f4e1eb2f5bd5b1e03bd37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.901856 13907 tablet_service.cc:1511] Processing CreateTablet for tablet b77b1535c9a745959ace811c22343da1 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:20:20.903159 13907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b77b1535c9a745959ace811c22343da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.904407 13912 tablet_service.cc:1511] Processing CreateTablet for tablet de1ba631650848269a3b412eb33fa082 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:20:20.905076 13906 tablet_service.cc:1511] Processing CreateTablet for tablet fde16174377d4429bc4f4a6966a810ef (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:20:20.906322 13912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de1ba631650848269a3b412eb33fa082. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.909165 13906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde16174377d4429bc4f4a6966a810ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.910107 13910 tablet_service.cc:1511] Processing CreateTablet for tablet 3929623d2d02465a8838f133336d7585 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:20:20.911180 14037 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:20.911514 13910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3929623d2d02465a8838f133336d7585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.913484 13911 tablet_service.cc:1511] Processing CreateTablet for tablet bf8d79643d7d43c5893cd4385c145911 (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:20:20.917721 13905 tablet_service.cc:1511] Processing CreateTablet for tablet 7bca3db3c481482d82efc43ff5ae3c6c (DEFAULT_TABLE table=test-workload [id=08891d61676c4f01befdce7f801ed886]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:20:20.925149 13911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf8d79643d7d43c5893cd4385c145911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.925891 14037 ts_tablet_manager.cc:1403] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.098s	user 0.021s	sys 0.012s
I20260709 13:20:20.929150 13905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bca3db3c481482d82efc43ff5ae3c6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:20.932057 14037 raft_consensus.cc:359] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:20.939694 14037 raft_consensus.cc:385] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:20.940930 14037 raft_consensus.cc:740] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:20.956259 14039 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:20.983228 14039 tablet_bootstrap.cc:654] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:20.989091 14037 consensus_queue.cc:260] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:20.991783 14040 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:20.996470 14023 heartbeater.cc:499] Master 127.2.200.254:35059 was elected leader, sending a full tablet report...
I20260709 13:20:20.997658 14037 ts_tablet_manager.cc:1434] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:20:20.999020 14037 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.003328 14039 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.003890 14039 ts_tablet_manager.cc:1403] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.019s
I20260709 13:20:21.005115 14037 tablet_bootstrap.cc:654] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.007289 14039 raft_consensus.cc:359] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.008054 14039 raft_consensus.cc:385] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.008335 14039 raft_consensus.cc:740] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.009357 14039 consensus_queue.cc:260] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.016261 14040 tablet_bootstrap.cc:654] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.021900 14039 ts_tablet_manager.cc:1434] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.018s	user 0.013s	sys 0.006s
I20260709 13:20:21.022055 13874 heartbeater.cc:499] Master 127.2.200.254:35059 was elected leader, sending a full tablet report...
I20260709 13:20:21.022253 14037 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.022868 14037 ts_tablet_manager.cc:1403] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.008s
I20260709 13:20:21.023044 14039 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.025895 14037 raft_consensus.cc:359] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.026609 14037 raft_consensus.cc:385] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.026891 14037 raft_consensus.cc:740] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.027667 14037 consensus_queue.cc:260] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.028373 14040 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.029155 14040 ts_tablet_manager.cc:1403] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.004s
I20260709 13:20:21.030149 14039 tablet_bootstrap.cc:654] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.030244 14037 ts_tablet_manager.cc:1434] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:21.031847 14037 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.033196 14040 raft_consensus.cc:359] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.034094 14040 raft_consensus.cc:385] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.034406 14040 raft_consensus.cc:740] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.035413 14040 consensus_queue.cc:260] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.035754 14042 raft_consensus.cc:493] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.036435 14042 raft_consensus.cc:515] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.039681 14042 leader_election.cc:290] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.039791 14037 tablet_bootstrap.cc:654] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.083227 13949 heartbeater.cc:499] Master 127.2.200.254:35059 was elected leader, sending a full tablet report...
I20260709 13:20:21.089046 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.091950 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.083187 14050 raft_consensus.cc:493] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.093288 14050 raft_consensus.cc:515] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
W20260709 13:20:21.094100 13964 leader_election.cc:343] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.096107 13924 raft_consensus.cc:2468] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 0.
I20260709 13:20:21.102710 14039 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.103593 14039 ts_tablet_manager.cc:1403] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.022s
I20260709 13:20:21.104943 13964 leader_election.cc:304] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.106874 14042 raft_consensus.cc:2804] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.107334 14042 raft_consensus.cc:493] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.107659 14042 raft_consensus.cc:3060] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.109324 14039 raft_consensus.cc:359] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.110189 14039 raft_consensus.cc:385] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.106937 14040 ts_tablet_manager.cc:1434] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.077s	user 0.020s	sys 0.054s
I20260709 13:20:21.110496 14039 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.111995 14040 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.116001 14039 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.117057 14042 raft_consensus.cc:515] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.120543 14039 ts_tablet_manager.cc:1434] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 13:20:21.110515 14050 leader_election.cc:290] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.119343 14040 tablet_bootstrap.cc:654] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.119513 14037 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.122421 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:21.122871 14039 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.124596 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:21.125543 13924 raft_consensus.cc:3060] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:21.129979 14024 tablet.cc:2406] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:21.134567 14039 tablet_bootstrap.cc:654] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:21.124511 13964 leader_election.cc:343] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.135862 13924 raft_consensus.cc:2468] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:21.123893 14042 leader_election.cc:290] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.123821 14037 ts_tablet_manager.cc:1403] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.092s	user 0.021s	sys 0.039s
I20260709 13:20:21.137821 13964 leader_election.cc:304] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.139035 14042 raft_consensus.cc:2804] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.141736 14037 raft_consensus.cc:359] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.143189 14037 raft_consensus.cc:385] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.143560 14037 raft_consensus.cc:740] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.144946 14037 consensus_queue.cc:260] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.150686 14040 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.151414 14040 ts_tablet_manager.cc:1403] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.004s
I20260709 13:20:21.152667 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.149313 14042 raft_consensus.cc:697] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:21.155272 14042 consensus_queue.cc:237] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.155530 14040 raft_consensus.cc:359] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.156810 14040 raft_consensus.cc:385] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.157351 14040 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.158223 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.158442 14040 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
W20260709 13:20:21.160079 13890 leader_election.cc:343] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.160914 14040 ts_tablet_manager.cc:1434] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:20:21.162101 14040 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.163825 14037 ts_tablet_manager.cc:1434] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:20:21.165162 14037 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.167070 14044 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.167654 14044 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.170431 14039 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.171030 14039 ts_tablet_manager.cc:1403] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.050s	user 0.030s	sys 0.006s
I20260709 13:20:21.171386 13890 leader_election.cc:304] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48; no voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.172250 14050 raft_consensus.cc:2749] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.174078 14039 raft_consensus.cc:359] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.174866 14039 raft_consensus.cc:385] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.175164 14039 raft_consensus.cc:740] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.175405 14037 tablet_bootstrap.cc:654] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.177342 14044 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.175822 13746 catalog_manager.cc:5697] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 0 to 1, leader changed from <none> to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 1 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.184346 14040 tablet_bootstrap.cc:654] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.189273 14039 consensus_queue.cc:260] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.191669 14039 ts_tablet_manager.cc:1434] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:20:21.192687 14039 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.199038 14039 tablet_bootstrap.cc:654] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.204152 14037 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.204862 14037 ts_tablet_manager.cc:1403] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.009s
I20260709 13:20:21.207988 14037 raft_consensus.cc:359] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.208845 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.208981 14037 raft_consensus.cc:385] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.209560 13924 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 0.
I20260709 13:20:21.209798 14037 raft_consensus.cc:740] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.210791 14039 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.211354 14039 ts_tablet_manager.cc:1403] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:20:21.211145 14037 consensus_queue.cc:260] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.213871 13815 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.214355 14039 raft_consensus.cc:359] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.214771 14044 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.215222 14039 raft_consensus.cc:385] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.215291 14044 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.215966 14044 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:21.220918 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:21.222376 14040 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.222931 14040 ts_tablet_manager.cc:1403] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.009s
I20260709 13:20:21.223924 14044 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.226663 14040 raft_consensus.cc:359] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.227665 14040 raft_consensus.cc:385] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.227836 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:21.228011 14040 raft_consensus.cc:740] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.228406 14039 raft_consensus.cc:740] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.229331 14040 consensus_queue.cc:260] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.229552 14037 ts_tablet_manager.cc:1434] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
I20260709 13:20:21.230047 13924 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.228180 14044 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Requested vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.229499 14039 consensus_queue.cc:260] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.234678 14040 ts_tablet_manager.cc:1434] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:20:21.235872 14040 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.239502 14037 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.242247 14040 tablet_bootstrap.cc:654] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.232692 14039 ts_tablet_manager.cc:1434] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:20:21.243434 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.244867 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:21.245831 14039 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
W20260709 13:20:21.246832 13815 leader_election.cc:343] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:21.247864 13815 leader_election.cc:343] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.248232 14037 tablet_bootstrap.cc:654] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.253271 14039 tablet_bootstrap.cc:654] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.254137 13924 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 1.
I20260709 13:20:21.255570 13815 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:21.256409 14044 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.257647 14044 raft_consensus.cc:697] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Becoming Leader. State: Replica: c5d61903be094928a2734135c78bfc38, State: Running, Role: LEADER
I20260709 13:20:21.258507 14044 consensus_queue.cc:237] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.259142 14037 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.259712 14037 ts_tablet_manager.cc:1403] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:20:21.256424 14040 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.262578 14040 ts_tablet_manager.cc:1403] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.027s	user 0.004s	sys 0.008s
I20260709 13:20:21.262818 14037 raft_consensus.cc:359] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.263618 14037 raft_consensus.cc:385] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.263880 14037 raft_consensus.cc:740] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.264734 14037 consensus_queue.cc:260] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.265676 14040 raft_consensus.cc:359] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.266381 14040 raft_consensus.cc:385] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.266667 14040 raft_consensus.cc:740] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.267099 14037 ts_tablet_manager.cc:1434] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:20:21.267570 14040 consensus_queue.cc:260] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.268179 14037 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.268008 13747 catalog_manager.cc:5697] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d61903be094928a2734135c78bfc38 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "c5d61903be094928a2734135c78bfc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.272233 14040 ts_tablet_manager.cc:1434] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:20:21.273334 14040 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.275141 14037 tablet_bootstrap.cc:654] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.279655 14040 tablet_bootstrap.cc:654] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.282799 14056 raft_consensus.cc:493] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.283317 14056 raft_consensus.cc:515] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.285486 14056 leader_election.cc:290] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.287149 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.287968 13849 raft_consensus.cc:2468] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 0.
I20260709 13:20:21.288784 14044 raft_consensus.cc:493] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.289386 14044 raft_consensus.cc:515] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.290041 13964 leader_election.cc:304] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.291043 14056 raft_consensus.cc:2804] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.291429 14056 raft_consensus.cc:493] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.289072 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.291770 14056 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.291761 14044 leader_election.cc:290] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
W20260709 13:20:21.297257 13964 leader_election.cc:343] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.305519 14040 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.306253 14040 ts_tablet_manager.cc:1403] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.008s
I20260709 13:20:21.307407 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.310475 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.310915 14040 raft_consensus.cc:359] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.311786 14040 raft_consensus.cc:385] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.312104 14040 raft_consensus.cc:740] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.313023 14040 consensus_queue.cc:260] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
W20260709 13:20:21.314230 13815 leader_election.cc:343] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:20:21.320061 13815 leader_election.cc:343] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.321925 13815 leader_election.cc:304] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:21.325733 14044 raft_consensus.cc:2749] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.325383 14056 raft_consensus.cc:515] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.324939 14040 ts_tablet_manager.cc:1434] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.004s
I20260709 13:20:21.329382 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:21.330087 13849 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.337095 14040 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.342306 13849 raft_consensus.cc:2468] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:21.345126 14040 tablet_bootstrap.cc:654] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.344940 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
W20260709 13:20:21.347055 13964 leader_election.cc:343] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.347790 13964 leader_election.cc:304] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:21.348809 14042 raft_consensus.cc:2804] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.349377 14042 raft_consensus.cc:697] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:21.350112 14039 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.350914 14039 ts_tablet_manager.cc:1403] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.105s	user 0.048s	sys 0.035s
I20260709 13:20:21.350332 14042 consensus_queue.cc:237] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.352334 14037 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.352984 14037 ts_tablet_manager.cc:1403] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.059s
I20260709 13:20:21.345501 14056 leader_election.cc:290] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.354521 14039 raft_consensus.cc:359] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.355511 14039 raft_consensus.cc:385] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.355880 14039 raft_consensus.cc:740] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.356633 14037 raft_consensus.cc:359] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.357542 14037 raft_consensus.cc:385] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.357889 14037 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.357124 14039 consensus_queue.cc:260] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.358897 14037 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.360950 14040 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.361197 14039 ts_tablet_manager.cc:1434] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:20:21.361250 14037 ts_tablet_manager.cc:1434] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:20:21.361606 14040 ts_tablet_manager.cc:1403] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.025s	user 0.022s	sys 0.000s
I20260709 13:20:21.362586 14037 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.365170 14040 raft_consensus.cc:359] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.365962 14040 raft_consensus.cc:385] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.366303 14040 raft_consensus.cc:740] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.366408 13746 catalog_manager.cc:5697] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 0 to 1, leader changed from <none> to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 1 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.367267 14040 consensus_queue.cc:260] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.370051 14037 tablet_bootstrap.cc:654] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.374038 14040 ts_tablet_manager.cc:1434] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:21.375183 14040 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.376012 14039 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.376986 14044 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.377586 14044 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.379802 14044 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.381067 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
W20260709 13:20:21.382915 13815 leader_election.cc:343] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.383701 14040 tablet_bootstrap.cc:654] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.385666 14037 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.386272 14037 ts_tablet_manager.cc:1403] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 13:20:21.387257 14039 tablet_bootstrap.cc:654] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.389493 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.389575 14037 raft_consensus.cc:359] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.390553 13997 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 0.
I20260709 13:20:21.391251 14037 raft_consensus.cc:385] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.392025 13815 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:21.393507 14044 raft_consensus.cc:2804] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.394217 14044 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.394759 14044 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.403120 14037 raft_consensus.cc:740] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.402954 14044 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.404222 14037 consensus_queue.cc:260] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.405435 14040 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.405639 14039 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.405985 14040 ts_tablet_manager.cc:1403] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 13:20:21.406163 14039 ts_tablet_manager.cc:1403] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 13:20:21.406878 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
W20260709 13:20:21.408347 13815 leader_election.cc:343] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.409189 14040 raft_consensus.cc:359] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.410002 14040 raft_consensus.cc:385] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.410290 14040 raft_consensus.cc:740] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.410480 14037 ts_tablet_manager.cc:1434] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:20:21.410506 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:21.411394 13997 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.411186 14040 consensus_queue.cc:260] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.412935 14039 raft_consensus.cc:359] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.413516 14040 ts_tablet_manager.cc:1434] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:20:21.413748 14039 raft_consensus.cc:385] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.414597 14040 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.416303 14039 raft_consensus.cc:740] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.417318 14039 consensus_queue.cc:260] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.419571 14039 ts_tablet_manager.cc:1434] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:20:21.410585 14044 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Requested vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.419683 13997 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 1.
I20260709 13:20:21.411731 14056 raft_consensus.cc:493] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.422276 13815 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:21.420943 14039 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.422294 14056 raft_consensus.cc:515] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.425706 14056 leader_election.cc:290] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.426301 14044 raft_consensus.cc:2804] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.427135 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.427830 13924 raft_consensus.cc:2468] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 0.
I20260709 13:20:21.427171 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.422523 14037 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.429955 13964 leader_election.cc:304] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
W20260709 13:20:21.430892 13964 leader_election.cc:343] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.421159 14040 tablet_bootstrap.cc:654] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.431819 14056 raft_consensus.cc:2804] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.432307 14056 raft_consensus.cc:493] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.432650 14056 raft_consensus.cc:3060] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.436944 14037 tablet_bootstrap.cc:654] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.430002 14044 raft_consensus.cc:697] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Becoming Leader. State: Replica: c5d61903be094928a2734135c78bfc38, State: Running, Role: LEADER
I20260709 13:20:21.437403 14039 tablet_bootstrap.cc:654] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.437510 14040 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.438042 14040 ts_tablet_manager.cc:1403] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.007s
I20260709 13:20:21.438172 14044 consensus_queue.cc:237] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.440138 14056 raft_consensus.cc:515] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.440865 14040 raft_consensus.cc:359] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.441521 14040 raft_consensus.cc:385] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.441788 14040 raft_consensus.cc:740] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.442487 14040 consensus_queue.cc:260] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.443431 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38"
W20260709 13:20:21.445137 13964 leader_election.cc:343] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.447466 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:21.448125 13924 raft_consensus.cc:3060] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.452653 14037 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.452893 14040 ts_tablet_manager.cc:1434] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:20:21.456336 14037 ts_tablet_manager.cc:1403] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.045s	user 0.007s	sys 0.006s
I20260709 13:20:21.456974 14040 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.459046 13924 raft_consensus.cc:2468] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:21.459592 14037 raft_consensus.cc:359] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.460289 14037 raft_consensus.cc:385] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.460589 14037 raft_consensus.cc:740] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.460390 13964 leader_election.cc:304] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.461457 14037 consensus_queue.cc:260] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.461927 14056 leader_election.cc:290] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.464103 14044 raft_consensus.cc:493] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.464298 14039 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.463889 14037 ts_tablet_manager.cc:1434] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:21.464859 14039 ts_tablet_manager.cc:1403] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.013s
I20260709 13:20:21.465842 14040 tablet_bootstrap.cc:654] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.465849 14037 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.466917 13747 catalog_manager.cc:5697] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d61903be094928a2734135c78bfc38 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "c5d61903be094928a2734135c78bfc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.467892 14039 raft_consensus.cc:359] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.469076 14039 raft_consensus.cc:385] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.469378 14039 raft_consensus.cc:740] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.470301 14039 consensus_queue.cc:260] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.472617 14037 tablet_bootstrap.cc:654] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.461418 14042 raft_consensus.cc:2804] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.472829 14039 ts_tablet_manager.cc:1434] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:21.466140 14044 raft_consensus.cc:515] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.473448 14042 raft_consensus.cc:697] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:21.474077 14039 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.474460 14042 consensus_queue.cc:237] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.476008 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.476585 14044 leader_election.cc:290] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.476665 13997 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 0.
I20260709 13:20:21.481591 13815 leader_election.cc:304] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.482812 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.483616 13924 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 0.
I20260709 13:20:21.483651 14044 raft_consensus.cc:2804] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.484660 14044 raft_consensus.cc:493] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.485044 14044 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.491935 14039 tablet_bootstrap.cc:654] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.496835 14044 raft_consensus.cc:515] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.500710 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:21.501447 13997 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.503017 14040 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.503696 14040 ts_tablet_manager.cc:1403] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.022s
I20260709 13:20:21.506798 14040 raft_consensus.cc:359] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.507710 14040 raft_consensus.cc:385] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.508049 14040 raft_consensus.cc:740] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.508922 14040 consensus_queue.cc:260] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.511229 14040 ts_tablet_manager.cc:1434] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:21.512288 14040 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: Bootstrap starting.
I20260709 13:20:21.513550 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:21.514194 13924 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.517633 14040 tablet_bootstrap.cc:654] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.520035 14044 leader_election.cc:290] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Requested vote from peers b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.524237 14040 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: No bootstrap required, opened a new log
I20260709 13:20:21.558606 14040 ts_tablet_manager.cc:1403] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.000s
I20260709 13:20:21.522459 13997 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 1.
I20260709 13:20:21.568116 14040 raft_consensus.cc:359] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.571009 14040 raft_consensus.cc:385] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.571455 14040 raft_consensus.cc:740] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.572556 14050 raft_consensus.cc:493] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.574437 14050 raft_consensus.cc:515] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.575034 13815 leader_election.cc:304] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.577096 14044 raft_consensus.cc:2804] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.577997 14044 raft_consensus.cc:697] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Becoming Leader. State: Replica: c5d61903be094928a2734135c78bfc38, State: Running, Role: LEADER
I20260709 13:20:21.580410 14044 consensus_queue.cc:237] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:21.581594 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.582964 13849 raft_consensus.cc:2393] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32aec9b0ab6f48acbf9588e8a36fce48 in current term 1: Already voted for candidate b59180b0156f41ca8fb678a29b0815ff in this term.
I20260709 13:20:21.572682 14040 consensus_queue.cc:260] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.585033 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.585800 14040 ts_tablet_manager.cc:1434] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.013s
I20260709 13:20:21.590214 13890 leader_election.cc:304] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48; no voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.591450 14047 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.590476 13745 catalog_manager.cc:5697] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 0 to 1, leader changed from <none> to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 1 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.598474 14039 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.599524 14039 ts_tablet_manager.cc:1403] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.126s	user 0.008s	sys 0.020s
I20260709 13:20:21.587513 14037 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.605170 14039 raft_consensus.cc:359] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.606216 14039 raft_consensus.cc:385] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.606582 14039 raft_consensus.cc:740] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.607622 14039 consensus_queue.cc:260] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.609508 14037 ts_tablet_manager.cc:1403] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.014s
I20260709 13:20:21.589080 14050 leader_election.cc:290] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.608314 13747 catalog_manager.cc:5697] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d61903be094928a2734135c78bfc38 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "c5d61903be094928a2734135c78bfc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.610562 14042 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.614856 14042 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.618849 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.619004 14047 raft_consensus.cc:2749] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.621966 13924 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 1.
I20260709 13:20:21.621666 14037 raft_consensus.cc:359] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.622884 14037 raft_consensus.cc:385] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.623267 14037 raft_consensus.cc:740] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.624440 14037 consensus_queue.cc:260] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.625468 14042 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.626485 14047 raft_consensus.cc:493] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.627310 14047 raft_consensus.cc:515] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.628262 14037 ts_tablet_manager.cc:1434] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:20:21.629772 14047 leader_election.cc:290] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.630363 14037 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: Bootstrap starting.
I20260709 13:20:21.630441 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.632511 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.633394 13997 raft_consensus.cc:2468] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 0.
I20260709 13:20:21.634688 14056 raft_consensus.cc:493] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.635494 14056 raft_consensus.cc:515] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.636862 14055 consensus_queue.cc:1048] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.638208 14056 leader_election.cc:290] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.640185 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.640404 13923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.641575 13923 raft_consensus.cc:2468] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 0.
I20260709 13:20:21.642002 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.643108 13924 raft_consensus.cc:2393] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b59180b0156f41ca8fb678a29b0815ff in current term 1: Already voted for candidate c5d61903be094928a2734135c78bfc38 in this term.
I20260709 13:20:21.639115 14037 tablet_bootstrap.cc:654] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.644353 13964 leader_election.cc:304] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
W20260709 13:20:21.645124 13890 leader_election.cc:343] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.645825 14056 raft_consensus.cc:2804] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.646377 14056 raft_consensus.cc:493] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.611913 14039 ts_tablet_manager.cc:1434] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 13:20:21.646863 14056 raft_consensus.cc:3060] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.646124 13890 leader_election.cc:304] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.648597 14047 raft_consensus.cc:2804] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.649021 14047 raft_consensus.cc:493] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.649374 14039 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.649449 14047 raft_consensus.cc:3060] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:21.653720 13964 leader_election.cc:343] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.660254 13997 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.666803 14050 raft_consensus.cc:493] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.667791 14050 raft_consensus.cc:515] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.668417 13964 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff; no voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.675448 14050 leader_election.cc:290] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.676106 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.677024 13849 raft_consensus.cc:2468] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 0.
I20260709 13:20:21.679075 14047 raft_consensus.cc:515] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.679564 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.680588 13998 raft_consensus.cc:2468] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 0.
I20260709 13:20:21.682444 13890 leader_election.cc:304] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.684315 14037 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: No bootstrap required, opened a new log
I20260709 13:20:21.684897 14037 ts_tablet_manager.cc:1403] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.025s
I20260709 13:20:21.687419 14042 raft_consensus.cc:2749] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.688398 14039 tablet_bootstrap.cc:654] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.688524 14044 raft_consensus.cc:493] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.687750 14037 raft_consensus.cc:359] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.687065 14050 raft_consensus.cc:2804] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.690464 14037 raft_consensus.cc:385] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.690209 14044 raft_consensus.cc:515] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.690583 14066 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:21.690996 14037 raft_consensus.cc:740] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.690929 14050 raft_consensus.cc:493] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.692029 14037 consensus_queue.cc:260] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.692492 14050 raft_consensus.cc:3060] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.692989 14044 leader_election.cc:290] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.693912 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:21.696902 14037 ts_tablet_manager.cc:1434] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:20:21.703207 14056 raft_consensus.cc:515] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.704730 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.708652 14047 leader_election.cc:290] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.709422 13996 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 0.
I20260709 13:20:21.709522 14047 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:21.705883 13890 leader_election.cc:343] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.710897 14047 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.711242 13849 raft_consensus.cc:3060] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.712980 14047 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.714529 14056 leader_election.cc:290] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:21.724979 13848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38" is_pre_election: true
I20260709 13:20:21.704372 14050 raft_consensus.cc:515] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.730530 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.731608 13847 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:21.732115 13924 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 0.
I20260709 13:20:21.733546 13923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:21.734031 13923 raft_consensus.cc:3060] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.738001 14050 leader_election.cc:290] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.740578 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.729135 13815 leader_election.cc:304] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.729585 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:21.744496 14044 raft_consensus.cc:2804] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:21.746446 14039 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.749418 13923 raft_consensus.cc:2468] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:21.751959 14066 raft_consensus.cc:493] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:21.754892 14039 ts_tablet_manager.cc:1403] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.016s
I20260709 13:20:21.753161 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:21.755496 14066 raft_consensus.cc:515] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.752604 13998 raft_consensus.cc:2393] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 32aec9b0ab6f48acbf9588e8a36fce48 in current term 1: Already voted for candidate c5d61903be094928a2734135c78bfc38 in this term.
W20260709 13:20:21.753257 13964 leader_election.cc:343] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:21.755800 13996 raft_consensus.cc:3060] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.754798 14044 raft_consensus.cc:493] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:21.756981 13997 raft_consensus.cc:3060] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.765857 14066 leader_election.cc:290] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.758168 14044 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.766559 13890 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48; no voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.766721 13849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:21.767382 13849 raft_consensus.cc:3060] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.773762 14088 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.775962 13849 raft_consensus.cc:2468] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 1.
I20260709 13:20:21.777273 14055 consensus_queue.cc:1048] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.766765 14066 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:20:21.781558 14044 raft_consensus.cc:515] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.782783 13964 leader_election.cc:304] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.784518 14042 raft_consensus.cc:2804] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.785175 14042 raft_consensus.cc:697] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:21.786353 14042 consensus_queue.cc:237] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.792018 13997 raft_consensus.cc:2468] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 1.
I20260709 13:20:21.793864 13890 leader_election.cc:304] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:21.783885 14044 leader_election.cc:290] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Requested vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:21.796583 14050 raft_consensus.cc:2804] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.797132 13890 leader_election.cc:304] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.797361 13923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:21.798022 14047 raft_consensus.cc:2804] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.801108 14039 raft_consensus.cc:359] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.802376 14039 raft_consensus.cc:385] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.797137 14050 raft_consensus.cc:697] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:21.802610 14039 raft_consensus.cc:740] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.806982 13923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:21.807741 13923 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.807606 14039 consensus_queue.cc:260] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.807684 14050 consensus_queue.cc:237] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.816509 14088 raft_consensus.cc:2749] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:21.820504 13997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:21.821156 13745 catalog_manager.cc:5697] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 0 to 1, leader changed from <none> to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 1 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:21.822775 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:21.823447 13998 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.823287 13815 leader_election.cc:304] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:21.824263 13996 raft_consensus.cc:2468] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 1.
I20260709 13:20:21.813766 14047 raft_consensus.cc:697] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:21.829752 14047 consensus_queue.cc:237] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.816506 14042 consensus_queue.cc:1048] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:20:21.835347 13998 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 1.
I20260709 13:20:21.828467 13923 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5d61903be094928a2734135c78bfc38 in term 1.
I20260709 13:20:21.838300 13815 leader_election.cc:304] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:21.839828 14066 raft_consensus.cc:2804] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:21.840399 14066 raft_consensus.cc:697] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Becoming Leader. State: Replica: c5d61903be094928a2734135c78bfc38, State: Running, Role: LEADER
I20260709 13:20:21.840049 14044 raft_consensus.cc:2749] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:21.835546 14039 ts_tablet_manager.cc:1434] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.001s
I20260709 13:20:21.842706 14039 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:21.841673 14066 consensus_queue.cc:237] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.858253 13746 catalog_manager.cc:5697] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.859112 14039 tablet_bootstrap.cc:654] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:21.861887 14055 consensus_queue.cc:1048] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.863322 14066 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:20:21.891676 14096 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.898108 13746 catalog_manager.cc:5697] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5d61903be094928a2734135c78bfc38 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "c5d61903be094928a2734135c78bfc38" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.910966 14039 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: No bootstrap required, opened a new log
I20260709 13:20:21.911590 14039 ts_tablet_manager.cc:1403] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.017s
I20260709 13:20:21.914350 14039 raft_consensus.cc:359] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.915002 14039 raft_consensus.cc:385] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:21.915249 14039 raft_consensus.cc:740] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:21.915848 14039 consensus_queue.cc:260] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:21.915967 13747 catalog_manager.cc:5697] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:21.918272 14039 ts_tablet_manager.cc:1434] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:20:21.927433 14055 consensus_queue.cc:1048] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:21.939714 13849 raft_consensus.cc:3060] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:21.949023 14056 consensus_queue.cc:1048] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.030243 14096 consensus_queue.cc:1048] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.042680 14095 consensus_queue.cc:1048] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:22.110613 14095 raft_consensus.cc:493] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:22.111124 14095 raft_consensus.cc:515] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:22.113010 14095 leader_election.cc:290] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:22.114039 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:22.114156 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:22.115031 13922 raft_consensus.cc:2393] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c5d61903be094928a2734135c78bfc38 in current term 1: Already voted for candidate b59180b0156f41ca8fb678a29b0815ff in this term.
I20260709 13:20:22.115993 13815 leader_election.cc:304] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:22.116652 14095 raft_consensus.cc:3060] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:22.123006 14095 raft_consensus.cc:2749] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:22.150825  2851 ts_manager.cc:295] Set tserver state for c5d61903be094928a2734135c78bfc38 to MAINTENANCE_MODE
I20260709 13:20:22.151787  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
I20260709 13:20:22.175076  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:22.176091  2851 tablet_replica.cc:333] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.176724  2851 raft_consensus.cc:2243] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.177201  2851 raft_consensus.cc:2272] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.180328  2851 tablet_replica.cc:333] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.181156  2851 raft_consensus.cc:2243] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.182051  2851 pending_rounds.cc:70] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Trying to abort 1 pending ops.
I20260709 13:20:22.182265  2851 pending_rounds.cc:77] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305638796677255168 op_type: NO_OP noop_request { }
I20260709 13:20:22.182564  2851 raft_consensus.cc:2889] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:22.182824  2851 raft_consensus.cc:2272] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.185771  2851 tablet_replica.cc:333] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.186568  2851 raft_consensus.cc:2243] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.187144  2851 raft_consensus.cc:2272] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.190186  2851 tablet_replica.cc:333] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.190757  2851 raft_consensus.cc:2243] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.191097  2851 raft_consensus.cc:2272] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.192986  2851 tablet_replica.cc:333] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.193506  2851 raft_consensus.cc:2243] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.194223  2851 raft_consensus.cc:2272] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.196826  2851 tablet_replica.cc:333] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.197537  2851 raft_consensus.cc:2243] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:22.198704  2851 raft_consensus.cc:2272] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.200516 14050 consensus_queue.cc:1048] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:22.202172  2851 tablet_replica.cc:333] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.203132  2851 raft_consensus.cc:2243] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.203580  2851 raft_consensus.cc:2272] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.207602  2851 tablet_replica.cc:333] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.208451  2851 raft_consensus.cc:2243] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.209023  2851 raft_consensus.cc:2272] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.212600  2851 tablet_replica.cc:333] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.213477  2851 raft_consensus.cc:2243] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:22.214157  2851 raft_consensus.cc:2272] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:22.217028  2851 tablet_replica.cc:333] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: stopping tablet replica
I20260709 13:20:22.217734  2851 raft_consensus.cc:2243] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:20:22.218569 13890 consensus_peers.cc:597] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:22.218703  2851 raft_consensus.cc:2272] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:22.222275 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:22.253822  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:20:22.332619 14056 consensus_queue.cc:1048] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:20:22.334031 13964 consensus_peers.cc:597] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.351976 13964 consensus_peers.cc:597] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.356756 13890 consensus_peers.cc:597] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.362867 13964 consensus_peers.cc:597] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:22.434803 13964 consensus_peers.cc:597] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:22.442207 14050 consensus_queue.cc:1048] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:23.223541 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:23.344874 14047 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.345445 14047 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.347600 14047 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:23.349675 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
W20260709 13:20:23.351390 13890 leader_election.cc:336] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.351765 13890 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48; no voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38
I20260709 13:20:23.352361 14047 raft_consensus.cc:2749] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:20:23.382149 13964 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111) [suppressed 118 similar messages]
I20260709 13:20:23.406699 14047 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.407291 14047 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.409047 14047 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:23.410243 14056 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.411012 14056 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.411214 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:23.412067 13996 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 1.
I20260709 13:20:23.413617 14056 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.413762 13890 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:23.414770 14047 raft_consensus.cc:2804] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:23.414813 13890 leader_election.cc:336] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.415395 14047 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.415194 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:23.416843 14047 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:23.419198 13964 leader_election.cc:336] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.422570 14047 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.423637 13922 raft_consensus.cc:2393] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b59180b0156f41ca8fb678a29b0815ff in current term 2: Already voted for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in this term.
I20260709 13:20:23.424640 14047 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:23.425622 13964 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff; no voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38
I20260709 13:20:23.426090 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:23.426468 14056 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:23.429193 13890 leader_election.cc:336] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.438874 14056 raft_consensus.cc:2749] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:20:23.445062 13996 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:23.450465 13890 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:23.455128 14047 raft_consensus.cc:2804] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.457980 14047 raft_consensus.cc:697] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:23.459111 14047 consensus_queue.cc:237] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.467893 13747 catalog_manager.cc:5697] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 1 to 2, leader changed from c5d61903be094928a2734135c78bfc38 (127.2.200.193) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.540905 14056 raft_consensus.cc:493] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.541380 14056 raft_consensus.cc:515] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:23.543614 14056 leader_election.cc:290] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.544879 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:23.545593 13922 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:23.546764 13964 leader_election.cc:304] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
W20260709 13:20:23.547389 13964 leader_election.cc:336] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.547508 14056 raft_consensus.cc:2804] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.548000 14056 raft_consensus.cc:493] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.548431 14056 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.555459 14056 raft_consensus.cc:515] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:23.557852 14056 leader_election.cc:290] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.559446 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:23.560050 13922 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:23.561364 13964 leader_election.cc:336] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.567200 13922 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:23.570336 13964 leader_election.cc:304] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:23.571269 14056 raft_consensus.cc:2804] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.571727 14056 raft_consensus.cc:697] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:23.572571 14056 consensus_queue.cc:237] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:23.580461 13747 catalog_manager.cc:5697] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 1 to 2, leader changed from c5d61903be094928a2734135c78bfc38 (127.2.200.193) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 2 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:23.665241 14056 raft_consensus.cc:493] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:23.665714 14056 raft_consensus.cc:515] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.667827 14056 leader_election.cc:290] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.669860 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:23.670774 13922 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:23.671932 13964 leader_election.cc:304] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:23.672720 14056 raft_consensus.cc:2804] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:20:23.672737 13964 leader_election.cc:336] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.673202 14056 raft_consensus.cc:493] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:23.673609 14056 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.679549 14056 raft_consensus.cc:515] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.681318 14056 leader_election.cc:290] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.683008 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:23.683694 13922 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:23.685004 13964 leader_election.cc:336] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.688880 14056 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.689450 14056 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.689724 13922 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:23.691295 13964 leader_election.cc:304] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:23.691418 14056 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.692262 14119 raft_consensus.cc:2804] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.696573 14119 raft_consensus.cc:697] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:23.697917 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:23.697595 14119 consensus_queue.cc:237] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.698614 13922 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 1.
I20260709 13:20:23.699950 13964 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
W20260709 13:20:23.700671 13964 leader_election.cc:336] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.700671 14056 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:23.701254 14056 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting leader election (detected failure of leader c5d61903be094928a2734135c78bfc38)
I20260709 13:20:23.701678 14056 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:23.706588 13747 catalog_manager.cc:5697] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 1 to 2, leader changed from c5d61903be094928a2734135c78bfc38 (127.2.200.193) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 2 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.707240 14056 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.709610 14056 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:23.711937 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:23.713035 13922 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:23.717414 13964 leader_election.cc:336] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111)
I20260709 13:20:23.720695 13922 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:23.721805 13964 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: c5d61903be094928a2734135c78bfc38
I20260709 13:20:23.722472 14056 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:23.722865 14056 raft_consensus.cc:697] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:23.723623 14056 consensus_queue.cc:237] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:23.736927 13747 catalog_manager.cc:5697] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 1 to 2, leader changed from c5d61903be094928a2734135c78bfc38 (127.2.200.193) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 2 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:23.992990 13996 raft_consensus.cc:1275] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:23.994652 14047 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:23.997251 13890 consensus_peers.cc:597] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:24.048688 13922 raft_consensus.cc:1275] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.050433 14056 consensus_queue.cc:1048] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:24.066552 13964 consensus_peers.cc:597] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:24.126003 13922 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:24.127674 14137 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:20:24.143210 13964 consensus_peers.cc:597] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:24.209580 13964 consensus_peers.cc:597] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:24.224681 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:24.323127 13922 raft_consensus.cc:1275] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:24.324846 14056 consensus_queue.cc:1048] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:24.697276 13964 consensus_peers.cc:597] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:24.794217 13890 consensus_peers.cc:597] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:24.955812 13890 consensus_peers.cc:597] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:25.016598 13964 consensus_peers.cc:597] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:25.046319 13964 consensus_peers.cc:597] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:25.139139 13964 consensus_peers.cc:597] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:25.225801 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:26.226801 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:20:26.542282 13890 consensus_peers.cc:597] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:26.587721 13964 consensus_peers.cc:597] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:26.763495 13964 consensus_peers.cc:597] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:26.887679 13964 consensus_peers.cc:597] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:26.889854 13964 consensus_peers.cc:597] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:20:27.215627 13964 consensus_peers.cc:597] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:20:27.228009 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:27.279241  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:27.286233 14143 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:27.286862 14144 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:27.287832 14146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:27.289113  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:27.290992  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:27.291190  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:27.291335  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603227291321 us; error 0 us; skew 500 ppm
I20260709 13:20:27.291805  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:27.295197  2851 webserver.cc:533] Webserver started at http://127.2.200.193:42285/ using document root <none> and password file <none>
I20260709 13:20:27.295841  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:27.296087  2851 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:20:27.300276  2851 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:20:27.304831 14151 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:27.305716  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:20:27.306034  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "c5d61903be094928a2734135c78bfc38"
format_stamp: "Formatted at 2026-07-09 13:20:20 on dist-test-slave-108k"
I20260709 13:20:27.306401  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:27.331614  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:27.333474  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:27.335295  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:27.339480 14158 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:20:27.394100  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:20:27.394387  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.056s	user 0.003s	sys 0.000s
I20260709 13:20:27.394742  2851 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:20:27.399340 14158 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.417523 14158 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.419049 14158 tablet_bootstrap.cc:492] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.419849 14158 ts_tablet_manager.cc:1403] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:20:27.422988 14158 raft_consensus.cc:359] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:27.423743 14158 raft_consensus.cc:740] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.424556 14158 consensus_queue.cc:260] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:27.427699 14158 ts_tablet_manager.cc:1434] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:27.428633 14158 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.445614 14158 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.446588 14158 tablet_bootstrap.cc:492] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.447806 14158 ts_tablet_manager.cc:1403] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 13:20:27.451818 14158 raft_consensus.cc:359] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.452445 14158 raft_consensus.cc:740] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.453130 14158 consensus_queue.cc:260] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.454758 14158 ts_tablet_manager.cc:1434] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:20:27.454998  2851 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:20:27.455389  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.061s	user 0.055s	sys 0.003s
I20260709 13:20:27.455581 14158 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.470847 14158 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:20:27.471941 14158 tablet_bootstrap.cc:492] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.472663 14158 ts_tablet_manager.cc:1403] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:20:27.474934 14158 raft_consensus.cc:359] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.476135 14158 raft_consensus.cc:740] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.477034 14158 consensus_queue.cc:260] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.479417 14158 ts_tablet_manager.cc:1434] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:27.480264 14158 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.495786 14158 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.496667 14158 tablet_bootstrap.cc:492] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.497308 14158 ts_tablet_manager.cc:1403] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:20:27.499579 14158 raft_consensus.cc:359] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.500123 14158 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.500648 14158 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.502457 14158 ts_tablet_manager.cc:1434] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:27.503101 14158 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.514156  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:36167
I20260709 13:20:27.514364 14219 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:36167 every 8 connection(s)
I20260709 13:20:27.520810  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:27.520917 14158 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.522259 14158 tablet_bootstrap.cc:492] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.523017 14158 ts_tablet_manager.cc:1403] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:20:27.525810 14158 raft_consensus.cc:359] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.526587 14158 raft_consensus.cc:740] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.527577 14158 consensus_queue.cc:260] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.529999 14158 ts_tablet_manager.cc:1434] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:27.530953 14158 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.531117 14194 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.540741 14194 pending_rounds.cc:85] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Aborting all ops after (but not including) 0
I20260709 13:20:27.541373 14194 pending_rounds.cc:107] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:20:27.541723 14194 raft_consensus.cc:2889] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:20:27.556977 14158 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.558033 14158 tablet_bootstrap.cc:492] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.558866 14158 ts_tablet_manager.cc:1403] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.004s
I20260709 13:20:27.561570 14158 raft_consensus.cc:359] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.562467 14158 raft_consensus.cc:740] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.563280 14158 consensus_queue.cc:260] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.565469 14158 ts_tablet_manager.cc:1434] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:27.566331 14158 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.575519 14222 heartbeater.cc:344] Connected to a master server at 127.2.200.254:35059
I20260709 13:20:27.575986 14222 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:27.577008 14222 heartbeater.cc:507] Master 127.2.200.254:35059 requested a full tablet report, sending...
W20260709 13:20:27.582144 13890 consensus_peers.cc:597] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:27.586691 14158 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.587437 14158 tablet_bootstrap.cc:492] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.587944 14158 ts_tablet_manager.cc:1403] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 13:20:27.590502 14158 raft_consensus.cc:359] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.591105 14158 raft_consensus.cc:740] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.591674 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:27.591987 14158 consensus_queue.cc:260] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.592424 13998 raft_consensus.cc:606] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:27.594266 14158 ts_tablet_manager.cc:1434] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:20:27.595000 14158 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.596693 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b77b1535c9a745959ace811c22343da1"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:27.597237 13998 raft_consensus.cc:606] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:27.599313 13746 ts_manager.cc:194] Re-registered known tserver with Master: c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167)
I20260709 13:20:27.601046 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de1ba631650848269a3b412eb33fa082"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:27.601650 13998 raft_consensus.cc:606] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:27.603586  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 13:20:27.603622 13964 consensus_peers.cc:597] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:20:27.604372  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:27.605151  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:27.608081 14158 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.608959 14158 tablet_bootstrap.cc:492] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.609440 14158 ts_tablet_manager.cc:1403] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:20:27.611248 14158 raft_consensus.cc:359] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.611720 14158 raft_consensus.cc:740] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.612275 14158 consensus_queue.cc:260] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.612973 13746 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35374
I20260709 13:20:27.613879 14158 ts_tablet_manager.cc:1434] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:27.614671 14158 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.616505 14222 heartbeater.cc:499] Master 127.2.200.254:35059 was elected leader, sending a full tablet report...
I20260709 13:20:27.627030 14158 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.628042 14158 tablet_bootstrap.cc:492] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.628690 14158 ts_tablet_manager.cc:1403] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:20:27.630555 14158 raft_consensus.cc:359] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.631067 14158 raft_consensus.cc:385] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:27.631316 14158 raft_consensus.cc:740] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.631896 14158 consensus_queue.cc:260] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.633369 14158 ts_tablet_manager.cc:1434] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:27.634128 14158 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Bootstrap starting.
I20260709 13:20:27.644886 14158 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:20:27.645699 14158 tablet_bootstrap.cc:492] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Bootstrap complete.
I20260709 13:20:27.646550 14158 ts_tablet_manager.cc:1403] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:20:27.648974 14158 raft_consensus.cc:359] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.649466 14158 raft_consensus.cc:740] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5d61903be094928a2734135c78bfc38, State: Initialized, Role: FOLLOWER
I20260709 13:20:27.650005 14158 consensus_queue.cc:260] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:27.651671 14158 ts_tablet_manager.cc:1434] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:27.653090 14194 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:27.678894 14194 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.225836 14141 raft_consensus.cc:993] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:28.226475 14141 raft_consensus.cc:1081] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
W20260709 13:20:28.229308 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:28.229804 13923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b77b1535c9a745959ace811c22343da1"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:28.230636 13923 raft_consensus.cc:493] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.231072 13923 raft_consensus.cc:3060] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.250124 13923 raft_consensus.cc:515] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.252429 13923 leader_election.cc:290] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:28.254688 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:28.257437 13998 raft_consensus.cc:3055] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:28.257799 13998 raft_consensus.cc:740] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:28.260259 13998 consensus_queue.cc:260] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.312500 14141 raft_consensus.cc:993] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:28.322710 14160 raft_consensus.cc:493] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:28.325107 13998 raft_consensus.cc:3060] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.343942 13998 raft_consensus.cc:2468] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:28.350859 14188 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b77b1535c9a745959ace811c22343da1" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:28.351137 13890 leader_election.cc:304] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:28.351840 14188 raft_consensus.cc:3060] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.352084 14047 raft_consensus.cc:2804] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:28.352731 14047 raft_consensus.cc:697] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:28.327358 14160 raft_consensus.cc:515] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.355880 14141 raft_consensus.cc:993] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:28.356436 14141 raft_consensus.cc:1081] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:28.358625 13922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:28.359192 13922 raft_consensus.cc:493] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.355875 14047 consensus_queue.cc:237] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.359746 13922 raft_consensus.cc:3060] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.365097 14191 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.365391 14190 raft_consensus.cc:3060] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:28.367621 14160 leader_election.cc:290] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:28.365104 14239 raft_consensus.cc:1081] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:28.377192 13924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de1ba631650848269a3b412eb33fa082"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:28.376960 13922 raft_consensus.cc:515] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.377799 13924 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.378232 13924 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.379283 13922 leader_election.cc:290] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:28.380455 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:28.381242 13998 raft_consensus.cc:3055] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:28.381574 13998 raft_consensus.cc:740] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:28.382498 13998 consensus_queue.cc:260] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.383632 13998 raft_consensus.cc:3060] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.386358 13924 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.386845 13747 catalog_manager.cc:5697] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 1 to 2, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:28.390153 13924 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 3 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:28.390420 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:28.391142 13996 raft_consensus.cc:3055] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:28.391474 13996 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:28.392334 13996 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.393998 13996 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.392455 14188 raft_consensus.cc:2468] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:28.402359 13996 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 3.
I20260709 13:20:28.408555 13890 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:28.409477 14047 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:28.410058 14047 raft_consensus.cc:697] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:28.410935 14047 consensus_queue.cc:237] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.425300 13998 raft_consensus.cc:2468] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:28.430275 13890 leader_election.cc:304] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:28.431187 14047 raft_consensus.cc:2804] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:28.432130 14047 raft_consensus.cc:697] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:28.433153 14047 consensus_queue.cc:237] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.434569 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bca3db3c481482d82efc43ff5ae3c6c" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:28.435202 14190 raft_consensus.cc:3060] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:28.434654 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:28.442515 14194 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:28.454198 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b59180b0156f41ca8fb678a29b0815ff" is_pre_election: true
I20260709 13:20:28.454838 14194 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 3.
I20260709 13:20:28.455893 14190 raft_consensus.cc:2468] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:28.456456 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "c5d61903be094928a2734135c78bfc38" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" is_pre_election: true
I20260709 13:20:28.458002 14155 leader_election.cc:304] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c5d61903be094928a2734135c78bfc38; no voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:28.458702 14160 raft_consensus.cc:2749] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:28.465458 13746 catalog_manager.cc:5697] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 2 to 3, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:28.466713 13746 catalog_manager.cc:5697] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 1 to 2, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:28.669315  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.678521 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3929623d2d02465a8838f133336d7585"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:28.679129 13998 raft_consensus.cc:606] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:28.691409 13922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
mode: GRACEFUL
new_leader_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:33220
I20260709 13:20:28.692167 13922 raft_consensus.cc:606] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Received request to transfer leadership to TS b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:28.695536 13922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de1ba631650848269a3b412eb33fa082"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
mode: GRACEFUL
new_leader_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:33220
I20260709 13:20:28.696178 13922 raft_consensus.cc:606] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Received request to transfer leadership to TS b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:28.697619  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:28.698208  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:28.698778  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:28.742575 14194 raft_consensus.cc:1275] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.743804 14047 consensus_queue.cc:1048] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.755203 13998 raft_consensus.cc:1275] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.757243 14047 consensus_queue.cc:1048] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.838143 14194 raft_consensus.cc:1275] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.839636 14047 consensus_queue.cc:1048] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:28.850145 13998 raft_consensus.cc:1275] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:28.853585 14240 consensus_queue.cc:1048] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:28.910300 13998 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:28.911912 14240 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:28.919214 14242 raft_consensus.cc:993] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: : Instructing follower b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:28.919762 14047 raft_consensus.cc:1081] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Signalling peer b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:28.921401 13996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de1ba631650848269a3b412eb33fa082"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:43054
I20260709 13:20:28.922200 13996 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:28.922583 13996 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:28.924321 14194 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:28.925771 14047 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:28.930192 13996 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.932734 13996 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 4 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:28.934278 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:28.934397 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:28.934911 13922 raft_consensus.cc:3055] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:28.935194 14194 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:28.935509 13922 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:28.936457 13922 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.937707 13922 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:28.943100 13922 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 4.
I20260709 13:20:28.943492 14194 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 4.
I20260709 13:20:28.944211 13964 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:28.945433 14243 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:28.945904 14243 raft_consensus.cc:697] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:28.946794 14243 consensus_queue.cc:237] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:28.954814 13746 catalog_manager.cc:5697] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 3 to 4, leader changed from 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 4 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:29.116312 14232 raft_consensus.cc:993] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:29.116845 14243 raft_consensus.cc:1081] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
W20260709 13:20:29.117027 13778 debug-util.cc:398] Leaking SignalData structure 0x7b0800024280 after lost signal to thread 2854
W20260709 13:20:29.118515 13778 debug-util.cc:398] Leaking SignalData structure 0x7b08001af620 after lost signal to thread 13781
I20260709 13:20:29.118561 13922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3929623d2d02465a8838f133336d7585"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:29.119503 13922 raft_consensus.cc:493] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.119925 13922 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:29.122578 13778 debug-util.cc:398] Leaking SignalData structure 0x7b080025bd20 after lost signal to thread 14219
I20260709 13:20:29.126681 13922 raft_consensus.cc:515] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:29.129534 13922 leader_election.cc:290] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:29.130342 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:29.130708 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:29.131466 14194 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.131562 13996 raft_consensus.cc:3055] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.132351 13996 raft_consensus.cc:740] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:29.133512 13996 consensus_queue.cc:260] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:29.135004 13996 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.139190 14194 raft_consensus.cc:2468] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:29.140548 13890 leader_election.cc:304] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:29.141660 14242 raft_consensus.cc:2804] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.142179 14242 raft_consensus.cc:697] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:29.143031 14242 consensus_queue.cc:237] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:29.145238 13996 raft_consensus.cc:2468] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:29.147243 14047 raft_consensus.cc:993] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: : Instructing follower b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:29.148825 14240 raft_consensus.cc:1081] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Signalling peer b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:29.152379 13998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:43054
I20260709 13:20:29.153101 13998 raft_consensus.cc:493] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.153507 13998 raft_consensus.cc:3060] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.155601 13746 catalog_manager.cc:5697] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 1 to 2, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:29.161158 13998 raft_consensus.cc:515] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:29.163305 13998 leader_election.cc:290] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:29.164783 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:29.165230 13922 raft_consensus.cc:3055] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:29.165485 13922 raft_consensus.cc:740] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:29.165987 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2f80638fa9f4e1eb2f5bd5b1e03bd37" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:29.166118 13922 consensus_queue.cc:260] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:29.166694 14194 raft_consensus.cc:3060] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.167618 13922 raft_consensus.cc:3060] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:29.174322 13922 raft_consensus.cc:2468] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:29.175673 13964 leader_election.cc:304] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:29.176685 14243 raft_consensus.cc:2804] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:29.177500 14243 raft_consensus.cc:697] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:29.177775 14194 raft_consensus.cc:2468] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:29.178380 14243 consensus_queue.cc:237] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:29.186654 13746 catalog_manager.cc:5697] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 1 to 2, leader changed from 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 2 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:29.230415 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:29.405725 13922 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:29.406960 14243 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:29.422079 14194 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:29.424398 14243 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:29.674444 14194 raft_consensus.cc:1275] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.675586 13998 raft_consensus.cc:1275] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.676375 14243 consensus_queue.cc:1048] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:29.677649 14271 consensus_queue.cc:1048] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:29.689810 13922 raft_consensus.cc:1275] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.700589 14232 consensus_queue.cc:1048] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.707046  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:29.725215 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:29.725860 13998 raft_consensus.cc:606] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:29.728740 14194 raft_consensus.cc:1275] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:29.731058 14278 consensus_queue.cc:1048] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:29.735359 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:29.736078 13998 raft_consensus.cc:606] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:29.739630 13922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
mode: GRACEFUL
new_leader_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:33220
I20260709 13:20:29.740167 13922 raft_consensus.cc:606] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Received request to transfer leadership to TS b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:29.741647  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:29.742728  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:29.743793  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:29.790666 14232 raft_consensus.cc:993] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:29.791257 14276 raft_consensus.cc:1081] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:29.792817 13922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:29.793263 13922 raft_consensus.cc:493] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:29.793516 13922 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:29.798329 13922 raft_consensus.cc:515] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:29.800696 13922 leader_election.cc:290] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 3 election: Requested vote from peers b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205), c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167)
I20260709 13:20:29.800735 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:29.801443 13998 raft_consensus.cc:3055] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:29.801757 13998 raft_consensus.cc:740] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:29.802547 13998 consensus_queue.cc:260] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:29.803369 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d7c31df5e5a44f0b73052328097db6c" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:29.803661 13998 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:29.804086 14194 raft_consensus.cc:3060] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:29.811209 13998 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 3.
I20260709 13:20:29.811465 14194 raft_consensus.cc:2468] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 3.
I20260709 13:20:29.812431 13890 leader_election.cc:304] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, b59180b0156f41ca8fb678a29b0815ff; no voters: 
I20260709 13:20:29.813114 14242 raft_consensus.cc:2804] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:29.813611 14242 raft_consensus.cc:697] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:29.814394 14242 consensus_queue.cc:237] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } }
I20260709 13:20:29.821738 13746 catalog_manager.cc:5697] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 2 to 3, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.182255 14232 raft_consensus.cc:993] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:30.182830 14276 raft_consensus.cc:1081] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:30.184603 13922 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:30.185070 13922 raft_consensus.cc:493] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.185318 13922 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.191295 13922 raft_consensus.cc:515] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:30.193195 13922 leader_election.cc:290] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 3 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:30.194543 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:30.196218 13998 raft_consensus.cc:3055] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:30.196590 13998 raft_consensus.cc:740] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:30.196535 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:30.199108 14194 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.197506 13998 consensus_queue.cc:260] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:30.203394 13998 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.206149 14194 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 3.
I20260709 13:20:30.207237 13890 leader_election.cc:304] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:30.207963 14271 raft_consensus.cc:2804] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:30.208331 14271 raft_consensus.cc:697] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:30.209142 14271 consensus_queue.cc:237] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:30.210829 13998 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 3.
I20260709 13:20:30.216626 13746 catalog_manager.cc:5697] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 2 to 3, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
W20260709 13:20:30.231781 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:30.247016 14242 raft_consensus.cc:993] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: : Instructing follower b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:30.247862 14271 raft_consensus.cc:1081] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Signalling peer b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:30.249518 13998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:43054
I20260709 13:20:30.250144 13998 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:30.250505 13998 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.261322 13998 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:30.263427 13998 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 3 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:30.264452 13922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:30.264827 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:30.265110 13922 raft_consensus.cc:3055] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:30.265403 14194 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.265431 13922 raft_consensus.cc:740] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:30.266407 13922 consensus_queue.cc:260] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:30.267797 13922 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:30.273005 14194 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 3.
I20260709 13:20:30.274139 13964 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:30.274915 14276 raft_consensus.cc:2804] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:30.275398 14276 raft_consensus.cc:697] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:30.276189 14276 consensus_queue.cc:237] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:30.276672 13922 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 3.
I20260709 13:20:30.283710 13746 catalog_manager.cc:5697] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 2 to 3, leader changed from 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 3 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:30.295089 14190 raft_consensus.cc:1275] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:30.296407 14271 consensus_queue.cc:1048] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.308140 13998 raft_consensus.cc:1275] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:30.313412 14271 consensus_queue.cc:1048] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.670114 14190 raft_consensus.cc:1275] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:30.671800 14276 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.684703 13922 raft_consensus.cc:1275] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:30.688985 14276 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:30.757153  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.766142 13922 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3929623d2d02465a8838f133336d7585"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
mode: GRACEFUL
new_leader_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:33220
I20260709 13:20:30.766762 13922 raft_consensus.cc:606] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Received request to transfer leadership to TS b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:30.769563 13924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
mode: GRACEFUL
new_leader_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:33220
I20260709 13:20:30.770177 13924 raft_consensus.cc:606] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Received request to transfer leadership to TS b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:30.773003 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:30.773597 13998 raft_consensus.cc:606] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:30.775009  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:30.775647  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:30.776356  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:30.813220 13998 raft_consensus.cc:1275] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:30.815512 14271 consensus_queue.cc:1048] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:30.823608 14190 raft_consensus.cc:1275] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:30.825742 14296 consensus_queue.cc:1048] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:31.094193 14297 raft_consensus.cc:993] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: : Instructing follower b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:31.094825 14299 raft_consensus.cc:1081] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Signalling peer b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:31.096694 13996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:43054
I20260709 13:20:31.097400 13996 raft_consensus.cc:493] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.097792 13996 raft_consensus.cc:3060] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.103197 13996 raft_consensus.cc:515] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.104867 13996 leader_election.cc:290] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:31.105629 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:31.105931 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5e9a88861274cd48b4346ea3601bdbc" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:31.106354 14190 raft_consensus.cc:3060] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.106549 13924 raft_consensus.cc:3055] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:31.106911 13924 raft_consensus.cc:740] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:31.107669 13924 consensus_queue.cc:260] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.108700 13924 raft_consensus.cc:3060] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:31.113685 14190 raft_consensus.cc:2468] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:31.115121 13964 leader_election.cc:304] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:31.115694 13924 raft_consensus.cc:2468] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 2.
I20260709 13:20:31.115981 14276 raft_consensus.cc:2804] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:31.116532 14276 raft_consensus.cc:697] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:31.117398 14276 consensus_queue.cc:237] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.125869 13744 catalog_manager.cc:5697] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 1 to 2, leader changed from 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 2 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:31.127934 14232 raft_consensus.cc:993] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:31.128456 14276 raft_consensus.cc:1081] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:31.129966 13924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:31.130508 13924 raft_consensus.cc:493] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.130864 13924 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:31.137936 13924 raft_consensus.cc:515] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.140754 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:31.141371 14190 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:31.141950 13996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde16174377d4429bc4f4a6966a810ef" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:31.142562 13996 raft_consensus.cc:3055] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:31.142858 13996 raft_consensus.cc:740] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:31.143715 13996 consensus_queue.cc:260] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.145107 13996 raft_consensus.cc:3060] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:31.147810 14190 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 4.
I20260709 13:20:31.148788 13924 leader_election.cc:290] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 4 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:31.149026 13890 leader_election.cc:304] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:31.149827 14299 raft_consensus.cc:2804] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:31.150192 14299 raft_consensus.cc:697] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:31.150799 14299 consensus_queue.cc:237] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.155706 13996 raft_consensus.cc:2468] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 4.
I20260709 13:20:31.158627 13744 catalog_manager.cc:5697] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 3 to 4, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 4 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:31.177767 14298 raft_consensus.cc:993] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: : Instructing follower b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:31.178350 14299 raft_consensus.cc:1081] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Signalling peer b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:31.179893 13996 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3929623d2d02465a8838f133336d7585"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:43054
I20260709 13:20:31.180367 13996 raft_consensus.cc:493] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.180653 13996 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.185873 13996 raft_consensus.cc:515] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.187819 13996 leader_election.cc:290] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 3 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:31.188596 14190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:31.188869 13924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3929623d2d02465a8838f133336d7585" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:31.189162 14190 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.189510 13924 raft_consensus.cc:3055] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:31.189869 13924 raft_consensus.cc:740] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:31.190662 13924 consensus_queue.cc:260] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.191794 13924 raft_consensus.cc:3060] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:31.194546 14190 raft_consensus.cc:2468] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 3.
I20260709 13:20:31.195641 13964 leader_election.cc:304] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:31.196355 14276 raft_consensus.cc:2804] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:31.196748 14276 raft_consensus.cc:697] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:31.197548 14276 consensus_queue.cc:237] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.199187 13924 raft_consensus.cc:2468] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 3.
I20260709 13:20:31.205390 13744 catalog_manager.cc:5697] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 2 to 3, leader changed from 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 3 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
W20260709 13:20:31.232969 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:31.698639 14190 raft_consensus.cc:1275] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:31.700345 14276 consensus_queue.cc:1048] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:31.704744 14194 raft_consensus.cc:1275] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.706424 14307 consensus_queue.cc:1048] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:31.715600 13924 raft_consensus.cc:1275] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:31.717885 14307 consensus_queue.cc:1048] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:31.754359 14194 raft_consensus.cc:1275] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:31.760241 14299 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:20:31.766775 13922 raft_consensus.cc:1275] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:31.776997 14311 consensus_queue.cc:1048] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:31.777298 13996 raft_consensus.cc:1275] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:20:31.786180  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:31.789233 14299 consensus_queue.cc:1048] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 13:20:31.828974 13924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
mode: GRACEFUL
new_leader_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:33220
I20260709 13:20:31.829850 13924 raft_consensus.cc:606] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Received request to transfer leadership to TS b59180b0156f41ca8fb678a29b0815ff
I20260709 13:20:31.835456 13996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de1ba631650848269a3b412eb33fa082"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:31.836174 13996 raft_consensus.cc:606] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:31.841848 13998 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
mode: GRACEFUL
new_leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:44066
I20260709 13:20:31.842808 13998 raft_consensus.cc:606] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Received request to transfer leadership to TS 32aec9b0ab6f48acbf9588e8a36fce48
I20260709 13:20:31.844893  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:20:31.845976  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:31.847065  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:31.867601 14299 raft_consensus.cc:993] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: : Instructing follower b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:31.868620 14324 raft_consensus.cc:1081] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Signalling peer b59180b0156f41ca8fb678a29b0815ff to start an election
I20260709 13:20:31.870229 13998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911"
dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
 from {username='slave'} at 127.0.0.1:43054
I20260709 13:20:31.870838 13998 raft_consensus.cc:493] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:31.871236 13998 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:31.879043 13998 raft_consensus.cc:515] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.881299 13998 leader_election.cc:290] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 4 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343)
I20260709 13:20:31.883872 13923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
I20260709 13:20:31.884713 13923 raft_consensus.cc:3055] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:20:31.884629 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf8d79643d7d43c5893cd4385c145911" candidate_uuid: "b59180b0156f41ca8fb678a29b0815ff" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:31.885442 13923 raft_consensus.cc:740] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:31.885972 14194 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:31.886850 13923 consensus_queue.cc:260] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.888747 13923 raft_consensus.cc:3060] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:20:31.896001 14194 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 4.
I20260709 13:20:31.898193 13964 leader_election.cc:304] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b59180b0156f41ca8fb678a29b0815ff, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:31.899041 13923 raft_consensus.cc:2468] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b59180b0156f41ca8fb678a29b0815ff in term 4.
I20260709 13:20:31.899290 14311 raft_consensus.cc:2804] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:20:31.900156 14311 raft_consensus.cc:697] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Becoming Leader. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:31.901721 14311 consensus_queue.cc:237] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:31.910714 13746 catalog_manager.cc:5697] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff reported cstate change: term changed from 3 to 4, leader changed from 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194) to b59180b0156f41ca8fb678a29b0815ff (127.2.200.195). New cstate: current_term: 4 leader_uuid: "b59180b0156f41ca8fb678a29b0815ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:32.208952 14315 raft_consensus.cc:993] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:32.209450 14311 raft_consensus.cc:1081] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:32.211325 13923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:32.211822 13923 raft_consensus.cc:493] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.212128 13923 raft_consensus.cc:3060] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:32.217958 13923 raft_consensus.cc:515] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:32.219729 13923 leader_election.cc:290] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:32.220613 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:32.221017 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eea1cada60a14052a0a9afbd9284ebc5" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:32.222087 14194 raft_consensus.cc:3060] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:32.227244 13998 raft_consensus.cc:3055] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:32.227705 13998 raft_consensus.cc:740] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:32.228930 13998 consensus_queue.cc:260] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:32.230425 13998 raft_consensus.cc:3060] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:32.233677 14315 raft_consensus.cc:993] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: : Instructing follower 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
I20260709 13:20:32.234256 14315 raft_consensus.cc:1081] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Signalling peer 32aec9b0ab6f48acbf9588e8a36fce48 to start an election
W20260709 13:20:32.234490 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:32.236194 13923 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de1ba631650848269a3b412eb33fa082"
dest_uuid: "32aec9b0ab6f48acbf9588e8a36fce48"
 from {username='slave'} at 127.0.0.1:47900
I20260709 13:20:32.236635 14194 raft_consensus.cc:2468] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:32.236864 13923 raft_consensus.cc:493] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:32.237371 13923 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:32.238047 13890 leader_election.cc:304] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:32.238936 14299 raft_consensus.cc:2804] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:32.239457 14299 raft_consensus.cc:697] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:32.240809 14299 consensus_queue.cc:237] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:32.247151 13923 raft_consensus.cc:515] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:32.249507 13923 leader_election.cc:290] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 5 election: Requested vote from peers c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167), b59180b0156f41ca8fb678a29b0815ff (127.2.200.195:34205)
I20260709 13:20:32.249776 13998 raft_consensus.cc:2468] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 2.
I20260709 13:20:32.251729 14194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c5d61903be094928a2734135c78bfc38"
I20260709 13:20:32.251976 13998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1ba631650848269a3b412eb33fa082" candidate_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b59180b0156f41ca8fb678a29b0815ff"
I20260709 13:20:32.253069 13998 raft_consensus.cc:3055] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:20:32.253412 13998 raft_consensus.cc:740] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b59180b0156f41ca8fb678a29b0815ff, State: Running, Role: LEADER
I20260709 13:20:32.253547 14194 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:32.254598 13998 consensus_queue.cc:260] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:32.256429 13998 raft_consensus.cc:3060] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:20:32.257792 13746 catalog_manager.cc:5697] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 1 to 2, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.261112 14194 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 5.
I20260709 13:20:32.262801 13890 leader_election.cc:304] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32aec9b0ab6f48acbf9588e8a36fce48, c5d61903be094928a2734135c78bfc38; no voters: 
I20260709 13:20:32.263911 14299 raft_consensus.cc:2804] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:20:32.264392 14299 raft_consensus.cc:697] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 5 LEADER]: Becoming Leader. State: Replica: 32aec9b0ab6f48acbf9588e8a36fce48, State: Running, Role: LEADER
I20260709 13:20:32.264451 13998 raft_consensus.cc:2468] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32aec9b0ab6f48acbf9588e8a36fce48 in term 5.
I20260709 13:20:32.265699 14299 consensus_queue.cc:237] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } }
I20260709 13:20:32.275492 13746 catalog_manager.cc:5697] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 reported cstate change: term changed from 4 to 5, leader changed from b59180b0156f41ca8fb678a29b0815ff (127.2.200.195) to 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194). New cstate: current_term: 5 leader_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:32.371630 14194 raft_consensus.cc:1275] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:32.372937 14311 consensus_queue.cc:1048] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:32.384135 13923 raft_consensus.cc:1275] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Refusing update from remote peer b59180b0156f41ca8fb678a29b0815ff: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:20:32.386271 14311 consensus_queue.cc:1048] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "32aec9b0ab6f48acbf9588e8a36fce48" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 46343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:32.731153 14194 raft_consensus.cc:1275] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:32.733191 14299 consensus_queue.cc:1048] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:32.744138 13998 raft_consensus.cc:1275] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:32.745671 13998 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 5 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:32.746096 14338 consensus_queue.cc:1048] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:32.747488 14338 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b59180b0156f41ca8fb678a29b0815ff" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 34205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:32.764478 14194 raft_consensus.cc:1275] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 5 FOLLOWER]: Refusing update from remote peer 32aec9b0ab6f48acbf9588e8a36fce48: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:20:32.766472 14338 consensus_queue.cc:1048] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5d61903be094928a2734135c78bfc38" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 36167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:20:32.858117  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:32.892268  2851 tablet_server.cc:179] TabletServer@127.2.200.193:36167 shutting down...
I20260709 13:20:32.919845  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:32.920658  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.921558  2851 raft_consensus.cc:2243] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.922106  2851 raft_consensus.cc:2272] T 7bca3db3c481482d82efc43ff5ae3c6c P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.924631  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.925364  2851 raft_consensus.cc:2243] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.925799  2851 raft_consensus.cc:2272] T c5e9a88861274cd48b4346ea3601bdbc P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.928086  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.928658  2851 raft_consensus.cc:2243] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.929168  2851 raft_consensus.cc:2272] T b77b1535c9a745959ace811c22343da1 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.931450  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.932025  2851 raft_consensus.cc:2243] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.932475  2851 raft_consensus.cc:2272] T bf8d79643d7d43c5893cd4385c145911 P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.936493  2851 tablet_replica.cc:333] stopping tablet replica
W20260709 13:20:32.937196 13890 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 86 similar messages]
I20260709 13:20:32.937359  2851 raft_consensus.cc:2243] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.938232  2851 raft_consensus.cc:2272] T eea1cada60a14052a0a9afbd9284ebc5 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:32.940898 13890 consensus_peers.cc:597] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:32.942098  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.942909  2851 raft_consensus.cc:2243] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.943578  2851 raft_consensus.cc:2272] T fde16174377d4429bc4f4a6966a810ef P c5d61903be094928a2734135c78bfc38 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.946172  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.946683  2851 raft_consensus.cc:2243] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.947075  2851 raft_consensus.cc:2272] T 3929623d2d02465a8838f133336d7585 P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.950120  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.950649  2851 raft_consensus.cc:2243] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.951109  2851 raft_consensus.cc:2272] T de1ba631650848269a3b412eb33fa082 P c5d61903be094928a2734135c78bfc38 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.953962  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.954459  2851 raft_consensus.cc:2243] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.954948  2851 raft_consensus.cc:2272] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P c5d61903be094928a2734135c78bfc38 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.957322  2851 tablet_replica.cc:333] stopping tablet replica
I20260709 13:20:32.957837  2851 raft_consensus.cc:2243] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:32.958302  2851 raft_consensus.cc:2272] T 2d7c31df5e5a44f0b73052328097db6c P c5d61903be094928a2734135c78bfc38 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:32.994115  2851 tablet_server.cc:196] TabletServer@127.2.200.193:36167 shutdown complete.
W20260709 13:20:32.997349 13890 consensus_peers.cc:597] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:33.018533 13964 consensus_peers.cc:597] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.028273  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
I20260709 13:20:33.057301  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.058283  2851 tablet_replica.cc:333] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.059183  2851 raft_consensus.cc:2243] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.060078  2851 raft_consensus.cc:2272] T eea1cada60a14052a0a9afbd9284ebc5 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.063431  2851 tablet_replica.cc:333] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.064044  2851 raft_consensus.cc:2243] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.065007  2851 raft_consensus.cc:2272] T fde16174377d4429bc4f4a6966a810ef P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.068446  2851 tablet_replica.cc:333] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.069501  2851 raft_consensus.cc:2243] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.070135  2851 raft_consensus.cc:2272] T c5e9a88861274cd48b4346ea3601bdbc P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.072738  2851 tablet_replica.cc:333] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.073329  2851 raft_consensus.cc:2243] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.074245  2851 raft_consensus.cc:2272] T 7bca3db3c481482d82efc43ff5ae3c6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.076676  2851 tablet_replica.cc:333] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.077267  2851 raft_consensus.cc:2243] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.077682  2851 raft_consensus.cc:2272] T 3929623d2d02465a8838f133336d7585 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.079667  2851 tablet_replica.cc:333] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.080163  2851 raft_consensus.cc:2243] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.080942  2851 raft_consensus.cc:2272] T de1ba631650848269a3b412eb33fa082 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.083631  2851 tablet_replica.cc:333] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.084167  2851 raft_consensus.cc:2243] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.085001  2851 raft_consensus.cc:2272] T 2d7c31df5e5a44f0b73052328097db6c P 32aec9b0ab6f48acbf9588e8a36fce48 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.087160  2851 tablet_replica.cc:333] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.087631  2851 raft_consensus.cc:2243] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.088081  2851 raft_consensus.cc:2272] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.090505  2851 tablet_replica.cc:333] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.091122  2851 raft_consensus.cc:2243] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.091593  2851 raft_consensus.cc:2272] T bf8d79643d7d43c5893cd4385c145911 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.095111  2851 tablet_replica.cc:333] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48: stopping tablet replica
I20260709 13:20:33.095656  2851 raft_consensus.cc:2243] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.096655  2851 raft_consensus.cc:2272] T b77b1535c9a745959ace811c22343da1 P 32aec9b0ab6f48acbf9588e8a36fce48 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.127630 13964 consensus_peers.cc:597] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff -> Peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Couldn't send request to peer 32aec9b0ab6f48acbf9588e8a36fce48. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:46343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.133682  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
W20260709 13:20:33.159933 13964 consensus_peers.cc:597] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff -> Peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Couldn't send request to peer 32aec9b0ab6f48acbf9588e8a36fce48. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:46343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.162750  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
I20260709 13:20:33.190593  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:33.191351  2851 tablet_replica.cc:333] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.192903  2851 raft_consensus.cc:2243] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.194388  2851 raft_consensus.cc:2272] T c5e9a88861274cd48b4346ea3601bdbc P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.197220  2851 tablet_replica.cc:333] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.197906  2851 raft_consensus.cc:2243] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.199000  2851 raft_consensus.cc:2272] T b2f80638fa9f4e1eb2f5bd5b1e03bd37 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.201682  2851 tablet_replica.cc:333] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.202294  2851 raft_consensus.cc:2243] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.202788  2851 raft_consensus.cc:2272] T 2d7c31df5e5a44f0b73052328097db6c P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.205973  2851 tablet_replica.cc:333] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.206615  2851 raft_consensus.cc:2243] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.207134  2851 raft_consensus.cc:2272] T fde16174377d4429bc4f4a6966a810ef P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.210276 13964 consensus_peers.cc:597] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff -> Peer c5d61903be094928a2734135c78bfc38 (127.2.200.193:36167): Couldn't send request to peer c5d61903be094928a2734135c78bfc38. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:36167: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.210472  2851 tablet_replica.cc:333] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.211400  2851 raft_consensus.cc:2243] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.211853  2851 raft_consensus.cc:2272] T eea1cada60a14052a0a9afbd9284ebc5 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.215041  2851 tablet_replica.cc:333] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.215812  2851 raft_consensus.cc:2243] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.216290  2851 raft_consensus.cc:2272] T de1ba631650848269a3b412eb33fa082 P b59180b0156f41ca8fb678a29b0815ff [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.217850 13964 consensus_peers.cc:597] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff -> Peer 32aec9b0ab6f48acbf9588e8a36fce48 (127.2.200.194:46343): Couldn't send request to peer 32aec9b0ab6f48acbf9588e8a36fce48. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:46343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:33.220162  2851 tablet_replica.cc:333] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.220887  2851 raft_consensus.cc:2243] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.221830  2851 raft_consensus.cc:2272] T 3929623d2d02465a8838f133336d7585 P b59180b0156f41ca8fb678a29b0815ff [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.223959  2851 tablet_replica.cc:333] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.224504  2851 raft_consensus.cc:2243] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.225013  2851 raft_consensus.cc:2272] T 7bca3db3c481482d82efc43ff5ae3c6c P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.227298  2851 tablet_replica.cc:333] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.227811  2851 raft_consensus.cc:2243] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.228617  2851 raft_consensus.cc:2272] T bf8d79643d7d43c5893cd4385c145911 P b59180b0156f41ca8fb678a29b0815ff [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.231588  2851 tablet_replica.cc:333] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff: stopping tablet replica
I20260709 13:20:33.232098  2851 raft_consensus.cc:2243] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:33.232534  2851 raft_consensus.cc:2272] T b77b1535c9a745959ace811c22343da1 P b59180b0156f41ca8fb678a29b0815ff [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:33.235581 13795 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:20:33.269968  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:20:33.299139  2851 master.cc:562] Master@127.2.200.254:35059 shutting down...
I20260709 13:20:33.321825  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:33.322409  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:33.322729  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P d0456b3d397e4e919b4b680eebf21ab7: stopping tablet replica
I20260709 13:20:33.363598  2851 master.cc:584] Master@127.2.200.254:35059 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13343 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:20:33.411978  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:36575
I20260709 13:20:33.413203  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:33.420015 14350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.420073 14349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.422639 14352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:33.423473  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:33.424363  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:33.424568  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:33.424714  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603233424701 us; error 0 us; skew 500 ppm
I20260709 13:20:33.425264  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:33.427613  2851 webserver.cc:533] Webserver started at http://127.2.200.254:33341/ using document root <none> and password file <none>
I20260709 13:20:33.428112  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:33.428287  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:33.428582  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:33.430392  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "d008b5fa79d145e48118cbd5c0b7bdb6"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.436088  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:33.440528 14357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.441468  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:33.441769  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "d008b5fa79d145e48118cbd5c0b7bdb6"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.442045  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:33.459651  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:33.461328  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:33.506290  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:36575
I20260709 13:20:33.506420 14408 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:36575 every 8 connection(s)
I20260709 13:20:33.510771 14409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:33.522686 14409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6: Bootstrap starting.
I20260709 13:20:33.527992 14409 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:33.533039 14409 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6: No bootstrap required, opened a new log
I20260709 13:20:33.535255 14409 raft_consensus.cc:359] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" member_type: VOTER }
I20260709 13:20:33.535638 14409 raft_consensus.cc:385] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:33.535820 14409 raft_consensus.cc:740] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d008b5fa79d145e48118cbd5c0b7bdb6, State: Initialized, Role: FOLLOWER
I20260709 13:20:33.536466 14409 consensus_queue.cc:260] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" member_type: VOTER }
I20260709 13:20:33.536922 14409 raft_consensus.cc:399] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:33.537168 14409 raft_consensus.cc:493] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:33.537743 14409 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:33.542956 14409 raft_consensus.cc:515] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" member_type: VOTER }
I20260709 13:20:33.543540 14409 leader_election.cc:304] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d008b5fa79d145e48118cbd5c0b7bdb6; no voters: 
I20260709 13:20:33.544709 14409 leader_election.cc:290] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:33.545107 14412 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:33.546453 14412 raft_consensus.cc:697] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 1 LEADER]: Becoming Leader. State: Replica: d008b5fa79d145e48118cbd5c0b7bdb6, State: Running, Role: LEADER
I20260709 13:20:33.547048 14412 consensus_queue.cc:237] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" member_type: VOTER }
I20260709 13:20:33.547578 14409 sys_catalog.cc:565] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:33.552146 14414 sys_catalog.cc:455] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d008b5fa79d145e48118cbd5c0b7bdb6. Latest consensus state: current_term: 1 leader_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" member_type: VOTER } }
I20260709 13:20:33.552953 14413 sys_catalog.cc:455] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d008b5fa79d145e48118cbd5c0b7bdb6" member_type: VOTER } }
I20260709 13:20:33.553560 14413 sys_catalog.cc:458] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:33.554443 14414 sys_catalog.cc:458] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:33.555725 14419 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:33.560984 14419 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:33.563884  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:33.569931 14419 catalog_manager.cc:1383] Generated new cluster ID: 6f0f5e583d964a9783b1ea47d727d2cb
I20260709 13:20:33.570247 14419 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:33.588369 14419 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:33.590021 14419 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:33.603644 14419 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6: Generated new TSK 0
I20260709 13:20:33.604229 14419 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:33.631503  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:33.638273 14430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.638841 14431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.642704 14433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:33.642840  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:33.644078  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:33.644321  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:33.644450  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603233644438 us; error 0 us; skew 500 ppm
I20260709 13:20:33.644961  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:33.647487  2851 webserver.cc:533] Webserver started at http://127.2.200.193:34483/ using document root <none> and password file <none>
I20260709 13:20:33.647933  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:33.648090  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:33.648298  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:33.649493  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "be5d35829b4d4d9baf52f93e03640f7a"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.653914  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:33.658288 14438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.659067  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:20:33.659360  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "be5d35829b4d4d9baf52f93e03640f7a"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.659618  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:33.682139  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:33.683669  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:33.685631  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:33.688194  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:33.688436  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.688664  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:33.688848  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:33.732682  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:38981
I20260709 13:20:33.732978 14500 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:38981 every 8 connection(s)
I20260709 13:20:33.738180  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:33.746490 14505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.748008 14506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:33.751358 14501 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36575
I20260709 13:20:33.751776 14501 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:33.752506  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:33.752542 14501 heartbeater.cc:507] Master 127.2.200.254:36575 requested a full tablet report, sending...
W20260709 13:20:33.752664 14508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:33.754113  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:33.754310  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:33.754513  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603233754492 us; error 0 us; skew 500 ppm
I20260709 13:20:33.755087  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:33.755080 14374 ts_manager.cc:194] Registered new tserver with Master: be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981)
I20260709 13:20:33.757392 14374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39222
I20260709 13:20:33.758177  2851 webserver.cc:533] Webserver started at http://127.2.200.194:44379/ using document root <none> and password file <none>
I20260709 13:20:33.758796  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:33.759020  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:33.759275  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:33.760963  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "b8eee019587f41aaaa1f0eaa574e7977"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.766543  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:20:33.770568 14513 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.771445  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:20:33.771740  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "b8eee019587f41aaaa1f0eaa574e7977"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.772015  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:33.787060  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:33.788306  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:33.790020  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:33.792222  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:33.792413  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.792631  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:33.792804  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:33.836086  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:45571
I20260709 13:20:33.836305 14575 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:45571 every 8 connection(s)
I20260709 13:20:33.841097  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:33.848990 14579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.850492 14580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:33.854136 14582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:33.854714 14576 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36575
I20260709 13:20:33.855290 14576 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:33.856211  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:33.856299 14576 heartbeater.cc:507] Master 127.2.200.254:36575 requested a full tablet report, sending...
I20260709 13:20:33.857584  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:33.857916  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:33.858148  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603233858125 us; error 0 us; skew 500 ppm
I20260709 13:20:33.859041  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:33.858984 14374 ts_manager.cc:194] Registered new tserver with Master: b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571)
I20260709 13:20:33.860989 14374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39238
I20260709 13:20:33.861778  2851 webserver.cc:533] Webserver started at http://127.2.200.195:42253/ using document root <none> and password file <none>
I20260709 13:20:33.862351  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:33.862550  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:33.862787  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:33.863889  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "a959bcfc3f5442368464808a7041d882"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.868422  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:20:33.872061 14587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.872992  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:33.873270  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "a959bcfc3f5442368464808a7041d882"
format_stamp: "Formatted at 2026-07-09 13:20:33 on dist-test-slave-108k"
I20260709 13:20:33.873533  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:33.902215  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:33.903756  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:33.905680  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:33.908169  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:33.908392  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:33.908646  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:33.908828  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:20:33.957996  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:43487
I20260709 13:20:33.958097 14649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:43487 every 8 connection(s)
I20260709 13:20:33.973858 14650 heartbeater.cc:344] Connected to a master server at 127.2.200.254:36575
I20260709 13:20:33.974330 14650 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:33.975165 14650 heartbeater.cc:507] Master 127.2.200.254:36575 requested a full tablet report, sending...
I20260709 13:20:33.977324 14374 ts_manager.cc:194] Registered new tserver with Master: a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:33.978425  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016397175s
I20260709 13:20:33.978678 14374 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39242
I20260709 13:20:34.006676 14374 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39250:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:34.009439 14374 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:34.075857 14615 tablet_service.cc:1511] Processing CreateTablet for tablet ffd5362057cd49a09bf4bd9640021774 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=001ed95a21fd400b8b52d617f11723dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.076205 14614 tablet_service.cc:1511] Processing CreateTablet for tablet a061d02b31db4f6f966c493440c6c0dc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=001ed95a21fd400b8b52d617f11723dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.077415 14615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd5362057cd49a09bf4bd9640021774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.079358 14540 tablet_service.cc:1511] Processing CreateTablet for tablet a061d02b31db4f6f966c493440c6c0dc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=001ed95a21fd400b8b52d617f11723dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.079911 14466 tablet_service.cc:1511] Processing CreateTablet for tablet ffd5362057cd49a09bf4bd9640021774 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=001ed95a21fd400b8b52d617f11723dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.080511 14614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a061d02b31db4f6f966c493440c6c0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.081431 14466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd5362057cd49a09bf4bd9640021774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.082140 14541 tablet_service.cc:1511] Processing CreateTablet for tablet ffd5362057cd49a09bf4bd9640021774 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=001ed95a21fd400b8b52d617f11723dd]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.080018 14465 tablet_service.cc:1511] Processing CreateTablet for tablet a061d02b31db4f6f966c493440c6c0dc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=001ed95a21fd400b8b52d617f11723dd]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.083701 14465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a061d02b31db4f6f966c493440c6c0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.084383 14540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a061d02b31db4f6f966c493440c6c0dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.093173 14541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffd5362057cd49a09bf4bd9640021774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.109388 14665 tablet_bootstrap.cc:492] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882: Bootstrap starting.
I20260709 13:20:34.116430 14666 tablet_bootstrap.cc:492] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: Bootstrap starting.
I20260709 13:20:34.119298 14665 tablet_bootstrap.cc:654] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.122457 14667 tablet_bootstrap.cc:492] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a: Bootstrap starting.
I20260709 13:20:34.123682 14666 tablet_bootstrap.cc:654] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.125658 14665 tablet_bootstrap.cc:492] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882: No bootstrap required, opened a new log
I20260709 13:20:34.126185 14665 ts_tablet_manager.cc:1403] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:20:34.129501 14666 tablet_bootstrap.cc:492] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: No bootstrap required, opened a new log
I20260709 13:20:34.129243 14665 raft_consensus.cc:359] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.129998 14665 raft_consensus.cc:385] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.130048 14666 ts_tablet_manager.cc:1403] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 13:20:34.130412 14665 raft_consensus.cc:740] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a959bcfc3f5442368464808a7041d882, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.131292 14667 tablet_bootstrap.cc:654] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.131443 14665 consensus_queue.cc:260] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.133584 14666 raft_consensus.cc:359] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.134305 14650 heartbeater.cc:499] Master 127.2.200.254:36575 was elected leader, sending a full tablet report...
I20260709 13:20:34.134572 14665 ts_tablet_manager.cc:1434] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:34.134377 14666 raft_consensus.cc:385] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.135094 14666 raft_consensus.cc:740] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.135867 14665 tablet_bootstrap.cc:492] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882: Bootstrap starting.
I20260709 13:20:34.135864 14666 consensus_queue.cc:260] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.145658 14665 tablet_bootstrap.cc:654] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.150907 14576 heartbeater.cc:499] Master 127.2.200.254:36575 was elected leader, sending a full tablet report...
I20260709 13:20:34.151309 14666 ts_tablet_manager.cc:1434] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: Time spent starting tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:20:34.152647 14666 tablet_bootstrap.cc:492] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: Bootstrap starting.
I20260709 13:20:34.156354 14671 raft_consensus.cc:493] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.157095 14667 tablet_bootstrap.cc:492] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a: No bootstrap required, opened a new log
I20260709 13:20:34.156970 14671 raft_consensus.cc:515] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.157835 14667 ts_tablet_manager.cc:1403] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.004s
I20260709 13:20:34.159166 14666 tablet_bootstrap.cc:654] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.161357 14667 raft_consensus.cc:359] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.162261 14667 raft_consensus.cc:385] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.162544 14667 raft_consensus.cc:740] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.163391 14667 consensus_queue.cc:260] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.165287 14665 tablet_bootstrap.cc:492] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882: No bootstrap required, opened a new log
I20260709 13:20:34.165967 14665 ts_tablet_manager.cc:1403] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.007s
I20260709 13:20:34.169732 14665 raft_consensus.cc:359] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.170573 14665 raft_consensus.cc:385] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.170905 14665 raft_consensus.cc:740] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a959bcfc3f5442368464808a7041d882, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.171659 14666 tablet_bootstrap.cc:492] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: No bootstrap required, opened a new log
I20260709 13:20:34.172339 14666 ts_tablet_manager.cc:1403] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 13:20:34.171864 14665 consensus_queue.cc:260] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.172741 14667 ts_tablet_manager.cc:1434] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:20:34.173496 14501 heartbeater.cc:499] Master 127.2.200.254:36575 was elected leader, sending a full tablet report...
I20260709 13:20:34.174728 14665 ts_tablet_manager.cc:1434] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:34.175498 14666 raft_consensus.cc:359] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.176476 14666 raft_consensus.cc:385] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.177346 14670 raft_consensus.cc:493] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.176743 14666 raft_consensus.cc:740] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.177870 14670 raft_consensus.cc:515] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.179157 14671 leader_election.cc:290] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487), be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981)
I20260709 13:20:34.183331 14670 leader_election.cc:290] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571)
I20260709 13:20:34.183804 14667 tablet_bootstrap.cc:492] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a: Bootstrap starting.
I20260709 13:20:34.200165 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882" is_pre_election: true
I20260709 13:20:34.201040 14625 raft_consensus.cc:2468] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 0.
I20260709 13:20:34.203329 14516 leader_election.cc:304] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977; no voters: 
I20260709 13:20:34.204370 14671 raft_consensus.cc:2804] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.205336 14671 raft_consensus.cc:493] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.205758 14671 raft_consensus.cc:3060] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.179062 14666 consensus_queue.cc:260] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.223254 14476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a" is_pre_election: true
I20260709 13:20:34.224251 14476 raft_consensus.cc:2468] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a959bcfc3f5442368464808a7041d882 in term 0.
I20260709 13:20:34.228579 14589 leader_election.cc:304] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:34.229763 14670 raft_consensus.cc:2804] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.230190 14670 raft_consensus.cc:493] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.230563 14670 raft_consensus.cc:3060] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.233099 14667 tablet_bootstrap.cc:654] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.230190 14666 ts_tablet_manager.cc:1434] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: Time spent starting tablet: real 0.058s	user 0.001s	sys 0.008s
I20260709 13:20:34.238984 14476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a" is_pre_election: true
I20260709 13:20:34.240097 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977" is_pre_election: true
I20260709 13:20:34.242343 14551 raft_consensus.cc:2468] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a959bcfc3f5442368464808a7041d882 in term 0.
W20260709 13:20:34.244333 14515 leader_election.cc:343] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:34.246308 14681 raft_consensus.cc:493] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.246948 14681 raft_consensus.cc:515] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.249221 14671 raft_consensus.cc:515] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.251797 14476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a" is_pre_election: true
I20260709 13:20:34.252589 14476 raft_consensus.cc:2468] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 0.
I20260709 13:20:34.254083 14515 leader_election.cc:304] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8eee019587f41aaaa1f0eaa574e7977, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:34.254994 14679 raft_consensus.cc:2804] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.255003 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:34.255743 14679 raft_consensus.cc:493] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.256166 14625 raft_consensus.cc:3060] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.256181 14679 raft_consensus.cc:3060] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.256724 14624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882" is_pre_election: true
I20260709 13:20:34.257529 14681 leader_election.cc:290] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.250866 14670 raft_consensus.cc:515] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.260017 14624 raft_consensus.cc:2393] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8eee019587f41aaaa1f0eaa574e7977 in current term 1: Already voted for candidate a959bcfc3f5442368464808a7041d882 in this term.
I20260709 13:20:34.261071 14667 tablet_bootstrap.cc:492] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a: No bootstrap required, opened a new log
I20260709 13:20:34.261927 14667 ts_tablet_manager.cc:1403] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.024s
I20260709 13:20:34.264972 14667 raft_consensus.cc:359] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.265488 14625 raft_consensus.cc:2468] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 1.
I20260709 13:20:34.265640 14667 raft_consensus.cc:385] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.265694 14679 raft_consensus.cc:515] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.266129 14476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
I20260709 13:20:34.266336 14667 raft_consensus.cc:740] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.267241 14516 leader_election.cc:304] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977; no voters: 
I20260709 13:20:34.267248 14667 consensus_queue.cc:260] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.268296 14476 raft_consensus.cc:3060] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.269114 14679 leader_election.cc:290] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 election: Requested vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.269002 14475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
I20260709 13:20:34.269562 14474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
I20260709 13:20:34.269747 14475 raft_consensus.cc:3060] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.269775 14679 raft_consensus.cc:2804] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:34.270516 14679 raft_consensus.cc:697] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Becoming Leader. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:34.271373 14679 consensus_queue.cc:237] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.272533 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
I20260709 13:20:34.273445 14551 raft_consensus.cc:2393] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a959bcfc3f5442368464808a7041d882 in current term 1: Already voted for candidate b8eee019587f41aaaa1f0eaa574e7977 in this term.
I20260709 13:20:34.274968 14591 leader_election.cc:304] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a959bcfc3f5442368464808a7041d882; no voters: b8eee019587f41aaaa1f0eaa574e7977, be5d35829b4d4d9baf52f93e03640f7a
I20260709 13:20:34.275161 14624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:34.276328 14624 raft_consensus.cc:2393] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8eee019587f41aaaa1f0eaa574e7977 in current term 1: Already voted for candidate a959bcfc3f5442368464808a7041d882 in this term.
I20260709 13:20:34.279110 14683 raft_consensus.cc:2749] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:34.279796 14476 raft_consensus.cc:2468] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 1.
I20260709 13:20:34.281051 14671 leader_election.cc:290] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 election: Requested vote from peers a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487), be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981)
I20260709 13:20:34.281916 14475 raft_consensus.cc:2468] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 1.
I20260709 13:20:34.282367 14667 ts_tablet_manager.cc:1434] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:20:34.282666 14670 leader_election.cc:290] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 election: Requested vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571)
I20260709 13:20:34.284410 14515 leader_election.cc:304] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8eee019587f41aaaa1f0eaa574e7977, be5d35829b4d4d9baf52f93e03640f7a; no voters: a959bcfc3f5442368464808a7041d882
I20260709 13:20:34.287223 14679 raft_consensus.cc:2804] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:34.287732 14679 raft_consensus.cc:697] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Becoming Leader. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:34.288555 14679 consensus_queue.cc:237] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.289821 14374 catalog_manager.cc:5697] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8eee019587f41aaaa1f0eaa574e7977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.302930 14373 catalog_manager.cc:5697] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8eee019587f41aaaa1f0eaa574e7977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.337618 14373 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39264:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:34.340026 14373 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:34.364945 14465 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd14068a8cd4c99beaeae532fbd7688 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a5ce79ca8c7d4c91919a52f28d02684d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.366199 14465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd14068a8cd4c99beaeae532fbd7688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.366029 14541 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd14068a8cd4c99beaeae532fbd7688 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a5ce79ca8c7d4c91919a52f28d02684d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.367326 14541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd14068a8cd4c99beaeae532fbd7688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.367409 14615 tablet_service.cc:1511] Processing CreateTablet for tablet 5cd14068a8cd4c99beaeae532fbd7688 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a5ce79ca8c7d4c91919a52f28d02684d]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:20:34.368639 14615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cd14068a8cd4c99beaeae532fbd7688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.370522 14466 tablet_service.cc:1511] Processing CreateTablet for tablet c36bc9a56ee146fda1edac94c72874c6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a5ce79ca8c7d4c91919a52f28d02684d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.371776 14466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36bc9a56ee146fda1edac94c72874c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.375054 14540 tablet_service.cc:1511] Processing CreateTablet for tablet c36bc9a56ee146fda1edac94c72874c6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a5ce79ca8c7d4c91919a52f28d02684d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.376365 14540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36bc9a56ee146fda1edac94c72874c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.383558 14666 tablet_bootstrap.cc:492] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977: Bootstrap starting.
I20260709 13:20:34.385622 14665 tablet_bootstrap.cc:492] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: Bootstrap starting.
I20260709 13:20:34.389989 14666 tablet_bootstrap.cc:654] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.392602 14614 tablet_service.cc:1511] Processing CreateTablet for tablet c36bc9a56ee146fda1edac94c72874c6 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=a5ce79ca8c7d4c91919a52f28d02684d]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:20:34.393321 14665 tablet_bootstrap.cc:654] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.393882 14614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36bc9a56ee146fda1edac94c72874c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:34.400391 14667 tablet_bootstrap.cc:492] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: Bootstrap starting.
I20260709 13:20:34.406823 14665 tablet_bootstrap.cc:492] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: No bootstrap required, opened a new log
I20260709 13:20:34.407419 14665 ts_tablet_manager.cc:1403] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.001s
I20260709 13:20:34.407974 14667 tablet_bootstrap.cc:654] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.410859 14665 raft_consensus.cc:359] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.411680 14665 raft_consensus.cc:385] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.411975 14665 raft_consensus.cc:740] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a959bcfc3f5442368464808a7041d882, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.412810 14665 consensus_queue.cc:260] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.415341 14665 ts_tablet_manager.cc:1434] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:34.415578 14666 tablet_bootstrap.cc:492] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977: No bootstrap required, opened a new log
I20260709 13:20:34.416195 14666 ts_tablet_manager.cc:1403] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.001s
I20260709 13:20:34.418926 14667 tablet_bootstrap.cc:492] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: No bootstrap required, opened a new log
I20260709 13:20:34.419536 14667 ts_tablet_manager.cc:1403] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.001s
I20260709 13:20:34.419765 14665 tablet_bootstrap.cc:492] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882: Bootstrap starting.
I20260709 13:20:34.419442 14666 raft_consensus.cc:359] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.420270 14666 raft_consensus.cc:385] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.420593 14666 raft_consensus.cc:740] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.421576 14666 consensus_queue.cc:260] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.423732 14667 raft_consensus.cc:359] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.424911 14667 raft_consensus.cc:385] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.425275 14667 raft_consensus.cc:740] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.426039 14667 consensus_queue.cc:260] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.427358 14666 ts_tablet_manager.cc:1434] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:34.428431 14666 tablet_bootstrap.cc:492] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: Bootstrap starting.
I20260709 13:20:34.428894 14665 tablet_bootstrap.cc:654] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.431404 14667 ts_tablet_manager.cc:1434] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:20:34.432616 14667 tablet_bootstrap.cc:492] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: Bootstrap starting.
I20260709 13:20:34.433012 14670 raft_consensus.cc:493] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.433509 14670 raft_consensus.cc:515] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.435525 14670 leader_election.cc:290] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571)
I20260709 13:20:34.436360 14475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a" is_pre_election: true
I20260709 13:20:34.437716 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977" is_pre_election: true
I20260709 13:20:34.438457 14551 raft_consensus.cc:2468] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a959bcfc3f5442368464808a7041d882 in term 0.
I20260709 13:20:34.440133 14667 tablet_bootstrap.cc:654] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.441486 14591 leader_election.cc:304] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977; no voters: 
I20260709 13:20:34.442457 14670 raft_consensus.cc:2804] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.442824 14670 raft_consensus.cc:493] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.443190 14670 raft_consensus.cc:3060] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:34.444870 14589 leader_election.cc:343] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:34.449791 14666 tablet_bootstrap.cc:654] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:34.455750 14670 raft_consensus.cc:515] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.456809 14665 tablet_bootstrap.cc:492] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882: No bootstrap required, opened a new log
I20260709 13:20:34.457485 14665 ts_tablet_manager.cc:1403] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.008s
I20260709 13:20:34.459285 14475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
W20260709 13:20:34.460923 14589 leader_election.cc:343] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:34.463024 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
I20260709 13:20:34.463824 14551 raft_consensus.cc:3060] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.463090 14665 raft_consensus.cc:359] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.465171 14665 raft_consensus.cc:385] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.465502 14665 raft_consensus.cc:740] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a959bcfc3f5442368464808a7041d882, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.466538 14666 tablet_bootstrap.cc:492] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: No bootstrap required, opened a new log
I20260709 13:20:34.466348 14665 consensus_queue.cc:260] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.467047 14667 tablet_bootstrap.cc:492] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: No bootstrap required, opened a new log
I20260709 13:20:34.467808 14667 ts_tablet_manager.cc:1403] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.014s
I20260709 13:20:34.467478 14666 ts_tablet_manager.cc:1403] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.016s
I20260709 13:20:34.468441 14665 ts_tablet_manager.cc:1434] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:20:34.463227 14670 leader_election.cc:290] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 election: Requested vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571)
I20260709 13:20:34.471033 14667 raft_consensus.cc:359] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.471750 14667 raft_consensus.cc:385] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.472038 14667 raft_consensus.cc:740] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.472829 14667 consensus_queue.cc:260] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.475122 14666 raft_consensus.cc:359] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.475839 14666 raft_consensus.cc:385] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:34.476125 14666 raft_consensus.cc:740] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Initialized, Role: FOLLOWER
I20260709 13:20:34.476894 14667 ts_tablet_manager.cc:1434] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:34.476145 14551 raft_consensus.cc:2468] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a959bcfc3f5442368464808a7041d882 in term 1.
I20260709 13:20:34.476925 14666 consensus_queue.cc:260] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.479532 14666 ts_tablet_manager.cc:1434] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:20:34.479813 14591 leader_election.cc:304] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977; no voters: be5d35829b4d4d9baf52f93e03640f7a
I20260709 13:20:34.480688 14670 raft_consensus.cc:2804] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:34.481371 14670 raft_consensus.cc:697] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 LEADER]: Becoming Leader. State: Replica: a959bcfc3f5442368464808a7041d882, State: Running, Role: LEADER
I20260709 13:20:34.482228 14670 consensus_queue.cc:237] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.492709 14373 catalog_manager.cc:5697] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 reported cstate change: term changed from 0 to 1, leader changed from <none> to a959bcfc3f5442368464808a7041d882 (127.2.200.195). New cstate: current_term: 1 leader_uuid: "a959bcfc3f5442368464808a7041d882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.505946 14679 raft_consensus.cc:493] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.506615 14679 raft_consensus.cc:515] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.508641 14679 leader_election.cc:290] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.509589 14475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a" is_pre_election: true
I20260709 13:20:34.509940 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882" is_pre_election: true
I20260709 13:20:34.510494 14475 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 0.
I20260709 13:20:34.510602 14625 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 0.
I20260709 13:20:34.511857 14516 leader_election.cc:304] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977; no voters: 
I20260709 13:20:34.512602 14679 raft_consensus.cc:2804] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:34.512931 14679 raft_consensus.cc:493] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:34.513221 14679 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.518666 14679 raft_consensus.cc:515] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.520375 14679 leader_election.cc:290] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 election: Requested vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.521063 14475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
I20260709 13:20:34.521385 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:34.521733 14475 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.521943 14625 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.530594 14625 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 1.
I20260709 13:20:34.530594 14475 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 1.
I20260709 13:20:34.532842 14515 leader_election.cc:304] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:34.533864 14679 raft_consensus.cc:2804] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:34.534674 14679 raft_consensus.cc:697] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Becoming Leader. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:34.535794 14679 consensus_queue.cc:237] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.545459 14373 catalog_manager.cc:5697] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "b8eee019587f41aaaa1f0eaa574e7977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.605281 14551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774"
dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
mode: GRACEFUL
new_leader_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
 from {username='slave'} at 127.0.0.1:53052
I20260709 13:20:34.605903 14551 raft_consensus.cc:606] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Received request to transfer leadership to TS be5d35829b4d4d9baf52f93e03640f7a
I20260709 13:20:34.612988 14551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc"
dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
mode: GRACEFUL
new_leader_uuid: "a959bcfc3f5442368464808a7041d882"
 from {username='slave'} at 127.0.0.1:53052
I20260709 13:20:34.613620 14551 raft_consensus.cc:606] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Received request to transfer leadership to TS a959bcfc3f5442368464808a7041d882
I20260709 13:20:34.627224 14625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688"
dest_uuid: "a959bcfc3f5442368464808a7041d882"
mode: GRACEFUL
new_leader_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
 from {username='slave'} at 127.0.0.1:58552
I20260709 13:20:34.627736 14625 raft_consensus.cc:606] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 LEADER]: Received request to transfer leadership to TS be5d35829b4d4d9baf52f93e03640f7a
I20260709 13:20:34.633237 14551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6"
dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
mode: GRACEFUL
new_leader_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
 from {username='slave'} at 127.0.0.1:53052
I20260709 13:20:34.633774 14551 raft_consensus.cc:606] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Received request to transfer leadership to TS be5d35829b4d4d9baf52f93e03640f7a
I20260709 13:20:34.700424 14675 raft_consensus.cc:493] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:34.701082 14675 raft_consensus.cc:515] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.703404 14675 leader_election.cc:290] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.714007 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977" is_pre_election: true
I20260709 13:20:34.715082 14551 raft_consensus.cc:2393] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate be5d35829b4d4d9baf52f93e03640f7a in current term 1: Already voted for candidate a959bcfc3f5442368464808a7041d882 in this term.
I20260709 13:20:34.717224 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a959bcfc3f5442368464808a7041d882" is_pre_election: true
I20260709 13:20:34.718729 14441 leader_election.cc:304] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: be5d35829b4d4d9baf52f93e03640f7a; no voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977
I20260709 13:20:34.719534 14675 raft_consensus.cc:3060] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:34.726308 14679 consensus_queue.cc:1048] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:34.726713 14675 raft_consensus.cc:2749] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:34.742337 14671 consensus_queue.cc:1048] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:34.749416 14679 raft_consensus.cc:993] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: : Instructing follower be5d35829b4d4d9baf52f93e03640f7a to start an election
I20260709 13:20:34.749881 14671 raft_consensus.cc:1081] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Signalling peer be5d35829b4d4d9baf52f93e03640f7a to start an election
I20260709 13:20:34.751332 14475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774"
dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
 from {username='slave'} at 127.0.0.1:47260
I20260709 13:20:34.751776 14475 raft_consensus.cc:493] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:34.752058 14475 raft_consensus.cc:3060] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.757603 14475 raft_consensus.cc:515] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.759447 14475 leader_election.cc:290] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 2 election: Requested vote from peers b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.760516 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:34.760989 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffd5362057cd49a09bf4bd9640021774" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
I20260709 13:20:34.761235 14625 raft_consensus.cc:3060] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.761634 14551 raft_consensus.cc:3055] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:34.761955 14551 raft_consensus.cc:740] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:34.762763 14551 consensus_queue.cc:260] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.763911 14551 raft_consensus.cc:3060] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.768458 14625 raft_consensus.cc:2468] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5d35829b4d4d9baf52f93e03640f7a in term 2.
I20260709 13:20:34.769887 14441 leader_election.cc:304] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:34.770202 14671 consensus_queue.cc:1048] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:34.770802 14675 raft_consensus.cc:2804] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:34.773133 14551 raft_consensus.cc:2468] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5d35829b4d4d9baf52f93e03640f7a in term 2.
I20260709 13:20:34.777050 14675 raft_consensus.cc:697] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Becoming Leader. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Running, Role: LEADER
I20260709 13:20:34.778254 14675 consensus_queue.cc:237] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } }
I20260709 13:20:34.785010 14681 consensus_queue.cc:1048] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:34.789290 14373 catalog_manager.cc:5697] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a reported cstate change: term changed from 1 to 2, leader changed from b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194) to be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193). New cstate: current_term: 2 leader_uuid: "be5d35829b4d4d9baf52f93e03640f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.796456 14671 raft_consensus.cc:993] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: : Instructing follower a959bcfc3f5442368464808a7041d882 to start an election
I20260709 13:20:34.797035 14681 raft_consensus.cc:1081] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Signalling peer a959bcfc3f5442368464808a7041d882 to start an election
I20260709 13:20:34.798810 14625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc"
dest_uuid: "a959bcfc3f5442368464808a7041d882"
 from {username='slave'} at 127.0.0.1:58544
I20260709 13:20:34.799369 14625 raft_consensus.cc:493] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:34.800352 14625 raft_consensus.cc:3060] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.808288 14625 raft_consensus.cc:515] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.811007 14475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
I20260709 13:20:34.811609 14475 raft_consensus.cc:3060] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.812176 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a061d02b31db4f6f966c493440c6c0dc" candidate_uuid: "a959bcfc3f5442368464808a7041d882" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
I20260709 13:20:34.812844 14551 raft_consensus.cc:3055] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:34.813184 14551 raft_consensus.cc:740] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:34.813974 14551 consensus_queue.cc:260] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.815048 14551 raft_consensus.cc:3060] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.816926 14625 leader_election.cc:290] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 2 election: Requested vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571)
I20260709 13:20:34.818583 14475 raft_consensus.cc:2468] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a959bcfc3f5442368464808a7041d882 in term 2.
I20260709 13:20:34.820042 14589 leader_election.cc:304] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:34.820935 14670 raft_consensus.cc:2804] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:34.821396 14670 raft_consensus.cc:697] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 2 LEADER]: Becoming Leader. State: Replica: a959bcfc3f5442368464808a7041d882, State: Running, Role: LEADER
I20260709 13:20:34.822053 14551 raft_consensus.cc:2468] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a959bcfc3f5442368464808a7041d882 in term 2.
I20260709 13:20:34.822177 14670 consensus_queue.cc:237] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.828500 14373 catalog_manager.cc:5697] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 reported cstate change: term changed from 1 to 2, leader changed from b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194) to a959bcfc3f5442368464808a7041d882 (127.2.200.195). New cstate: current_term: 2 leader_uuid: "a959bcfc3f5442368464808a7041d882" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:34.923354 14681 consensus_queue.cc:1048] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:34.935633 14679 consensus_queue.cc:1048] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:34.943928 14679 raft_consensus.cc:993] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: : Instructing follower be5d35829b4d4d9baf52f93e03640f7a to start an election
I20260709 13:20:34.944353 14679 raft_consensus.cc:1081] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Signalling peer be5d35829b4d4d9baf52f93e03640f7a to start an election
I20260709 13:20:34.945798 14475 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6"
dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
 from {username='slave'} at 127.0.0.1:47260
I20260709 13:20:34.946336 14475 raft_consensus.cc:493] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:34.946691 14475 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.953186 14475 raft_consensus.cc:515] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.956565 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
I20260709 13:20:34.957108 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:34.957481 14551 raft_consensus.cc:3055] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:34.957886 14475 leader_election.cc:290] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 2 election: Requested vote from peers b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:34.957892 14551 raft_consensus.cc:740] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:34.958889 14625 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.959626 14551 consensus_queue.cc:260] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.961305 14551 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.966972 14625 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5d35829b4d4d9baf52f93e03640f7a in term 2.
I20260709 13:20:34.968165 14441 leader_election.cc:304] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:34.968474 14551 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5d35829b4d4d9baf52f93e03640f7a in term 2.
I20260709 13:20:34.969148 14675 raft_consensus.cc:2804] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:34.969751 14675 raft_consensus.cc:697] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Becoming Leader. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Running, Role: LEADER
I20260709 13:20:34.970620 14675 consensus_queue.cc:237] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:34.977301 14372 catalog_manager.cc:5697] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a reported cstate change: term changed from 1 to 2, leader changed from b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194) to be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193). New cstate: current_term: 2 leader_uuid: "be5d35829b4d4d9baf52f93e03640f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:34.980636 14670 consensus_queue.cc:1048] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:34.987964 14683 raft_consensus.cc:993] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: : Instructing follower be5d35829b4d4d9baf52f93e03640f7a to start an election
I20260709 13:20:34.988838 14670 raft_consensus.cc:1081] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 LEADER]: Signalling peer be5d35829b4d4d9baf52f93e03640f7a to start an election
I20260709 13:20:34.992694 14476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688"
dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
 from {username='slave'} at 127.0.0.1:47272
I20260709 13:20:34.993291 14476 raft_consensus.cc:493] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:34.993673 14476 raft_consensus.cc:3060] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:34.995090 14670 consensus_queue.cc:1048] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:35.001567 14476 raft_consensus.cc:515] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:35.007128 14551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
I20260709 13:20:35.007251 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cd14068a8cd4c99beaeae532fbd7688" candidate_uuid: "be5d35829b4d4d9baf52f93e03640f7a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:35.007789 14551 raft_consensus.cc:3060] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.007923 14625 raft_consensus.cc:3055] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:35.008472 14625 raft_consensus.cc:740] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a959bcfc3f5442368464808a7041d882, State: Running, Role: LEADER
I20260709 13:20:35.009331 14625 consensus_queue.cc:260] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:35.010390 14625 raft_consensus.cc:3060] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:35.013780 14476 leader_election.cc:290] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 2 election: Requested vote from peers b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194:45571), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:35.016445 14625 raft_consensus.cc:2468] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5d35829b4d4d9baf52f93e03640f7a in term 2.
I20260709 13:20:35.016829 14551 raft_consensus.cc:2468] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be5d35829b4d4d9baf52f93e03640f7a in term 2.
I20260709 13:20:35.017535 14441 leader_election.cc:304] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, be5d35829b4d4d9baf52f93e03640f7a; no voters: 
I20260709 13:20:35.018483 14675 raft_consensus.cc:2804] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:35.018953 14675 raft_consensus.cc:697] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Becoming Leader. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Running, Role: LEADER
I20260709 13:20:35.019598 14675 consensus_queue.cc:237] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:35.025382 14373 catalog_manager.cc:5697] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a reported cstate change: term changed from 1 to 2, leader changed from a959bcfc3f5442368464808a7041d882 (127.2.200.195) to be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193). New cstate: current_term: 2 leader_uuid: "be5d35829b4d4d9baf52f93e03640f7a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.117012  2851 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:20:35.118593  2851 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:20:35.118971  2851 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:20:35.133044 14476 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6"
dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
mode: GRACEFUL
new_leader_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
 from {username='slave'} at 127.0.0.1:47286
I20260709 13:20:35.133665 14476 raft_consensus.cc:606] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Received request to transfer leadership to TS b8eee019587f41aaaa1f0eaa574e7977
I20260709 13:20:35.135125  2851 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:20:35.272324 14551 raft_consensus.cc:1275] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Refusing update from remote peer a959bcfc3f5442368464808a7041d882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.273547 14713 consensus_queue.cc:1048] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:35.281217 14476 raft_consensus.cc:1275] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Refusing update from remote peer a959bcfc3f5442368464808a7041d882: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.283121 14713 consensus_queue.cc:1048] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [LEADER]: Connected to new peer: Peer: permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:35.361129 14551 raft_consensus.cc:1275] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Refusing update from remote peer be5d35829b4d4d9baf52f93e03640f7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.362617 14675 consensus_queue.cc:1048] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:35.371723 14625 raft_consensus.cc:1275] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Refusing update from remote peer be5d35829b4d4d9baf52f93e03640f7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.373389 14717 consensus_queue.cc:1048] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:35.401682 14625 raft_consensus.cc:1275] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Refusing update from remote peer be5d35829b4d4d9baf52f93e03640f7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.403194 14717 consensus_queue.cc:1048] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:35.412719 14551 raft_consensus.cc:1275] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Refusing update from remote peer be5d35829b4d4d9baf52f93e03640f7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.414600 14675 consensus_queue.cc:1048] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:35.422585 14706 raft_consensus.cc:993] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: : Instructing follower b8eee019587f41aaaa1f0eaa574e7977 to start an election
I20260709 13:20:35.423015 14706 raft_consensus.cc:1081] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Signalling peer b8eee019587f41aaaa1f0eaa574e7977 to start an election
I20260709 13:20:35.424612 14551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6"
dest_uuid: "b8eee019587f41aaaa1f0eaa574e7977"
 from {username='slave'} at 127.0.0.1:53056
I20260709 13:20:35.425179 14551 raft_consensus.cc:493] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:35.425459 14551 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:35.430835 14551 raft_consensus.cc:515] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:35.432435 14551 leader_election.cc:290] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 3 election: Requested vote from peers be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193:38981), a959bcfc3f5442368464808a7041d882 (127.2.200.195:43487)
I20260709 13:20:35.433480 14625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a959bcfc3f5442368464808a7041d882"
I20260709 13:20:35.434202 14625 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:35.434280 14476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36bc9a56ee146fda1edac94c72874c6" candidate_uuid: "b8eee019587f41aaaa1f0eaa574e7977" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "be5d35829b4d4d9baf52f93e03640f7a"
I20260709 13:20:35.434921 14476 raft_consensus.cc:3055] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:35.435241 14476 raft_consensus.cc:740] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: be5d35829b4d4d9baf52f93e03640f7a, State: Running, Role: LEADER
I20260709 13:20:35.436014 14476 consensus_queue.cc:260] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:35.437305 14476 raft_consensus.cc:3060] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:35.439847 14625 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 3.
I20260709 13:20:35.441323 14516 leader_election.cc:304] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a959bcfc3f5442368464808a7041d882, b8eee019587f41aaaa1f0eaa574e7977; no voters: 
I20260709 13:20:35.442013 14679 raft_consensus.cc:2804] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:35.442108 14476 raft_consensus.cc:2468] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8eee019587f41aaaa1f0eaa574e7977 in term 3.
I20260709 13:20:35.442528 14679 raft_consensus.cc:697] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 3 LEADER]: Becoming Leader. State: Replica: b8eee019587f41aaaa1f0eaa574e7977, State: Running, Role: LEADER
I20260709 13:20:35.443329 14679 consensus_queue.cc:237] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } }
I20260709 13:20:35.450852 14373 catalog_manager.cc:5697] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 reported cstate change: term changed from 2 to 3, leader changed from be5d35829b4d4d9baf52f93e03640f7a (127.2.200.193) to b8eee019587f41aaaa1f0eaa574e7977 (127.2.200.194). New cstate: current_term: 3 leader_uuid: "b8eee019587f41aaaa1f0eaa574e7977" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be5d35829b4d4d9baf52f93e03640f7a" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 38981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8eee019587f41aaaa1f0eaa574e7977" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 45571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:35.489806  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
I20260709 13:20:35.511953 14625 raft_consensus.cc:1275] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Refusing update from remote peer be5d35829b4d4d9baf52f93e03640f7a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:35.513546  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:35.513921 14706 consensus_queue.cc:1048] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a959bcfc3f5442368464808a7041d882" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 43487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:35.514427  2851 tablet_replica.cc:333] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: stopping tablet replica
I20260709 13:20:35.515259  2851 raft_consensus.cc:2243] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.516124  2851 pending_rounds.cc:70] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: Trying to abort 1 pending ops.
I20260709 13:20:35.516376  2851 pending_rounds.cc:77] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638850647199744 op_type: NO_OP noop_request { }
I20260709 13:20:35.516858  2851 raft_consensus.cc:2889] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:35.517241  2851 raft_consensus.cc:2272] T 5cd14068a8cd4c99beaeae532fbd7688 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.520869  2851 tablet_replica.cc:333] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a: stopping tablet replica
I20260709 13:20:35.521812  2851 raft_consensus.cc:2243] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.522444  2851 raft_consensus.cc:2272] T c36bc9a56ee146fda1edac94c72874c6 P be5d35829b4d4d9baf52f93e03640f7a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.524926  2851 tablet_replica.cc:333] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a: stopping tablet replica
I20260709 13:20:35.525489  2851 raft_consensus.cc:2243] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.526305  2851 raft_consensus.cc:2272] T ffd5362057cd49a09bf4bd9640021774 P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.528854  2851 tablet_replica.cc:333] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a: stopping tablet replica
I20260709 13:20:35.529369  2851 raft_consensus.cc:2243] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.529819  2851 raft_consensus.cc:2272] T a061d02b31db4f6f966c493440c6c0dc P be5d35829b4d4d9baf52f93e03640f7a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.555444  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:20:35.572135  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
I20260709 13:20:35.591284  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:35.591895  2851 tablet_replica.cc:333] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: stopping tablet replica
I20260709 13:20:35.592417  2851 raft_consensus.cc:2243] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.593101  2851 pending_rounds.cc:70] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: Trying to abort 1 pending ops.
I20260709 13:20:35.593273  2851 pending_rounds.cc:77] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305638852385984512 op_type: NO_OP noop_request { }
I20260709 13:20:35.593505  2851 raft_consensus.cc:2889] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:35.593729  2851 raft_consensus.cc:2272] T c36bc9a56ee146fda1edac94c72874c6 P b8eee019587f41aaaa1f0eaa574e7977 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.596632  2851 tablet_replica.cc:333] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977: stopping tablet replica
I20260709 13:20:35.597463  2851 raft_consensus.cc:2243] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.597920  2851 raft_consensus.cc:2272] T 5cd14068a8cd4c99beaeae532fbd7688 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.600410  2851 tablet_replica.cc:333] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977: stopping tablet replica
I20260709 13:20:35.600997  2851 raft_consensus.cc:2243] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.601420  2851 raft_consensus.cc:2272] T a061d02b31db4f6f966c493440c6c0dc P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.604267  2851 tablet_replica.cc:333] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977: stopping tablet replica
I20260709 13:20:35.604924  2851 raft_consensus.cc:2243] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.605482  2851 raft_consensus.cc:2272] T ffd5362057cd49a09bf4bd9640021774 P b8eee019587f41aaaa1f0eaa574e7977 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.621510  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
I20260709 13:20:35.634399  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
I20260709 13:20:35.655365  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:35.656160  2851 tablet_replica.cc:333] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882: stopping tablet replica
I20260709 13:20:35.656921  2851 raft_consensus.cc:2243] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.657472  2851 raft_consensus.cc:2272] T c36bc9a56ee146fda1edac94c72874c6 P a959bcfc3f5442368464808a7041d882 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.660128  2851 tablet_replica.cc:333] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: stopping tablet replica
I20260709 13:20:35.660703  2851 raft_consensus.cc:2243] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.661163  2851 pending_rounds.cc:70] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: Trying to abort 1 pending ops.
I20260709 13:20:35.661309  2851 pending_rounds.cc:77] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305638850647199744 op_type: NO_OP noop_request { }
I20260709 13:20:35.661531  2851 raft_consensus.cc:2889] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:20:35.661763  2851 raft_consensus.cc:2272] T 5cd14068a8cd4c99beaeae532fbd7688 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.663981  2851 tablet_replica.cc:333] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882: stopping tablet replica
I20260709 13:20:35.664501  2851 raft_consensus.cc:2243] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.665400  2851 raft_consensus.cc:2272] T a061d02b31db4f6f966c493440c6c0dc P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.668119  2851 tablet_replica.cc:333] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882: stopping tablet replica
I20260709 13:20:35.668709  2851 raft_consensus.cc:2243] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:35.669355  2851 raft_consensus.cc:2272] T ffd5362057cd49a09bf4bd9640021774 P a959bcfc3f5442368464808a7041d882 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.682979  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:20:35.696368  2851 master.cc:562] Master@127.2.200.254:36575 shutting down...
I20260709 13:20:35.714768  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:35.715355  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:35.715673  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P d008b5fa79d145e48118cbd5c0b7bdb6: stopping tablet replica
I20260709 13:20:35.735139  2851 master.cc:584] Master@127.2.200.254:36575 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2353 ms)
[----------] 6 tests from LeaderRebalancerTest (326738 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:20:35.765498  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:46303
I20260709 13:20:35.766712  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:35.772363 14718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:35.772910 14719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:35.773581 14721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:35.775888  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:35.777014  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:35.777227  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:35.777392  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603235777376 us; error 0 us; skew 500 ppm
I20260709 13:20:35.778009  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:35.781059  2851 webserver.cc:533] Webserver started at http://127.2.200.254:37813/ using document root <none> and password file <none>
I20260709 13:20:35.781560  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:35.781725  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:35.781991  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:35.783026  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "e16e90fef38a4944b5bcaff045116d5f"
format_stamp: "Formatted at 2026-07-09 13:20:35 on dist-test-slave-108k"
I20260709 13:20:35.787657  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:35.791519 14726 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:35.792440  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:35.792863  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "e16e90fef38a4944b5bcaff045116d5f"
format_stamp: "Formatted at 2026-07-09 13:20:35 on dist-test-slave-108k"
I20260709 13:20:35.793237  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:35.803763  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:35.804841  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:35.847576  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:46303
I20260709 13:20:35.847925 14777 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:46303 every 8 connection(s)
I20260709 13:20:35.851801 14778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:35.863619 14778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f: Bootstrap starting.
I20260709 13:20:35.868479 14778 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:35.872598 14778 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f: No bootstrap required, opened a new log
I20260709 13:20:35.874830 14778 raft_consensus.cc:359] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e90fef38a4944b5bcaff045116d5f" member_type: VOTER }
I20260709 13:20:35.875216 14778 raft_consensus.cc:385] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:35.875391 14778 raft_consensus.cc:740] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16e90fef38a4944b5bcaff045116d5f, State: Initialized, Role: FOLLOWER
I20260709 13:20:35.875900 14778 consensus_queue.cc:260] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e90fef38a4944b5bcaff045116d5f" member_type: VOTER }
I20260709 13:20:35.876314 14778 raft_consensus.cc:399] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:35.876511 14778 raft_consensus.cc:493] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:35.876715 14778 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:35.882436 14778 raft_consensus.cc:515] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e90fef38a4944b5bcaff045116d5f" member_type: VOTER }
I20260709 13:20:35.883098 14778 leader_election.cc:304] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e16e90fef38a4944b5bcaff045116d5f; no voters: 
I20260709 13:20:35.884490 14778 leader_election.cc:290] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:35.884898 14781 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:35.886420 14781 raft_consensus.cc:697] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 1 LEADER]: Becoming Leader. State: Replica: e16e90fef38a4944b5bcaff045116d5f, State: Running, Role: LEADER
I20260709 13:20:35.887036 14781 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e90fef38a4944b5bcaff045116d5f" member_type: VOTER }
I20260709 13:20:35.887820 14778 sys_catalog.cc:565] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:35.889953 14782 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e16e90fef38a4944b5bcaff045116d5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e90fef38a4944b5bcaff045116d5f" member_type: VOTER } }
I20260709 13:20:35.890707 14782 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:35.889989 14783 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e16e90fef38a4944b5bcaff045116d5f. Latest consensus state: current_term: 1 leader_uuid: "e16e90fef38a4944b5bcaff045116d5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16e90fef38a4944b5bcaff045116d5f" member_type: VOTER } }
I20260709 13:20:35.892663 14783 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:35.894575 14785 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:35.899487 14785 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:35.904523  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:35.909668 14785 catalog_manager.cc:1383] Generated new cluster ID: 59f12c5355314df3bfd70bce652bca7d
I20260709 13:20:35.909950 14785 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:35.945068 14785 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:35.946388 14785 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:35.961864 14785 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f: Generated new TSK 0
I20260709 13:20:35.962442 14785 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:35.971172  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:35.977200 14799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:35.977774 14800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:35.979511 14802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:35.980278  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:35.981575  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:35.981828  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:35.981976  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603235981963 us; error 0 us; skew 500 ppm
I20260709 13:20:35.982522  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:35.985083  2851 webserver.cc:533] Webserver started at http://127.2.200.193:43681/ using document root <none> and password file <none>
I20260709 13:20:35.985554  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:35.985711  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:35.985925  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:35.986997  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "0c0e5f5eb88f4f748002e2a595358edd"
format_stamp: "Formatted at 2026-07-09 13:20:35 on dist-test-slave-108k"
I20260709 13:20:35.992169  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:35.995908 14807 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:35.996845  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:35.997153  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "0c0e5f5eb88f4f748002e2a595358edd"
format_stamp: "Formatted at 2026-07-09 13:20:35 on dist-test-slave-108k"
I20260709 13:20:35.997429  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.016356  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.017545  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.018955  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.021446  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.021651  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.021891  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.022049  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.065910  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:39301
I20260709 13:20:36.066048 14869 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:39301 every 8 connection(s)
I20260709 13:20:36.071645  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.080250 14874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.081053 14875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.082386 14877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.084468  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:36.085629  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.085882  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.086084  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603236086062 us; error 0 us; skew 500 ppm
I20260709 13:20:36.086148 14870 heartbeater.cc:344] Connected to a master server at 127.2.200.254:46303
I20260709 13:20:36.086597 14870 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.086859  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.087503 14870 heartbeater.cc:507] Master 127.2.200.254:46303 requested a full tablet report, sending...
I20260709 13:20:36.090544  2851 webserver.cc:533] Webserver started at http://127.2.200.194:45841/ using document root <none> and password file <none>
I20260709 13:20:36.090595 14743 ts_manager.cc:194] Registered new tserver with Master: 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301)
I20260709 13:20:36.091410  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.091706  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.092032  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.093263 14743 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58648
I20260709 13:20:36.093676  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-108k"
I20260709 13:20:36.098853  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:20:36.103219 14882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.104185  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:36.104487  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-108k"
I20260709 13:20:36.104815  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.117019  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.118117  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.119616  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.121889  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.122104  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.122324  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.122469  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.166833  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:43425
I20260709 13:20:36.166977 14944 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:43425 every 8 connection(s)
I20260709 13:20:36.171855  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:36.179581 14949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.181512 14948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:36.181876 14951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:36.182163  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:36.183581  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:36.183872  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:36.184089  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603236184070 us; error 0 us; skew 500 ppm
I20260709 13:20:36.184674  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:36.185252 14945 heartbeater.cc:344] Connected to a master server at 127.2.200.254:46303
I20260709 13:20:36.185835 14945 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.186975 14945 heartbeater.cc:507] Master 127.2.200.254:46303 requested a full tablet report, sending...
I20260709 13:20:36.187479  2851 webserver.cc:533] Webserver started at http://127.2.200.195:44343/ using document root <none> and password file <none>
I20260709 13:20:36.188230  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:36.188531  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:36.188930  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:36.189857 14743 ts_manager.cc:194] Registered new tserver with Master: d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:36.190303  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "7fe73df8ba834685bab3e3f4654917bc"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-108k"
I20260709 13:20:36.191319 14743 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58660
I20260709 13:20:36.195647  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:20:36.199646 14956 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.200671  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:20:36.201177  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "7fe73df8ba834685bab3e3f4654917bc"
format_stamp: "Formatted at 2026-07-09 13:20:36 on dist-test-slave-108k"
I20260709 13:20:36.201561  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:36.228639  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:36.229768  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:36.231300  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:36.233682  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:36.233868  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.234110  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:36.234266  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:36.279901  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:36937
I20260709 13:20:36.280028 15018 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:36937 every 8 connection(s)
I20260709 13:20:36.294790 15019 heartbeater.cc:344] Connected to a master server at 127.2.200.254:46303
I20260709 13:20:36.295471 15019 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:36.296638 15019 heartbeater.cc:507] Master 127.2.200.254:46303 requested a full tablet report, sending...
I20260709 13:20:36.299244 14743 ts_manager.cc:194] Registered new tserver with Master: 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:36.300119  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016768972s
I20260709 13:20:36.300721 14743 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58676
I20260709 13:20:36.327395 14743 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58680:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:36.329988 14743 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:36.397230 14835 tablet_service.cc:1511] Processing CreateTablet for tablet b557d31b901d4795aaf7b402a1b6d1a0 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.398651 14835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b557d31b901d4795aaf7b402a1b6d1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.399088 14984 tablet_service.cc:1511] Processing CreateTablet for tablet b557d31b901d4795aaf7b402a1b6d1a0 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.400411 14984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b557d31b901d4795aaf7b402a1b6d1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.400568 14834 tablet_service.cc:1511] Processing CreateTablet for tablet 89653be736a44a029993f04e352b9952 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.402447 14833 tablet_service.cc:1511] Processing CreateTablet for tablet c3dabb31e1fc4ffb8b1a73c9e6740758 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:36.403836 14833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3dabb31e1fc4ffb8b1a73c9e6740758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.405817 14832 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1030e4a8e74205bf9703aa001b3dc1 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.406080 14980 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2d2d4cf76842b2938e6562db643648 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:36.406951 14982 tablet_service.cc:1511] Processing CreateTablet for tablet c3dabb31e1fc4ffb8b1a73c9e6740758 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:36.407497 14980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2d2d4cf76842b2938e6562db643648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.408239 14982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3dabb31e1fc4ffb8b1a73c9e6740758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.410171 14910 tablet_service.cc:1511] Processing CreateTablet for tablet b557d31b901d4795aaf7b402a1b6d1a0 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:36.410712 14981 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1030e4a8e74205bf9703aa001b3dc1 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.411788 14909 tablet_service.cc:1511] Processing CreateTablet for tablet 89653be736a44a029993f04e352b9952 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.412236 14981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1030e4a8e74205bf9703aa001b3dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.413172 14909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89653be736a44a029993f04e352b9952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.413769 14979 tablet_service.cc:1511] Processing CreateTablet for tablet a4b7a6c16d1448a4933b9cbfef34938c (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:36.415031 14979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b7a6c16d1448a4933b9cbfef34938c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.405844 14983 tablet_service.cc:1511] Processing CreateTablet for tablet 89653be736a44a029993f04e352b9952 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:36.417893 14908 tablet_service.cc:1511] Processing CreateTablet for tablet c3dabb31e1fc4ffb8b1a73c9e6740758 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:36.418537 14983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89653be736a44a029993f04e352b9952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.419798 14907 tablet_service.cc:1511] Processing CreateTablet for tablet 0d1030e4a8e74205bf9703aa001b3dc1 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:36.422057 14906 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2d2d4cf76842b2938e6562db643648 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:36.424667 14831 tablet_service.cc:1511] Processing CreateTablet for tablet 9b2d2d4cf76842b2938e6562db643648 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:36.427068 14830 tablet_service.cc:1511] Processing CreateTablet for tablet a4b7a6c16d1448a4933b9cbfef34938c (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:36.429590 14907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1030e4a8e74205bf9703aa001b3dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.431387 14910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b557d31b901d4795aaf7b402a1b6d1a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.434401 14906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2d2d4cf76842b2938e6562db643648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.435652 14908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3dabb31e1fc4ffb8b1a73c9e6740758. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.438218 14905 tablet_service.cc:1511] Processing CreateTablet for tablet a4b7a6c16d1448a4933b9cbfef34938c (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:36.439821 14905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b7a6c16d1448a4933b9cbfef34938c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.444144 14832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d1030e4a8e74205bf9703aa001b3dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.445559 14830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4b7a6c16d1448a4933b9cbfef34938c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.446736 14834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89653be736a44a029993f04e352b9952. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.447901 14831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b2d2d4cf76842b2938e6562db643648. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.483613 14978 tablet_service.cc:1511] Processing CreateTablet for tablet ad37e59c7e3a4d39a854e7b99639c9ce (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:36.485350 14978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad37e59c7e3a4d39a854e7b99639c9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.507097 14904 tablet_service.cc:1511] Processing CreateTablet for tablet ad37e59c7e3a4d39a854e7b99639c9ce (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:36.508569 14904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad37e59c7e3a4d39a854e7b99639c9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.512305 14903 tablet_service.cc:1511] Processing CreateTablet for tablet 709f3eebae3c4e008cb2757687013389 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:36.513782 14903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709f3eebae3c4e008cb2757687013389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.521143 14977 tablet_service.cc:1511] Processing CreateTablet for tablet 709f3eebae3c4e008cb2757687013389 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:36.522157 14829 tablet_service.cc:1511] Processing CreateTablet for tablet ad37e59c7e3a4d39a854e7b99639c9ce (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:36.522832 14977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709f3eebae3c4e008cb2757687013389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.523471 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad37e59c7e3a4d39a854e7b99639c9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.528458 14828 tablet_service.cc:1511] Processing CreateTablet for tablet 709f3eebae3c4e008cb2757687013389 (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:36.529955 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 709f3eebae3c4e008cb2757687013389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.540339 14976 tablet_service.cc:1511] Processing CreateTablet for tablet 92430dc685ee4963bf0d07d3018843bc (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:36.544575 14976 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92430dc685ee4963bf0d07d3018843bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.549079 14827 tablet_service.cc:1511] Processing CreateTablet for tablet 92430dc685ee4963bf0d07d3018843bc (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:36.551321 14827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92430dc685ee4963bf0d07d3018843bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.561465 15036 tablet_bootstrap.cc:492] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.568432 15036 tablet_bootstrap.cc:654] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.571848 15034 tablet_bootstrap.cc:492] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:36.582535 14902 tablet_service.cc:1511] Processing CreateTablet for tablet 92430dc685ee4963bf0d07d3018843bc (DEFAULT_TABLE table=test-workload [id=a3950a367baf407f86eaf7d62b0005c7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:36.584208 14902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92430dc685ee4963bf0d07d3018843bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:36.623147 15034 tablet_bootstrap.cc:654] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.641906 15036 tablet_bootstrap.cc:492] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.642390 15036 ts_tablet_manager.cc:1403] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.081s	user 0.031s	sys 0.043s
I20260709 13:20:36.645275 15034 tablet_bootstrap.cc:492] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:36.645171 15036 raft_consensus.cc:359] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.645897 15036 raft_consensus.cc:385] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.645993 15034 ts_tablet_manager.cc:1403] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.003s
I20260709 13:20:36.646226 15036 raft_consensus.cc:740] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.647193 15036 consensus_queue.cc:260] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.649236 15034 raft_consensus.cc:359] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.650172 15034 raft_consensus.cc:385] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.650542 15034 raft_consensus.cc:740] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.651546 15034 consensus_queue.cc:260] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.691496 14870 heartbeater.cc:499] Master 127.2.200.254:46303 was elected leader, sending a full tablet report...
I20260709 13:20:36.703425 15036 ts_tablet_manager.cc:1434] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.040s
I20260709 13:20:36.707724 15036 tablet_bootstrap.cc:492] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.714490 15036 tablet_bootstrap.cc:654] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.745944 15036 tablet_bootstrap.cc:492] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.746459 15036 ts_tablet_manager.cc:1403] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.008s
I20260709 13:20:36.749249 15036 raft_consensus.cc:359] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.750125 15036 raft_consensus.cc:385] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.750411 15036 raft_consensus.cc:740] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.750725 15019 heartbeater.cc:499] Master 127.2.200.254:46303 was elected leader, sending a full tablet report...
I20260709 13:20:36.750870 15034 ts_tablet_manager.cc:1434] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.104s	user 0.033s	sys 0.062s
I20260709 13:20:36.751159 15036 consensus_queue.cc:260] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.752660 15034 tablet_bootstrap.cc:492] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:36.753517 15036 ts_tablet_manager.cc:1434] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:20:36.754597 15036 tablet_bootstrap.cc:492] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.759075 15034 tablet_bootstrap.cc:654] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.760288 15036 tablet_bootstrap.cc:654] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.765226 15035 tablet_bootstrap.cc:492] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:36.765806 15036 tablet_bootstrap.cc:492] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.766359 15036 ts_tablet_manager.cc:1403] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 13:20:36.769495 15036 raft_consensus.cc:359] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.770280 15036 raft_consensus.cc:385] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.770622 15036 raft_consensus.cc:740] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.770838 15034 tablet_bootstrap.cc:492] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:36.771515 15034 ts_tablet_manager.cc:1403] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:20:36.771507 15036 consensus_queue.cc:260] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.773867 15036 ts_tablet_manager.cc:1434] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:20:36.774971 15036 tablet_bootstrap.cc:492] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.774777 15034 raft_consensus.cc:359] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.775652 15034 raft_consensus.cc:385] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.776006 15034 raft_consensus.cc:740] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.776983 15034 consensus_queue.cc:260] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.779458 15034 ts_tablet_manager.cc:1434] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:36.780182 15035 tablet_bootstrap.cc:654] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.780514 15034 tablet_bootstrap.cc:492] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:36.781467 15036 tablet_bootstrap.cc:654] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.789479 15034 tablet_bootstrap.cc:654] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.803360 15035 tablet_bootstrap.cc:492] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:36.804219 15035 ts_tablet_manager.cc:1403] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.000s
I20260709 13:20:36.808823 15035 raft_consensus.cc:359] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.809614 15035 raft_consensus.cc:385] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.809952 15036 tablet_bootstrap.cc:492] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.809994 15035 raft_consensus.cc:740] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.811450 15035 consensus_queue.cc:260] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.810838 15036 ts_tablet_manager.cc:1403] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.017s
I20260709 13:20:36.814608 15034 tablet_bootstrap.cc:492] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:36.815200 15034 ts_tablet_manager.cc:1403] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.035s	user 0.029s	sys 0.003s
I20260709 13:20:36.816393 15036 raft_consensus.cc:359] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:36.817538 15036 raft_consensus.cc:385] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.817919 15036 raft_consensus.cc:740] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.818682 15034 raft_consensus.cc:359] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.819525 15034 raft_consensus.cc:385] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.819098 15036 consensus_queue.cc:260] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:36.819882 15034 raft_consensus.cc:740] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.821730 15036 ts_tablet_manager.cc:1434] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:20:36.822844 14945 heartbeater.cc:499] Master 127.2.200.254:46303 was elected leader, sending a full tablet report...
I20260709 13:20:36.823221 15036 tablet_bootstrap.cc:492] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.823292 15040 raft_consensus.cc:493] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.823305 15034 consensus_queue.cc:260] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.824193 15040 raft_consensus.cc:515] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.824196 15035 ts_tablet_manager.cc:1434] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 13:20:36.826395 15035 tablet_bootstrap.cc:492] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:36.828478 15040 leader_election.cc:290] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:36.833794 15036 tablet_bootstrap.cc:654] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.836362 15035 tablet_bootstrap.cc:654] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.838657 15034 ts_tablet_manager.cc:1434] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:20:36.842739 15034 tablet_bootstrap.cc:492] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:36.845083 15036 tablet_bootstrap.cc:492] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.845732 15036 ts_tablet_manager.cc:1403] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 13:20:36.849313 15036 raft_consensus.cc:359] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.850605 15036 raft_consensus.cc:385] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.851166 15036 raft_consensus.cc:740] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.852241 15036 consensus_queue.cc:260] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.852182 15034 tablet_bootstrap.cc:654] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.854844 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92430dc685ee4963bf0d07d3018843bc" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
W20260709 13:20:36.857224 14958 leader_election.cc:343] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.857929 15035 tablet_bootstrap.cc:492] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:36.858654 15035 ts_tablet_manager.cc:1403] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.004s
I20260709 13:20:36.859304 15036 ts_tablet_manager.cc:1434] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:20:36.860644 15036 tablet_bootstrap.cc:492] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.862085 15035 raft_consensus.cc:359] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.863091 15035 raft_consensus.cc:385] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.863483 15035 raft_consensus.cc:740] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.864542 15035 consensus_queue.cc:260] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.867388 15035 ts_tablet_manager.cc:1434] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:20:36.868278 15036 tablet_bootstrap.cc:654] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.868933 15035 tablet_bootstrap.cc:492] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:36.888456 15035 tablet_bootstrap.cc:654] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:36.898998 14791 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:36.899034 15040 raft_consensus.cc:493] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.900864 15040 raft_consensus.cc:515] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.904206 15034 tablet_bootstrap.cc:492] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:36.905036 15034 ts_tablet_manager.cc:1403] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.063s	user 0.027s	sys 0.026s
I20260709 13:20:36.905658 15036 tablet_bootstrap.cc:492] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.906463 15036 ts_tablet_manager.cc:1403] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.046s	user 0.026s	sys 0.011s
I20260709 13:20:36.906554 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:36.908108 15035 tablet_bootstrap.cc:492] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:36.905661 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92430dc685ee4963bf0d07d3018843bc" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:36.908793 15034 raft_consensus.cc:359] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:36.904978 15040 leader_election.cc:290] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:36.909132 14920 raft_consensus.cc:2468] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:36.909621 15034 raft_consensus.cc:385] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.909962 15034 raft_consensus.cc:740] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.910074 15036 raft_consensus.cc:359] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
W20260709 13:20:36.910972 14958 leader_election.cc:343] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.911352 15036 raft_consensus.cc:385] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.911067 15034 consensus_queue.cc:260] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:36.911828 15036 raft_consensus.cc:740] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.912227 14958 leader_election.cc:304] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:36.912786 15036 consensus_queue.cc:260] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.913300 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:36.914991 15036 ts_tablet_manager.cc:1434] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:36.915732 15040 raft_consensus.cc:2804] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:36.916152 15036 tablet_bootstrap.cc:492] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:36.916160 15040 raft_consensus.cc:493] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:36.917011 15040 raft_consensus.cc:3060] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.917078 15034 ts_tablet_manager.cc:1434] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:20:36.918327 15034 tablet_bootstrap.cc:492] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:36.923283 15036 tablet_bootstrap.cc:654] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.923596 15039 raft_consensus.cc:493] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.924160 15039 raft_consensus.cc:515] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.924913 15034 tablet_bootstrap.cc:654] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.926327 15040 raft_consensus.cc:515] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.929334 15039 leader_election.cc:290] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
W20260709 13:20:36.932307 14958 leader_election.cc:343] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.935211 14958 leader_election.cc:304] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc; no voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:36.936839 15040 leader_election.cc:290] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:36.939378 15040 raft_consensus.cc:2749] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:36.939590 15035 ts_tablet_manager.cc:1403] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.003s
I20260709 13:20:36.949102 15035 raft_consensus.cc:359] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.955802 15035 raft_consensus.cc:385] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.956715 15035 raft_consensus.cc:740] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.959582 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92430dc685ee4963bf0d07d3018843bc" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:36.959635 15047 raft_consensus.cc:493] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.963359 15047 raft_consensus.cc:515] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.966133 15047 leader_election.cc:290] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:36.961761 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92430dc685ee4963bf0d07d3018843bc" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:36.969214 14920 raft_consensus.cc:3060] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:36.971588 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
W20260709 13:20:36.973433 14809 leader_election.cc:343] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.976403 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
W20260709 13:20:36.978133 14810 leader_election.cc:343] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.978653 14810 leader_election.cc:304] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd; no voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:36.979166 15060 raft_consensus.cc:493] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:36.979872 15039 raft_consensus.cc:2749] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:36.979780 15060 raft_consensus.cc:515] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.982127 15036 tablet_bootstrap.cc:492] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:36.983003 15036 ts_tablet_manager.cc:1403] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.067s	user 0.034s	sys 0.021s
I20260709 13:20:36.978579 15035 consensus_queue.cc:260] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.982406 15060 leader_election.cc:290] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:36.984855 15034 tablet_bootstrap.cc:492] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:36.985446 15035 ts_tablet_manager.cc:1434] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 13:20:36.985635 15034 ts_tablet_manager.cc:1403] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.068s	user 0.046s	sys 0.012s
I20260709 13:20:36.986176 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:36.978881 14920 raft_consensus.cc:2468] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:36.986935 14845 raft_consensus.cc:2468] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:36.986832 15035 tablet_bootstrap.cc:492] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:36.990259 15034 raft_consensus.cc:359] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.991408 15034 raft_consensus.cc:385] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.991835 15034 raft_consensus.cc:740] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
W20260709 13:20:36.987061 14958 leader_election.cc:343] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:36.992281 15036 raft_consensus.cc:359] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.993276 15036 raft_consensus.cc:385] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:36.993706 15036 raft_consensus.cc:740] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:36.993324 15034 consensus_queue.cc:260] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.994609 15036 consensus_queue.cc:260] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:36.996014 15035 tablet_bootstrap.cc:654] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.996670 15034 ts_tablet_manager.cc:1434] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:20:36.997254 15036 ts_tablet_manager.cc:1434] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:36.998039 15034 tablet_bootstrap.cc:492] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:36.998358 15036 tablet_bootstrap.cc:492] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:37.006429 15036 tablet_bootstrap.cc:654] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.006428 15034 tablet_bootstrap.cc:654] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:36.993573 14958 leader_election.cc:304] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.010921 15060 raft_consensus.cc:2804] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.011317 15060 raft_consensus.cc:493] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.011648 15060 raft_consensus.cc:3060] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.013482 15040 raft_consensus.cc:493] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.014087 15040 raft_consensus.cc:515] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.016310 15040 leader_election.cc:290] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.020645 15034 tablet_bootstrap.cc:492] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:37.021442 15034 ts_tablet_manager.cc:1403] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 13:20:37.025597 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.026490 14845 raft_consensus.cc:2468] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.030833 15034 raft_consensus.cc:359] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.032984 15034 raft_consensus.cc:385] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.033350 15034 raft_consensus.cc:740] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.034274 15036 tablet_bootstrap.cc:492] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:37.034180 15034 consensus_queue.cc:260] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.032176 15060 raft_consensus.cc:515] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.034811 15036 ts_tablet_manager.cc:1403] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.013s
I20260709 13:20:37.036604 15034 ts_tablet_manager.cc:1434] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:20:37.037725 15034 tablet_bootstrap.cc:492] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:37.038082 15036 raft_consensus.cc:359] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.038780 15036 raft_consensus.cc:385] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.039041 15036 raft_consensus.cc:740] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.040130 15036 consensus_queue.cc:260] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.045161 15036 ts_tablet_manager.cc:1434] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:37.046247 15036 tablet_bootstrap.cc:492] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:37.049329 15034 tablet_bootstrap.cc:654] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.052066 15036 tablet_bootstrap.cc:654] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.036801 15060 leader_election.cc:290] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.031090 14958 leader_election.cc:304] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.063541 15039 raft_consensus.cc:493] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.064157 15039 raft_consensus.cc:515] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.067217 15034 tablet_bootstrap.cc:492] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:37.067972 15034 ts_tablet_manager.cc:1403] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.006s
I20260709 13:20:37.068539 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:37.069721 15039 leader_election.cc:290] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
W20260709 13:20:37.071276 14810 leader_election.cc:343] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.071730 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
W20260709 13:20:37.073184 14809 leader_election.cc:343] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.073619 14809 leader_election.cc:304] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd; no voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.074457 15039 raft_consensus.cc:2749] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:37.075029 15034 raft_consensus.cc:359] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.075881 15034 raft_consensus.cc:385] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.076185 15034 raft_consensus.cc:740] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.076948 15036 tablet_bootstrap.cc:492] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:37.077522 15036 ts_tablet_manager.cc:1403] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.021s
I20260709 13:20:37.077112 15034 consensus_queue.cc:260] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.080315 15034 ts_tablet_manager.cc:1434] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:37.080224 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.081171 15036 raft_consensus.cc:359] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.081626 15034 tablet_bootstrap.cc:492] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:37.081988 15036 raft_consensus.cc:385] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.082365 15036 raft_consensus.cc:740] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.082217 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.083822 15036 consensus_queue.cc:260] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.086212 15036 ts_tablet_manager.cc:1434] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:20:37.088332 15034 tablet_bootstrap.cc:654] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.090245 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.090986 14845 raft_consensus.cc:3060] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.093966 15034 tablet_bootstrap.cc:492] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:37.094551 15034 ts_tablet_manager.cc:1403] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:20:37.072052 15060 raft_consensus.cc:2804] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.097334 15040 raft_consensus.cc:493] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.097852 15040 raft_consensus.cc:515] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.098343 14958 leader_election.cc:304] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:37.099861 15060 raft_consensus.cc:493] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.099967 15040 leader_election.cc:290] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.100389 15060 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.100543 15040 raft_consensus.cc:2804] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.101058 15040 raft_consensus.cc:697] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.101903 15040 consensus_queue.cc:237] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.104970 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.108323 15034 raft_consensus.cc:359] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.109112 15034 raft_consensus.cc:385] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.109370 15034 raft_consensus.cc:740] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.110215 15034 consensus_queue.cc:260] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.113112 15035 tablet_bootstrap.cc:492] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:37.113799 15035 ts_tablet_manager.cc:1403] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.127s	user 0.046s	sys 0.070s
I20260709 13:20:37.119204 14845 raft_consensus.cc:2468] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.121413 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89653be736a44a029993f04e352b9952" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.122184 14845 raft_consensus.cc:2468] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 0.
W20260709 13:20:37.122020 14958 leader_election.cc:343] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.123517 15034 ts_tablet_manager.cc:1434] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.003s
I20260709 13:20:37.123339 15060 raft_consensus.cc:515] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.124050 14884 leader_election.cc:304] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
W20260709 13:20:37.124207 14958 leader_election.cc:343] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.124809 15034 tablet_bootstrap.cc:492] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:37.125094 15047 raft_consensus.cc:2804] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:37.125538 14958 leader_election.cc:343] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.125568 15047 raft_consensus.cc:493] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.122516 15035 raft_consensus.cc:359] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.126714 15047 raft_consensus.cc:3060] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.128209 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.128973 14845 raft_consensus.cc:2468] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.125564 15060 leader_election.cc:290] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.126776 15035 raft_consensus.cc:385] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.131281 15035 raft_consensus.cc:740] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.131302 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.131778 15034 tablet_bootstrap.cc:654] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.132128 15035 consensus_queue.cc:260] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.134057 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.134745 14845 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.135474 15047 raft_consensus.cc:515] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.137434 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.138379 15047 leader_election.cc:290] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.139762 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89653be736a44a029993f04e352b9952" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.140143 15034 tablet_bootstrap.cc:492] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:37.140498 14844 raft_consensus.cc:3060] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.140688 15034 ts_tablet_manager.cc:1403] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:20:37.144227 15034 raft_consensus.cc:359] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.145591 15034 raft_consensus.cc:385] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.145859 15034 raft_consensus.cc:740] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.146610 15035 ts_tablet_manager.cc:1434] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.009s
I20260709 13:20:37.146602 15034 consensus_queue.cc:260] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.147792 15035 tablet_bootstrap.cc:492] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:37.149822 15034 ts_tablet_manager.cc:1434] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:20:37.150898 14844 raft_consensus.cc:2468] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 1.
I20260709 13:20:37.151937 14884 leader_election.cc:304] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.152634 15072 raft_consensus.cc:2804] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.153224 15072 raft_consensus.cc:697] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:37.154292 15072 consensus_queue.cc:237] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.154912 15035 tablet_bootstrap.cc:654] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.153205 14958 leader_election.cc:304] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.157621 15060 raft_consensus.cc:2804] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.158159 15060 raft_consensus.cc:697] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.158999 15060 consensus_queue.cc:237] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.159266 14958 leader_election.cc:304] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.160249 15071 raft_consensus.cc:2804] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.160709 15071 raft_consensus.cc:493] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.161077 15071 raft_consensus.cc:3060] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.164425 15035 tablet_bootstrap.cc:492] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:37.165026 15035 ts_tablet_manager.cc:1403] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:20:37.168673 15035 raft_consensus.cc:359] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.169529 15035 raft_consensus.cc:385] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.169843 15035 raft_consensus.cc:740] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.169108 14739 catalog_manager.cc:5697] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.170598 15035 consensus_queue.cc:260] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.171537 15071 raft_consensus.cc:515] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.172899 15035 ts_tablet_manager.cc:1434] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:37.174041 15035 tablet_bootstrap.cc:492] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:37.180123 15035 tablet_bootstrap.cc:654] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.180439 14742 catalog_manager.cc:5697] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.182791 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89653be736a44a029993f04e352b9952" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:37.183542 14994 raft_consensus.cc:2468] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 0.
W20260709 13:20:37.181994 14958 leader_election.cc:343] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.184892 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89653be736a44a029993f04e352b9952" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.185822 14993 raft_consensus.cc:3060] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:20:37.186061 14958 leader_election.cc:343] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.189622 15071 leader_election.cc:290] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.191531 15035 tablet_bootstrap.cc:492] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:37.191450 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.192265 15035 ts_tablet_manager.cc:1403] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:20:37.192364 14844 raft_consensus.cc:3060] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.194777 15072 raft_consensus.cc:493] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.195319 15072 raft_consensus.cc:515] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.195497 15035 raft_consensus.cc:359] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.197872 15035 raft_consensus.cc:385] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.198190 15035 raft_consensus.cc:740] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.198705 15039 raft_consensus.cc:493] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.184978 14845 raft_consensus.cc:2468] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.198910 15035 consensus_queue.cc:260] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.200109 14958 leader_election.cc:304] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.200383 14844 raft_consensus.cc:2468] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.199239 15039 raft_consensus.cc:515] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.201584 14958 leader_election.cc:304] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.201745 15071 raft_consensus.cc:2804] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.202356 15060 raft_consensus.cc:2804] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.202831 15060 raft_consensus.cc:697] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.203280 15035 ts_tablet_manager.cc:1434] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:20:37.203646 15060 consensus_queue.cc:237] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.204869 15035 tablet_bootstrap.cc:492] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:37.205919 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.206686 14919 raft_consensus.cc:2468] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:37.207954 15071 raft_consensus.cc:697] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.200495 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.206082 15069 raft_consensus.cc:493] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.209015 15071 consensus_queue.cc:237] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.209769 15069 raft_consensus.cc:515] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.212095 15069 leader_election.cc:290] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.212374 15035 tablet_bootstrap.cc:654] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.208101 14809 leader_election.cc:304] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.218577 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.220839 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:37.221105 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.221843 14994 raft_consensus.cc:2468] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:37.222450 14844 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.222411 14920 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.221109 15035 tablet_bootstrap.cc:492] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:37.225055 15035 ts_tablet_manager.cc:1403] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.001s
W20260709 13:20:37.224671 14958 leader_election.cc:343] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:37.226696 14958 leader_election.cc:304] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.227888 15071 raft_consensus.cc:2804] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.228464 15071 raft_consensus.cc:493] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.228964 15071 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.228708 15039 leader_election.cc:290] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.228894 15035 raft_consensus.cc:359] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.230067 15035 raft_consensus.cc:385] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.230460 15035 raft_consensus.cc:740] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.230201 15039 raft_consensus.cc:2804] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.231683 15039 raft_consensus.cc:493] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.232600 15039 raft_consensus.cc:3060] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.232126 15035 consensus_queue.cc:260] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.234934 15035 ts_tablet_manager.cc:1434] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:20:37.236040 15035 tablet_bootstrap.cc:492] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:37.240195 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.241178 14844 raft_consensus.cc:2393] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0d2d0a4884a45f6896b6ea7ed976676 in current term 1: Already voted for candidate 7fe73df8ba834685bab3e3f4654917bc in this term.
I20260709 13:20:37.243033 15035 tablet_bootstrap.cc:654] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.243109 14993 raft_consensus.cc:2468] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 1.
I20260709 13:20:37.247457 15072 leader_election.cc:290] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.249056 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
W20260709 13:20:37.252444 14809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:43425, user_credentials={real_user=slave}} blocked reactor thread for 44427.5us
I20260709 13:20:37.254997 15035 tablet_bootstrap.cc:492] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:37.255559 15035 ts_tablet_manager.cc:1403] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:20:37.258226 14885 leader_election.cc:304] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0d2d0a4884a45f6896b6ea7ed976676; no voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:37.258147 15035 raft_consensus.cc:359] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.258940 15035 raft_consensus.cc:385] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.259439 15035 raft_consensus.cc:740] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.258718 15071 raft_consensus.cc:515] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.259768 15072 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.260247 15035 consensus_queue.cc:260] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.261648 15071 leader_election.cc:290] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.263311 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.268553 14844 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.269030 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.269626 14920 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.263615 15069 raft_consensus.cc:493] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.271504 15069 raft_consensus.cc:515] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.269717 15039 raft_consensus.cc:515] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.273675 15069 leader_election.cc:290] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.274485 15039 leader_election.cc:290] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.275168 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.275753 14919 raft_consensus.cc:3060] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.277266 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.267493 15072 raft_consensus.cc:2749] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:37.277441 14920 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.278015 14918 raft_consensus.cc:2468] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.279038 14958 leader_election.cc:304] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.265300 15035 ts_tablet_manager.cc:1434] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:37.279738 15069 raft_consensus.cc:2804] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.280290 15069 raft_consensus.cc:697] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.281191 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.281179 15069 consensus_queue.cc:237] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.282048 14993 raft_consensus.cc:3060] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.282826 15035 tablet_bootstrap.cc:492] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:37.281191 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.283689 14845 raft_consensus.cc:2468] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.288709 14919 raft_consensus.cc:2468] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:37.279873 14958 leader_election.cc:304] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.290266 14809 leader_election.cc:304] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.290894 15071 raft_consensus.cc:2804] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.291137 15039 raft_consensus.cc:2804] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.291428 15071 raft_consensus.cc:493] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.292025 15071 raft_consensus.cc:3060] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.293043 15035 tablet_bootstrap.cc:654] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:37.279623 14844 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.294634 14742 catalog_manager.cc:5697] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.298733 15039 raft_consensus.cc:697] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:37.299698 15039 consensus_queue.cc:237] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.300047 14993 raft_consensus.cc:2468] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:37.296663 14742 catalog_manager.cc:5697] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.303468 15071 raft_consensus.cc:515] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.307940 15071 leader_election.cc:290] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.314179 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.315071 14919 raft_consensus.cc:3060] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.333155 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.334060 14844 raft_consensus.cc:3060] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.335476 15084 raft_consensus.cc:493] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.336133 15084 raft_consensus.cc:515] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.339370 14919 raft_consensus.cc:2468] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.340306 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92430dc685ee4963bf0d07d3018843bc" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.340999 14958 leader_election.cc:304] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.341482 14920 raft_consensus.cc:2393] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c0e5f5eb88f4f748002e2a595358edd in current term 1: Already voted for candidate 7fe73df8ba834685bab3e3f4654917bc in this term.
I20260709 13:20:37.341946 15071 raft_consensus.cc:2804] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.342479 15071 raft_consensus.cc:697] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.343299 15071 consensus_queue.cc:237] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.345564 15084 leader_election.cc:290] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.346891 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92430dc685ee4963bf0d07d3018843bc" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:37.348709 14810 leader_election.cc:304] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd; no voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.350219 15084 raft_consensus.cc:3060] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.358328 14844 raft_consensus.cc:2468] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.360293 15035 tablet_bootstrap.cc:492] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:37.360894 15035 ts_tablet_manager.cc:1403] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.047s
I20260709 13:20:37.361605 15084 raft_consensus.cc:2749] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:37.363801 15035 raft_consensus.cc:359] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.364436 15035 raft_consensus.cc:385] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:37.364660 15035 raft_consensus.cc:740] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:37.365302 15035 consensus_queue.cc:260] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.367231 15035 ts_tablet_manager.cc:1434] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:20:37.367270 14742 catalog_manager.cc:5697] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 1 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.369130 14739 catalog_manager.cc:5697] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.370776 14739 catalog_manager.cc:5697] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.372000 14739 catalog_manager.cc:5697] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.397102 15071 raft_consensus.cc:493] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.397712 15071 raft_consensus.cc:515] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.400185 15071 leader_election.cc:290] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.400995 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.401192 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:37.401582 14844 raft_consensus.cc:2468] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.401777 14919 raft_consensus.cc:2468] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 0.
I20260709 13:20:37.402551 14958 leader_election.cc:304] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.403287 15071 raft_consensus.cc:2804] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:37.404150 15071 raft_consensus.cc:493] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:37.404392 15071 raft_consensus.cc:3060] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.410843 15071 raft_consensus.cc:515] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.412545 15071 leader_election.cc:290] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.413642 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.413672 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.414238 14844 raft_consensus.cc:3060] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.414609 14919 raft_consensus.cc:3060] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.419615 14844 raft_consensus.cc:2468] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.420840 14958 leader_election.cc:304] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.421527 15071 raft_consensus.cc:2804] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:37.421509 14919 raft_consensus.cc:2468] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 1.
I20260709 13:20:37.422189 15071 raft_consensus.cc:697] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.423070 15071 consensus_queue.cc:237] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.430948 14739 catalog_manager.cc:5697] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:37.520804 15071 consensus_queue.cc:1048] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.533332 15071 consensus_queue.cc:1048] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.543102 15071 consensus_queue.cc:1048] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.554510 14919 raft_consensus.cc:3060] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.557498 15072 raft_consensus.cc:493] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:37.558074 15072 raft_consensus.cc:515] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.560191 15072 leader_election.cc:290] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937), 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301)
I20260709 13:20:37.561848 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:37.562564 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:37.563395 14844 raft_consensus.cc:2393] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d0d2d0a4884a45f6896b6ea7ed976676 in current term 1: Already voted for candidate 7fe73df8ba834685bab3e3f4654917bc in this term.
I20260709 13:20:37.564543 14884 leader_election.cc:304] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0d2d0a4884a45f6896b6ea7ed976676; no voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:37.565783 15072 raft_consensus.cc:3060] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:37.566656 15069 consensus_queue.cc:1048] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.576218 15072 raft_consensus.cc:2749] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:37.589334 14993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
mode: GRACEFUL
new_leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:20:37.589872 14993 raft_consensus.cc:606] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Received request to transfer leadership to TS 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:37.605700 14919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "89653be736a44a029993f04e352b9952"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
mode: GRACEFUL
new_leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:58988
I20260709 13:20:37.606274 14919 raft_consensus.cc:606] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Received request to transfer leadership to TS 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:37.612341 14993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
mode: GRACEFUL
new_leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:20:37.612897 14993 raft_consensus.cc:606] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Received request to transfer leadership to TS 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:37.618643 14993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
mode: GRACEFUL
new_leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:20:37.619263 14993 raft_consensus.cc:606] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Received request to transfer leadership to TS 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:37.625013 14993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
mode: GRACEFUL
new_leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:20:37.625522 14993 raft_consensus.cc:606] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Received request to transfer leadership to TS d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.630822 14993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
mode: GRACEFUL
new_leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:20:37.631671 14993 raft_consensus.cc:606] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Received request to transfer leadership to TS d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.638043 14993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
mode: GRACEFUL
new_leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:55826
I20260709 13:20:37.638550 14993 raft_consensus.cc:606] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Received request to transfer leadership to TS d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.653478 14844 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "709f3eebae3c4e008cb2757687013389"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
mode: GRACEFUL
new_leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:36138
I20260709 13:20:37.654207 14844 raft_consensus.cc:606] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Received request to transfer leadership to TS d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:37.689561 15069 consensus_queue.cc:1048] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.692379 15084 consensus_queue.cc:1048] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.703293 15084 raft_consensus.cc:993] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: : Instructing follower d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:37.704100 15039 raft_consensus.cc:1081] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Signalling peer d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:37.706198 14920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "709f3eebae3c4e008cb2757687013389"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:58982
I20260709 13:20:37.706825 14920 raft_consensus.cc:493] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.707194 14920 raft_consensus.cc:3060] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.708813 15104 consensus_queue.cc:1048] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.709432 15071 consensus_queue.cc:1048] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.714782 14920 raft_consensus.cc:515] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.717780 14920 leader_election.cc:290] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.720886 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.721498 14844 raft_consensus.cc:3055] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.721810 14844 raft_consensus.cc:740] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:37.722580 14844 consensus_queue.cc:260] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.723538 14844 raft_consensus.cc:3060] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:20:37.723855 15104 consensus_queue.cc:1175] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7fe73df8ba834685bab3e3f4654917bc" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:20:37.721810 14919 raft_consensus.cc:1240] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Rejecting Update request from peer 0c0e5f5eb88f4f748002e2a595358edd for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:37.726536 15060 raft_consensus.cc:993] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: : Instructing follower d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:37.727038 15060 raft_consensus.cc:1081] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Signalling peer d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:37.729071 14918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:20:37.729769 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "709f3eebae3c4e008cb2757687013389" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.729749 14918 raft_consensus.cc:493] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.730546 14993 raft_consensus.cc:3060] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.730767 14918 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.733646 14844 raft_consensus.cc:2468] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:37.735584 14884 leader_election.cc:304] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.736413 15072 raft_consensus.cc:2804] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.736909 15072 raft_consensus.cc:697] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:37.737969 14993 raft_consensus.cc:2468] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:37.737710 15072 consensus_queue.cc:237] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.738698 14918 raft_consensus.cc:515] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.740686 15047 consensus_queue.cc:1048] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.743132 14918 leader_election.cc:290] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.744202 15071 consensus_queue.cc:1048] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.744367 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.745223 14845 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.749771 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.750424 14993 raft_consensus.cc:3055] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.750739 14993 raft_consensus.cc:740] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.751534 14993 consensus_queue.cc:260] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.752821 14993 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.755092 14739 catalog_manager.cc:5697] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 1 to 2, leader changed from 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193) to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.756716 14845 raft_consensus.cc:2468] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:37.758004 14884 leader_election.cc:304] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.758873 15072 raft_consensus.cc:2804] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.759557 15072 raft_consensus.cc:697] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:37.759912 14993 raft_consensus.cc:2468] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:37.760506 15072 consensus_queue.cc:237] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.771763 15047 raft_consensus.cc:993] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: : Instructing follower 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.772697 15072 raft_consensus.cc:1081] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Signalling peer 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.774063 15071 consensus_queue.cc:1048] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.776274 14845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "89653be736a44a029993f04e352b9952"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:36134
I20260709 13:20:37.776911 14845 raft_consensus.cc:493] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.777307 14845 raft_consensus.cc:3060] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.778883 14742 catalog_manager.cc:5697] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 1 to 2, leader changed from 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195) to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.780468 15072 consensus_queue.cc:1048] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:37.785094 14845 raft_consensus.cc:515] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.787422 14844 raft_consensus.cc:1240] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Rejecting Update request from peer d0d2d0a4884a45f6896b6ea7ed976676 for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:37.789079 15072 consensus_queue.cc:1059] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.789870 15047 raft_consensus.cc:3055] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.790239 15047 raft_consensus.cc:740] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:37.791121 15047 consensus_queue.cc:260] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.791538 14845 leader_election.cc:290] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.792214 15047 raft_consensus.cc:3060] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.792982 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89653be736a44a029993f04e352b9952" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.793476 14993 raft_consensus.cc:3060] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.791711 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89653be736a44a029993f04e352b9952" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.797219 15071 raft_consensus.cc:993] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: : Instructing follower 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.797688 15069 raft_consensus.cc:1081] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Signalling peer 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.799836 14843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:45248
I20260709 13:20:37.800393 14843 raft_consensus.cc:493] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.800731 14843 raft_consensus.cc:3060] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.804661 14993 raft_consensus.cc:2468] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.807808 14810 leader_election.cc:304] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.808642 15104 raft_consensus.cc:2804] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.807255 14843 raft_consensus.cc:515] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.809157 15104 raft_consensus.cc:697] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:37.809713 14918 raft_consensus.cc:2468] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.810017 15104 consensus_queue.cc:237] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.811399 14843 leader_election.cc:290] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Requested vote from peers 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:37.812814 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.813424 14993 raft_consensus.cc:3055] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.813745 14993 raft_consensus.cc:740] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.814664 14993 consensus_queue.cc:260] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.815778 14993 raft_consensus.cc:3060] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.816550 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b557d31b901d4795aaf7b402a1b6d1a0" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.817225 14918 raft_consensus.cc:3060] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.823062 14993 raft_consensus.cc:2468] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.823215 14742 catalog_manager.cc:5697] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 1 to 2, leader changed from d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194) to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 2 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.824211 14810 leader_election.cc:304] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:37.824980 15104 raft_consensus.cc:2804] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.825500 15104 raft_consensus.cc:697] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:37.826257 15104 consensus_queue.cc:237] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } }
I20260709 13:20:37.826761 15071 consensus_queue.cc:1048] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.824962 14918 raft_consensus.cc:2468] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.835878 15060 raft_consensus.cc:993] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: : Instructing follower d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:37.836303 15060 raft_consensus.cc:1081] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Signalling peer d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:37.837612 14742 catalog_manager.cc:5697] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 1 to 2, leader changed from 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195) to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 2 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.840418 14919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:20:37.841005 14919 raft_consensus.cc:493] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.841369 14919 raft_consensus.cc:3060] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.844482 15040 consensus_queue.cc:1048] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.848614 14919 raft_consensus.cc:515] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.851116 15040 consensus_queue.cc:1048] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.853682 14919 leader_election.cc:290] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.856225 14844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:37.859179 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4b7a6c16d1448a4933b9cbfef34938c" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.859763 14993 raft_consensus.cc:3055] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.860064 14993 raft_consensus.cc:740] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.860901 14993 consensus_queue.cc:260] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.861968 14993 raft_consensus.cc:3060] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.862654 15040 consensus_queue.cc:1048] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.864372 15069 raft_consensus.cc:993] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: : Instructing follower 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.864835 15069 raft_consensus.cc:1081] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Signalling peer 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.872171 14845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:45248
I20260709 13:20:37.872778 14845 raft_consensus.cc:493] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.873206 14845 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.874666 14993 raft_consensus.cc:2468] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:37.875667 15071 consensus_queue.cc:1048] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.882169 14845 raft_consensus.cc:515] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.882244 14885 leader_election.cc:304] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:37.883320 15047 raft_consensus.cc:2804] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.883805 15047 raft_consensus.cc:697] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:37.884747 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.884605 15047 consensus_queue.cc:237] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.885334 14919 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.890165 14845 leader_election.cc:290] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.891423 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.892012 14993 raft_consensus.cc:3055] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.892315 14993 raft_consensus.cc:740] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.893148 14993 consensus_queue.cc:260] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.894055 14993 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.894529 14919 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.895159 15060 raft_consensus.cc:993] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: : Instructing follower 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.895632 15040 raft_consensus.cc:1081] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Signalling peer 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:37.895749 14809 leader_election.cc:304] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.895781 14918 raft_consensus.cc:1240] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Rejecting Update request from peer 7fe73df8ba834685bab3e3f4654917bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:37.896637 15104 raft_consensus.cc:2804] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.897131 15104 raft_consensus.cc:697] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:37.897918 15104 consensus_queue.cc:237] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.901253 14843 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:45248
I20260709 13:20:37.901857 14843 raft_consensus.cc:493] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:37.902207 14843 raft_consensus.cc:3060] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.904681 14739 catalog_manager.cc:5697] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 1 to 2, leader changed from 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195) to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.909968 14993 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.911566 14843 raft_consensus.cc:515] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.912616 14845 raft_consensus.cc:1240] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Rejecting Update request from peer 7fe73df8ba834685bab3e3f4654917bc for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:37.912665 14743 catalog_manager.cc:5697] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 1 to 2, leader changed from 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195) to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 2 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:37.915621 15060 consensus_queue.cc:1059] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:37.916478 15040 raft_consensus.cc:3055] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:37.916828 15040 raft_consensus.cc:740] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:37.917649 15040 consensus_queue.cc:260] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.918890 15040 raft_consensus.cc:3060] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.926993 14843 leader_election.cc:290] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:37.927639 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:37.928109 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d1030e4a8e74205bf9703aa001b3dc1" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:37.928550 14918 raft_consensus.cc:3060] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:37.934731 14918 raft_consensus.cc:2468] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.936071 14993 raft_consensus.cc:2468] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:37.936870 14809 leader_election.cc:304] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:37.937553 15039 raft_consensus.cc:2804] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:37.937919 15039 raft_consensus.cc:697] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:37.938503 15039 consensus_queue.cc:237] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:37.944742 14742 catalog_manager.cc:5697] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 1 to 2, leader changed from 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195) to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 2 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.148969 14845 raft_consensus.cc:1275] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.150488 15047 consensus_queue.cc:1048] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.154876 15071 raft_consensus.cc:993] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: : Instructing follower d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:38.155361 15040 raft_consensus.cc:1081] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Signalling peer d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:38.157051 14918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:57316
I20260709 13:20:38.157673 14918 raft_consensus.cc:493] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:38.158082 14918 raft_consensus.cc:3060] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.161343 14993 raft_consensus.cc:1275] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.162791 15047 consensus_queue.cc:1048] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.165923 14993 raft_consensus.cc:1275] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.166702 14918 raft_consensus.cc:515] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:38.169759 15047 consensus_queue.cc:1048] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.170681 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:38.171270 14845 raft_consensus.cc:3060] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.172652 14918 leader_election.cc:290] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:38.174655 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b2d2d4cf76842b2938e6562db643648" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:38.175283 14993 raft_consensus.cc:3055] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:38.175614 14993 raft_consensus.cc:740] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:38.178623 14993 consensus_queue.cc:260] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:38.179991 14993 raft_consensus.cc:3060] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.181175 14843 raft_consensus.cc:1275] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.183032 15109 consensus_queue.cc:1048] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.185050 14845 raft_consensus.cc:2468] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:38.188449 14884 leader_election.cc:304] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:38.189515 15109 raft_consensus.cc:2804] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:38.189999 15109 raft_consensus.cc:697] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:38.190790 15109 consensus_queue.cc:237] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:38.194317 14993 raft_consensus.cc:2468] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:38.198556 14743 catalog_manager.cc:5697] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 1 to 2, leader changed from 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195) to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:38.265892 14993 raft_consensus.cc:1275] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.267196 15039 consensus_queue.cc:1048] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.276307 14918 raft_consensus.cc:1275] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.278065 15039 consensus_queue.cc:1048] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.283555 14919 raft_consensus.cc:1275] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.285153 15039 consensus_queue.cc:1048] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.293314 14993 raft_consensus.cc:1275] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.295195 15039 consensus_queue.cc:1048] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:38.323330 14843 raft_consensus.cc:3060] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:38.329742 14843 raft_consensus.cc:1275] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.329624 14918 raft_consensus.cc:1275] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.331120 15109 consensus_queue.cc:1048] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.331585 15039 consensus_queue.cc:1048] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.341159 14993 raft_consensus.cc:1275] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.343626 14994 raft_consensus.cc:1275] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.345880 15109 consensus_queue.cc:1048] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.349337 15104 consensus_queue.cc:1048] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.354001 14918 raft_consensus.cc:1275] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.356251 15104 consensus_queue.cc:1048] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:38.372498 14993 raft_consensus.cc:1275] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.374233 15118 consensus_queue.cc:1048] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.774847 14845 raft_consensus.cc:1275] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.776450 15109 consensus_queue.cc:1048] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:38.786747 14993 raft_consensus.cc:1275] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:38.788395 15109 consensus_queue.cc:1048] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:40.687844 14742 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57930:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:40.690872 14742 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:40.747895 14827 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2a621e7d8c46ddaf9ee5c0cc140b7e (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:40.748489 14906 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2a621e7d8c46ddaf9ee5c0cc140b7e (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:40.749253 14827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2a621e7d8c46ddaf9ee5c0cc140b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.749789 14906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2a621e7d8c46ddaf9ee5c0cc140b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.752003 14834 tablet_service.cc:1511] Processing CreateTablet for tablet a863cc9bc7b64f68b70158e2cb91c6b8 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:40.753298 14834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a863cc9bc7b64f68b70158e2cb91c6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.753664 14981 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2a621e7d8c46ddaf9ee5c0cc140b7e (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:40.755309 14981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2a621e7d8c46ddaf9ee5c0cc140b7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.756743 14829 tablet_service.cc:1511] Processing CreateTablet for tablet a928ed0d703f4860a9d4d1ea1963519d (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:40.758674 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a928ed0d703f4860a9d4d1ea1963519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.755172 14982 tablet_service.cc:1511] Processing CreateTablet for tablet a863cc9bc7b64f68b70158e2cb91c6b8 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:40.759485 14910 tablet_service.cc:1511] Processing CreateTablet for tablet a928ed0d703f4860a9d4d1ea1963519d (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:40.760579 14982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a863cc9bc7b64f68b70158e2cb91c6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.760890 14910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a928ed0d703f4860a9d4d1ea1963519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.761914 14908 tablet_service.cc:1511] Processing CreateTablet for tablet a863cc9bc7b64f68b70158e2cb91c6b8 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:40.763222 14908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a863cc9bc7b64f68b70158e2cb91c6b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.771844 14983 tablet_service.cc:1511] Processing CreateTablet for tablet a928ed0d703f4860a9d4d1ea1963519d (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:40.774010 14983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a928ed0d703f4860a9d4d1ea1963519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.782425 14828 tablet_service.cc:1511] Processing CreateTablet for tablet 30cbac131f574cc6acaa2f98a967ef89 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:40.783900 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cbac131f574cc6acaa2f98a967ef89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.784601 14907 tablet_service.cc:1511] Processing CreateTablet for tablet 30cbac131f574cc6acaa2f98a967ef89 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:40.785950 14907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cbac131f574cc6acaa2f98a967ef89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.798652 14979 tablet_service.cc:1511] Processing CreateTablet for tablet 30cbac131f574cc6acaa2f98a967ef89 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:40.800269 14979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30cbac131f574cc6acaa2f98a967ef89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.801748 14833 tablet_service.cc:1511] Processing CreateTablet for tablet a73828514c3043fb852da03a101db3fe (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:40.803077 14833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73828514c3043fb852da03a101db3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.822389 14904 tablet_service.cc:1511] Processing CreateTablet for tablet a73828514c3043fb852da03a101db3fe (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:40.823818 14904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73828514c3043fb852da03a101db3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.831310 14984 tablet_service.cc:1511] Processing CreateTablet for tablet a73828514c3043fb852da03a101db3fe (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:40.833278 14984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a73828514c3043fb852da03a101db3fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.835634 14835 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6234ee161748a59f13f389e91c57ae (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:40.836946 14835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6234ee161748a59f13f389e91c57ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.856104 14903 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6234ee161748a59f13f389e91c57ae (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:40.857586 14903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6234ee161748a59f13f389e91c57ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.878429 14977 tablet_service.cc:1511] Processing CreateTablet for tablet 3e6234ee161748a59f13f389e91c57ae (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:40.880096 14977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e6234ee161748a59f13f389e91c57ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.880436 15135 tablet_bootstrap.cc:492] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:40.890301 14905 tablet_service.cc:1511] Processing CreateTablet for tablet f6aa2f8b6022488f885571b55a6e92f9 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:40.892529 15135 tablet_bootstrap.cc:654] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:40.892408 15134 tablet_bootstrap.cc:492] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:40.896062 14978 tablet_service.cc:1511] Processing CreateTablet for tablet f6aa2f8b6022488f885571b55a6e92f9 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:40.897501 14978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6aa2f8b6022488f885571b55a6e92f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.899026 14834 tablet_service.cc:1511] Processing CreateTablet for tablet f6aa2f8b6022488f885571b55a6e92f9 (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:40.900395 14834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6aa2f8b6022488f885571b55a6e92f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.896066 14905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6aa2f8b6022488f885571b55a6e92f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.903589 14831 tablet_service.cc:1511] Processing CreateTablet for tablet a6dedcce838f42679328b21582ddf40b (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:40.905012 14831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dedcce838f42679328b21582ddf40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.909426 14903 tablet_service.cc:1511] Processing CreateTablet for tablet a6dedcce838f42679328b21582ddf40b (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:40.909679 14982 tablet_service.cc:1511] Processing CreateTablet for tablet a6dedcce838f42679328b21582ddf40b (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:40.911293 14982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dedcce838f42679328b21582ddf40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.919049 14903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dedcce838f42679328b21582ddf40b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.919763 15134 tablet_bootstrap.cc:654] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:40.920784 15133 tablet_bootstrap.cc:492] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:40.926141 14904 tablet_service.cc:1511] Processing CreateTablet for tablet d145f839de674ba4b0b3b87a100eafaf (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:40.927518 14904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d145f839de674ba4b0b3b87a100eafaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.930023 14829 tablet_service.cc:1511] Processing CreateTablet for tablet d145f839de674ba4b0b3b87a100eafaf (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:40.934551 14979 tablet_service.cc:1511] Processing CreateTablet for tablet d145f839de674ba4b0b3b87a100eafaf (DEFAULT_TABLE table=soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:40.949528 14979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d145f839de674ba4b0b3b87a100eafaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.954206 15133 tablet_bootstrap.cc:654] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:40.959436 14791 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:40.960368 15134 tablet_bootstrap.cc:492] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:40.961227 15134 ts_tablet_manager.cc:1403] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 13:20:40.959553 14829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d145f839de674ba4b0b3b87a100eafaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:40.964922 15134 raft_consensus.cc:359] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:40.967808 15134 raft_consensus.cc:385] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:40.968153 15134 raft_consensus.cc:740] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:40.972081 15134 consensus_queue.cc:260] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:40.987028 15134 ts_tablet_manager.cc:1434] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.005s
I20260709 13:20:40.987617 15135 tablet_bootstrap.cc:492] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:40.988215 15135 ts_tablet_manager.cc:1403] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.108s	user 0.009s	sys 0.013s
I20260709 13:20:40.988442 15134 tablet_bootstrap.cc:492] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:40.995952 15135 raft_consensus.cc:359] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:40.996788 15135 raft_consensus.cc:385] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:40.997138 15135 raft_consensus.cc:740] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:40.997969 15135 consensus_queue.cc:260] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.002441 15135 ts_tablet_manager.cc:1434] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:20:41.003670 15135 tablet_bootstrap.cc:492] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.004073 15134 tablet_bootstrap.cc:654] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.005339 15133 tablet_bootstrap.cc:492] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.006637 15133 ts_tablet_manager.cc:1403] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.017s
I20260709 13:20:41.010223 15135 tablet_bootstrap.cc:654] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.009950 15133 raft_consensus.cc:359] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.012794 15133 raft_consensus.cc:385] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.013144 15133 raft_consensus.cc:740] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.014196 15133 consensus_queue.cc:260] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.016225 15133 ts_tablet_manager.cc:1434] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:20:41.016474 15135 tablet_bootstrap.cc:492] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.017077 15135 ts_tablet_manager.cc:1403] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.007s
I20260709 13:20:41.017805 15133 tablet_bootstrap.cc:492] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.019804 15134 tablet_bootstrap.cc:492] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.020387 15134 ts_tablet_manager.cc:1403] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.001s
I20260709 13:20:41.020154 15135 raft_consensus.cc:359] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.021365 15135 raft_consensus.cc:385] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.021819 15135 raft_consensus.cc:740] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.022861 15135 consensus_queue.cc:260] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.023757 15134 raft_consensus.cc:359] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.024607 15134 raft_consensus.cc:385] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.024955 15134 raft_consensus.cc:740] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.025888 15135 ts_tablet_manager.cc:1434] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:20:41.025745 15134 consensus_queue.cc:260] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.027079 15135 tablet_bootstrap.cc:492] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.031317 15134 ts_tablet_manager.cc:1434] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:20:41.032867 15134 tablet_bootstrap.cc:492] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.035444 15135 tablet_bootstrap.cc:654] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.038847 15133 tablet_bootstrap.cc:654] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.039731 15134 tablet_bootstrap.cc:654] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.054328 15134 tablet_bootstrap.cc:492] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.054946 15133 tablet_bootstrap.cc:492] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.054975 15134 ts_tablet_manager.cc:1403] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:20:41.055691 15133 ts_tablet_manager.cc:1403] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.011s
I20260709 13:20:41.055951 15135 tablet_bootstrap.cc:492] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.056447 15135 ts_tablet_manager.cc:1403] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.004s
I20260709 13:20:41.058815 15134 raft_consensus.cc:359] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.059149 15133 raft_consensus.cc:359] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.059739 15134 raft_consensus.cc:385] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.059945 15133 raft_consensus.cc:385] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.060252 15134 raft_consensus.cc:740] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.060362 15133 raft_consensus.cc:740] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.059527 15135 raft_consensus.cc:359] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.061131 15135 raft_consensus.cc:385] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.061066 15134 consensus_queue.cc:260] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.061226 15133 consensus_queue.cc:260] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.061828 15135 raft_consensus.cc:740] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.063913 15134 ts_tablet_manager.cc:1434] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:20:41.064092 15133 ts_tablet_manager.cc:1434] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:20:41.065275 15134 tablet_bootstrap.cc:492] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.065654 15133 tablet_bootstrap.cc:492] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.067193 15135 consensus_queue.cc:260] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.069689 15118 raft_consensus.cc:493] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.069921 15135 ts_tablet_manager.cc:1434] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:20:41.070186 15118 raft_consensus.cc:515] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.071116 15135 tablet_bootstrap.cc:492] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.072320 15134 tablet_bootstrap.cc:654] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.073640 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.074333 14994 raft_consensus.cc:2468] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.076890 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.077538 14918 raft_consensus.cc:2468] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.078109 15135 tablet_bootstrap.cc:654] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.079694 14810 leader_election.cc:304] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:41.072353 15118 leader_election.cc:290] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.088179 15118 raft_consensus.cc:2804] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.088548 15118 raft_consensus.cc:493] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.088912 15118 raft_consensus.cc:3060] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.091099 15135 tablet_bootstrap.cc:492] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.091673 15135 ts_tablet_manager.cc:1403] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:20:41.094974 15135 raft_consensus.cc:359] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.095542 15135 raft_consensus.cc:385] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.095809 15135 raft_consensus.cc:740] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.096511 15135 consensus_queue.cc:260] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.099149 15135 ts_tablet_manager.cc:1434] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:41.099790 15134 tablet_bootstrap.cc:492] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.100353 15134 ts_tablet_manager.cc:1403] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.013s
I20260709 13:20:41.100373 15135 tablet_bootstrap.cc:492] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.104019 15134 raft_consensus.cc:359] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.104836 15134 raft_consensus.cc:385] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.105154 15134 raft_consensus.cc:740] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.106076 15134 consensus_queue.cc:260] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.107144 15133 tablet_bootstrap.cc:654] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.108932 15135 tablet_bootstrap.cc:654] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.109135 15134 ts_tablet_manager.cc:1434] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:20:41.110548 15134 tablet_bootstrap.cc:492] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.108989 15118 raft_consensus.cc:515] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.115131 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:41.115763 14918 raft_consensus.cc:3060] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.117805 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.118125 15134 tablet_bootstrap.cc:654] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.119694 15133 tablet_bootstrap.cc:492] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.120796 15133 ts_tablet_manager.cc:1403] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.006s
I20260709 13:20:41.118423 14994 raft_consensus.cc:3060] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.126719 15133 raft_consensus.cc:359] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.127528 15133 raft_consensus.cc:385] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.127750 15135 tablet_bootstrap.cc:492] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.128014 15134 tablet_bootstrap.cc:492] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.128446 15135 ts_tablet_manager.cc:1403] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.009s
I20260709 13:20:41.128682 15134 ts_tablet_manager.cc:1403] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.010s
I20260709 13:20:41.127867 15133 raft_consensus.cc:740] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.115284 15118 leader_election.cc:290] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.131389 15133 consensus_queue.cc:260] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.131644 15135 raft_consensus.cc:359] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.132092 14918 raft_consensus.cc:2468] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.132359 15135 raft_consensus.cc:385] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.133831 15133 ts_tablet_manager.cc:1434] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:20:41.135515 15135 raft_consensus.cc:740] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.134277 14809 leader_election.cc:304] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.136595 15133 tablet_bootstrap.cc:492] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.136917 15118 raft_consensus.cc:2804] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.136679 15135 consensus_queue.cc:260] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.137564 15118 raft_consensus.cc:697] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:41.138610 15118 consensus_queue.cc:237] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.139448 15135 ts_tablet_manager.cc:1434] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:20:41.140560 15135 tablet_bootstrap.cc:492] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.134898 15134 raft_consensus.cc:359] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.142347 15134 raft_consensus.cc:385] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.142673 15134 raft_consensus.cc:740] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.143492 15134 consensus_queue.cc:260] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.145927 15134 ts_tablet_manager.cc:1434] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:20:41.147100 15134 tablet_bootstrap.cc:492] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.147593 15135 tablet_bootstrap.cc:654] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.148641 15047 raft_consensus.cc:493] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.149804 15047 raft_consensus.cc:515] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.152978 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.153699 14845 raft_consensus.cc:2468] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 0.
I20260709 13:20:41.153829 15134 tablet_bootstrap.cc:654] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.155194 14884 leader_election.cc:304] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.157701 15047 leader_election.cc:290] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.157927 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.158281 15047 raft_consensus.cc:2804] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.158556 15047 raft_consensus.cc:493] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.158756 15047 raft_consensus.cc:3060] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.159044 15133 tablet_bootstrap.cc:654] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:41.159415 14885 leader_election.cc:343] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.161410 15135 tablet_bootstrap.cc:492] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.162237 15135 ts_tablet_manager.cc:1403] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:20:41.165832 15135 raft_consensus.cc:359] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.166749 15135 raft_consensus.cc:385] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.167116 15135 raft_consensus.cc:740] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.168040 15135 consensus_queue.cc:260] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.171761 14994 raft_consensus.cc:2468] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.172073 15133 tablet_bootstrap.cc:492] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.172722 15133 ts_tablet_manager.cc:1403] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.004s
I20260709 13:20:41.173175 15135 ts_tablet_manager.cc:1434] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:20:41.174106 15118 raft_consensus.cc:493] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.174384 15135 tablet_bootstrap.cc:492] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.174696 15118 raft_consensus.cc:515] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.176036 15133 raft_consensus.cc:359] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.176823 15133 raft_consensus.cc:385] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.177135 15133 raft_consensus.cc:740] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.177461 15118 leader_election.cc:290] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.178076 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2a621e7d8c46ddaf9ee5c0cc140b7e" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.178835 14918 raft_consensus.cc:2468] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.172583 14741 catalog_manager.cc:5697] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 1 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.178714 15133 consensus_queue.cc:260] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.180751 14809 leader_election.cc:304] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.192239 15146 raft_consensus.cc:2804] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.192616 15146 raft_consensus.cc:493] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.193064 15146 raft_consensus.cc:3060] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.193219 15133 ts_tablet_manager.cc:1434] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 13:20:41.193704 15134 tablet_bootstrap.cc:492] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.194209 15134 ts_tablet_manager.cc:1403] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.000s
I20260709 13:20:41.196334 15133 tablet_bootstrap.cc:492] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.200189 15134 raft_consensus.cc:359] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.201156 15134 raft_consensus.cc:385] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.201476 15134 raft_consensus.cc:740] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.202279 15134 consensus_queue.cc:260] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.204422 15133 tablet_bootstrap.cc:654] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.205165 15135 tablet_bootstrap.cc:654] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.215060 15146 raft_consensus.cc:515] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.221944 15146 leader_election.cc:290] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.219534 15134 ts_tablet_manager.cc:1434] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.004s
I20260709 13:20:41.223475 15047 raft_consensus.cc:515] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.223798 15134 tablet_bootstrap.cc:492] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.220149 15156 raft_consensus.cc:493] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.216271 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2a621e7d8c46ddaf9ee5c0cc140b7e" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.226374 14994 raft_consensus.cc:2468] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.232681 15134 tablet_bootstrap.cc:654] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.233492 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2a621e7d8c46ddaf9ee5c0cc140b7e" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.234112 15156 raft_consensus.cc:515] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.234129 14994 raft_consensus.cc:3060] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.237325 15156 leader_election.cc:290] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.238518 15135 tablet_bootstrap.cc:492] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.239143 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2a621e7d8c46ddaf9ee5c0cc140b7e" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:41.240592 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.250108 14918 raft_consensus.cc:3060] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.250347 14919 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.250582 14992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.242496 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:41.251674 14992 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.251804 14845 raft_consensus.cc:3060] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.253180 14810 leader_election.cc:304] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:41.253892 15156 raft_consensus.cc:2804] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.254161 15156 raft_consensus.cc:493] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.254371 15156 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.242745 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.243152 15047 leader_election.cc:290] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.246106 15133 tablet_bootstrap.cc:492] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.247403 15134 tablet_bootstrap.cc:492] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.249624 15135 ts_tablet_manager.cc:1403] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.008s
W20260709 13:20:41.259187 14885 leader_election.cc:343] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.260926 15156 raft_consensus.cc:515] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.262068 15134 ts_tablet_manager.cc:1403] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.005s
I20260709 13:20:41.263132 14918 raft_consensus.cc:2468] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.263362 15156 leader_election.cc:290] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.261075 15135 raft_consensus.cc:359] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.264474 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:41.264689 14809 leader_election.cc:304] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.265228 14919 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.265648 15159 raft_consensus.cc:2804] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.265972 15134 raft_consensus.cc:359] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.265175 15135 raft_consensus.cc:385] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.266570 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.267663 15134 raft_consensus.cc:385] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.268816 15134 raft_consensus.cc:740] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.267292 15159 raft_consensus.cc:697] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:41.269783 15134 consensus_queue.cc:260] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.270303 15159 consensus_queue.cc:237] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.271821 15134 ts_tablet_manager.cc:1434] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:41.272732 15134 tablet_bootstrap.cc:492] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.268325 15133 ts_tablet_manager.cc:1403] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.008s
I20260709 13:20:41.273432 14845 raft_consensus.cc:2468] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 1.
I20260709 13:20:41.274791 14884 leader_election.cc:304] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:41.275573 15146 raft_consensus.cc:493] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.276213 15146 raft_consensus.cc:515] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.267802 14993 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.267306 15135 raft_consensus.cc:740] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.276458 15153 raft_consensus.cc:2804] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.276587 15133 raft_consensus.cc:359] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.277539 15153 raft_consensus.cc:697] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:41.277666 15135 consensus_queue.cc:260] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.278088 15133 raft_consensus.cc:385] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.278604 15133 raft_consensus.cc:740] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.278717 15153 consensus_queue.cc:237] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.279561 15133 consensus_queue.cc:260] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.280277 15135 ts_tablet_manager.cc:1434] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:20:41.281581 15135 tablet_bootstrap.cc:492] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.285035 15146 leader_election.cc:290] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.288297 15135 tablet_bootstrap.cc:654] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.288657 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.289176 14919 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.289402 14920 raft_consensus.cc:2468] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.291054 14809 leader_election.cc:304] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.291877 15156 raft_consensus.cc:2804] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.292089 14809 leader_election.cc:304] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.292903 15146 raft_consensus.cc:2804] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.293186 15134 tablet_bootstrap.cc:654] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.293298 15146 raft_consensus.cc:493] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.293753 15146 raft_consensus.cc:3060] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.294927 14994 raft_consensus.cc:2468] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.295416 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.292593 15156 raft_consensus.cc:697] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
W20260709 13:20:41.298575 14810 leader_election.cc:343] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.302472 15133 ts_tablet_manager.cc:1434] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:20:41.304201 14993 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.307821 15134 tablet_bootstrap.cc:492] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.308449 15134 ts_tablet_manager.cc:1403] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.007s
I20260709 13:20:41.297621 15156 consensus_queue.cc:237] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.307863 14741 catalog_manager.cc:5697] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.311407 15135 tablet_bootstrap.cc:492] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.311945 15135 ts_tablet_manager.cc:1403] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 13:20:41.313335 15133 tablet_bootstrap.cc:492] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.314848 15135 raft_consensus.cc:359] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.315585 15135 raft_consensus.cc:385] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.315855 15135 raft_consensus.cc:740] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.319547 15134 raft_consensus.cc:359] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.320346 15134 raft_consensus.cc:385] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.320622 15134 raft_consensus.cc:740] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.316363 15146 raft_consensus.cc:515] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.316548 15135 consensus_queue.cc:260] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.323774 15135 ts_tablet_manager.cc:1434] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:20:41.324177 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:41.324852 14919 raft_consensus.cc:3060] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.321444 15134 consensus_queue.cc:260] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.325959 15047 raft_consensus.cc:493] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.326395 15047 raft_consensus.cc:515] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.324805 15135 tablet_bootstrap.cc:492] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: Bootstrap starting.
I20260709 13:20:41.327358 15134 ts_tablet_manager.cc:1434] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:20:41.327340 14742 catalog_manager.cc:5697] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 1 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.328542 15134 tablet_bootstrap.cc:492] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: Bootstrap starting.
I20260709 13:20:41.331909 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dedcce838f42679328b21582ddf40b" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.332652 14845 raft_consensus.cc:2468] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 0.
I20260709 13:20:41.333806 14919 raft_consensus.cc:2468] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.335096 14809 leader_election.cc:304] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.335330 15146 leader_election.cc:290] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.336215 15146 raft_consensus.cc:2804] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.336640 15146 raft_consensus.cc:697] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:41.337217 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.337626 14884 leader_election.cc:304] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.338778 15157 raft_consensus.cc:2804] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.339143 15157 raft_consensus.cc:493] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.339442 15157 raft_consensus.cc:3060] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.337496 15146 consensus_queue.cc:237] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
W20260709 13:20:41.338790 14810 leader_election.cc:343] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.328683 15047 leader_election.cc:290] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.347254 15157 raft_consensus.cc:515] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.350454 15133 tablet_bootstrap.cc:654] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.351325 15135 tablet_bootstrap.cc:654] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.353080 15156 raft_consensus.cc:493] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.353596 15156 raft_consensus.cc:515] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.354465 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dedcce838f42679328b21582ddf40b" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
W20260709 13:20:41.355907 14885 leader_election.cc:343] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.356320 15157 leader_election.cc:290] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.357048 15157 raft_consensus.cc:493] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.357538 15157 raft_consensus.cc:515] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.358412 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dedcce838f42679328b21582ddf40b" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
W20260709 13:20:41.359947 14885 leader_election.cc:343] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.357450 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dedcce838f42679328b21582ddf40b" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:41.350579 15134 tablet_bootstrap.cc:654] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.360885 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6aa2f8b6022488f885571b55a6e92f9" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.361732 14843 raft_consensus.cc:2468] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 0.
I20260709 13:20:41.362196 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cbac131f574cc6acaa2f98a967ef89" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.362811 14919 raft_consensus.cc:2468] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.363358 14884 leader_election.cc:304] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.364099 14809 leader_election.cc:304] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.364308 15047 raft_consensus.cc:2804] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.364836 15047 raft_consensus.cc:493] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.365020 15159 raft_consensus.cc:2804] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.360893 14845 raft_consensus.cc:3060] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.365473 15159 raft_consensus.cc:493] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.365569 15157 leader_election.cc:290] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.366880 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6aa2f8b6022488f885571b55a6e92f9" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.367667 15159 raft_consensus.cc:3060] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.371799 15135 tablet_bootstrap.cc:492] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: No bootstrap required, opened a new log
I20260709 13:20:41.372460 15135 ts_tablet_manager.cc:1403] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.000s
I20260709 13:20:41.367439 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cbac131f574cc6acaa2f98a967ef89" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.373394 14994 raft_consensus.cc:2468] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.374773 15156 leader_election.cc:290] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.375560 15135 raft_consensus.cc:359] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
W20260709 13:20:41.377372 14885 leader_election.cc:343] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.378453 15134 tablet_bootstrap.cc:492] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: No bootstrap required, opened a new log
I20260709 13:20:41.379045 15134 ts_tablet_manager.cc:1403] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.000s
I20260709 13:20:41.378762 15159 raft_consensus.cc:515] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.367493 15047 raft_consensus.cc:3060] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.381637 14845 raft_consensus.cc:2468] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 1.
I20260709 13:20:41.383375 15134 raft_consensus.cc:359] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.384472 15135 raft_consensus.cc:385] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.384289 14884 leader_election.cc:304] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:41.385466 15157 raft_consensus.cc:2804] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.386152 15157 raft_consensus.cc:697] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:41.386603 15047 raft_consensus.cc:515] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.385035 15135 raft_consensus.cc:740] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.388401 15047 leader_election.cc:290] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.386956 15157 consensus_queue.cc:237] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.390540 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6aa2f8b6022488f885571b55a6e92f9" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
W20260709 13:20:41.391932 14885 leader_election.cc:343] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.391840 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cbac131f574cc6acaa2f98a967ef89" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:41.387856 15135 consensus_queue.cc:260] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.392904 14919 raft_consensus.cc:3060] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.393548 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6aa2f8b6022488f885571b55a6e92f9" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:41.394358 14845 raft_consensus.cc:3060] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.394466 15135 ts_tablet_manager.cc:1434] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:20:41.384182 15134 raft_consensus.cc:385] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.395394 15134 raft_consensus.cc:740] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.396109 15134 consensus_queue.cc:260] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.398166 15134 ts_tablet_manager.cc:1434] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:20:41.400569 15133 tablet_bootstrap.cc:492] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.401187 15133 ts_tablet_manager.cc:1403] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.026s
I20260709 13:20:41.402258 14919 raft_consensus.cc:2468] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.403952 14809 leader_election.cc:304] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.404256 15133 raft_consensus.cc:359] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.404889 15156 raft_consensus.cc:2804] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.405061 15133 raft_consensus.cc:385] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.405632 15156 raft_consensus.cc:697] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:41.404963 14739 catalog_manager.cc:5697] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.406711 15156 consensus_queue.cc:237] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.405638 15133 raft_consensus.cc:740] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.408149 15133 consensus_queue.cc:260] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.410248 15159 leader_election.cc:290] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.410879 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30cbac131f574cc6acaa2f98a967ef89" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.411664 14993 raft_consensus.cc:3060] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.410861 15133 ts_tablet_manager.cc:1434] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:20:41.416102 15133 tablet_bootstrap.cc:492] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.416478 14845 raft_consensus.cc:2468] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 1.
I20260709 13:20:41.418239 14884 leader_election.cc:304] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:41.420388 14993 raft_consensus.cc:2468] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:41.420609 15157 raft_consensus.cc:2804] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:41.423520 15157 raft_consensus.cc:697] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:41.424366 15133 tablet_bootstrap.cc:654] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.424484 15157 consensus_queue.cc:237] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.431768 15047 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.432344 15047 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.433633 14741 catalog_manager.cc:5697] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 1 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.437175 15146 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.443010 15146 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.445206 15133 tablet_bootstrap.cc:492] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.445794 15133 ts_tablet_manager.cc:1403] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.010s
I20260709 13:20:41.439859 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.440493 15047 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.446202 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.446388 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.446417 14845 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 0.
I20260709 13:20:41.447726 14919 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 0.
I20260709 13:20:41.447999 14884 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.449121 14809 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:41.449265 15153 raft_consensus.cc:2804] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:20:41.450191 14810 leader_election.cc:343] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.450675 15153 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.450138 15133 raft_consensus.cc:359] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.450120 15159 raft_consensus.cc:2804] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:41.445210 15146 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.451350 15133 raft_consensus.cc:385] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.451601 15159 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:41.451874 15133 raft_consensus.cc:740] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.452342 15159 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.452842 15133 consensus_queue.cc:260] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.453395 14741 catalog_manager.cc:5697] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 1 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.455514 15133 ts_tablet_manager.cc:1434] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:20:41.456108 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:41.451275 15153 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.456640 15133 tablet_bootstrap.cc:492] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
W20260709 13:20:41.461434 14885 leader_election.cc:343] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.467167 15133 tablet_bootstrap.cc:654] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.467756 15159 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.471438 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:41.472734 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
W20260709 13:20:41.472936 14810 leader_election.cc:343] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.474117 14739 catalog_manager.cc:5697] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 0 to 1, leader changed from <none> to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.474574 15159 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.464681 15153 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.478482 14919 raft_consensus.cc:2393] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c0e5f5eb88f4f748002e2a595358edd in current term 1: Already voted for candidate d0d2d0a4884a45f6896b6ea7ed976676 in this term.
I20260709 13:20:41.481345 14809 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd; no voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:41.481382 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:41.482347 14845 raft_consensus.cc:2393] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d0d2d0a4884a45f6896b6ea7ed976676 in current term 1: Already voted for candidate 0c0e5f5eb88f4f748002e2a595358edd in this term.
I20260709 13:20:41.485457 15159 raft_consensus.cc:2749] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.486829 15153 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:41.487030 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
W20260709 13:20:41.489058 14885 leader_election.cc:343] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:41.489495 14885 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d0d2d0a4884a45f6896b6ea7ed976676; no voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:41.490655 15153 raft_consensus.cc:2749] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.494241 15133 tablet_bootstrap.cc:492] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.494201 14742 catalog_manager.cc:5697] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 1 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:41.495222 15133 ts_tablet_manager.cc:1403] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.012s
I20260709 13:20:41.498091 15133 raft_consensus.cc:359] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.498734 15133 raft_consensus.cc:385] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.498955 15133 raft_consensus.cc:740] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.499665 15133 consensus_queue.cc:260] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.501794 15133 ts_tablet_manager.cc:1434] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:20:41.502821 15133 tablet_bootstrap.cc:492] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: Bootstrap starting.
I20260709 13:20:41.509452 15133 tablet_bootstrap.cc:654] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:41.515113 15133 tablet_bootstrap.cc:492] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: No bootstrap required, opened a new log
I20260709 13:20:41.515774 15133 ts_tablet_manager.cc:1403] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:20:41.518514 15133 raft_consensus.cc:359] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.519098 15133 raft_consensus.cc:385] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:41.519403 15133 raft_consensus.cc:740] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Initialized, Role: FOLLOWER
I20260709 13:20:41.519977 15133 consensus_queue.cc:260] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.521567 15133 ts_tablet_manager.cc:1434] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:20:41.584846 15159 consensus_queue.cc:1048] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.598785 15146 consensus_queue.cc:1048] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.604094 15139 raft_consensus.cc:493] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.604751 15139 raft_consensus.cc:515] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.607713 15139 leader_election.cc:290] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:41.611606 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dedcce838f42679328b21582ddf40b" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.610939 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dedcce838f42679328b21582ddf40b" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.612534 14845 raft_consensus.cc:2393] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fe73df8ba834685bab3e3f4654917bc in current term 1: Already voted for candidate d0d2d0a4884a45f6896b6ea7ed976676 in this term.
I20260709 13:20:41.613696 14958 leader_election.cc:304] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc; no voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:41.614408 15139 raft_consensus.cc:3060] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.620044 15139 raft_consensus.cc:2749] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.691720 15139 raft_consensus.cc:493] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.693655 15139 raft_consensus.cc:515] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.696231 15183 raft_consensus.cc:493] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.697384 15183 raft_consensus.cc:515] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.700418 15183 leader_election.cc:290] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:41.701297 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.704623 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.705878 14843 raft_consensus.cc:2393] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fe73df8ba834685bab3e3f4654917bc in current term 1: Already voted for candidate d0d2d0a4884a45f6896b6ea7ed976676 in this term.
I20260709 13:20:41.706024 15139 leader_election.cc:290] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:41.708108 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.709487 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.709887 14918 raft_consensus.cc:2393] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fe73df8ba834685bab3e3f4654917bc in current term 1: Already voted for candidate 0c0e5f5eb88f4f748002e2a595358edd in this term.
I20260709 13:20:41.711650 14958 leader_election.cc:304] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc; no voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:41.713491 14958 leader_election.cc:304] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc; no voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:41.714715 15183 raft_consensus.cc:3060] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.714948 15139 raft_consensus.cc:3060] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.725194 15159 consensus_queue.cc:1048] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.728082 15139 raft_consensus.cc:2749] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.728267 15183 raft_consensus.cc:2749] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.747828 15146 consensus_queue.cc:1048] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.757730 15146 consensus_queue.cc:1048] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.773420 15118 consensus_queue.cc:1048] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.786749 15153 consensus_queue.cc:1048] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.787822 15156 consensus_queue.cc:1048] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.791548 15153 consensus_queue.cc:1048] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.834473 15156 consensus_queue.cc:1048] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.849277 15139 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:41.850145 15139 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:41.850471 15118 consensus_queue.cc:1048] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.853423 14845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd" is_pre_election: true
I20260709 13:20:41.854405 14845 raft_consensus.cc:2393] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fe73df8ba834685bab3e3f4654917bc in current term 1: Already voted for candidate 0c0e5f5eb88f4f748002e2a595358edd in this term.
I20260709 13:20:41.854655 15139 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:41.856369 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:41.857599 14918 raft_consensus.cc:2393] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7fe73df8ba834685bab3e3f4654917bc in current term 1: Already voted for candidate d0d2d0a4884a45f6896b6ea7ed976676 in this term.
I20260709 13:20:41.858954 14958 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc; no voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:41.859761 15139 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.869696 15139 raft_consensus.cc:2749] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:41.872910 15118 consensus_queue.cc:1048] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.875916 15153 consensus_queue.cc:1048] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:41.894775 15157 consensus_queue.cc:1048] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.913722 15157 consensus_queue.cc:1048] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:41.926419 14993 raft_consensus.cc:3060] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:41.936254 15157 consensus_queue.cc:1048] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:20:41.967408 14791 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:20:42.974121 14791 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:43.301952 15156 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:43.302521 15156 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.304477 15156 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:43.305195 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" is_pre_election: true
I20260709 13:20:43.305506 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc" is_pre_election: true
I20260709 13:20:43.305938 14918 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:43.306051 14993 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 1.
I20260709 13:20:43.307358 14810 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:43.308007 15156 raft_consensus.cc:2804] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:20:43.308302 15156 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:43.308640 15156 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.315573 15156 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.317487 15156 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:43.318706 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:43.319442 14918 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.319705 14993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:43.320320 14993 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.327076 14918 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:43.327260 14993 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:43.328554 14810 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:43.329496 15156 raft_consensus.cc:2804] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.330091 15156 raft_consensus.cc:697] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:43.331079 15156 consensus_queue.cc:237] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.340798 14742 catalog_manager.cc:5697] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 0 to 2, leader changed from <none> to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 2 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.470060 14918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
mode: GRACEFUL
new_leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:58988
I20260709 13:20:43.470816 14918 raft_consensus.cc:606] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Received request to transfer leadership to TS 0c0e5f5eb88f4f748002e2a595358edd
I20260709 13:20:43.480439 14843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a73828514c3043fb852da03a101db3fe"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
mode: GRACEFUL
new_leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:36138
I20260709 13:20:43.481166 14843 raft_consensus.cc:606] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Received request to transfer leadership to TS d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:43.486586 14843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
mode: GRACEFUL
new_leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:36138
I20260709 13:20:43.487198 14843 raft_consensus.cc:606] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Received request to transfer leadership to TS d0d2d0a4884a45f6896b6ea7ed976676
I20260709 13:20:43.490715 15146 raft_consensus.cc:993] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: : Instructing follower d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:43.491168 15146 raft_consensus.cc:1081] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Signalling peer d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:43.493039 14918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:58982
I20260709 13:20:43.493791 14918 raft_consensus.cc:493] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.494164 14918 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.500978 14843 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
mode: GRACEFUL
new_leader_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:36138
I20260709 13:20:43.501600 14843 raft_consensus.cc:606] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Received request to transfer leadership to TS 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:43.501399 14918 raft_consensus.cc:515] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.503461 14918 leader_election.cc:290] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:43.504160 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:43.504469 14994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:43.504822 14843 raft_consensus.cc:3055] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.505216 14843 raft_consensus.cc:740] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:43.505251 14994 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.505966 14843 consensus_queue.cc:260] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.507354 14843 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.515621 14994 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:43.516418 14843 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:43.518297 14884 leader_election.cc:304] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:43.519130 15153 raft_consensus.cc:2804] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.520602 15153 raft_consensus.cc:697] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:43.522064 15153 consensus_queue.cc:237] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.530494 14742 catalog_manager.cc:5697] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 1 to 2, leader changed from 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193) to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.716310 14994 raft_consensus.cc:1275] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:43.718968 15146 consensus_queue.cc:1048] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.728236 15156 raft_consensus.cc:993] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: : Instructing follower 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:43.729002 15146 raft_consensus.cc:1081] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Signalling peer 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:43.731271 14991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:20:43.734385 14991 raft_consensus.cc:493] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.734936 14991 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:43.738238 14918 raft_consensus.cc:1275] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:20:43.739507 15208 consensus_queue.cc:1048] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:43.746091 14991 raft_consensus.cc:515] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.750991 14991 leader_election.cc:290] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:43.752619 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:43.753361 14918 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:43.754475 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d145f839de674ba4b0b3b87a100eafaf" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:43.755084 14843 raft_consensus.cc:3055] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:43.755471 14843 raft_consensus.cc:740] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:43.756440 14843 consensus_queue.cc:260] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.758893 14843 raft_consensus.cc:3060] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:43.763455 14918 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:43.764714 14958 leader_election.cc:304] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:43.765559 15139 raft_consensus.cc:2804] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:43.766831 15139 raft_consensus.cc:697] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:43.767755 15139 consensus_queue.cc:237] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.769132 14843 raft_consensus.cc:2468] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:43.778439 14742 catalog_manager.cc:5697] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 2 to 3, leader changed from 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193) to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 3 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:43.815026 15156 raft_consensus.cc:993] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: : Instructing follower d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:43.815611 15208 raft_consensus.cc:1081] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Signalling peer d0d2d0a4884a45f6896b6ea7ed976676 to start an election
I20260709 13:20:43.817704 14918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a73828514c3043fb852da03a101db3fe"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
 from {username='slave'} at 127.0.0.1:58982
I20260709 13:20:43.818188 14918 raft_consensus.cc:493] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.818591 14918 raft_consensus.cc:3060] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.823874 14918 raft_consensus.cc:515] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.825395 14918 leader_election.cc:290] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:43.826365 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:43.826424 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a73828514c3043fb852da03a101db3fe" candidate_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:43.826994 14843 raft_consensus.cc:3055] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.827131 14991 raft_consensus.cc:3060] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.827291 14843 raft_consensus.cc:740] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:43.828075 14843 consensus_queue.cc:260] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.829144 14843 raft_consensus.cc:3060] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.835582 14991 raft_consensus.cc:2468] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:43.837646 14885 leader_election.cc:304] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:43.838634 14843 raft_consensus.cc:2468] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d0d2d0a4884a45f6896b6ea7ed976676 in term 2.
I20260709 13:20:43.838826 15204 raft_consensus.cc:2804] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.839747 15204 raft_consensus.cc:697] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Leader. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:43.840703 15204 consensus_queue.cc:237] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.848223 14742 catalog_manager.cc:5697] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 reported cstate change: term changed from 1 to 2, leader changed from 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193) to d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:43.905395 14991 raft_consensus.cc:1275] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.907022 15204 consensus_queue.cc:1048] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.923216 14843 raft_consensus.cc:1275] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:43.924996 15205 consensus_queue.cc:1048] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:43.925235 15153 raft_consensus.cc:993] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: : Instructing follower 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:43.926350 15205 raft_consensus.cc:1081] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Signalling peer 0c0e5f5eb88f4f748002e2a595358edd to start an election
I20260709 13:20:43.929049 14845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
 from {username='slave'} at 127.0.0.1:36134
I20260709 13:20:43.929947 14845 raft_consensus.cc:493] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:43.930661 14845 raft_consensus.cc:3060] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.939128 14845 raft_consensus.cc:515] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.940747 14845 leader_election.cc:290] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Requested vote from peers d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425), 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195:36937)
I20260709 13:20:43.941864 14919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:43.941864 14991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a928ed0d703f4860a9d4d1ea1963519d" candidate_uuid: "0c0e5f5eb88f4f748002e2a595358edd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
I20260709 13:20:43.942543 14919 raft_consensus.cc:3055] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:43.942919 14919 raft_consensus.cc:740] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:43.942950 14991 raft_consensus.cc:3060] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.943892 14919 consensus_queue.cc:260] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.945103 14919 raft_consensus.cc:3060] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:43.950747 14991 raft_consensus.cc:2468] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:43.952129 14810 leader_election.cc:304] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:43.952416 14919 raft_consensus.cc:2468] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c0e5f5eb88f4f748002e2a595358edd in term 2.
I20260709 13:20:43.953140 15208 raft_consensus.cc:2804] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:43.953850 15208 raft_consensus.cc:697] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Leader. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:43.955292 15208 consensus_queue.cc:237] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:43.964090 14741 catalog_manager.cc:5697] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd reported cstate change: term changed from 1 to 2, leader changed from d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194) to 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193). New cstate: current_term: 2 leader_uuid: "0c0e5f5eb88f4f748002e2a595358edd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:44.360220 14919 raft_consensus.cc:1275] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:44.361768 15139 consensus_queue.cc:1048] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:44.372166 14845 raft_consensus.cc:1275] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:20:44.372905 14991 raft_consensus.cc:1275] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:44.374697 15205 consensus_queue.cc:1048] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:44.375196 15219 consensus_queue.cc:1048] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:44.393930 14845 raft_consensus.cc:1275] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer d0d2d0a4884a45f6896b6ea7ed976676: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:44.395946 15205 consensus_queue.cc:1048] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:44.550462 14994 raft_consensus.cc:1275] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:44.551909 15156 consensus_queue.cc:1048] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:20:44.560485 14919 raft_consensus.cc:1275] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 0c0e5f5eb88f4f748002e2a595358edd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:44.562217 15208 consensus_queue.cc:1048] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:46.505430 14741 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57930:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:46.528586 14741 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57930:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:46.605814  2851 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:46.673221 15261 tablet.cc:1724] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.618579 15253 tablet.cc:1724] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.691362 15256 tablet.cc:1724] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:46.746201 14884 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:39301, user_credentials={real_user=slave}} blocked reactor thread for 68698.5us
W20260709 13:20:46.757108 15020 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:a863cc9bc7b64f68b70158e2cb91c6b8)
W20260709 13:20:46.821863 15265 log.cc:927] Time spent T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:20:46.860520 15020 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:a863cc9bc7b64f68b70158e2cb91c6b8)
W20260709 13:20:46.866561 15020 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:a863cc9bc7b64f68b70158e2cb91c6b8)
I20260709 13:20:46.890434 15285 tablet.cc:1724] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.904294 15282 tablet.cc:1724] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.916050 15284 tablet.cc:1724] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.831066 15269 tablet.cc:1724] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.823729 15273 tablet.cc:1724] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.928946 15286 tablet.cc:1724] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.950347 14919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
mode: GRACEFUL
new_leader_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:59002
I20260709 13:20:46.951025 14919 raft_consensus.cc:606] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Received request to transfer leadership to TS 7fe73df8ba834685bab3e3f4654917bc
W20260709 13:20:46.955708 15272 log.cc:927] Time spent T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: Append to log took a long time: real 0.207s	user 0.003s	sys 0.000s
I20260709 13:20:46.961127 15292 tablet.cc:1724] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:46.964010 15256 tablet.cc:1724] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.006201 15285 tablet.cc:1724] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.006916 15269 tablet.cc:1724] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.016454 15289 tablet.cc:1724] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.019176 15282 tablet.cc:1724] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.030939 15253 tablet.cc:1724] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.069365 15273 tablet.cc:1724] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.082772 15229 raft_consensus.cc:993] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: : Instructing follower 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.082404 15293 tablet.cc:1724] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.083314 15229 raft_consensus.cc:1081] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Signalling peer 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.084667 15284 tablet.cc:1724] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.091279 15261 tablet.cc:1724] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.097137 15269 tablet.cc:1724] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.095883 15292 tablet.cc:1724] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.086231 14992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:55822
I20260709 13:20:47.075454 15289 tablet.cc:1724] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.108479 14992 raft_consensus.cc:493] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:47.109014 14992 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.112556 14842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
mode: GRACEFUL
new_leader_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:34372
I20260709 13:20:47.113474 14842 raft_consensus.cc:606] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Received request to transfer leadership to TS 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:47.115208  2851 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:20:47.114658 15256 tablet.cc:1724] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.113430 15292 tablet.cc:1724] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.118616 14741 catalog_manager.cc:5789] TS 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301) does not have the latest schema for tablet 30cbac131f574cc6acaa2f98a967ef89 (table soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]). Expected version 1 got 0
I20260709 13:20:47.119719 14741 catalog_manager.cc:5789] TS 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301) does not have the latest schema for tablet a928ed0d703f4860a9d4d1ea1963519d (table soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f]). Expected version 1 got 0
I20260709 13:20:47.120931  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:47.132222 14916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce"
dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
mode: GRACEFUL
new_leader_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:59002
I20260709 13:20:47.119943 15289 tablet.cc:1724] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.132889 14916 raft_consensus.cc:606] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Received request to transfer leadership to TS 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:47.146004 15286 tablet.cc:1724] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:47.148864 14842 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758"
dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
mode: GRACEFUL
new_leader_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:34372
I20260709 13:20:47.149575 14842 raft_consensus.cc:606] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Received request to transfer leadership to TS 7fe73df8ba834685bab3e3f4654917bc
I20260709 13:20:47.155303 15229 raft_consensus.cc:993] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: : Instructing follower 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.158602 15229 raft_consensus.cc:1081] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Signalling peer 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.159191  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:47.159895  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:47.165561 14991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:55822
I20260709 13:20:47.166193 14991 raft_consensus.cc:493] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:47.166606 14991 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.184304 14992 raft_consensus.cc:515] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.190514 15230 raft_consensus.cc:993] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: : Instructing follower 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.191095 15230 raft_consensus.cc:1081] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Signalling peer 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.195250 14989 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:20:47.195958 14989 raft_consensus.cc:493] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:47.196349 14989 raft_consensus.cc:3060] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.196926 14916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:47.197618 14916 raft_consensus.cc:3055] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:47.197921 14916 raft_consensus.cc:740] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:47.198815 14916 consensus_queue.cc:260] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.200026 14916 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.200493 14842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e6234ee161748a59f13f389e91c57ae" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:47.201287 14842 raft_consensus.cc:3060] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.202553 14992 leader_election.cc:290] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:47.188680 14991 raft_consensus.cc:515] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.211900 14991 leader_election.cc:290] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:47.213106 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:47.213730 14843 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.213455 14920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad37e59c7e3a4d39a854e7b99639c9ce" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:47.217043 14920 raft_consensus.cc:3055] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:47.217306 14920 raft_consensus.cc:740] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d0d2d0a4884a45f6896b6ea7ed976676, State: Running, Role: LEADER
I20260709 13:20:47.218053 14920 consensus_queue.cc:260] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.219075 14920 raft_consensus.cc:3060] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.219964 14916 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:47.222903 14843 raft_consensus.cc:2468] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:47.224210 14958 leader_election.cc:304] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:47.225359 15283 raft_consensus.cc:2804] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:47.226194 15283 raft_consensus.cc:697] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:47.227293 14989 raft_consensus.cc:515] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.227224 15283 consensus_queue.cc:237] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.228644 14958 leader_election.cc:304] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c0e5f5eb88f4f748002e2a595358edd, 7fe73df8ba834685bab3e3f4654917bc; no voters: 
I20260709 13:20:47.229888 15227 raft_consensus.cc:2804] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:47.230397 15227 raft_consensus.cc:697] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:47.231231 15227 consensus_queue.cc:237] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.232312 14989 leader_election.cc:290] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 2 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:47.233001 14842 raft_consensus.cc:2468] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:47.236066 14920 raft_consensus.cc:2468] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:47.236297 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:47.236904 14918 raft_consensus.cc:3060] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.237232 14842 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a863cc9bc7b64f68b70158e2cb91c6b8" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:47.237828 14842 raft_consensus.cc:3055] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:47.238159 14842 raft_consensus.cc:740] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:47.238932 14842 consensus_queue.cc:260] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.240239 14842 raft_consensus.cc:3060] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:47.244263 14918 raft_consensus.cc:2468] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 2.
I20260709 13:20:47.247105 14958 leader_election.cc:304] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:47.247983 15227 raft_consensus.cc:2804] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:47.245191 14739 catalog_manager.cc:6242] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f: soft_deleted_table [id=8e006218c7ec413d9bf9d55e7e53141f] alter complete (version 1)
I20260709 13:20:47.248436 15227 raft_consensus.cc:697] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 2 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:47.249512 15227 consensus_queue.cc:237] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.250239 14842 raft_consensus.cc:2468] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 2.
I20260709 13:20:47.258633 14742 catalog_manager.cc:5697] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 2 to 3, leader changed from d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194) to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 3 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.260684 14742 catalog_manager.cc:5697] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 2 to 3, leader changed from d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194) to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 3 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.275682 14741 catalog_manager.cc:5697] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 1 to 2, leader changed from 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193) to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 2 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.606787 15260 raft_consensus.cc:993] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: : Instructing follower 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.607302 15267 raft_consensus.cc:1081] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Signalling peer 7fe73df8ba834685bab3e3f4654917bc to start an election
I20260709 13:20:47.609208 14991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758"
dest_uuid: "7fe73df8ba834685bab3e3f4654917bc"
 from {username='slave'} at 127.0.0.1:55818
I20260709 13:20:47.609720 14991 raft_consensus.cc:493] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:47.609961 14991 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.614635 14991 raft_consensus.cc:515] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.616012 14991 leader_election.cc:290] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Requested vote from peers 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301), d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425)
I20260709 13:20:47.616868 14843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c0e5f5eb88f4f748002e2a595358edd"
I20260709 13:20:47.617106 14918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3dabb31e1fc4ffb8b1a73c9e6740758" candidate_uuid: "7fe73df8ba834685bab3e3f4654917bc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d0d2d0a4884a45f6896b6ea7ed976676"
I20260709 13:20:47.617615 14918 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.617612 14843 raft_consensus.cc:3055] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:20:47.618115 14843 raft_consensus.cc:740] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c0e5f5eb88f4f748002e2a595358edd, State: Running, Role: LEADER
I20260709 13:20:47.618844 14843 consensus_queue.cc:260] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.620024 14843 raft_consensus.cc:3060] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:47.625303 14918 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:47.626669 14958 leader_election.cc:304] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fe73df8ba834685bab3e3f4654917bc, d0d2d0a4884a45f6896b6ea7ed976676; no voters: 
I20260709 13:20:47.627403 15227 raft_consensus.cc:2804] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:20:47.627480 14843 raft_consensus.cc:2468] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fe73df8ba834685bab3e3f4654917bc in term 3.
I20260709 13:20:47.627861 15227 raft_consensus.cc:697] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Becoming Leader. State: Replica: 7fe73df8ba834685bab3e3f4654917bc, State: Running, Role: LEADER
I20260709 13:20:47.628818 15227 consensus_queue.cc:237] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } }
I20260709 13:20:47.636804 14741 catalog_manager.cc:5697] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc reported cstate change: term changed from 2 to 3, leader changed from 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193) to 7fe73df8ba834685bab3e3f4654917bc (127.2.200.195). New cstate: current_term: 3 leader_uuid: "7fe73df8ba834685bab3e3f4654917bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fe73df8ba834685bab3e3f4654917bc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36937 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:47.666242 14843 raft_consensus.cc:1275] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:47.667564 15227 consensus_queue.cc:1048] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:47.670508 14918 raft_consensus.cc:1275] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:20:47.671835 15283 consensus_queue.cc:1048] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:20:47.734246 14843 raft_consensus.cc:1275] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:47.735778 15279 consensus_queue.cc:1048] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.737200 14916 raft_consensus.cc:1275] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:20:47.738664 15279 consensus_queue.cc:1048] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.748875 14842 raft_consensus.cc:1275] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.750991 15279 consensus_queue.cc:1048] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:47.764077 14916 raft_consensus.cc:1275] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:47.765631 15279 consensus_queue.cc:1048] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:20:48.048930 14843 raft_consensus.cc:1275] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:48.050516 15307 consensus_queue.cc:1048] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c0e5f5eb88f4f748002e2a595358edd" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 39301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:48.061004 14916 raft_consensus.cc:1275] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Refusing update from remote peer 7fe73df8ba834685bab3e3f4654917bc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:20:48.063788 15279 consensus_queue.cc:1048] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d0d2d0a4884a45f6896b6ea7ed976676" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:20:48.231313  2851 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:20:48.238034  2851 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:20:48.238569  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:48.244267  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:20:48.244746  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:49.280125  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
W20260709 13:20:49.300503 14884 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
W20260709 13:20:49.304630 14884 consensus_peers.cc:597] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.317868 14958 consensus_peers.cc:597] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.317924  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:49.319661  2851 tablet_replica.cc:333] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.320994  2851 raft_consensus.cc:2243] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.322520  2851 raft_consensus.cc:2272] T 30cbac131f574cc6acaa2f98a967ef89 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.325547  2851 tablet_replica.cc:333] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.326529  2851 raft_consensus.cc:2243] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.327081  2851 raft_consensus.cc:2272] T 3e6234ee161748a59f13f389e91c57ae P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.329191  2851 tablet_replica.cc:333] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.329874  2851 raft_consensus.cc:2243] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.330286  2851 raft_consensus.cc:2272] T a73828514c3043fb852da03a101db3fe P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.332142  2851 tablet_replica.cc:333] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.332683  2851 raft_consensus.cc:2243] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.333490  2851 raft_consensus.cc:2272] T a928ed0d703f4860a9d4d1ea1963519d P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.336073  2851 tablet_replica.cc:333] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.336802  2851 raft_consensus.cc:2243] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.337340  2851 raft_consensus.cc:2272] T f6aa2f8b6022488f885571b55a6e92f9 P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.339459  2851 tablet_replica.cc:333] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.340018  2851 raft_consensus.cc:2243] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.340382  2851 raft_consensus.cc:2272] T a863cc9bc7b64f68b70158e2cb91c6b8 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.342450  2851 tablet_replica.cc:333] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.342964  2851 raft_consensus.cc:2243] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.343346  2851 raft_consensus.cc:2272] T d145f839de674ba4b0b3b87a100eafaf P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.345359  2851 tablet_replica.cc:333] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.345887  2851 raft_consensus.cc:2243] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.346659  2851 raft_consensus.cc:2272] T 89653be736a44a029993f04e352b9952 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.348781  2851 tablet_replica.cc:333] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.349292  2851 raft_consensus.cc:2243] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.350030  2851 raft_consensus.cc:2272] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.352106  2851 tablet_replica.cc:333] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.352630  2851 raft_consensus.cc:2243] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.353113  2851 raft_consensus.cc:2272] T 92430dc685ee4963bf0d07d3018843bc P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.355515  2851 tablet_replica.cc:333] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.355996  2851 raft_consensus.cc:2243] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.356480  2851 raft_consensus.cc:2272] T 709f3eebae3c4e008cb2757687013389 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.358492  2851 tablet_replica.cc:333] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.358958  2851 raft_consensus.cc:2243] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.359334  2851 raft_consensus.cc:2272] T a4b7a6c16d1448a4933b9cbfef34938c P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.361511  2851 tablet_replica.cc:333] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.361991  2851 raft_consensus.cc:2243] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.362418  2851 raft_consensus.cc:2272] T a6dedcce838f42679328b21582ddf40b P 0c0e5f5eb88f4f748002e2a595358edd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.364228  2851 tablet_replica.cc:333] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.364722  2851 raft_consensus.cc:2243] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.365100  2851 raft_consensus.cc:2272] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.367092  2851 tablet_replica.cc:333] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.367600  2851 raft_consensus.cc:2243] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.367997  2851 raft_consensus.cc:2272] T 9b2d2d4cf76842b2938e6562db643648 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.370199  2851 tablet_replica.cc:333] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.371160  2851 raft_consensus.cc:2243] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.371974  2851 raft_consensus.cc:2272] T b557d31b901d4795aaf7b402a1b6d1a0 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.375144  2851 tablet_replica.cc:333] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.375773  2851 raft_consensus.cc:2243] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.376294  2851 raft_consensus.cc:2272] T ad37e59c7e3a4d39a854e7b99639c9ce P 0c0e5f5eb88f4f748002e2a595358edd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.378823  2851 tablet_replica.cc:333] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd: stopping tablet replica
I20260709 13:20:49.379492  2851 raft_consensus.cc:2243] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.380371  2851 raft_consensus.cc:2272] T 0d1030e4a8e74205bf9703aa001b3dc1 P 0c0e5f5eb88f4f748002e2a595358edd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.426283  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:20:49.463958  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
W20260709 13:20:49.472280 14884 consensus_peers.cc:597] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:39301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.500949  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:49.501883  2851 tablet_replica.cc:333] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.502862  2851 raft_consensus.cc:2243] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.504094  2851 raft_consensus.cc:2272] T a73828514c3043fb852da03a101db3fe P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.506203  2851 tablet_replica.cc:333] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.506834  2851 raft_consensus.cc:2243] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.507252  2851 raft_consensus.cc:2272] T 30cbac131f574cc6acaa2f98a967ef89 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.509347  2851 tablet_replica.cc:333] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.510051  2851 raft_consensus.cc:2243] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.510776  2851 raft_consensus.cc:2272] T f6aa2f8b6022488f885571b55a6e92f9 P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.512645  2851 tablet_replica.cc:333] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.513228  2851 raft_consensus.cc:2243] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.513652  2851 raft_consensus.cc:2272] T a863cc9bc7b64f68b70158e2cb91c6b8 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.515516  2851 tablet_replica.cc:333] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.516021  2851 raft_consensus.cc:2243] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.516934  2851 raft_consensus.cc:2272] T 3e6234ee161748a59f13f389e91c57ae P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.519467  2851 tablet_replica.cc:333] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.520033  2851 raft_consensus.cc:2243] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.520442  2851 raft_consensus.cc:2272] T a928ed0d703f4860a9d4d1ea1963519d P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.522621  2851 tablet_replica.cc:333] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.523149  2851 raft_consensus.cc:2243] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.523581  2851 raft_consensus.cc:2272] T b557d31b901d4795aaf7b402a1b6d1a0 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.525593  2851 tablet_replica.cc:333] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.526119  2851 raft_consensus.cc:2243] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.526922  2851 raft_consensus.cc:2272] T 9b2d2d4cf76842b2938e6562db643648 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.528998  2851 tablet_replica.cc:333] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.529490  2851 raft_consensus.cc:2243] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.530256  2851 raft_consensus.cc:2272] T a6dedcce838f42679328b21582ddf40b P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.532402  2851 tablet_replica.cc:333] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.532900  2851 raft_consensus.cc:2243] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.533293  2851 raft_consensus.cc:2272] T c3dabb31e1fc4ffb8b1a73c9e6740758 P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.535079  2851 tablet_replica.cc:333] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.535575  2851 raft_consensus.cc:2243] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.536345  2851 raft_consensus.cc:2272] T a4b7a6c16d1448a4933b9cbfef34938c P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.538475  2851 tablet_replica.cc:333] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.539006  2851 raft_consensus.cc:2243] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.539419  2851 raft_consensus.cc:2272] T d145f839de674ba4b0b3b87a100eafaf P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.541226  2851 tablet_replica.cc:333] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.541728  2851 raft_consensus.cc:2243] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.542128  2851 raft_consensus.cc:2272] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.544090  2851 tablet_replica.cc:333] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.544597  2851 raft_consensus.cc:2243] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.545070  2851 raft_consensus.cc:2272] T 89653be736a44a029993f04e352b9952 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.546908  2851 tablet_replica.cc:333] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.547423  2851 raft_consensus.cc:2243] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.548202  2851 raft_consensus.cc:2272] T 709f3eebae3c4e008cb2757687013389 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.550282  2851 tablet_replica.cc:333] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.550781  2851 raft_consensus.cc:2243] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.551222  2851 raft_consensus.cc:2272] T 0d1030e4a8e74205bf9703aa001b3dc1 P d0d2d0a4884a45f6896b6ea7ed976676 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.553958  2851 tablet_replica.cc:333] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.554591  2851 raft_consensus.cc:2243] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.556524  2851 raft_consensus.cc:2272] T ad37e59c7e3a4d39a854e7b99639c9ce P d0d2d0a4884a45f6896b6ea7ed976676 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:49.557756 14958 consensus_peers.cc:597] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc -> Peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Couldn't send request to peer d0d2d0a4884a45f6896b6ea7ed976676. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.559463  2851 tablet_replica.cc:333] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676: stopping tablet replica
I20260709 13:20:49.560194  2851 raft_consensus.cc:2243] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.560794  2851 raft_consensus.cc:2272] T 92430dc685ee4963bf0d07d3018843bc P d0d2d0a4884a45f6896b6ea7ed976676 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:49.575691 14958 consensus_peers.cc:597] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:39301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.592960 14958 consensus_peers.cc:597] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:39301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.608593  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
W20260709 13:20:49.614573 14958 consensus_peers.cc:597] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:39301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.624840 14958 consensus_peers.cc:597] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc -> Peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Couldn't send request to peer d0d2d0a4884a45f6896b6ea7ed976676. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:43425: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:20:49.640050 14958 consensus_peers.cc:597] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc -> Peer 0c0e5f5eb88f4f748002e2a595358edd (127.2.200.193:39301): Couldn't send request to peer 0c0e5f5eb88f4f748002e2a595358edd. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:39301: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.647519  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
I20260709 13:20:49.681844  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:20:49.682566  2851 tablet_replica.cc:333] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.683215  2851 raft_consensus.cc:2243] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.683712  2851 raft_consensus.cc:2272] T a73828514c3043fb852da03a101db3fe P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.685851  2851 tablet_replica.cc:333] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.686409  2851 raft_consensus.cc:2243] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.686853  2851 raft_consensus.cc:2272] T a928ed0d703f4860a9d4d1ea1963519d P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.688704  2851 tablet_replica.cc:333] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.689409  2851 raft_consensus.cc:2243] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.690678  2851 raft_consensus.cc:2272] T 3e6234ee161748a59f13f389e91c57ae P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.693276  2851 tablet_replica.cc:333] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.693894  2851 raft_consensus.cc:2243] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.694365  2851 raft_consensus.cc:2272] T 30cbac131f574cc6acaa2f98a967ef89 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.696839  2851 tablet_replica.cc:333] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.697459  2851 raft_consensus.cc:2243] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.697975  2851 raft_consensus.cc:2272] T f6aa2f8b6022488f885571b55a6e92f9 P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.700344  2851 tablet_replica.cc:333] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.701122  2851 raft_consensus.cc:2243] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.702080  2851 raft_consensus.cc:2272] T a863cc9bc7b64f68b70158e2cb91c6b8 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.705057  2851 tablet_replica.cc:333] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.705837  2851 raft_consensus.cc:2243] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.707024  2851 raft_consensus.cc:2272] T d145f839de674ba4b0b3b87a100eafaf P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:20:49.708366 14958 consensus_peers.cc:597] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc -> Peer d0d2d0a4884a45f6896b6ea7ed976676 (127.2.200.194:43425): Couldn't send request to peer d0d2d0a4884a45f6896b6ea7ed976676. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.194:43425: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:20:49.709844  2851 tablet_replica.cc:333] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.710799  2851 raft_consensus.cc:2243] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.711283  2851 raft_consensus.cc:2272] T 89653be736a44a029993f04e352b9952 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.713557  2851 tablet_replica.cc:333] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.714124  2851 raft_consensus.cc:2243] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.714546  2851 raft_consensus.cc:2272] T 8c2a621e7d8c46ddaf9ee5c0cc140b7e P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.716720  2851 tablet_replica.cc:333] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.717303  2851 raft_consensus.cc:2243] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.717762  2851 raft_consensus.cc:2272] T 0d1030e4a8e74205bf9703aa001b3dc1 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.719774  2851 tablet_replica.cc:333] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.720311  2851 raft_consensus.cc:2243] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.721129  2851 raft_consensus.cc:2272] T ad37e59c7e3a4d39a854e7b99639c9ce P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.723129  2851 tablet_replica.cc:333] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.723603  2851 raft_consensus.cc:2243] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.724016  2851 raft_consensus.cc:2272] T b557d31b901d4795aaf7b402a1b6d1a0 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.726238  2851 tablet_replica.cc:333] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.726712  2851 raft_consensus.cc:2243] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.727476  2851 raft_consensus.cc:2272] T 709f3eebae3c4e008cb2757687013389 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.730139  2851 tablet_replica.cc:333] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.730960  2851 raft_consensus.cc:2243] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.731968  2851 raft_consensus.cc:2272] T 92430dc685ee4963bf0d07d3018843bc P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.734653  2851 tablet_replica.cc:333] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.735401  2851 raft_consensus.cc:2243] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.735863  2851 raft_consensus.cc:2272] T a4b7a6c16d1448a4933b9cbfef34938c P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.738099  2851 tablet_replica.cc:333] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.738592  2851 raft_consensus.cc:2243] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.739003  2851 raft_consensus.cc:2272] T a6dedcce838f42679328b21582ddf40b P 7fe73df8ba834685bab3e3f4654917bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.741422  2851 tablet_replica.cc:333] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.741854  2851 raft_consensus.cc:2243] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.742630  2851 raft_consensus.cc:2272] T c3dabb31e1fc4ffb8b1a73c9e6740758 P 7fe73df8ba834685bab3e3f4654917bc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.744866  2851 tablet_replica.cc:333] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc: stopping tablet replica
I20260709 13:20:49.745342  2851 raft_consensus.cc:2243] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:20:49.745751  2851 raft_consensus.cc:2272] T 9b2d2d4cf76842b2938e6562db643648 P 7fe73df8ba834685bab3e3f4654917bc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.786545  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:20:49.822393  2851 master.cc:562] Master@127.2.200.254:46303 shutting down...
I20260709 13:20:49.847831  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:20:49.848529  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:20:49.848964  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P e16e90fef38a4944b5bcaff045116d5f: stopping tablet replica
I20260709 13:20:49.870630  2851 master.cc:584] Master@127.2.200.254:46303 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (14163 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:20:49.930254  2851 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.2.200.254:40583
I20260709 13:20:49.931638  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:49.938668 15319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:49.938685 15318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.940524  2851 server_base.cc:1061] running on GCE node
W20260709 13:20:49.940629 15321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:49.941733  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:49.941926  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:49.942080  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603249942056 us; error 0 us; skew 500 ppm
I20260709 13:20:49.942574  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:49.945238  2851 webserver.cc:533] Webserver started at http://127.2.200.254:42881/ using document root <none> and password file <none>
I20260709 13:20:49.945701  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:49.945873  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:49.946132  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:49.947209  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/master-0-root/instance:
uuid: "4421c2d69c494b5ea84d3f003abc48ec"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-108k"
I20260709 13:20:49.951956  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:20:49.956008 15326 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:49.956835  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:20:49.957199  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/master-0-root
uuid: "4421c2d69c494b5ea84d3f003abc48ec"
format_stamp: "Formatted at 2026-07-09 13:20:49 on dist-test-slave-108k"
I20260709 13:20:49.957446  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:49.981115  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:49.982288  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:50.024905  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.254:40583
I20260709 13:20:50.025004 15377 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.254:40583 every 8 connection(s)
I20260709 13:20:50.028822 15378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.045110 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec: Bootstrap starting.
I20260709 13:20:50.050190 15378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.055055 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec: No bootstrap required, opened a new log
I20260709 13:20:50.057375 15378 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4421c2d69c494b5ea84d3f003abc48ec" member_type: VOTER }
I20260709 13:20:50.057772 15378 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.057999 15378 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4421c2d69c494b5ea84d3f003abc48ec, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.058634 15378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4421c2d69c494b5ea84d3f003abc48ec" member_type: VOTER }
I20260709 13:20:50.059110 15378 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:20:50.059341 15378 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:20:50.059589 15378 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:50.064561 15378 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4421c2d69c494b5ea84d3f003abc48ec" member_type: VOTER }
I20260709 13:20:50.065138 15378 leader_election.cc:304] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4421c2d69c494b5ea84d3f003abc48ec; no voters: 
I20260709 13:20:50.066288 15378 leader_election.cc:290] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:20:50.066622 15381 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:50.067991 15381 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 1 LEADER]: Becoming Leader. State: Replica: 4421c2d69c494b5ea84d3f003abc48ec, State: Running, Role: LEADER
I20260709 13:20:50.068578 15381 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4421c2d69c494b5ea84d3f003abc48ec" member_type: VOTER }
I20260709 13:20:50.069294 15378 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:20:50.072923 15383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4421c2d69c494b5ea84d3f003abc48ec. Latest consensus state: current_term: 1 leader_uuid: "4421c2d69c494b5ea84d3f003abc48ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4421c2d69c494b5ea84d3f003abc48ec" member_type: VOTER } }
I20260709 13:20:50.072902 15382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4421c2d69c494b5ea84d3f003abc48ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4421c2d69c494b5ea84d3f003abc48ec" member_type: VOTER } }
I20260709 13:20:50.073752 15383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:50.073823 15382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [sys.catalog]: This master's current role is: LEADER
I20260709 13:20:50.077736 15387 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:20:50.082537 15387 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:20:50.087055  2851 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:20:50.091832 15387 catalog_manager.cc:1383] Generated new cluster ID: 72025e9b738e456ba7ca1156268cfc04
I20260709 13:20:50.092170 15387 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:20:50.107650 15387 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:20:50.109043 15387 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:20:50.126226 15387 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec: Generated new TSK 0
I20260709 13:20:50.126868 15387 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:20:50.154732  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:50.161398 15399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:50.161799 15400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:50.165092  2851 server_base.cc:1061] running on GCE node
W20260709 13:20:50.166050 15402 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:50.166970  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:50.167194  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:50.167333  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603250167322 us; error 0 us; skew 500 ppm
I20260709 13:20:50.167781  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:50.170303  2851 webserver.cc:533] Webserver started at http://127.2.200.193:43919/ using document root <none> and password file <none>
I20260709 13:20:50.170943  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:50.171161  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:50.171417  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:50.172482  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-0-root/instance:
uuid: "2e7632d2760e4ec8909541cec49d3288"
format_stamp: "Formatted at 2026-07-09 13:20:50 on dist-test-slave-108k"
I20260709 13:20:50.176993  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:20:50.180459 15407 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.181278  2851 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:20:50.181560  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-0-root
uuid: "2e7632d2760e4ec8909541cec49d3288"
format_stamp: "Formatted at 2026-07-09 13:20:50 on dist-test-slave-108k"
I20260709 13:20:50.181823  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:50.196998  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:50.198573  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:50.200265  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:50.202907  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:50.203161  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.203387  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:50.203562  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.251379  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.193:32835
I20260709 13:20:50.251521 15469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.193:32835 every 8 connection(s)
I20260709 13:20:50.256397  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:50.263988 15474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:50.264640 15475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:50.266817 15477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:50.268462  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:50.269330 15470 heartbeater.cc:344] Connected to a master server at 127.2.200.254:40583
I20260709 13:20:50.269564  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:20:50.269815 15470 heartbeater.cc:461] Registering TS with master...
W20260709 13:20:50.269872  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:50.270190  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603250270169 us; error 0 us; skew 500 ppm
I20260709 13:20:50.270821 15470 heartbeater.cc:507] Master 127.2.200.254:40583 requested a full tablet report, sending...
I20260709 13:20:50.270998  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:50.273710 15343 ts_manager.cc:194] Registered new tserver with Master: 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835)
I20260709 13:20:50.274083  2851 webserver.cc:533] Webserver started at http://127.2.200.194:45359/ using document root <none> and password file <none>
I20260709 13:20:50.274672  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:50.274837  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:50.275122  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:50.276216 15343 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41054
I20260709 13:20:50.276351  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-1-root/instance:
uuid: "8572907d902c419daac824efe24b9219"
format_stamp: "Formatted at 2026-07-09 13:20:50 on dist-test-slave-108k"
I20260709 13:20:50.281914  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:50.285346 15482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.286391  2851 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:20:50.286835  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-1-root
uuid: "8572907d902c419daac824efe24b9219"
format_stamp: "Formatted at 2026-07-09 13:20:50 on dist-test-slave-108k"
I20260709 13:20:50.287137  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:50.300534  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:50.301782  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:50.303295  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:50.305711  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:50.305891  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.306128  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:50.306288  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.355105  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.194:42537
I20260709 13:20:50.355228 15545 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.194:42537 every 8 connection(s)
I20260709 13:20:50.360321  2851 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:20:50.368430 15549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:50.368518 15550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:20:50.372061 15552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:20:50.372831 15546 heartbeater.cc:344] Connected to a master server at 127.2.200.254:40583
I20260709 13:20:50.373219 15546 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:50.373687  2851 server_base.cc:1061] running on GCE node
I20260709 13:20:50.374183 15546 heartbeater.cc:507] Master 127.2.200.254:40583 requested a full tablet report, sending...
I20260709 13:20:50.374809  2851 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:20:50.375113  2851 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:20:50.375322  2851 hybrid_clock.cc:648] HybridClock initialized: now 1783603250375305 us; error 0 us; skew 500 ppm
I20260709 13:20:50.376062  2851 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:20:50.376704 15343 ts_manager.cc:194] Registered new tserver with Master: 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:50.378870  2851 webserver.cc:533] Webserver started at http://127.2.200.195:41605/ using document root <none> and password file <none>
I20260709 13:20:50.379048 15343 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41066
I20260709 13:20:50.379449  2851 fs_manager.cc:362] Metadata directory not provided
I20260709 13:20:50.379727  2851 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:20:50.379974  2851 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:20:50.381757  2851 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-2-root/instance:
uuid: "5fb839e1f6284f28a5698aeedbb713dc"
format_stamp: "Formatted at 2026-07-09 13:20:50 on dist-test-slave-108k"
I20260709 13:20:50.387193  2851 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:20:50.392272 15557 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.393627  2851 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:20:50.394026  2851 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-2-root
uuid: "5fb839e1f6284f28a5698aeedbb713dc"
format_stamp: "Formatted at 2026-07-09 13:20:50 on dist-test-slave-108k"
I20260709 13:20:50.394305  2851 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYI2Jxx/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602908838664-2851-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:20:50.408571  2851 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:20:50.409915  2851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:20:50.411473  2851 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:20:50.414037  2851 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:20:50.414252  2851 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.414562  2851 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:20:50.414768  2851 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:20:50.463835  2851 rpc_server.cc:307] RPC server started. Bound to: 127.2.200.195:36029
I20260709 13:20:50.463958 15619 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.2.200.195:36029 every 8 connection(s)
I20260709 13:20:50.478710 15620 heartbeater.cc:344] Connected to a master server at 127.2.200.254:40583
I20260709 13:20:50.479374 15620 heartbeater.cc:461] Registering TS with master...
I20260709 13:20:50.480338 15620 heartbeater.cc:507] Master 127.2.200.254:40583 requested a full tablet report, sending...
I20260709 13:20:50.482630 15343 ts_manager.cc:194] Registered new tserver with Master: 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:50.482860  2851 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015958196s
I20260709 13:20:50.484323 15343 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41078
I20260709 13:20:50.512826 15343 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41084:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:50.515944 15343 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:20:50.598549 15510 tablet_service.cc:1511] Processing CreateTablet for tablet d347077f6a38436cbd3f8a4b576e25de (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:50.600208 15510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d347077f6a38436cbd3f8a4b576e25de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.601346 15435 tablet_service.cc:1511] Processing CreateTablet for tablet d347077f6a38436cbd3f8a4b576e25de (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:50.602752 15435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d347077f6a38436cbd3f8a4b576e25de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.604051 15508 tablet_service.cc:1511] Processing CreateTablet for tablet fff3611aaa19462c9ef0a8f951f2aef8 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:50.605422 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff3611aaa19462c9ef0a8f951f2aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.613929 15507 tablet_service.cc:1511] Processing CreateTablet for tablet d1a14ab557d24442ad423a1c8a32fd71 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:50.614329 15434 tablet_service.cc:1511] Processing CreateTablet for tablet c382123eecb645629a091a46d926010e (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:50.615535 15434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c382123eecb645629a091a46d926010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.602823 15509 tablet_service.cc:1511] Processing CreateTablet for tablet c382123eecb645629a091a46d926010e (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:50.618546 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 7091192e79024f80bdee9b03802a9336 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:50.620158 15433 tablet_service.cc:1511] Processing CreateTablet for tablet fff3611aaa19462c9ef0a8f951f2aef8 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:50.621373 15505 tablet_service.cc:1511] Processing CreateTablet for tablet 8eec348b9fe349c7a73af8039a9e0f89 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:50.621943 15504 tablet_service.cc:1511] Processing CreateTablet for tablet 2c51c8c75dcb4225af4febe90e71c80f (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:50.615450 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a14ab557d24442ad423a1c8a32fd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.622510 15432 tablet_service.cc:1511] Processing CreateTablet for tablet d1a14ab557d24442ad423a1c8a32fd71 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:50.623284 15509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c382123eecb645629a091a46d926010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.623960 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7091192e79024f80bdee9b03802a9336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.624571 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eec348b9fe349c7a73af8039a9e0f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.625701 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c51c8c75dcb4225af4febe90e71c80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.625986 15430 tablet_service.cc:1511] Processing CreateTablet for tablet 8eec348b9fe349c7a73af8039a9e0f89 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:50.627852 15503 tablet_service.cc:1511] Processing CreateTablet for tablet 9db8c0722aed4993a0e79305c889a80a (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:50.628196 15429 tablet_service.cc:1511] Processing CreateTablet for tablet 2c51c8c75dcb4225af4febe90e71c80f (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:50.624708 15431 tablet_service.cc:1511] Processing CreateTablet for tablet 7091192e79024f80bdee9b03802a9336 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:50.629906 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a14ab557d24442ad423a1c8a32fd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.630558 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7091192e79024f80bdee9b03802a9336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.631871 15503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db8c0722aed4993a0e79305c889a80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.634543 15428 tablet_service.cc:1511] Processing CreateTablet for tablet 9db8c0722aed4993a0e79305c889a80a (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:50.636719 15427 tablet_service.cc:1511] Processing CreateTablet for tablet 622fd85e9f104a068bdd351171b5d494 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:50.637938 15502 tablet_service.cc:1511] Processing CreateTablet for tablet 622fd85e9f104a068bdd351171b5d494 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:50.639551 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622fd85e9f104a068bdd351171b5d494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.641283 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff3611aaa19462c9ef0a8f951f2aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.643905 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c51c8c75dcb4225af4febe90e71c80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.649153 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eec348b9fe349c7a73af8039a9e0f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.649833 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db8c0722aed4993a0e79305c889a80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.653100 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622fd85e9f104a068bdd351171b5d494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.665910 15635 tablet_bootstrap.cc:492] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:50.672362 15635 tablet_bootstrap.cc:654] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.682998 15585 tablet_service.cc:1511] Processing CreateTablet for tablet d347077f6a38436cbd3f8a4b576e25de (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:50.684854 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d347077f6a38436cbd3f8a4b576e25de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.708844 15637 tablet_bootstrap.cc:492] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:50.710541 15584 tablet_service.cc:1511] Processing CreateTablet for tablet c382123eecb645629a091a46d926010e (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:50.711959 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c382123eecb645629a091a46d926010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.716102 15637 tablet_bootstrap.cc:654] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.726063 15583 tablet_service.cc:1511] Processing CreateTablet for tablet fff3611aaa19462c9ef0a8f951f2aef8 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:50.727553 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fff3611aaa19462c9ef0a8f951f2aef8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.736280 15582 tablet_service.cc:1511] Processing CreateTablet for tablet d1a14ab557d24442ad423a1c8a32fd71 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:50.737758 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1a14ab557d24442ad423a1c8a32fd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.746515 15581 tablet_service.cc:1511] Processing CreateTablet for tablet 7091192e79024f80bdee9b03802a9336 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:50.747980 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7091192e79024f80bdee9b03802a9336. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.761143 15580 tablet_service.cc:1511] Processing CreateTablet for tablet 8eec348b9fe349c7a73af8039a9e0f89 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:50.762946 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eec348b9fe349c7a73af8039a9e0f89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.780508 15579 tablet_service.cc:1511] Processing CreateTablet for tablet 2c51c8c75dcb4225af4febe90e71c80f (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:50.782009 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c51c8c75dcb4225af4febe90e71c80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.790503 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 9db8c0722aed4993a0e79305c889a80a (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:50.791957 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9db8c0722aed4993a0e79305c889a80a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.797148 15639 tablet_bootstrap.cc:492] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:50.809463 15639 tablet_bootstrap.cc:654] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.815523 15585 tablet_service.cc:1511] Processing CreateTablet for tablet 622fd85e9f104a068bdd351171b5d494 (DEFAULT_TABLE table=test-workload [id=fa49f5b3fcee400991f780873bc6fe8e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:50.817236 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622fd85e9f104a068bdd351171b5d494. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:50.828147 15639 tablet_bootstrap.cc:492] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:50.828891 15639 ts_tablet_manager.cc:1403] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.003s
I20260709 13:20:50.832403 15639 raft_consensus.cc:359] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.836640 15639 raft_consensus.cc:385] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.837189 15639 raft_consensus.cc:740] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.838248 15639 consensus_queue.cc:260] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.852535 15635 tablet_bootstrap.cc:492] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:50.853329 15635 ts_tablet_manager.cc:1403] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.188s	user 0.039s	sys 0.090s
I20260709 13:20:50.854046 15637 tablet_bootstrap.cc:492] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:50.854511 15637 ts_tablet_manager.cc:1403] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.146s	user 0.074s	sys 0.066s
I20260709 13:20:50.856995 15620 heartbeater.cc:499] Master 127.2.200.254:40583 was elected leader, sending a full tablet report...
I20260709 13:20:50.856725 15635 raft_consensus.cc:359] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.856801 15637 raft_consensus.cc:359] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.857569 15635 raft_consensus.cc:385] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.857728 15637 raft_consensus.cc:385] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.857944 15635 raft_consensus.cc:740] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.858042 15639 ts_tablet_manager.cc:1434] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 13:20:50.858141 15637 raft_consensus.cc:740] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.859251 15639 tablet_bootstrap.cc:492] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:50.859267 15635 consensus_queue.cc:260] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.859567 15637 consensus_queue.cc:260] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.866313 15639 tablet_bootstrap.cc:654] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.871564 15470 heartbeater.cc:499] Master 127.2.200.254:40583 was elected leader, sending a full tablet report...
I20260709 13:20:50.872052 15637 ts_tablet_manager.cc:1434] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.007s
I20260709 13:20:50.871580 15635 ts_tablet_manager.cc:1434] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.013s
I20260709 13:20:50.875902 15635 tablet_bootstrap.cc:492] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:50.876597 15639 tablet_bootstrap.cc:492] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:50.877172 15639 ts_tablet_manager.cc:1403] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:20:50.878244 15637 tablet_bootstrap.cc:492] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:50.880285 15639 raft_consensus.cc:359] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.877161 15546 heartbeater.cc:499] Master 127.2.200.254:40583 was elected leader, sending a full tablet report...
I20260709 13:20:50.883242 15635 tablet_bootstrap.cc:654] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.887105 15639 raft_consensus.cc:385] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.887449 15639 raft_consensus.cc:740] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.888213 15637 tablet_bootstrap.cc:654] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.888830 15639 consensus_queue.cc:260] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.891481 15639 ts_tablet_manager.cc:1434] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:20:50.892616 15639 tablet_bootstrap.cc:492] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:50.898870 15639 tablet_bootstrap.cc:654] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.910715 15639 tablet_bootstrap.cc:492] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:50.911230 15639 ts_tablet_manager.cc:1403] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:20:50.914156 15639 raft_consensus.cc:359] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.914943 15639 raft_consensus.cc:385] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.915275 15639 raft_consensus.cc:740] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.916235 15639 consensus_queue.cc:260] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.920367 15639 ts_tablet_manager.cc:1434] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:20:50.921420 15639 tablet_bootstrap.cc:492] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:50.928017 15639 tablet_bootstrap.cc:654] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.937866 15643 raft_consensus.cc:493] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:50.938463 15643 raft_consensus.cc:515] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.939618 15639 tablet_bootstrap.cc:492] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:50.940213 15639 ts_tablet_manager.cc:1403] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:20:50.943841 15639 raft_consensus.cc:359] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.944585 15639 raft_consensus.cc:385] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.944885 15639 raft_consensus.cc:740] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.946980 15639 consensus_queue.cc:260] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.950588 15643 leader_election.cc:290] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:50.951948 15639 ts_tablet_manager.cc:1434] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:20:50.953101 15639 tablet_bootstrap.cc:492] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:50.959925 15639 tablet_bootstrap.cc:654] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:50.976572 15637 tablet_bootstrap.cc:492] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:50.977185 15637 ts_tablet_manager.cc:1403] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.099s	user 0.029s	sys 0.035s
I20260709 13:20:50.979408 15635 tablet_bootstrap.cc:492] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:50.980008 15635 ts_tablet_manager.cc:1403] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.104s	user 0.029s	sys 0.070s
I20260709 13:20:50.983114 15635 raft_consensus.cc:359] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.983876 15635 raft_consensus.cc:385] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.984182 15635 raft_consensus.cc:740] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:50.984965 15635 consensus_queue.cc:260] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.987210 15635 ts_tablet_manager.cc:1434] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:50.989106 15635 tablet_bootstrap.cc:492] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:50.995596 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db8c0722aed4993a0e79305c889a80a" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:50.996215 15635 tablet_bootstrap.cc:654] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:50.997547 15484 leader_election.cc:343] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:50.980257 15637 raft_consensus.cc:359] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:50.998723 15637 raft_consensus.cc:385] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:50.999069 15637 raft_consensus.cc:740] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.000082 15637 consensus_queue.cc:260] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.005769 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db8c0722aed4993a0e79305c889a80a" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.006458 15595 raft_consensus.cc:2468] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.006860 15637 ts_tablet_manager.cc:1434] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:20:51.007000 15639 tablet_bootstrap.cc:492] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:51.008104 15639 ts_tablet_manager.cc:1403] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.055s	user 0.032s	sys 0.021s
I20260709 13:20:51.008263 15637 tablet_bootstrap.cc:492] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.009971 15486 leader_election.cc:304] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.011283 15643 raft_consensus.cc:2804] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.011749 15643 raft_consensus.cc:493] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.012244 15643 raft_consensus.cc:3060] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.012989 15635 tablet_bootstrap.cc:492] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.013583 15635 ts_tablet_manager.cc:1403] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:20:51.015647 15637 tablet_bootstrap.cc:654] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.016705 15635 raft_consensus.cc:359] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.017488 15635 raft_consensus.cc:385] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.011301 15639 raft_consensus.cc:359] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.017822 15635 raft_consensus.cc:740] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.017959 15639 raft_consensus.cc:385] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.018344 15639 raft_consensus.cc:740] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.018671 15635 consensus_queue.cc:260] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.019723 15639 consensus_queue.cc:260] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.021345 15635 ts_tablet_manager.cc:1434] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:20:51.022365 15635 tablet_bootstrap.cc:492] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:51.022475 15639 ts_tablet_manager.cc:1434] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:20:51.023514 15639 tablet_bootstrap.cc:492] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:51.029325 15635 tablet_bootstrap.cc:654] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.029501 15639 tablet_bootstrap.cc:654] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.033023 15643 raft_consensus.cc:515] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.038514 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db8c0722aed4993a0e79305c889a80a" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
W20260709 13:20:51.040215 15484 leader_election.cc:343] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.042680 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db8c0722aed4993a0e79305c889a80a" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.043362 15595 raft_consensus.cc:3060] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.051975 15595 raft_consensus.cc:2468] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.052899 15643 leader_election.cc:290] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.054306 15486 leader_election.cc:304] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.056550 15643 raft_consensus.cc:2804] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.059402 15643 raft_consensus.cc:697] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.060696 15643 consensus_queue.cc:237] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.063664 15637 tablet_bootstrap.cc:492] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.064420 15637 ts_tablet_manager.cc:1403] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.015s
I20260709 13:20:51.067668 15639 tablet_bootstrap.cc:492] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:51.068023 15635 tablet_bootstrap.cc:492] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.067771 15637 raft_consensus.cc:359] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.068426 15639 ts_tablet_manager.cc:1403] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.045s	user 0.031s	sys 0.013s
I20260709 13:20:51.068750 15635 ts_tablet_manager.cc:1403] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.047s	user 0.028s	sys 0.017s
I20260709 13:20:51.068825 15637 raft_consensus.cc:385] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.069482 15637 raft_consensus.cc:740] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.070502 15642 raft_consensus.cc:493] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.071098 15642 raft_consensus.cc:515] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.071637 15637 consensus_queue.cc:260] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.072993 15639 raft_consensus.cc:359] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.074747 15639 raft_consensus.cc:385] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.075146 15639 raft_consensus.cc:740] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.073971 15635 raft_consensus.cc:359] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.074769 15637 ts_tablet_manager.cc:1434] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.006s
I20260709 13:20:51.076411 15639 consensus_queue.cc:260] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.077226 15637 tablet_bootstrap.cc:492] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.077876 15642 leader_election.cc:290] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.078866 15639 ts_tablet_manager.cc:1434] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:20:51.080112 15639 tablet_bootstrap.cc:492] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
W20260709 13:20:51.082654 15391 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:51.083124 15635 raft_consensus.cc:385] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.083633 15635 raft_consensus.cc:740] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.082978 15341 catalog_manager.cc:5697] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.084545 15635 consensus_queue.cc:260] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.086916 15635 ts_tablet_manager.cc:1434] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:20:51.087857 15635 tablet_bootstrap.cc:492] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:51.095065 15635 tablet_bootstrap.cc:654] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.101959 15639 tablet_bootstrap.cc:654] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.103549 15637 tablet_bootstrap.cc:654] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.122721 15643 raft_consensus.cc:493] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.123404 15643 raft_consensus.cc:515] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.125388 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.126123 15595 raft_consensus.cc:2468] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 0.
I20260709 13:20:51.127102 15641 raft_consensus.cc:493] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.127282 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.127693 15641 raft_consensus.cc:515] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.128065 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:51.128136 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.129458 15594 raft_consensus.cc:2468] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.127774 15411 leader_election.cc:304] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:51.125471 15643 leader_election.cc:290] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
W20260709 13:20:51.133438 15484 leader_election.cc:343] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.133837 15641 leader_election.cc:290] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
W20260709 13:20:51.134409 15411 leader_election.cc:343] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.134681 15642 raft_consensus.cc:2804] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.141054 15642 raft_consensus.cc:493] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.142872 15642 raft_consensus.cc:3060] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.154731 15639 tablet_bootstrap.cc:492] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:51.155433 15639 ts_tablet_manager.cc:1403] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.000s
I20260709 13:20:51.156945 15643 raft_consensus.cc:493] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.157548 15643 raft_consensus.cc:515] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.159828 15643 leader_election.cc:290] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.164305 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.165097 15445 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.166492 15484 leader_election.cc:304] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.166884 15635 tablet_bootstrap.cc:492] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.167420 15643 raft_consensus.cc:2804] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.167842 15643 raft_consensus.cc:493] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.168255 15643 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.169595 15637 tablet_bootstrap.cc:492] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.170183 15637 ts_tablet_manager.cc:1403] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.025s
I20260709 13:20:51.168358 15639 raft_consensus.cc:359] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.171120 15639 raft_consensus.cc:385] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.171401 15639 raft_consensus.cc:740] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.172188 15639 consensus_queue.cc:260] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.174436 15639 ts_tablet_manager.cc:1434] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:20:51.175443 15639 tablet_bootstrap.cc:492] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:51.178610 15637 raft_consensus.cc:359] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.179682 15637 raft_consensus.cc:385] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.180096 15637 raft_consensus.cc:740] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.180210 15486 leader_election.cc:304] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.181522 15656 raft_consensus.cc:2804] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.167474 15635 ts_tablet_manager.cc:1403] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.080s	user 0.027s	sys 0.038s
I20260709 13:20:51.182024 15656 raft_consensus.cc:493] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.182545 15656 raft_consensus.cc:3060] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.184993 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.185308 15635 raft_consensus.cc:359] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.186079 15635 raft_consensus.cc:385] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.186348 15635 raft_consensus.cc:740] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.186453 15643 raft_consensus.cc:515] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.187273 15635 consensus_queue.cc:260] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.182482 15641 raft_consensus.cc:493] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.189508 15639 tablet_bootstrap.cc:654] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.189723 15641 raft_consensus.cc:515] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.193936 15594 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.193755 15642 raft_consensus.cc:515] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.197081 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:51.197260 15656 raft_consensus.cc:515] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.198503 15643 leader_election.cc:290] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
W20260709 13:20:51.198800 15411 leader_election.cc:343] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.200139 15656 leader_election.cc:290] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.200143 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.201267 15445 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.201427 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.202028 15595 raft_consensus.cc:3060] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.203853 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.205132 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
W20260709 13:20:51.205475 15484 leader_election.cc:343] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.205739 15594 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.192584 15641 leader_election.cc:290] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:51.206825 15637 consensus_queue.cc:260] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.216979 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:51.217294 15637 ts_tablet_manager.cc:1434] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.002s
I20260709 13:20:51.217955 15519 raft_consensus.cc:2393] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fb839e1f6284f28a5698aeedbb713dc in current term 1: Already voted for candidate 8572907d902c419daac824efe24b9219 in this term.
I20260709 13:20:51.218436 15637 tablet_bootstrap.cc:492] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.218694 15594 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.219628 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:51.220553 15520 raft_consensus.cc:2393] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fb839e1f6284f28a5698aeedbb713dc in current term 1: Already voted for candidate 8572907d902c419daac824efe24b9219 in this term.
W20260709 13:20:51.221170 15621 tablet.cc:2406] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:20:51.220517 15595 raft_consensus.cc:2468] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.222965 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.223167 15445 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.223611 15593 raft_consensus.cc:3060] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.224452 15484 leader_election.cc:304] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.225396 15643 raft_consensus.cc:2804] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.226054 15643 raft_consensus.cc:697] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.226873 15643 consensus_queue.cc:237] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.230638 15642 leader_election.cc:290] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.232645 15593 raft_consensus.cc:2468] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 1.
I20260709 13:20:51.234795 15641 raft_consensus.cc:493] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.236423 15641 raft_consensus.cc:515] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.234885 15486 leader_election.cc:304] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.239753 15656 raft_consensus.cc:2804] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.240932 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
W20260709 13:20:51.242617 15561 leader_election.cc:343] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.242951 15641 leader_election.cc:290] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:51.245929 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.246729 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
W20260709 13:20:51.247386 15559 leader_election.cc:343] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.247629 15444 raft_consensus.cc:2393] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5fb839e1f6284f28a5698aeedbb713dc in current term 1: Already voted for candidate 8572907d902c419daac824efe24b9219 in this term.
I20260709 13:20:51.247951 15559 leader_election.cc:304] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc; no voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219
I20260709 13:20:51.248414 15411 leader_election.cc:304] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:51.249048 15641 raft_consensus.cc:2749] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.247270 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.249300 15559 leader_election.cc:304] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc; no voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219
I20260709 13:20:51.251119 15641 raft_consensus.cc:2749] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.251065 15642 raft_consensus.cc:2804] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.242569 15639 tablet_bootstrap.cc:492] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:51.253376 15639 ts_tablet_manager.cc:1403] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.078s	user 0.000s	sys 0.014s
I20260709 13:20:51.253037 15341 catalog_manager.cc:5697] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.252632 15642 raft_consensus.cc:697] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:51.255514 15642 consensus_queue.cc:237] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.256896 15639 raft_consensus.cc:359] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.257691 15639 raft_consensus.cc:385] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.258021 15639 raft_consensus.cc:740] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.258912 15639 consensus_queue.cc:260] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.261257 15639 ts_tablet_manager.cc:1434] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:20:51.262254 15639 tablet_bootstrap.cc:492] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:51.268105 15639 tablet_bootstrap.cc:654] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.271776 15635 ts_tablet_manager.cc:1434] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.089s	user 0.026s	sys 0.046s
I20260709 13:20:51.273032 15635 tablet_bootstrap.cc:492] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:51.275451 15672 raft_consensus.cc:493] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.276024 15672 raft_consensus.cc:515] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.279767 15635 tablet_bootstrap.cc:654] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.279650 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
W20260709 13:20:51.275508 15559 leader_election.cc:343] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.280567 15559 leader_election.cc:304] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc; no voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219
W20260709 13:20:51.281103 15561 leader_election.cc:343] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.283682 15641 raft_consensus.cc:2749] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.283516 15637 tablet_bootstrap.cc:654] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.284566 15639 tablet_bootstrap.cc:492] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:51.285219 15639 ts_tablet_manager.cc:1403] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.003s
I20260709 13:20:51.286311 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.287058 15445 raft_consensus.cc:2468] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:51.287457 15672 leader_election.cc:290] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:51.283751 15656 raft_consensus.cc:697] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.288591 15639 raft_consensus.cc:359] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.283520 15341 catalog_manager.cc:5697] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.289623 15656 consensus_queue.cc:237] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.291661 15639 raft_consensus.cc:385] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.292050 15639 raft_consensus.cc:740] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.293035 15639 consensus_queue.cc:260] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.294883 15639 ts_tablet_manager.cc:1434] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:20:51.295517 15635 tablet_bootstrap.cc:492] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.295976 15637 tablet_bootstrap.cc:492] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.296123 15635 ts_tablet_manager.cc:1403] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 13:20:51.296535 15637 ts_tablet_manager.cc:1403] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.003s
I20260709 13:20:51.298928 15635 raft_consensus.cc:359] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.299747 15635 raft_consensus.cc:385] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.299424 15637 raft_consensus.cc:359] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.300146 15635 raft_consensus.cc:740] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.301007 15635 consensus_queue.cc:260] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.303380 15635 ts_tablet_manager.cc:1434] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:20:51.304520 15635 tablet_bootstrap.cc:492] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:51.311100 15635 tablet_bootstrap.cc:654] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.288465 15559 leader_election.cc:304] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:51.310717 15341 catalog_manager.cc:5697] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.311970 15672 raft_consensus.cc:2804] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.312336 15672 raft_consensus.cc:493] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.312801 15672 raft_consensus.cc:3060] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.317210 15635 tablet_bootstrap.cc:492] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.317878 15635 ts_tablet_manager.cc:1403] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 13:20:51.300348 15637 raft_consensus.cc:385] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.318573 15637 raft_consensus.cc:740] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.319577 15637 consensus_queue.cc:260] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.322173 15637 ts_tablet_manager.cc:1434] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260709 13:20:51.320830 15635 raft_consensus.cc:359] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.322788 15635 raft_consensus.cc:385] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.323149 15635 raft_consensus.cc:740] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.323454 15637 tablet_bootstrap.cc:492] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.323769 15672 raft_consensus.cc:515] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.324088 15635 consensus_queue.cc:260] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.326424 15672 leader_election.cc:290] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:51.327477 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.328141 15445 raft_consensus.cc:3060] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.329322 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
W20260709 13:20:51.330852 15561 leader_election.cc:343] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.332684 15635 ts_tablet_manager.cc:1434] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:20:51.333217 15637 tablet_bootstrap.cc:654] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.333802 15635 tablet_bootstrap.cc:492] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:51.335546 15445 raft_consensus.cc:2468] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:51.335915 15656 raft_consensus.cc:493] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.336584 15656 raft_consensus.cc:515] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.336958 15559 leader_election.cc:304] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:51.338274 15672 raft_consensus.cc:2804] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.339537 15672 raft_consensus.cc:697] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:51.340440 15672 consensus_queue.cc:237] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.341766 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7091192e79024f80bdee9b03802a9336" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.342556 15593 raft_consensus.cc:2468] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.343338 15656 leader_election.cc:290] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.343825 15486 leader_election.cc:304] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.344019 15635 tablet_bootstrap.cc:654] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.344710 15656 raft_consensus.cc:2804] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.344233 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7091192e79024f80bdee9b03802a9336" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.346072 15445 raft_consensus.cc:2468] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.345223 15656 raft_consensus.cc:493] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.346944 15656 raft_consensus.cc:3060] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.350008 15635 tablet_bootstrap.cc:492] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.350528 15635 ts_tablet_manager.cc:1403] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.000s
I20260709 13:20:51.351748 15341 catalog_manager.cc:5697] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:51.352499 15635 raft_consensus.cc:359] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.353225 15635 raft_consensus.cc:385] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.353440 15635 raft_consensus.cc:740] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.353984 15635 consensus_queue.cc:260] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.354575 15656 raft_consensus.cc:515] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.355670 15635 ts_tablet_manager.cc:1434] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:51.356791 15635 tablet_bootstrap.cc:492] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:51.357371 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7091192e79024f80bdee9b03802a9336" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.357940 15445 raft_consensus.cc:3060] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.362846 15635 tablet_bootstrap.cc:654] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.367822 15635 tablet_bootstrap.cc:492] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:51.368219 15635 ts_tablet_manager.cc:1403] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:20:51.368692 15637 tablet_bootstrap.cc:492] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.369341 15637 ts_tablet_manager.cc:1403] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.005s
I20260709 13:20:51.370024 15656 leader_election.cc:290] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.370249 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7091192e79024f80bdee9b03802a9336" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.370415 15672 raft_consensus.cc:493] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.370868 15445 raft_consensus.cc:2468] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.371279 15672 raft_consensus.cc:515] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.371722 15635 raft_consensus.cc:359] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.372298 15635 raft_consensus.cc:385] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.372462 15635 raft_consensus.cc:740] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.373095 15635 consensus_queue.cc:260] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.374092 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.374270 15484 leader_election.cc:304] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.374516 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:51.374955 15635 ts_tablet_manager.cc:1434] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:20:51.374753 15445 raft_consensus.cc:2468] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:51.373426 15672 leader_election.cc:290] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:51.370975 15593 raft_consensus.cc:3060] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.375944 15559 leader_election.cc:304] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
W20260709 13:20:51.376717 15561 leader_election.cc:343] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.380528 15672 raft_consensus.cc:2804] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.381352 15672 raft_consensus.cc:493] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.381840 15672 raft_consensus.cc:3060] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.381980 15593 raft_consensus.cc:2468] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.383890 15637 raft_consensus.cc:359] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.384459 15637 raft_consensus.cc:385] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.384693 15637 raft_consensus.cc:740] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.381070 15656 raft_consensus.cc:2804] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.386296 15637 consensus_queue.cc:260] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.386811 15656 raft_consensus.cc:697] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.388217 15656 consensus_queue.cc:237] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.389079 15637 ts_tablet_manager.cc:1434] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 13:20:51.390635 15637 tablet_bootstrap.cc:492] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.390938 15672 raft_consensus.cc:515] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.393860 15672 leader_election.cc:290] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:51.394675 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.395364 15445 raft_consensus.cc:3060] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.396586 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
W20260709 13:20:51.398017 15561 leader_election.cc:343] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:51.399735 15637 tablet_bootstrap.cc:654] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.398933 15343 catalog_manager.cc:5697] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.402647 15445 raft_consensus.cc:2468] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:51.403856 15559 leader_election.cc:304] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:51.404722 15672 raft_consensus.cc:2804] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.404866 15637 tablet_bootstrap.cc:492] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.405270 15672 raft_consensus.cc:697] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:51.405443 15637 ts_tablet_manager.cc:1403] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:20:51.406155 15672 consensus_queue.cc:237] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.408419 15637 raft_consensus.cc:359] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.409219 15637 raft_consensus.cc:385] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.409523 15637 raft_consensus.cc:740] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.410457 15637 consensus_queue.cc:260] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.412590 15637 ts_tablet_manager.cc:1434] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:51.413265 15671 raft_consensus.cc:493] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.413959 15637 tablet_bootstrap.cc:492] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.413782 15671 raft_consensus.cc:515] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.415979 15671 leader_election.cc:290] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.416638 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.417121 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.417840 15593 raft_consensus.cc:2393] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8572907d902c419daac824efe24b9219 in current term 1: Already voted for candidate 2e7632d2760e4ec8909541cec49d3288 in this term.
I20260709 13:20:51.419082 15486 leader_election.cc:304] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:51.418802 15341 catalog_manager.cc:5697] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:51.420858 15637 tablet_bootstrap.cc:654] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.420939 15671 raft_consensus.cc:3060] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.429713 15637 tablet_bootstrap.cc:492] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.429776 15671 raft_consensus.cc:2749] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.430373 15637 ts_tablet_manager.cc:1403] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:20:51.433316 15637 raft_consensus.cc:359] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.433921 15637 raft_consensus.cc:385] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.434104 15637 raft_consensus.cc:740] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.434746 15637 consensus_queue.cc:260] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.436493 15637 ts_tablet_manager.cc:1434] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:20:51.437503 15637 tablet_bootstrap.cc:492] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:51.442266 15637 tablet_bootstrap.cc:654] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:51.447988 15637 tablet_bootstrap.cc:492] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:51.448428 15637 ts_tablet_manager.cc:1403] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:51.450434 15637 raft_consensus.cc:359] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.450918 15637 raft_consensus.cc:385] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:51.451121 15637 raft_consensus.cc:740] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:51.451639 15637 consensus_queue.cc:260] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.453157 15637 ts_tablet_manager.cc:1434] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:20:51.460175 15671 raft_consensus.cc:493] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.460638 15671 raft_consensus.cc:515] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.462255 15671 leader_election.cc:290] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.463354 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.463575 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.463990 15593 raft_consensus.cc:2468] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.464607 15445 raft_consensus.cc:2468] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.465060 15486 leader_election.cc:304] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.465783 15671 raft_consensus.cc:2804] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.466059 15671 raft_consensus.cc:493] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.466297 15671 raft_consensus.cc:3060] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.471657 15671 raft_consensus.cc:515] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.473390 15671 leader_election.cc:290] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.474215 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.474812 15445 raft_consensus.cc:3060] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.474469 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.475531 15593 raft_consensus.cc:3060] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.481159 15593 raft_consensus.cc:2468] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.481392 15445 raft_consensus.cc:2468] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.482194 15486 leader_election.cc:304] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.482950 15671 raft_consensus.cc:2804] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.483327 15671 raft_consensus.cc:697] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.484050 15671 consensus_queue.cc:237] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.491354 15341 catalog_manager.cc:5697] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.511716 15642 raft_consensus.cc:493] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.512257 15642 raft_consensus.cc:515] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.514092 15642 leader_election.cc:290] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.515075 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db8c0722aed4993a0e79305c889a80a" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:51.515308 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9db8c0722aed4993a0e79305c889a80a" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.516098 15593 raft_consensus.cc:2393] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e7632d2760e4ec8909541cec49d3288 in current term 1: Already voted for candidate 8572907d902c419daac824efe24b9219 in this term.
I20260709 13:20:51.517271 15411 leader_election.cc:304] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288; no voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219
I20260709 13:20:51.518141 15642 raft_consensus.cc:3060] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.518648 15671 raft_consensus.cc:493] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.519186 15671 raft_consensus.cc:515] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.521714 15671 leader_election.cc:290] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.522187 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.522316 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.523136 15445 raft_consensus.cc:2393] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8572907d902c419daac824efe24b9219 in current term 1: Already voted for candidate 5fb839e1f6284f28a5698aeedbb713dc in this term.
I20260709 13:20:51.524049 15484 leader_election.cc:304] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:51.524725 15671 raft_consensus.cc:3060] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.525498 15642 raft_consensus.cc:2749] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.529985 15671 raft_consensus.cc:2749] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.534842 15671 consensus_queue.cc:1048] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.547423 15671 consensus_queue.cc:1048] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.564980 15671 raft_consensus.cc:493] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.565510 15671 raft_consensus.cc:515] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.567242 15671 leader_election.cc:290] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.568190 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.568399 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.568955 15445 raft_consensus.cc:2468] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.569010 15593 raft_consensus.cc:2468] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:51.569990 15484 leader_election.cc:304] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.570704 15671 raft_consensus.cc:2804] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:51.570984 15671 raft_consensus.cc:493] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:51.571319 15671 raft_consensus.cc:3060] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.577936 15671 raft_consensus.cc:515] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.579708 15671 leader_election.cc:290] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.580798 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:51.581032 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.581360 15445 raft_consensus.cc:3060] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.581596 15593 raft_consensus.cc:3060] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.587000 15445 raft_consensus.cc:2468] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.587069 15593 raft_consensus.cc:2468] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:51.588099 15484 leader_election.cc:304] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.588793 15671 raft_consensus.cc:2804] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:51.589255 15671 raft_consensus.cc:697] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.590044 15671 consensus_queue.cc:237] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.597173 15341 catalog_manager.cc:5697] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.604821 15671 raft_consensus.cc:493] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.605441 15671 raft_consensus.cc:515] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.607208 15671 leader_election.cc:290] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.608232 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:51.608349 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.608969 15445 raft_consensus.cc:2393] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8572907d902c419daac824efe24b9219 in current term 1: Already voted for candidate 5fb839e1f6284f28a5698aeedbb713dc in this term.
I20260709 13:20:51.610045 15484 leader_election.cc:304] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:51.610651 15671 raft_consensus.cc:3060] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.616043 15671 raft_consensus.cc:2749] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.682154 15642 raft_consensus.cc:493] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:51.683015 15642 raft_consensus.cc:515] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.685031 15642 leader_election.cc:290] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.685757 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:51.686040 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:51.686810 15593 raft_consensus.cc:2393] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e7632d2760e4ec8909541cec49d3288 in current term 1: Already voted for candidate 8572907d902c419daac824efe24b9219 in this term.
I20260709 13:20:51.687996 15411 leader_election.cc:304] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288; no voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219
I20260709 13:20:51.688941 15642 raft_consensus.cc:3060] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:51.695631 15642 raft_consensus.cc:2749] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:51.757589 15671 consensus_queue.cc:1048] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.761193 15671 consensus_queue.cc:1048] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.772182 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:51.773093 15671 consensus_queue.cc:1048] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.773553 15595 raft_consensus.cc:606] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.791280 15656 consensus_queue.cc:1048] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.825242 15671 consensus_queue.cc:1048] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.827394 15520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c382123eecb645629a091a46d926010e"
dest_uuid: "8572907d902c419daac824efe24b9219"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:42490
I20260709 13:20:51.831005 15520 raft_consensus.cc:606] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.834390 15642 consensus_queue.cc:1048] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.859583 15642 consensus_queue.cc:1048] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.882305 15656 raft_consensus.cc:993] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:51.882948 15656 raft_consensus.cc:1081] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:51.883643 15641 consensus_queue.cc:1048] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.887996 15445 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c382123eecb645629a091a46d926010e"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52562
W20260709 13:20:51.888428 15486 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.195:36029, user_credentials={real_user=slave}} blocked reactor thread for 56359.5us
I20260709 13:20:51.888935 15445 raft_consensus.cc:493] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.889544 15445 raft_consensus.cc:3060] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.890477 15643 consensus_queue.cc:1048] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.895999 15520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8"
dest_uuid: "8572907d902c419daac824efe24b9219"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:42490
I20260709 13:20:51.896687 15520 raft_consensus.cc:606] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.898509 15672 consensus_queue.cc:1048] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.906673 15445 raft_consensus.cc:515] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.907618 15520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71"
dest_uuid: "8572907d902c419daac824efe24b9219"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:42490
I20260709 13:20:51.908331 15520 raft_consensus.cc:606] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:51.912647 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:51.913486 15518 raft_consensus.cc:3055] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:51.913928 15518 raft_consensus.cc:740] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:51.915228 15518 consensus_queue.cc:260] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.916606 15518 raft_consensus.cc:3060] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.924918 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:51.925832 15672 consensus_queue.cc:1048] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.927416 15445 leader_election.cc:290] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:51.928112 15595 raft_consensus.cc:606] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 8572907d902c419daac824efe24b9219
I20260709 13:20:51.929877 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c382123eecb645629a091a46d926010e" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:51.930565 15594 raft_consensus.cc:3060] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.939657 15518 raft_consensus.cc:2468] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:51.940933 15641 consensus_queue.cc:1048] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:51.955277 15411 leader_election.cc:304] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:51.955389 15643 consensus_queue.cc:1048] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:51.956395 15711 raft_consensus.cc:2804] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:51.956964 15711 raft_consensus.cc:697] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:51.958042 15711 consensus_queue.cc:237] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.944859 15594 raft_consensus.cc:2468] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:51.970520 15672 raft_consensus.cc:993] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:51.972985 15641 raft_consensus.cc:1081] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:51.975929 15341 catalog_manager.cc:5697] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 8572907d902c419daac824efe24b9219 (127.2.200.194) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:51.979388 15443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52570
I20260709 13:20:51.980113 15443 raft_consensus.cc:493] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:51.980562 15443 raft_consensus.cc:3060] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:51.995862 15672 raft_consensus.cc:993] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:51.996815 15672 raft_consensus.cc:1081] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:51.998237 15443 raft_consensus.cc:515] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:51.998750 15519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89"
dest_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:42476
I20260709 13:20:52.001169 15519 raft_consensus.cc:493] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.001641 15519 raft_consensus.cc:3060] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.003952 15518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:52.008133 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d347077f6a38436cbd3f8a4b576e25de" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:52.008869 15594 raft_consensus.cc:3055] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:52.009232 15594 raft_consensus.cc:740] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:52.010494 15594 consensus_queue.cc:260] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.011355 15519 raft_consensus.cc:515] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.014704 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:52.015326 15445 raft_consensus.cc:3060] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.011740 15594 raft_consensus.cc:3060] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.021373 15443 leader_election.cc:290] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:52.021800 15706 consensus_queue.cc:1048] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:52.029306 15643 consensus_queue.cc:1048] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.035988 15445 raft_consensus.cc:2468] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
I20260709 13:20:52.037763 15444 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
mode: GRACEFUL
new_leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:52578
I20260709 13:20:52.041222 15594 raft_consensus.cc:2468] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:52.042218 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eec348b9fe349c7a73af8039a9e0f89" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:52.044607 15444 raft_consensus.cc:606] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Received request to transfer leadership to TS 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:52.044808 15593 raft_consensus.cc:3055] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:52.045302 15484 leader_election.cc:304] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:52.042550 15520 raft_consensus.cc:1240] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Rejecting Update request from peer 5fb839e1f6284f28a5698aeedbb713dc for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:52.047008 15643 raft_consensus.cc:2804] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:52.047550 15643 raft_consensus.cc:697] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:52.043977 15519 leader_election.cc:290] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:52.048451 15672 consensus_queue.cc:1059] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.045248 15593 raft_consensus.cc:740] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:52.048823 15643 consensus_queue.cc:237] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.050427 15593 consensus_queue.cc:260] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.051944 15593 raft_consensus.cc:3060] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.051961 15411 leader_election.cc:304] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:52.058459 15711 raft_consensus.cc:2804] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:52.059029 15711 raft_consensus.cc:697] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:52.058125 15341 catalog_manager.cc:5697] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.060082 15711 consensus_queue.cc:237] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.065277 15656 consensus_queue.cc:1048] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:52.073873 15593 raft_consensus.cc:2468] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
W20260709 13:20:52.074733 15719 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:20:52.078635 15706 raft_consensus.cc:993] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:52.079257 15643 raft_consensus.cc:1081] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:52.081333 15444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:20:52.081959 15444 raft_consensus.cc:493] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.082294 15444 raft_consensus.cc:3060] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.084021 15341 catalog_manager.cc:5697] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.091101 15444 raft_consensus.cc:515] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.094889 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:52.095048 15444 leader_election.cc:290] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:52.095569 15519 raft_consensus.cc:3055] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:52.095803 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fff3611aaa19462c9ef0a8f951f2aef8" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:52.095947 15519 raft_consensus.cc:740] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:52.097041 15519 consensus_queue.cc:260] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.098240 15519 raft_consensus.cc:3060] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.105020 15593 raft_consensus.cc:3060] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.105249 15519 raft_consensus.cc:2468] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:52.106621 15411 leader_election.cc:304] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:52.107658 15710 raft_consensus.cc:2804] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:52.108121 15710 raft_consensus.cc:697] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:52.109061 15710 consensus_queue.cc:237] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.112407 15593 raft_consensus.cc:2468] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:52.115991 15341 catalog_manager.cc:5697] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 8572907d902c419daac824efe24b9219 (127.2.200.194) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.365999 15706 raft_consensus.cc:993] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:52.366465 15706 raft_consensus.cc:1081] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:52.368461 15444 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:20:52.369230 15444 raft_consensus.cc:493] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.369542 15444 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.375427 15444 raft_consensus.cc:515] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.377095 15444 leader_election.cc:290] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:52.378113 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:52.378279 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:52.378886 15519 raft_consensus.cc:3055] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:52.378962 15593 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.379338 15519 raft_consensus.cc:740] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:52.380326 15519 consensus_queue.cc:260] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.381772 15519 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.387564 15593 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:52.388944 15411 leader_election.cc:304] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:52.389348 15519 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:52.389954 15710 raft_consensus.cc:2804] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:52.390633 15710 raft_consensus.cc:697] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:52.391660 15710 consensus_queue.cc:237] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.398708 15341 catalog_manager.cc:5697] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 8572907d902c419daac824efe24b9219 (127.2.200.194) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:52.423956 15593 raft_consensus.cc:1275] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.425202 15710 consensus_queue.cc:1048] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.434507 15519 raft_consensus.cc:1275] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.435806 15710 consensus_queue.cc:1048] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.461750 15593 raft_consensus.cc:1275] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.463158 15706 consensus_queue.cc:1048] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.472102 15443 raft_consensus.cc:1275] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.473806 15705 consensus_queue.cc:1048] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.496394 15724 raft_consensus.cc:993] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: : Instructing follower 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:52.496869 15710 raft_consensus.cc:1081] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Signalling peer 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:52.498585 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:33458
I20260709 13:20:52.499049 15593 raft_consensus.cc:493] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:52.499326 15593 raft_consensus.cc:3060] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.504750 15593 raft_consensus.cc:515] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.506493 15593 leader_election.cc:290] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:52.507180 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:52.507871 15443 raft_consensus.cc:3055] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:52.507776 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622fd85e9f104a068bdd351171b5d494" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:52.508415 15443 raft_consensus.cc:740] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:52.508723 15520 raft_consensus.cc:3060] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.509433 15443 consensus_queue.cc:260] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.510581 15443 raft_consensus.cc:3060] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.514696 15520 raft_consensus.cc:2468] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 2.
I20260709 13:20:52.515751 15443 raft_consensus.cc:2468] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 2.
I20260709 13:20:52.515950 15561 leader_election.cc:304] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:52.516851 15719 raft_consensus.cc:2804] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:52.517236 15719 raft_consensus.cc:697] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:52.517998 15719 consensus_queue.cc:237] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:52.526623 15343 catalog_manager.cc:5697] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 1 to 2, leader changed from 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193) to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 2 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:52.565004 15593 raft_consensus.cc:1275] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.566596 15710 consensus_queue.cc:1048] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.572358 15595 raft_consensus.cc:1275] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.573997 15724 consensus_queue.cc:1048] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.575192 15520 raft_consensus.cc:3060] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:52.583853 15519 raft_consensus.cc:1275] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.585871 15710 consensus_queue.cc:1048] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.590840 15520 raft_consensus.cc:1275] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.592487 15711 consensus_queue.cc:1048] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:52.993726 15593 raft_consensus.cc:1275] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:52.995014 15711 consensus_queue.cc:1048] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:53.009410 15519 raft_consensus.cc:1275] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:53.011121 15710 consensus_queue.cc:1048] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:53.086323 15519 raft_consensus.cc:1275] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:53.087682 15719 consensus_queue.cc:1048] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:53.100785 15443 raft_consensus.cc:1275] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:53.102543 15731 consensus_queue.cc:1048] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:55.080629 15342 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41090:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:20:55.084561 15342 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:20:55.134905 15391 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:55.143719 15433 tablet_service.cc:1511] Processing CreateTablet for tablet b9d0c1f87d794977bf39c18be30fd43b (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:55.145681 15433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0c1f87d794977bf39c18be30fd43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.146503 15504 tablet_service.cc:1511] Processing CreateTablet for tablet b9d0c1f87d794977bf39c18be30fd43b (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:55.147991 15504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0c1f87d794977bf39c18be30fd43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.150022 15581 tablet_service.cc:1511] Processing CreateTablet for tablet b9d0c1f87d794977bf39c18be30fd43b (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:20:55.151204 15434 tablet_service.cc:1511] Processing CreateTablet for tablet d64e963685d9480ab0a8ee62adf95005 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:55.152562 15434 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e963685d9480ab0a8ee62adf95005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.153791 15579 tablet_service.cc:1511] Processing CreateTablet for tablet d64e963685d9480ab0a8ee62adf95005 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:55.151667 15581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0c1f87d794977bf39c18be30fd43b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.155622 15579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e963685d9480ab0a8ee62adf95005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.158567 15505 tablet_service.cc:1511] Processing CreateTablet for tablet d64e963685d9480ab0a8ee62adf95005 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:20:55.159487 15510 tablet_service.cc:1511] Processing CreateTablet for tablet 96ebee84dc394b079ab2a9548c1158a4 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:55.160153 15505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d64e963685d9480ab0a8ee62adf95005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.160331 15435 tablet_service.cc:1511] Processing CreateTablet for tablet 96ebee84dc394b079ab2a9548c1158a4 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:55.161785 15435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ebee84dc394b079ab2a9548c1158a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.163053 15583 tablet_service.cc:1511] Processing CreateTablet for tablet 96ebee84dc394b079ab2a9548c1158a4 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:20:55.164472 15583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ebee84dc394b079ab2a9548c1158a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.164784 15430 tablet_service.cc:1511] Processing CreateTablet for tablet fde4bcbfce3c4d6b84926a6b1d791984 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:55.166148 15430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde4bcbfce3c4d6b84926a6b1d791984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.169157 15580 tablet_service.cc:1511] Processing CreateTablet for tablet fde4bcbfce3c4d6b84926a6b1d791984 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:55.170692 15580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde4bcbfce3c4d6b84926a6b1d791984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.171010 15429 tablet_service.cc:1511] Processing CreateTablet for tablet a5f5e55629994cadabde89eb933503e1 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:55.174404 15429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f5e55629994cadabde89eb933503e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.174943 15502 tablet_service.cc:1511] Processing CreateTablet for tablet fde4bcbfce3c4d6b84926a6b1d791984 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:20:55.178623 15585 tablet_service.cc:1511] Processing CreateTablet for tablet a5f5e55629994cadabde89eb933503e1 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:55.180130 15585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f5e55629994cadabde89eb933503e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.182086 15431 tablet_service.cc:1511] Processing CreateTablet for tablet dea0b6263e2e437a8049a7787d62b40e (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:55.182864 15508 tablet_service.cc:1511] Processing CreateTablet for tablet a5f5e55629994cadabde89eb933503e1 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:20:55.183189 15503 tablet_service.cc:1511] Processing CreateTablet for tablet dea0b6263e2e437a8049a7787d62b40e (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:55.185202 15428 tablet_service.cc:1511] Processing CreateTablet for tablet a401495f5bb540cd8174c8e6f2f503de (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:55.187763 15509 tablet_service.cc:1511] Processing CreateTablet for tablet a401495f5bb540cd8174c8e6f2f503de (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:55.183579 15431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea0b6263e2e437a8049a7787d62b40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.191603 15427 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3173cf7df64c0985f76ac2663e55aa (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:55.191871 15584 tablet_service.cc:1511] Processing CreateTablet for tablet dea0b6263e2e437a8049a7787d62b40e (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:20:55.193354 15584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea0b6263e2e437a8049a7787d62b40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.193842 15506 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3173cf7df64c0985f76ac2663e55aa (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:55.196038 15427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3173cf7df64c0985f76ac2663e55aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.196609 15582 tablet_service.cc:1511] Processing CreateTablet for tablet a401495f5bb540cd8174c8e6f2f503de (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:20:55.197009 15578 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3173cf7df64c0985f76ac2663e55aa (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:20:55.197999 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a401495f5bb540cd8174c8e6f2f503de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.198642 15578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3173cf7df64c0985f76ac2663e55aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.200305 15432 tablet_service.cc:1511] Processing CreateTablet for tablet a3cceb16ba5e41728f40cbc51bc7e333 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:55.201126 15428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a401495f5bb540cd8174c8e6f2f503de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.202534 15432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cceb16ba5e41728f40cbc51bc7e333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.202773 15507 tablet_service.cc:1511] Processing CreateTablet for tablet a3cceb16ba5e41728f40cbc51bc7e333 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:55.160809 15510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96ebee84dc394b079ab2a9548c1158a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.206660 15506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3173cf7df64c0985f76ac2663e55aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.209141 15502 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde4bcbfce3c4d6b84926a6b1d791984. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.209941 15507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cceb16ba5e41728f40cbc51bc7e333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.212718 15509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a401495f5bb540cd8174c8e6f2f503de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.217223 15503 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dea0b6263e2e437a8049a7787d62b40e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.220597 15508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5f5e55629994cadabde89eb933503e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.238893 15577 tablet_service.cc:1511] Processing CreateTablet for tablet a3cceb16ba5e41728f40cbc51bc7e333 (DEFAULT_TABLE table=soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:20:55.240522 15577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3cceb16ba5e41728f40cbc51bc7e333. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:20:55.330278 15747 tablet_bootstrap.cc:492] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.354637 15749 tablet_bootstrap.cc:492] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.357944 15750 tablet_bootstrap.cc:492] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.358611 15747 tablet_bootstrap.cc:654] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.373178 15750 tablet_bootstrap.cc:654] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.373816 15749 tablet_bootstrap.cc:654] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.375697 15747 tablet_bootstrap.cc:492] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.376279 15747 ts_tablet_manager.cc:1403] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.008s
I20260709 13:20:55.379112 15749 tablet_bootstrap.cc:492] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.379128 15750 tablet_bootstrap.cc:492] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.379729 15749 ts_tablet_manager.cc:1403] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
I20260709 13:20:55.379894 15750 ts_tablet_manager.cc:1403] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 13:20:55.379781 15747 raft_consensus.cc:359] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.380813 15747 raft_consensus.cc:385] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.381141 15747 raft_consensus.cc:740] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.382050 15747 consensus_queue.cc:260] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.383296 15749 raft_consensus.cc:359] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.384150 15749 raft_consensus.cc:385] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.384450 15749 raft_consensus.cc:740] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.384918 15747 ts_tablet_manager.cc:1434] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.004s
I20260709 13:20:55.385385 15749 consensus_queue.cc:260] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.386025 15747 tablet_bootstrap.cc:492] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.387828 15749 ts_tablet_manager.cc:1434] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:20:55.382654 15750 raft_consensus.cc:359] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.388491 15750 raft_consensus.cc:385] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.388870 15749 tablet_bootstrap.cc:492] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.388818 15750 raft_consensus.cc:740] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.389940 15750 consensus_queue.cc:260] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.392671 15750 ts_tablet_manager.cc:1434] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:20:55.393028 15747 tablet_bootstrap.cc:654] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.393725 15750 tablet_bootstrap.cc:492] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.396190 15749 tablet_bootstrap.cc:654] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.400221 15750 tablet_bootstrap.cc:654] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.408411 15749 tablet_bootstrap.cc:492] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.409201 15749 ts_tablet_manager.cc:1403] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:20:55.412568 15749 raft_consensus.cc:359] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.413398 15749 raft_consensus.cc:385] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.413717 15749 raft_consensus.cc:740] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.414495 15749 consensus_queue.cc:260] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.416678 15735 raft_consensus.cc:493] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.417181 15749 ts_tablet_manager.cc:1434] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:20:55.417183 15735 raft_consensus.cc:515] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.420740 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.423218 15443 raft_consensus.cc:2468] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:55.422495 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:55.424836 15519 raft_consensus.cc:2468] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:55.426287 15561 leader_election.cc:304] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:55.428218 15735 leader_election.cc:290] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.428795 15735 raft_consensus.cc:2804] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.429139 15735 raft_consensus.cc:493] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.429454 15735 raft_consensus.cc:3060] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.449751 15749 tablet_bootstrap.cc:492] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.458367 15749 tablet_bootstrap.cc:654] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.472671 15749 tablet_bootstrap.cc:492] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.473316 15749 ts_tablet_manager.cc:1403] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:20:55.476639 15749 raft_consensus.cc:359] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.477449 15749 raft_consensus.cc:385] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.477759 15749 raft_consensus.cc:740] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.478732 15749 consensus_queue.cc:260] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.481513 15749 ts_tablet_manager.cc:1434] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:20:55.482856 15749 tablet_bootstrap.cc:492] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.493845 15749 tablet_bootstrap.cc:654] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
W20260709 13:20:55.496249 15561 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.2.200.194:42537, user_credentials={real_user=slave}} blocked reactor thread for 70064.3us
I20260709 13:20:55.503041 15749 tablet_bootstrap.cc:492] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.503707 15749 ts_tablet_manager.cc:1403] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 13:20:55.506372 15735 raft_consensus.cc:515] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.507113 15749 raft_consensus.cc:359] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.507984 15749 raft_consensus.cc:385] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.508291 15749 raft_consensus.cc:740] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.509055 15749 consensus_queue.cc:260] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.510385 15750 tablet_bootstrap.cc:492] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.510993 15750 ts_tablet_manager.cc:1403] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.117s	user 0.057s	sys 0.054s
I20260709 13:20:55.511567 15747 tablet_bootstrap.cc:492] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.511641 15749 ts_tablet_manager.cc:1434] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:55.512238 15747 ts_tablet_manager.cc:1403] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.126s	user 0.021s	sys 0.101s
I20260709 13:20:55.512869 15749 tablet_bootstrap.cc:492] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.514528 15750 raft_consensus.cc:359] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.515300 15750 raft_consensus.cc:385] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.515301 15747 raft_consensus.cc:359] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.515654 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:55.515805 15750 raft_consensus.cc:740] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.516215 15747 raft_consensus.cc:385] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.516386 15443 raft_consensus.cc:3060] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.516613 15747 raft_consensus.cc:740] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.517105 15750 consensus_queue.cc:260] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.517629 15747 consensus_queue.cc:260] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.519697 15750 ts_tablet_manager.cc:1434] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:20:55.520005 15749 tablet_bootstrap.cc:654] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.520315 15747 ts_tablet_manager.cc:1434] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:20:55.520978 15750 tablet_bootstrap.cc:492] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.522145 15747 tablet_bootstrap.cc:492] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.528436 15750 tablet_bootstrap.cc:654] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.530308 15747 tablet_bootstrap.cc:654] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.540333 15443 raft_consensus.cc:2468] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:55.540621 15750 tablet_bootstrap.cc:492] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.545292 15750 ts_tablet_manager.cc:1403] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:20:55.546566 15559 leader_election.cc:304] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:55.547434 15757 raft_consensus.cc:2804] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.548264 15750 raft_consensus.cc:359] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.549098 15750 raft_consensus.cc:385] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.549408 15750 raft_consensus.cc:740] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.550238 15750 consensus_queue.cc:260] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.544237 15747 tablet_bootstrap.cc:492] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.553105 15747 ts_tablet_manager.cc:1403] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.004s
I20260709 13:20:55.555510 15757 raft_consensus.cc:697] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:55.556346 15757 consensus_queue.cc:237] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.557068 15747 raft_consensus.cc:359] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.552647 15750 ts_tablet_manager.cc:1434] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:20:55.557727 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:55.558471 15519 raft_consensus.cc:3060] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.558916 15750 tablet_bootstrap.cc:492] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.556627 15735 leader_election.cc:290] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.557785 15747 raft_consensus.cc:385] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.565114 15747 raft_consensus.cc:740] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.566322 15747 consensus_queue.cc:260] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.567271 15749 tablet_bootstrap.cc:492] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.567813 15749 ts_tablet_manager.cc:1403] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.027s
I20260709 13:20:55.569016 15747 ts_tablet_manager.cc:1434] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.003s
I20260709 13:20:55.570289 15747 tablet_bootstrap.cc:492] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.570842 15749 raft_consensus.cc:359] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.571573 15749 raft_consensus.cc:385] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.571839 15749 raft_consensus.cc:740] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.572623 15749 consensus_queue.cc:260] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.575130 15749 ts_tablet_manager.cc:1434] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:20:55.576110 15749 tablet_bootstrap.cc:492] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.577575 15750 tablet_bootstrap.cc:654] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.582805 15749 tablet_bootstrap.cc:654] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.582963 15747 tablet_bootstrap.cc:654] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.584700 15519 raft_consensus.cc:2468] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:55.595504 15750 tablet_bootstrap.cc:492] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.596319 15750 ts_tablet_manager.cc:1403] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.001s
I20260709 13:20:55.599737 15750 raft_consensus.cc:359] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.600462 15750 raft_consensus.cc:385] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.600730 15750 raft_consensus.cc:740] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.603443 15750 consensus_queue.cc:260] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.606300 15750 ts_tablet_manager.cc:1434] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:20:55.607502 15750 tablet_bootstrap.cc:492] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.608964 15749 tablet_bootstrap.cc:492] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.609515 15749 ts_tablet_manager.cc:1403] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.016s
I20260709 13:20:55.612629 15749 raft_consensus.cc:359] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.609851 15341 catalog_manager.cc:5697] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.613417 15749 raft_consensus.cc:385] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.613754 15749 raft_consensus.cc:740] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.614533 15749 consensus_queue.cc:260] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.616036 15747 tablet_bootstrap.cc:492] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.616544 15747 ts_tablet_manager.cc:1403] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.016s
I20260709 13:20:55.617301 15749 ts_tablet_manager.cc:1434] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:20:55.617777 15750 tablet_bootstrap.cc:654] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.618845 15749 tablet_bootstrap.cc:492] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.619468 15747 raft_consensus.cc:359] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.620184 15747 raft_consensus.cc:385] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.620451 15747 raft_consensus.cc:740] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.621393 15747 consensus_queue.cc:260] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.624047 15747 ts_tablet_manager.cc:1434] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:55.625077 15747 tablet_bootstrap.cc:492] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.628003 15749 tablet_bootstrap.cc:654] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.640453 15747 tablet_bootstrap.cc:654] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.642131 15705 raft_consensus.cc:493] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.642805 15705 raft_consensus.cc:515] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.647497 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:55.647545 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.648125 15593 raft_consensus.cc:2468] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:55.648412 15443 raft_consensus.cc:2468] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:55.650761 15484 leader_election.cc:304] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:55.657255 15736 raft_consensus.cc:2804] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.657663 15736 raft_consensus.cc:493] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.657970 15736 raft_consensus.cc:3060] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.663125 15705 leader_election.cc:290] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:55.667596 15750 tablet_bootstrap.cc:492] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.668155 15750 ts_tablet_manager.cc:1403] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.061s	user 0.024s	sys 0.026s
I20260709 13:20:55.671984 15736 raft_consensus.cc:515] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.672902 15749 tablet_bootstrap.cc:492] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.673517 15749 ts_tablet_manager.cc:1403] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.016s
I20260709 13:20:55.672533 15750 raft_consensus.cc:359] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.675626 15750 raft_consensus.cc:385] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.675906 15750 raft_consensus.cc:740] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.676602 15749 raft_consensus.cc:359] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.677327 15749 raft_consensus.cc:385] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.677605 15749 raft_consensus.cc:740] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.678108 15736 leader_election.cc:290] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:55.678664 15757 raft_consensus.cc:493] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.679144 15757 raft_consensus.cc:515] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.679639 15750 consensus_queue.cc:260] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.681006 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:55.684499 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.685181 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:55.684604 15750 ts_tablet_manager.cc:1434] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
W20260709 13:20:55.713949 15561 leader_election.cc:343] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.714354 15444 raft_consensus.cc:2468] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:55.712432 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:55.714816 15750 tablet_bootstrap.cc:492] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.715523 15559 leader_election.cc:304] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:55.715556 15593 raft_consensus.cc:3060] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.716432 15735 raft_consensus.cc:2804] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.716876 15735 raft_consensus.cc:493] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.717240 15747 tablet_bootstrap.cc:492] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.713375 15749 consensus_queue.cc:260] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.717188 15735 raft_consensus.cc:3060] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.729925 15735 raft_consensus.cc:515] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.735734 15763 raft_consensus.cc:493] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.736445 15763 raft_consensus.cc:515] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.682340 15757 leader_election.cc:290] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.738425 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:55.738616 15763 leader_election.cc:290] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.739066 15444 raft_consensus.cc:3060] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.740031 15750 tablet_bootstrap.cc:654] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.740213 15445 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.719259 15749 ts_tablet_manager.cc:1434] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.004s
I20260709 13:20:55.741106 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:55.742336 15749 tablet_bootstrap.cc:492] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
W20260709 13:20:55.742602 15561 leader_election.cc:343] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.740903 15445 raft_consensus.cc:2468] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:55.717772 15747 ts_tablet_manager.cc:1403] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.008s
I20260709 13:20:55.712800 15443 raft_consensus.cc:3060] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.745009 15559 leader_election.cc:304] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:55.745775 15763 raft_consensus.cc:2804] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.746129 15763 raft_consensus.cc:493] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.746461 15763 raft_consensus.cc:3060] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.731564 15593 raft_consensus.cc:2468] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:55.750269 15486 leader_election.cc:304] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:55.751402 15772 raft_consensus.cc:2804] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.751904 15772 raft_consensus.cc:697] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:55.752713 15772 consensus_queue.cc:237] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.761195 15749 tablet_bootstrap.cc:654] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.764005 15750 tablet_bootstrap.cc:492] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.764564 15750 ts_tablet_manager.cc:1403] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.014s
I20260709 13:20:55.764938 15747 raft_consensus.cc:359] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.765681 15747 raft_consensus.cc:385] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.765959 15747 raft_consensus.cc:740] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.767612 15750 raft_consensus.cc:359] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.768325 15750 raft_consensus.cc:385] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.768628 15750 raft_consensus.cc:740] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.769412 15750 consensus_queue.cc:260] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.770340 15735 leader_election.cc:290] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.771103 15444 raft_consensus.cc:2468] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:55.771797 15750 ts_tablet_manager.cc:1434] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:55.772315 15559 leader_election.cc:304] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:55.773236 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:55.773237 15735 raft_consensus.cc:2804] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.774881 15735 raft_consensus.cc:697] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:55.775566 15735 consensus_queue.cc:237] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.779408 15736 raft_consensus.cc:493] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:20:55.780499 15561 leader_election.cc:343] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.781651 15736 raft_consensus.cc:515] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.783923 15736 leader_election.cc:290] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:55.780198 15750 tablet_bootstrap.cc:492] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.786571 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3173cf7df64c0985f76ac2663e55aa" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:55.786612 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3173cf7df64c0985f76ac2663e55aa" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.788786 15749 tablet_bootstrap.cc:492] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.789283 15749 ts_tablet_manager.cc:1403] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.000s
W20260709 13:20:55.789283 15486 leader_election.cc:343] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.788177 15747 consensus_queue.cc:260] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.792160 15749 raft_consensus.cc:359] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.792672 15444 raft_consensus.cc:2468] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:55.792855 15749 raft_consensus.cc:385] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.793362 15749 raft_consensus.cc:740] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.794193 15749 consensus_queue.cc:260] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.796177 15749 ts_tablet_manager.cc:1434] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:20:55.795928 15484 leader_election.cc:304] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:55.797168 15749 tablet_bootstrap.cc:492] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: Bootstrap starting.
I20260709 13:20:55.797258 15736 raft_consensus.cc:2804] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.797811 15736 raft_consensus.cc:493] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.798134 15736 raft_consensus.cc:3060] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.799084 15750 tablet_bootstrap.cc:654] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.799449 15443 raft_consensus.cc:2468] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:55.790962 15763 raft_consensus.cc:515] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.801970 15757 raft_consensus.cc:493] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.803601 15757 raft_consensus.cc:515] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.809927 15757 leader_election.cc:290] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.810283 15747 ts_tablet_manager.cc:1434] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.003s
I20260709 13:20:55.811769 15747 tablet_bootstrap.cc:492] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.814028 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.814996 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:55.815775 15520 raft_consensus.cc:2468] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
W20260709 13:20:55.816861 15559 leader_election.cc:343] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.817534 15749 tablet_bootstrap.cc:654] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.818231 15561 leader_election.cc:304] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:55.819615 15757 raft_consensus.cc:2804] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.820017 15757 raft_consensus.cc:493] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.821203 15757 raft_consensus.cc:3060] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.822978 15736 raft_consensus.cc:515] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.825304 15736 leader_election.cc:290] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:55.826069 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3173cf7df64c0985f76ac2663e55aa" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:55.826686 15444 raft_consensus.cc:3060] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.826602 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3173cf7df64c0985f76ac2663e55aa" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:55.827394 15593 raft_consensus.cc:3060] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.828837 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
W20260709 13:20:55.830313 15561 leader_election.cc:343] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.831274 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:55.832374 15443 raft_consensus.cc:3060] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.835440 15593 raft_consensus.cc:2468] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:55.831840 15763 leader_election.cc:290] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.837256 15486 leader_election.cc:304] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:55.836614 15340 catalog_manager.cc:5697] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.838236 15736 raft_consensus.cc:2804] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.838968 15736 raft_consensus.cc:697] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:55.839845 15341 catalog_manager.cc:5697] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.839845 15736 consensus_queue.cc:237] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.838238 15747 tablet_bootstrap.cc:654] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.845086 15444 raft_consensus.cc:2468] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:55.848469 15443 raft_consensus.cc:2468] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:55.862854 15749 tablet_bootstrap.cc:492] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: No bootstrap required, opened a new log
I20260709 13:20:55.863408 15749 ts_tablet_manager.cc:1403] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent bootstrapping tablet: real 0.066s	user 0.002s	sys 0.011s
I20260709 13:20:55.864295 15747 tablet_bootstrap.cc:492] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.861384 15757 raft_consensus.cc:515] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.864848 15747 ts_tablet_manager.cc:1403] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.011s
I20260709 13:20:55.866299 15749 raft_consensus.cc:359] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.867025 15749 raft_consensus.cc:385] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.867185 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:55.867913 15747 raft_consensus.cc:359] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.868623 15747 raft_consensus.cc:385] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:20:55.868856 15559 leader_election.cc:343] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:20:55.867265 15749 raft_consensus.cc:740] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.870270 15750 tablet_bootstrap.cc:492] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.870338 15559 leader_election.cc:304] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 8572907d902c419daac824efe24b9219
I20260709 13:20:55.870918 15750 ts_tablet_manager.cc:1403] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.098s	user 0.025s	sys 0.023s
I20260709 13:20:55.870682 15749 consensus_queue.cc:260] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.871739 15763 raft_consensus.cc:2804] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.872196 15763 raft_consensus.cc:697] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:55.873314 15763 consensus_queue.cc:237] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.874540 15750 raft_consensus.cc:359] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.875304 15750 raft_consensus.cc:385] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.875578 15750 raft_consensus.cc:740] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.876303 15750 consensus_queue.cc:260] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.868996 15747 raft_consensus.cc:740] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.876672 15749 ts_tablet_manager.cc:1434] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:20:55.878993 15747 consensus_queue.cc:260] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.880952 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:55.881673 15520 raft_consensus.cc:3060] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.883554 15750 ts_tablet_manager.cc:1434] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:20:55.885192 15750 tablet_bootstrap.cc:492] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.888995 15340 catalog_manager.cc:5697] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:55.890417 15747 ts_tablet_manager.cc:1434] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:20:55.891737 15747 tablet_bootstrap.cc:492] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.891814 15750 tablet_bootstrap.cc:654] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.899150 15747 tablet_bootstrap.cc:654] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.903219 15750 tablet_bootstrap.cc:492] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.903771 15750 ts_tablet_manager.cc:1403] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.010s
I20260709 13:20:55.906495 15750 raft_consensus.cc:359] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.907186 15750 raft_consensus.cc:385] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.907459 15750 raft_consensus.cc:740] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.908097 15750 consensus_queue.cc:260] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.914172 15747 tablet_bootstrap.cc:492] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.914711 15750 ts_tablet_manager.cc:1434] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:20:55.914781 15747 ts_tablet_manager.cc:1403] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.011s
I20260709 13:20:55.916070 15750 tablet_bootstrap.cc:492] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: Bootstrap starting.
I20260709 13:20:55.918184 15747 raft_consensus.cc:359] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.918875 15747 raft_consensus.cc:385] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.919170 15747 raft_consensus.cc:740] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.919646 15757 leader_election.cc:290] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.919843 15747 consensus_queue.cc:260] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.921271 15343 catalog_manager.cc:5697] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.923930 15750 tablet_bootstrap.cc:654] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.922184 15520 raft_consensus.cc:2468] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:55.922503 15747 ts_tablet_manager.cc:1434] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:20:55.928741 15747 tablet_bootstrap.cc:492] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.928838 15561 leader_election.cc:304] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:55.930207 15757 raft_consensus.cc:2804] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:55.930685 15750 tablet_bootstrap.cc:492] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: No bootstrap required, opened a new log
I20260709 13:20:55.930752 15757 raft_consensus.cc:697] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:55.931236 15750 ts_tablet_manager.cc:1403] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:20:55.932082 15757 consensus_queue.cc:237] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.934414 15750 raft_consensus.cc:359] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.935122 15750 raft_consensus.cc:385] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.935381 15750 raft_consensus.cc:740] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.936321 15747 tablet_bootstrap.cc:654] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.936058 15750 consensus_queue.cc:260] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.938218 15750 ts_tablet_manager.cc:1434] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:20:55.947062 15747 tablet_bootstrap.cc:492] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.947558 15747 ts_tablet_manager.cc:1403] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.005s
I20260709 13:20:55.949842 15747 raft_consensus.cc:359] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.950331 15747 raft_consensus.cc:385] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.950533 15747 raft_consensus.cc:740] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.951295 15747 consensus_queue.cc:260] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.953495 15747 ts_tablet_manager.cc:1434] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:20:55.954447 15747 tablet_bootstrap.cc:492] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: Bootstrap starting.
I20260709 13:20:55.954676 15340 catalog_manager.cc:5697] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:55.959496 15747 tablet_bootstrap.cc:654] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: Neither blocks nor log segments found. Creating new log.
I20260709 13:20:55.964962 15747 tablet_bootstrap.cc:492] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: No bootstrap required, opened a new log
I20260709 13:20:55.965466 15747 ts_tablet_manager.cc:1403] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.004s
I20260709 13:20:55.967957 15747 raft_consensus.cc:359] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.968626 15747 raft_consensus.cc:385] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:20:55.968890 15747 raft_consensus.cc:740] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Initialized, Role: FOLLOWER
I20260709 13:20:55.969485 15747 consensus_queue.cc:260] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.970990 15747 ts_tablet_manager.cc:1434] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:20:55.984282 15757 raft_consensus.cc:493] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:55.984865 15757 raft_consensus.cc:515] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.986966 15757 leader_election.cc:290] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:55.987905 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:55.988451 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:55.988979 15443 raft_consensus.cc:2468] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:55.989233 15520 raft_consensus.cc:2468] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 0.
I20260709 13:20:55.990276 15559 leader_election.cc:304] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:55.991047 15757 raft_consensus.cc:2804] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:55.991458 15757 raft_consensus.cc:493] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:55.991863 15757 raft_consensus.cc:3060] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:55.997692 15757 raft_consensus.cc:515] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:55.999441 15757 leader_election.cc:290] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:56.000187 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:56.000509 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.000986 15443 raft_consensus.cc:3060] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.001188 15520 raft_consensus.cc:3060] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.006589 15520 raft_consensus.cc:2468] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:56.007637 15561 leader_election.cc:304] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.008443 15443 raft_consensus.cc:2468] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 1.
I20260709 13:20:56.008496 15757 raft_consensus.cc:2804] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:56.009760 15757 raft_consensus.cc:697] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.010537 15757 consensus_queue.cc:237] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.019380 15340 catalog_manager.cc:5697] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 1 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.034917 15736 raft_consensus.cc:493] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.035627 15736 raft_consensus.cc:515] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.037561 15736 leader_election.cc:290] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.038311 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:56.038430 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:56.039244 15593 raft_consensus.cc:2468] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:56.039230 15443 raft_consensus.cc:2468] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 0.
I20260709 13:20:56.040526 15484 leader_election.cc:304] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.041440 15772 raft_consensus.cc:2804] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:56.041764 15772 raft_consensus.cc:493] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.041990 15772 raft_consensus.cc:3060] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.048416 15772 raft_consensus.cc:515] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.050064 15772 leader_election.cc:290] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.050902 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:56.051434 15443 raft_consensus.cc:3060] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.051250 15593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.052073 15593 raft_consensus.cc:3060] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.056490 15593 raft_consensus.cc:2468] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:56.056850 15443 raft_consensus.cc:2468] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 1.
I20260709 13:20:56.057562 15486 leader_election.cc:304] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.058403 15772 raft_consensus.cc:2804] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:56.058780 15772 raft_consensus.cc:697] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:56.059508 15772 consensus_queue.cc:237] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.067178 15340 catalog_manager.cc:5697] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 1 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.079900 15757 consensus_queue.cc:1048] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.089015 15748 raft_consensus.cc:493] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.089511 15748 raft_consensus.cc:515] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.091584 15748 leader_election.cc:290] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.093379 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:56.093542 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:56.094206 15520 raft_consensus.cc:2393] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2e7632d2760e4ec8909541cec49d3288 in current term 1: Already voted for candidate 5fb839e1f6284f28a5698aeedbb713dc in this term.
I20260709 13:20:56.091400 15757 consensus_queue.cc:1048] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.095225 15411 leader_election.cc:304] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288; no voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219
I20260709 13:20:56.096957 15748 raft_consensus.cc:3060] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.103960 15748 raft_consensus.cc:2749] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:56.132246 15796 raft_consensus.cc:493] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.132737 15796 raft_consensus.cc:515] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.134433 15796 leader_election.cc:290] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.135340 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219" is_pre_election: true
I20260709 13:20:56.135581 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:56.136023 15520 raft_consensus.cc:2468] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 0.
I20260709 13:20:56.136185 15595 raft_consensus.cc:2468] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 0.
I20260709 13:20:56.137398 15411 leader_election.cc:304] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.138165 15748 raft_consensus.cc:2804] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:20:56.138526 15748 raft_consensus.cc:493] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:20:56.138834 15748 raft_consensus.cc:3060] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.142738 15772 raft_consensus.cc:493] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:20:56.143220 15772 raft_consensus.cc:515] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
W20260709 13:20:56.144363 15391 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:20:56.144940 15772 leader_election.cc:290] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.145723 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e7632d2760e4ec8909541cec49d3288" is_pre_election: true
I20260709 13:20:56.145895 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc" is_pre_election: true
I20260709 13:20:56.146575 15443 raft_consensus.cc:2393] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8572907d902c419daac824efe24b9219 in current term 1: Already voted for candidate 5fb839e1f6284f28a5698aeedbb713dc in this term.
I20260709 13:20:56.146368 15748 raft_consensus.cc:515] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.147476 15484 leader_election.cc:304] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:56.148098 15772 raft_consensus.cc:3060] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.148372 15748 leader_election.cc:290] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.149426 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.149489 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.150106 15520 raft_consensus.cc:3060] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.150219 15595 raft_consensus.cc:3060] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.155287 15520 raft_consensus.cc:2468] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 1.
I20260709 13:20:56.155444 15772 raft_consensus.cc:2749] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:20:56.156340 15411 leader_election.cc:304] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.157037 15748 raft_consensus.cc:2804] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:20:56.157497 15748 raft_consensus.cc:697] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:56.157929 15595 raft_consensus.cc:2468] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 1.
I20260709 13:20:56.158854 15748 consensus_queue.cc:237] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.167899 15341 catalog_manager.cc:5697] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 1 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.178531 15757 consensus_queue.cc:1048] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.190148 15757 consensus_queue.cc:1048] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.207803 15772 consensus_queue.cc:1048] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.220338 15772 consensus_queue.cc:1048] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.259639 15757 consensus_queue.cc:1048] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.270783 15520 raft_consensus.cc:3060] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:20:56.280169 15757 consensus_queue.cc:1048] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.332485 15770 consensus_queue.cc:1048] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.342669 15770 consensus_queue.cc:1048] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.368491 15757 consensus_queue.cc:1048] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.380796 15763 consensus_queue.cc:1048] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.392570 15520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b"
dest_uuid: "8572907d902c419daac824efe24b9219"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:42490
I20260709 13:20:56.393126 15520 raft_consensus.cc:606] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:56.401149 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:56.401935 15595 raft_consensus.cc:606] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:56.408272 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:56.408984 15595 raft_consensus.cc:606] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:56.415033 15520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984"
dest_uuid: "8572907d902c419daac824efe24b9219"
mode: GRACEFUL
new_leader_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:42490
I20260709 13:20:56.415747 15520 raft_consensus.cc:606] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Received request to transfer leadership to TS 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:56.421993 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:56.422616 15595 raft_consensus.cc:606] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 8572907d902c419daac824efe24b9219
I20260709 13:20:56.428755 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:56.429366 15595 raft_consensus.cc:606] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 8572907d902c419daac824efe24b9219
I20260709 13:20:56.434832 15595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
mode: GRACEFUL
new_leader_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:33468
I20260709 13:20:56.435459 15595 raft_consensus.cc:606] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Received request to transfer leadership to TS 8572907d902c419daac824efe24b9219
I20260709 13:20:56.444856 15443 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
mode: GRACEFUL
new_leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:52578
I20260709 13:20:56.445477 15443 raft_consensus.cc:606] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Received request to transfer leadership to TS 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:56.496726 15801 raft_consensus.cc:993] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.497205 15763 raft_consensus.cc:1081] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.498605 15443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52570
I20260709 13:20:56.498998 15443 raft_consensus.cc:493] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.499224 15443 raft_consensus.cc:3060] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.504287 15443 raft_consensus.cc:515] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.505743 15443 leader_election.cc:290] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.506836 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.507273 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96ebee84dc394b079ab2a9548c1158a4" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.507529 15595 raft_consensus.cc:3055] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.507990 15520 raft_consensus.cc:3060] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.508008 15595 raft_consensus.cc:740] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.509001 15595 consensus_queue.cc:260] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.509951 15763 consensus_queue.cc:1048] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.510267 15595 raft_consensus.cc:3060] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.515492 15520 raft_consensus.cc:2468] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.516709 15411 leader_election.cc:304] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.517593 15796 raft_consensus.cc:2804] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.518152 15796 raft_consensus.cc:697] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:56.517930 15595 raft_consensus.cc:2468] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.519039 15796 consensus_queue.cc:237] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.522665 15735 raft_consensus.cc:993] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:56.523133 15735 raft_consensus.cc:1081] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:56.526765 15519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1"
dest_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:42476
I20260709 13:20:56.527727 15519 raft_consensus.cc:493] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.528223 15519 raft_consensus.cc:3060] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.529115 15735 consensus_queue.cc:1048] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:20:56.529220 15343 catalog_manager.cc:5697] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.536145 15519 raft_consensus.cc:515] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.538128 15520 raft_consensus.cc:1240] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Rejecting Update request from peer 5fb839e1f6284f28a5698aeedbb713dc for earlier term 1. Current term is 2. Ops: []
I20260709 13:20:56.540336 15519 leader_election.cc:290] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.542796 15735 consensus_queue.cc:1059] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.542862 15444 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:56.543695 15763 raft_consensus.cc:3055] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.544034 15763 raft_consensus.cc:740] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.544852 15763 consensus_queue.cc:260] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.546084 15763 raft_consensus.cc:3060] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.546087 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5f5e55629994cadabde89eb933503e1" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.558455 15595 raft_consensus.cc:2468] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
I20260709 13:20:56.560245 15486 leader_election.cc:304] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 2e7632d2760e4ec8909541cec49d3288
I20260709 13:20:56.561389 15770 raft_consensus.cc:2804] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.561893 15770 raft_consensus.cc:697] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:56.562637 15770 consensus_queue.cc:237] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.569581 15343 catalog_manager.cc:5697] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.615054 15770 consensus_queue.cc:1048] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.622925 15736 consensus_queue.cc:1048] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.634087 15736 raft_consensus.cc:993] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.634568 15736 raft_consensus.cc:1081] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.636983 15443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:20:56.637502 15443 raft_consensus.cc:493] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.637806 15443 raft_consensus.cc:3060] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.643538 15443 raft_consensus.cc:515] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.645164 15443 leader_election.cc:290] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.646497 15519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.647186 15519 raft_consensus.cc:3055] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.647212 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0c1f87d794977bf39c18be30fd43b" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.647555 15519 raft_consensus.cc:740] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:56.648540 15519 consensus_queue.cc:260] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.649331 15595 raft_consensus.cc:3060] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.649931 15519 raft_consensus.cc:3060] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.654600 15796 consensus_queue.cc:1048] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.655974 15595 raft_consensus.cc:2468] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.657089 15411 leader_election.cc:304] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:56.657281 15519 raft_consensus.cc:2468] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.657797 15796 raft_consensus.cc:2804] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.658392 15796 raft_consensus.cc:697] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:56.659228 15796 consensus_queue.cc:237] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.664965 15796 consensus_queue.cc:1048] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:20:56.669728 15343 catalog_manager.cc:5697] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 8572907d902c419daac824efe24b9219 (127.2.200.194) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.682039 15817 raft_consensus.cc:993] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: : Instructing follower 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:56.682540 15817 raft_consensus.cc:1081] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Signalling peer 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:56.685464 15593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:33458
I20260709 13:20:56.686075 15593 raft_consensus.cc:493] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.686425 15593 raft_consensus.cc:3060] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.692014 15593 raft_consensus.cc:515] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.693413 15593 leader_election.cc:290] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:20:56.694262 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:56.694432 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3cceb16ba5e41728f40cbc51bc7e333" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.694891 15443 raft_consensus.cc:3055] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.695025 15520 raft_consensus.cc:3060] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.695242 15443 raft_consensus.cc:740] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:56.696249 15443 consensus_queue.cc:260] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.697315 15443 raft_consensus.cc:3060] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.703343 15443 raft_consensus.cc:2468] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 2.
I20260709 13:20:56.703608 15520 raft_consensus.cc:2468] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 2.
I20260709 13:20:56.704298 15559 leader_election.cc:304] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:56.705149 15735 raft_consensus.cc:2804] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.705660 15735 raft_consensus.cc:697] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.706480 15735 consensus_queue.cc:237] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.713697 15343 catalog_manager.cc:5697] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 1 to 2, leader changed from 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193) to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 2 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:20:56.732892 15736 raft_consensus.cc:993] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.733331 15736 raft_consensus.cc:1081] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.735221 15443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52562
I20260709 13:20:56.735831 15443 raft_consensus.cc:493] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.736124 15443 raft_consensus.cc:3060] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.741237 15443 raft_consensus.cc:515] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.742970 15443 leader_election.cc:290] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.743700 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.744038 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde4bcbfce3c4d6b84926a6b1d791984" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.744433 15520 raft_consensus.cc:3055] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.744601 15595 raft_consensus.cc:3060] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.744874 15520 raft_consensus.cc:740] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:56.745739 15520 consensus_queue.cc:260] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.747453 15520 raft_consensus.cc:3060] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.753804 15757 raft_consensus.cc:993] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:56.754473 15757 raft_consensus.cc:1081] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:56.754739 15595 raft_consensus.cc:2468] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.755779 15520 raft_consensus.cc:2468] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.756983 15520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e"
dest_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:42476
I20260709 13:20:56.757505 15520 raft_consensus.cc:493] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.757850 15520 raft_consensus.cc:3060] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.757732 15411 leader_election.cc:304] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:20:56.759312 15748 raft_consensus.cc:2804] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.759812 15748 raft_consensus.cc:697] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:56.760610 15748 consensus_queue.cc:237] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.764735 15520 raft_consensus.cc:515] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.767480 15520 leader_election.cc:290] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.768433 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.768942 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dea0b6263e2e437a8049a7787d62b40e" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:56.769131 15595 raft_consensus.cc:3055] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.769510 15595 raft_consensus.cc:740] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.769519 15443 raft_consensus.cc:3060] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.769703 15343 catalog_manager.cc:5697] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 8572907d902c419daac824efe24b9219 (127.2.200.194) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.771596 15595 consensus_queue.cc:260] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.773046 15595 raft_consensus.cc:3060] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.776521 15443 raft_consensus.cc:2468] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
I20260709 13:20:56.777700 15484 leader_election.cc:304] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.778482 15736 raft_consensus.cc:2804] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.778962 15736 raft_consensus.cc:697] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:56.779697 15736 consensus_queue.cc:237] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.780082 15595 raft_consensus.cc:2468] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
I20260709 13:20:56.787868 15343 catalog_manager.cc:5697] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.798691 15763 raft_consensus.cc:993] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:56.799196 15763 raft_consensus.cc:1081] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 8572907d902c419daac824efe24b9219 to start an election
I20260709 13:20:56.801185 15520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de"
dest_uuid: "8572907d902c419daac824efe24b9219"
 from {username='slave'} at 127.0.0.1:42476
I20260709 13:20:56.801736 15520 raft_consensus.cc:493] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.802117 15520 raft_consensus.cc:3060] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.806991 15520 raft_consensus.cc:515] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.808432 15520 leader_election.cc:290] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.809289 15443 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:20:56.809544 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a401495f5bb540cd8174c8e6f2f503de" candidate_uuid: "8572907d902c419daac824efe24b9219" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.809808 15443 raft_consensus.cc:3060] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.810146 15595 raft_consensus.cc:3055] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.810405 15595 raft_consensus.cc:740] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.811080 15595 consensus_queue.cc:260] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.812021 15595 raft_consensus.cc:3060] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.814831 15443 raft_consensus.cc:2468] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
I20260709 13:20:56.815832 15484 leader_election.cc:304] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.816499 15736 raft_consensus.cc:2804] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.816982 15736 raft_consensus.cc:697] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Becoming Leader. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:20:56.817376 15595 raft_consensus.cc:2468] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8572907d902c419daac824efe24b9219 in term 2.
I20260709 13:20:56.817795 15736 consensus_queue.cc:237] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.825125 15343 catalog_manager.cc:5697] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 8572907d902c419daac824efe24b9219 (127.2.200.194). New cstate: current_term: 2 leader_uuid: "8572907d902c419daac824efe24b9219" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:56.947880 15735 raft_consensus.cc:993] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: : Instructing follower 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.948413 15763 raft_consensus.cc:1081] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Signalling peer 2e7632d2760e4ec8909541cec49d3288 to start an election
I20260709 13:20:56.950512 15443 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
 from {username='slave'} at 127.0.0.1:52570
I20260709 13:20:56.950984 15443 raft_consensus.cc:493] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:56.951332 15443 raft_consensus.cc:3060] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.956740 15443 raft_consensus.cc:515] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.958307 15443 leader_election.cc:290] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Requested vote from peers 8572907d902c419daac824efe24b9219 (127.2.200.194:42537), 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195:36029)
I20260709 13:20:56.959493 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:20:56.959813 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d64e963685d9480ab0a8ee62adf95005" candidate_uuid: "2e7632d2760e4ec8909541cec49d3288" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
I20260709 13:20:56.960065 15520 raft_consensus.cc:3060] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.960369 15595 raft_consensus.cc:3055] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:20:56.960672 15595 raft_consensus.cc:740] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:20:56.961352 15595 consensus_queue.cc:260] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.962306 15595 raft_consensus.cc:3060] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:56.965185 15520 raft_consensus.cc:2468] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.966287 15411 leader_election.cc:304] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:20:56.967049 15748 raft_consensus.cc:2804] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:20:56.967047 15595 raft_consensus.cc:2468] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e7632d2760e4ec8909541cec49d3288 in term 2.
I20260709 13:20:56.967542 15748 raft_consensus.cc:697] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Leader. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:20:56.968312 15748 consensus_queue.cc:237] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:20:56.975262 15343 catalog_manager.cc:5697] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 reported cstate change: term changed from 1 to 2, leader changed from 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195) to 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193). New cstate: current_term: 2 leader_uuid: "2e7632d2760e4ec8909541cec49d3288" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: UNKNOWN } } }
I20260709 13:20:57.017493 15520 raft_consensus.cc:1275] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.018842 15748 consensus_queue.cc:1048] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.028096 15595 raft_consensus.cc:1275] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.031186 15748 consensus_queue.cc:1048] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.040374 15520 raft_consensus.cc:1275] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.042105 15817 consensus_queue.cc:1048] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.052268 15595 raft_consensus.cc:1275] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.053974 15748 consensus_queue.cc:1048] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.073180 15595 raft_consensus.cc:1275] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.074643 15736 consensus_queue.cc:1048] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.085008 15443 raft_consensus.cc:3060] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:57.093344 15443 raft_consensus.cc:1275] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.094751 15736 consensus_queue.cc:1048] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.107250 15443 raft_consensus.cc:1275] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.108986 15763 consensus_queue.cc:1048] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.117175 15520 raft_consensus.cc:1275] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.118659 15757 consensus_queue.cc:1048] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.184748 15595 raft_consensus.cc:1275] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.186115 15819 consensus_queue.cc:1048] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.195531 15520 raft_consensus.cc:1275] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.197311 15796 consensus_queue.cc:1048] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.209611 15595 raft_consensus.cc:1275] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.210847 15736 consensus_queue.cc:1048] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.221720 15443 raft_consensus.cc:1275] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.223623 15814 consensus_queue.cc:1048] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.348537 15520 raft_consensus.cc:1275] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.350136 15796 consensus_queue.cc:1048] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.358533 15595 raft_consensus.cc:1275] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 2e7632d2760e4ec8909541cec49d3288: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.360054 15796 consensus_queue.cc:1048] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.406663 15443 raft_consensus.cc:1275] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.408053 15770 consensus_queue.cc:1048] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:57.408632 15595 raft_consensus.cc:1275] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Refusing update from remote peer 8572907d902c419daac824efe24b9219: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:20:57.409878 15770 consensus_queue.cc:1048] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:20:59.449456 15341 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41090:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:20:59.474050 15341 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41090:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:20:59.501557  2851 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:20:59.588070 15517 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f"
dest_uuid: "8572907d902c419daac824efe24b9219"
mode: GRACEFUL
new_leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:60208
I20260709 13:20:59.588972 15517 raft_consensus.cc:606] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Received request to transfer leadership to TS 5fb839e1f6284f28a5698aeedbb713dc
W20260709 13:20:59.754949 15856 log.cc:927] Time spent T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:20:59.769527 15862 log.cc:927] Time spent T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: Append to log took a long time: real 0.122s	user 0.005s	sys 0.000s
W20260709 13:20:59.776836 15847 log.cc:927] Time spent T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: Append to log took a long time: real 0.106s	user 0.002s	sys 0.000s
W20260709 13:20:59.777335 15857 log.cc:927] Time spent T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
I20260709 13:20:59.799553 15882 tablet.cc:1724] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:59.802971 15855 log.cc:927] Time spent T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
W20260709 13:20:59.806561 15864 log.cc:927] Time spent T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 13:20:59.793707 15881 tablet.cc:1724] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.865202 15440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71"
dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
mode: GRACEFUL
new_leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:57560
W20260709 13:20:59.872583 15851 log.cc:927] Time spent T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: Append to log took a long time: real 0.202s	user 0.002s	sys 0.000s
I20260709 13:20:59.872607 15869 raft_consensus.cc:993] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: : Instructing follower 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:59.874415 15869 raft_consensus.cc:1081] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Signalling peer 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:59.876711 15594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:33442
I20260709 13:20:59.877524 15594 raft_consensus.cc:493] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.877930 15594 raft_consensus.cc:3060] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.889166 15889 tablet.cc:1724] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.885918 15440 raft_consensus.cc:606] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Received request to transfer leadership to TS 5fb839e1f6284f28a5698aeedbb713dc
I20260709 13:20:59.902928 15876 raft_consensus.cc:993] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: : Instructing follower 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:59.903455 15876 raft_consensus.cc:1081] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Signalling peer 5fb839e1f6284f28a5698aeedbb713dc to start an election
I20260709 13:20:59.913360  2851 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:20:59.914248  2851 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:20:59.929124 15895 tablet.cc:1724] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.931519 15897 tablet.cc:1724] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:59.939244 15891 log.cc:927] Time spent T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:20:59.940623 15887 tablet.cc:1724] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.950654 15894 tablet.cc:1724] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.954512 15587 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71"
dest_uuid: "5fb839e1f6284f28a5698aeedbb713dc"
 from {username='slave'} at 127.0.0.1:33458
I20260709 13:20:59.955191 15587 raft_consensus.cc:493] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:20:59.955559 15587 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:20:59.957428 15889 tablet.cc:1724] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:59.958487 15883 log.cc:927] Time spent T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 13:20:59.954573 15896 tablet.cc:1724] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:20:59.960695 15880 log.cc:927] Time spent T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: Append to log took a long time: real 0.168s	user 0.000s	sys 0.002s
I20260709 13:20:59.965605 15882 tablet.cc:1724] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.979835 15594 raft_consensus.cc:515] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
W20260709 13:20:59.982340 15559 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.2.200.193:32835, user_credentials={real_user=slave}} blocked reactor thread for 91459.8us
I20260709 13:20:59.989810 15890 tablet.cc:1724] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.990141 15893 tablet.cc:1724] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:20:59.876781 15892 tablet.cc:1724] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.005834 15594 leader_election.cc:290] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 2 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:21:00.006163 15515 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:21:00.006966 15515 raft_consensus.cc:3055] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:21:00.007354 15515 raft_consensus.cc:740] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8572907d902c419daac824efe24b9219, State: Running, Role: LEADER
I20260709 13:21:00.008311 15515 consensus_queue.cc:260] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:21:00.008778 15897 tablet.cc:1724] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.010070 15515 raft_consensus.cc:3060] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:20:59.999178 15899 tablet.cc:1724] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.023833 15587 raft_consensus.cc:515] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:21:00.024127 15897 tablet.cc:1724] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.031827 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c51c8c75dcb4225af4febe90e71c80f" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:21:00.032581 15442 raft_consensus.cc:3060] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:21:00.042888 15442 raft_consensus.cc:2468] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 2.
I20260709 13:21:00.043402 15587 leader_election.cc:290] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 3 election: Requested vote from peers 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835), 8572907d902c419daac824efe24b9219 (127.2.200.194:42537)
I20260709 13:21:00.044636 15520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8572907d902c419daac824efe24b9219"
I20260709 13:21:00.045367 15520 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:00.045610 15889 tablet.cc:1724] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.047802 15559 leader_election.cc:304] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e7632d2760e4ec8909541cec49d3288, 5fb839e1f6284f28a5698aeedbb713dc; no voters: 
I20260709 13:21:00.049429 15898 raft_consensus.cc:2804] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:21:00.049932 15898 raft_consensus.cc:697] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 2 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:21:00.050812 15898 consensus_queue.cc:237] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:21:00.054785 15895 tablet.cc:1724] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.055655 15520 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 3.
I20260709 13:21:00.057029 15561 leader_election.cc:304] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fb839e1f6284f28a5698aeedbb713dc, 8572907d902c419daac824efe24b9219; no voters: 
I20260709 13:21:00.058049 15867 raft_consensus.cc:2804] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:21:00.058544 15867 raft_consensus.cc:697] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 3 LEADER]: Becoming Leader. State: Replica: 5fb839e1f6284f28a5698aeedbb713dc, State: Running, Role: LEADER
I20260709 13:21:00.059566 15867 consensus_queue.cc:237] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:21:00.058439 15515 raft_consensus.cc:2468] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 2.
I20260709 13:21:00.071008 15897 tablet.cc:1724] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.073239 15882 tablet.cc:1724] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.073869 15442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1a14ab557d24442ad423a1c8a32fd71" candidate_uuid: "5fb839e1f6284f28a5698aeedbb713dc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e7632d2760e4ec8909541cec49d3288"
I20260709 13:21:00.021858 15881 tablet.cc:1724] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.070154 15890 tablet.cc:1724] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.087870 15442 raft_consensus.cc:3055] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:21:00.079628 15889 tablet.cc:1724] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.088286 15442 raft_consensus.cc:740] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e7632d2760e4ec8909541cec49d3288, State: Running, Role: LEADER
I20260709 13:21:00.089578 15442 consensus_queue.cc:260] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } }
I20260709 13:21:00.091008 15442 raft_consensus.cc:3060] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:21:00.084830 15887 tablet.cc:1724] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.100374 15442 raft_consensus.cc:2468] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fb839e1f6284f28a5698aeedbb713dc in term 3.
I20260709 13:21:00.105012 15899 tablet.cc:1724] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.114140 15882 tablet.cc:1724] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.090922 15341 catalog_manager.cc:5697] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 1 to 2, leader changed from 8572907d902c419daac824efe24b9219 (127.2.200.194) to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 2 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:00.123255 15881 tablet.cc:1724] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:21:00.153457 15340 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec: soft_deleted_table [id=a7eda530c9fb4e2289f7b3bc00b9d38c] alter complete (version 1)
I20260709 13:21:00.164197 15340 catalog_manager.cc:5697] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc reported cstate change: term changed from 2 to 3, leader changed from 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193) to 5fb839e1f6284f28a5698aeedbb713dc (127.2.200.195). New cstate: current_term: 3 leader_uuid: "5fb839e1f6284f28a5698aeedbb713dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fb839e1f6284f28a5698aeedbb713dc" member_type: VOTER last_known_addr { host: "127.2.200.195" port: 36029 } health_report { overall_health: HEALTHY } } }
I20260709 13:21:00.578914 15442 raft_consensus.cc:1275] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 3 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:00.580569 15867 consensus_queue.cc:1048] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:21:00.594900 15515 raft_consensus.cc:1275] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:00.597646 15867 consensus_queue.cc:1048] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:21:00.598708 15515 raft_consensus.cc:1275] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 3 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:21:00.601372 15867 consensus_queue.cc:1048] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "8572907d902c419daac824efe24b9219" member_type: VOTER last_known_addr { host: "127.2.200.194" port: 42537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:21:00.612394 15442 raft_consensus.cc:1275] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Refusing update from remote peer 5fb839e1f6284f28a5698aeedbb713dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:21:00.615305 15907 consensus_queue.cc:1048] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e7632d2760e4ec8909541cec49d3288" member_type: VOTER last_known_addr { host: "127.2.200.193" port: 32835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:21:00.983389  2851 tablet_server.cc:179] TabletServer@127.2.200.193:0 shutting down...
W20260709 13:21:00.993424 15484 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:21:01.000401 15484 consensus_peers.cc:597] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.001433 15484 consensus_peers.cc:597] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.002300 15484 consensus_peers.cc:597] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.019263  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:01.020282  2851 tablet_replica.cc:333] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.021111  2851 raft_consensus.cc:2243] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.021704  2851 raft_consensus.cc:2272] T a3cceb16ba5e41728f40cbc51bc7e333 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.024830  2851 tablet_replica.cc:333] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.025534  2851 raft_consensus.cc:2243] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.026346  2851 raft_consensus.cc:2272] T fde4bcbfce3c4d6b84926a6b1d791984 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.028283  2851 tablet_replica.cc:333] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.028878  2851 raft_consensus.cc:2243] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.029698  2851 raft_consensus.cc:2272] T fff3611aaa19462c9ef0a8f951f2aef8 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.031821  2851 tablet_replica.cc:333] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.032524  2851 raft_consensus.cc:2243] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.033002  2851 raft_consensus.cc:2272] T a401495f5bb540cd8174c8e6f2f503de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.035647  2851 tablet_replica.cc:333] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.036334  2851 raft_consensus.cc:2243] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.037146  2851 raft_consensus.cc:2272] T c382123eecb645629a091a46d926010e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.040083  2851 tablet_replica.cc:333] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.040738  2851 raft_consensus.cc:2243] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.041539  2851 raft_consensus.cc:2272] T b9d0c1f87d794977bf39c18be30fd43b P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.043820  2851 tablet_replica.cc:333] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.044417  2851 raft_consensus.cc:2243] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.044854  2851 raft_consensus.cc:2272] T 8eec348b9fe349c7a73af8039a9e0f89 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.046761  2851 tablet_replica.cc:333] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.047278  2851 raft_consensus.cc:2243] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.047998  2851 raft_consensus.cc:2272] T d64e963685d9480ab0a8ee62adf95005 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.050460  2851 tablet_replica.cc:333] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.050988  2851 raft_consensus.cc:2243] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.051788  2851 raft_consensus.cc:2272] T a5f5e55629994cadabde89eb933503e1 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.051826 15484 consensus_peers.cc:597] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.054148  2851 tablet_replica.cc:333] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.054687  2851 raft_consensus.cc:2243] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.055147  2851 raft_consensus.cc:2272] T dea0b6263e2e437a8049a7787d62b40e P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.057456  2851 tablet_replica.cc:333] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.057966  2851 raft_consensus.cc:2243] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.058710  2851 raft_consensus.cc:2272] T d347077f6a38436cbd3f8a4b576e25de P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.060967  2851 tablet_replica.cc:333] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.061451  2851 raft_consensus.cc:2243] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.061858  2851 raft_consensus.cc:2272] T 9db8c0722aed4993a0e79305c889a80a P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.063668  2851 tablet_replica.cc:333] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.064136  2851 raft_consensus.cc:2243] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.064884  2851 raft_consensus.cc:2272] T 96ebee84dc394b079ab2a9548c1158a4 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.066624  2851 tablet_replica.cc:333] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.067122  2851 raft_consensus.cc:2243] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.067505  2851 raft_consensus.cc:2272] T 2c51c8c75dcb4225af4febe90e71c80f P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.069936  2851 tablet_replica.cc:333] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.070564  2851 raft_consensus.cc:2243] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.071040  2851 raft_consensus.cc:2272] T 7091192e79024f80bdee9b03802a9336 P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.074162  2851 tablet_replica.cc:333] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.074975  2851 raft_consensus.cc:2243] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.075675  2851 raft_consensus.cc:2272] T 622fd85e9f104a068bdd351171b5d494 P 2e7632d2760e4ec8909541cec49d3288 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.077643 15484 consensus_peers.cc:597] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.078255  2851 tablet_replica.cc:333] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.078972  2851 raft_consensus.cc:2243] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.079579  2851 raft_consensus.cc:2272] T 5d3173cf7df64c0985f76ac2663e55aa P 2e7632d2760e4ec8909541cec49d3288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.083185  2851 tablet_replica.cc:333] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288: stopping tablet replica
I20260709 13:21:01.084033  2851 raft_consensus.cc:2243] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.084566  2851 raft_consensus.cc:2272] T d1a14ab557d24442ad423a1c8a32fd71 P 2e7632d2760e4ec8909541cec49d3288 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.085994 15559 consensus_peers.cc:597] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.119453  2851 tablet_server.cc:196] TabletServer@127.2.200.193:0 shutdown complete.
I20260709 13:21:01.162442  2851 tablet_server.cc:179] TabletServer@127.2.200.194:0 shutting down...
W20260709 13:21:01.176292 15561 consensus_peers.cc:597] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc -> Peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Couldn't send request to peer 8572907d902c419daac824efe24b9219. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:21:01.187371 15559 consensus_peers.cc:597] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:32835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.200403  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:01.201187  2851 tablet_replica.cc:333] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.201786  2851 raft_consensus.cc:2243] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.202268  2851 raft_consensus.cc:2272] T a3cceb16ba5e41728f40cbc51bc7e333 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.204169  2851 tablet_replica.cc:333] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.204708  2851 raft_consensus.cc:2243] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.205183  2851 raft_consensus.cc:2272] T 622fd85e9f104a068bdd351171b5d494 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.207083  2851 tablet_replica.cc:333] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.207620  2851 raft_consensus.cc:2243] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.208050  2851 raft_consensus.cc:2272] T fde4bcbfce3c4d6b84926a6b1d791984 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.209882  2851 tablet_replica.cc:333] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.210412  2851 raft_consensus.cc:2243] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.210809  2851 raft_consensus.cc:2272] T fff3611aaa19462c9ef0a8f951f2aef8 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.212623  2851 tablet_replica.cc:333] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.213173  2851 raft_consensus.cc:2243] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.213958  2851 raft_consensus.cc:2272] T 5d3173cf7df64c0985f76ac2663e55aa P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.215771  2851 tablet_replica.cc:333] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.216301  2851 raft_consensus.cc:2243] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.216697  2851 raft_consensus.cc:2272] T d1a14ab557d24442ad423a1c8a32fd71 P 8572907d902c419daac824efe24b9219 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.219591  2851 tablet_replica.cc:333] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.220185  2851 raft_consensus.cc:2243] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.220616  2851 raft_consensus.cc:2272] T b9d0c1f87d794977bf39c18be30fd43b P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.222398  2851 tablet_replica.cc:333] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.222914  2851 raft_consensus.cc:2243] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.223670  2851 raft_consensus.cc:2272] T 8eec348b9fe349c7a73af8039a9e0f89 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.225628  2851 tablet_replica.cc:333] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.226209  2851 raft_consensus.cc:2243] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.227213  2851 raft_consensus.cc:2272] T a401495f5bb540cd8174c8e6f2f503de P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.230062  2851 tablet_replica.cc:333] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.231210  2851 raft_consensus.cc:2243] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.231781  2851 raft_consensus.cc:2272] T c382123eecb645629a091a46d926010e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.234699  2851 tablet_replica.cc:333] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.235464  2851 raft_consensus.cc:2243] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.236002  2851 raft_consensus.cc:2272] T 96ebee84dc394b079ab2a9548c1158a4 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.239207  2851 tablet_replica.cc:333] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.240191  2851 raft_consensus.cc:2243] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.240818  2851 raft_consensus.cc:2272] T 2c51c8c75dcb4225af4febe90e71c80f P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.246357  2851 tablet_replica.cc:333] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.247208  2851 raft_consensus.cc:2243] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.248194  2851 raft_consensus.cc:2272] T 7091192e79024f80bdee9b03802a9336 P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.248649 15484 consensus_peers.cc:597] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:32835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.251148  2851 tablet_replica.cc:333] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.251982  2851 raft_consensus.cc:2243] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.252983  2851 raft_consensus.cc:2272] T dea0b6263e2e437a8049a7787d62b40e P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.254962  2851 tablet_replica.cc:333] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.255460  2851 raft_consensus.cc:2243] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.255834  2851 raft_consensus.cc:2272] T d64e963685d9480ab0a8ee62adf95005 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.257639  2851 tablet_replica.cc:333] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.258093  2851 raft_consensus.cc:2243] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.258878  2851 raft_consensus.cc:2272] T a5f5e55629994cadabde89eb933503e1 P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.261785  2851 tablet_replica.cc:333] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.262341  2851 raft_consensus.cc:2243] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.262749  2851 raft_consensus.cc:2272] T d347077f6a38436cbd3f8a4b576e25de P 8572907d902c419daac824efe24b9219 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.264729  2851 tablet_replica.cc:333] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219: stopping tablet replica
I20260709 13:21:01.265262  2851 raft_consensus.cc:2243] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.266083  2851 raft_consensus.cc:2272] T 9db8c0722aed4993a0e79305c889a80a P 8572907d902c419daac824efe24b9219 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.269239 15561 consensus_peers.cc:597] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc -> Peer 8572907d902c419daac824efe24b9219 (127.2.200.194:42537): Couldn't send request to peer 8572907d902c419daac824efe24b9219. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.308228  2851 tablet_server.cc:196] TabletServer@127.2.200.194:0 shutdown complete.
I20260709 13:21:01.341926  2851 tablet_server.cc:179] TabletServer@127.2.200.195:0 shutting down...
I20260709 13:21:01.373929  2851 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:21:01.374733  2851 tablet_replica.cc:333] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.375607  2851 raft_consensus.cc:2243] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.376464  2851 raft_consensus.cc:2272] T a3cceb16ba5e41728f40cbc51bc7e333 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.378469  2851 tablet_replica.cc:333] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.379029  2851 raft_consensus.cc:2243] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.379455  2851 raft_consensus.cc:2272] T 96ebee84dc394b079ab2a9548c1158a4 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.381253  2851 tablet_replica.cc:333] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.381979  2851 raft_consensus.cc:2243] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.382619  2851 raft_consensus.cc:2272] T 7091192e79024f80bdee9b03802a9336 P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.385121  2851 tablet_replica.cc:333] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.385715  2851 raft_consensus.cc:2243] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.386718  2851 raft_consensus.cc:2272] T 2c51c8c75dcb4225af4febe90e71c80f P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.389575  2851 tablet_replica.cc:333] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.390427  2851 raft_consensus.cc:2243] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.390954  2851 raft_consensus.cc:2272] T fde4bcbfce3c4d6b84926a6b1d791984 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.393049  2851 tablet_replica.cc:333] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.393590  2851 raft_consensus.cc:2243] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.394027  2851 raft_consensus.cc:2272] T fff3611aaa19462c9ef0a8f951f2aef8 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.396062  2851 tablet_replica.cc:333] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.396600  2851 raft_consensus.cc:2243] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.397047  2851 raft_consensus.cc:2272] T 5d3173cf7df64c0985f76ac2663e55aa P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.398797  2851 tablet_replica.cc:333] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.399319  2851 raft_consensus.cc:2243] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.400116  2851 raft_consensus.cc:2272] T d1a14ab557d24442ad423a1c8a32fd71 P 5fb839e1f6284f28a5698aeedbb713dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.403432  2851 tablet_replica.cc:333] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.404186  2851 raft_consensus.cc:2243] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.404744  2851 raft_consensus.cc:2272] T d64e963685d9480ab0a8ee62adf95005 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.407591  2851 tablet_replica.cc:333] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.408218  2851 raft_consensus.cc:2243] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.408710  2851 raft_consensus.cc:2272] T a5f5e55629994cadabde89eb933503e1 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.411209  2851 tablet_replica.cc:333] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.411780  2851 raft_consensus.cc:2243] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.412243  2851 raft_consensus.cc:2272] T dea0b6263e2e437a8049a7787d62b40e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.414211  2851 tablet_replica.cc:333] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.414760  2851 raft_consensus.cc:2243] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.415184  2851 raft_consensus.cc:2272] T d347077f6a38436cbd3f8a4b576e25de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.417171  2851 tablet_replica.cc:333] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.417649  2851 raft_consensus.cc:2243] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.418045  2851 raft_consensus.cc:2272] T 9db8c0722aed4993a0e79305c889a80a P 5fb839e1f6284f28a5698aeedbb713dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.419881  2851 tablet_replica.cc:333] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.420356  2851 raft_consensus.cc:2243] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.420753  2851 raft_consensus.cc:2272] T b9d0c1f87d794977bf39c18be30fd43b P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.422591  2851 tablet_replica.cc:333] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.423161  2851 raft_consensus.cc:2243] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.423700  2851 raft_consensus.cc:2272] T 8eec348b9fe349c7a73af8039a9e0f89 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.426236  2851 tablet_replica.cc:333] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.426887  2851 raft_consensus.cc:2243] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.427294  2851 raft_consensus.cc:2272] T a401495f5bb540cd8174c8e6f2f503de P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:21:01.427505 15559 consensus_peers.cc:597] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc -> Peer 2e7632d2760e4ec8909541cec49d3288 (127.2.200.193:32835): Couldn't send request to peer 2e7632d2760e4ec8909541cec49d3288. Status: Network error: Client connection negotiation failed: client connection to 127.2.200.193:32835: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:21:01.429330  2851 tablet_replica.cc:333] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.429890  2851 raft_consensus.cc:2243] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:21:01.430312  2851 raft_consensus.cc:2272] T c382123eecb645629a091a46d926010e P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.432281  2851 tablet_replica.cc:333] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc: stopping tablet replica
I20260709 13:21:01.432703  2851 raft_consensus.cc:2243] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.433465  2851 raft_consensus.cc:2272] T 622fd85e9f104a068bdd351171b5d494 P 5fb839e1f6284f28a5698aeedbb713dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.473773  2851 tablet_server.cc:196] TabletServer@127.2.200.195:0 shutdown complete.
I20260709 13:21:01.505328  2851 master.cc:562] Master@127.2.200.254:40583 shutting down...
I20260709 13:21:01.528755  2851 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:21:01.529364  2851 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:21:01.529683  2851 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4421c2d69c494b5ea84d3f003abc48ec: stopping tablet replica
I20260709 13:21:01.552367  2851 master.cc:584] Master@127.2.200.254:40583 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11680 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (25844 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (352583 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:21:01.614506  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 383 messages since previous log ~14 seconds ago
I20260709 13:21:01.614717  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 383 messages since previous log ~14 seconds ago
I20260709 13:21:01.614856  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 378 messages since previous log ~14 seconds ago
I20260709 13:21:01.615018  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:21:01.615167  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~34 seconds ago
I20260709 13:21:01.615315  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 2 messages since previous log ~151 seconds ago
I20260709 13:21:01.615440  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 4 messages since previous log ~294 seconds ago
I20260709 13:21:01.615587  2851 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 2 messages since previous log ~111 seconds ago
I20260709 13:21:01.615724  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 2 messages since previous log ~111 seconds ago
I20260709 13:21:01.615914  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 13:21:01.616168  2851 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 44 messages since previous log ~10 seconds ago
